36
Using Smartphones to Research Daily Life Dr. Neal Lathia Computer Laboratory, University of Cambridge [email protected]

Using Smartphones to Research Daily Life

Embed Size (px)

Citation preview

Page 1: Using Smartphones to Research Daily Life

Using Smartphones to Research Daily Life

Dr. Neal LathiaComputer Laboratory, University of [email protected]

Page 2: Using Smartphones to Research Daily Life

“First were mainframes, each shared by lots of people. Now we are in the personal computing era, person and machine staring uneasily at each other across the desktop. Next comes ubiquitous computing [...] when technology recedes into the background of our lives.”

- Weiser

Page 3: Using Smartphones to Research Daily Life

Android: 1.5 million daily activations

Page 4: Using Smartphones to Research Daily Life

Phone CallsText MessagesSocial MediaE-mailCameraCalendarsMapsTransportGamesNewsVideos

Page 5: Using Smartphones to Research Daily Life

Phone CallsText MessagesSocial MediaE-mailCameraCalendarsMapsTransportGamesNewsMusicVideos

Communication Patterns;

Social Networks and Sharing; Information

Diffusion;Points of Interest;

Mobility; App Usage...

Page 6: Using Smartphones to Research Daily Life
Page 7: Using Smartphones to Research Daily Life

AccelerometerMicrophoneCameraGPSCompassGyroscopeWi-FiBluetoothProximityNFCLight

Page 8: Using Smartphones to Research Daily Life

AccelerometerMicrophoneCameraGPSCompassGyroscopeWi-FiBluetoothProximityNFCLight

Activities; Transportation

Modes; Co-location; Mobility; Speaker

Detection; Speech Inferences; Context

Identification

Page 9: Using Smartphones to Research Daily Life

How can we sense, identify, and capture high-level behaviours (e.g., walking, running) from low-level sensors (e.g., accelerometer)?

“Classic” Research Question (1):

For ever higher level behavioursGiven energy, computation constraints

Page 10: Using Smartphones to Research Daily Life

How can we verify or understand qualitative aspects of behaviour that can be sensed (i.e., the why)?

“Classic” Research Question (2):

Choices, feelings, reasons, semantics (e.g., home vs. lat/lon).

Page 11: Using Smartphones to Research Daily Life

Experience Sampling

Page 12: Using Smartphones to Research Daily Life

Experience Sampling

Mood; Location Semantics

Focus/Engagement; Transportation

Choices; Physical Activity; Health;

Reactions to Music

Page 13: Using Smartphones to Research Daily Life

Researching Daily Life:Reflecting on the 'scientific' method

Page 14: Using Smartphones to Research Daily Life

Hypothesis

Measure

Test

Tradition...

Page 15: Using Smartphones to Research Daily Life

Hypothesis

Measure

Test

ESM Design

Sensor-ESM studies...

Sensor-Sampling Design

Page 16: Using Smartphones to Research Daily Life

HypothesisMeasure

Test

ESM Design

Ready for the public...

Sensor-Sampling Design

User Experience Design

Build App

Test App

Deploy App

Market App

Debug AppUpdate App

Re-design UXUser Support

De-noise data

Page 17: Using Smartphones to Research Daily Life
Page 18: Using Smartphones to Research Daily Life

Emotion Sense Basics:

(a) Complete a “long” survey about how you feel & your current context

(b) Receive notifications that ask you to complete a “short” survey

(c) View how your survey responses compare to the sensor data your phone has collected.

Page 19: Using Smartphones to Research Daily Life

Emotion Sense Surveys

(momentary)Positive/Negative AffectDay “Goodness”Current LocationTexting/Calling HabitsCurrent ActivityDevice InteractionRecent SpeechPersonalitySociabilityConnectednessEngagement

(non-momentary)Demographics

Satisfaction with LifePersonality

GratitudeHealth

SociabilityJob SatisfactionLife AspirationsConnectedness

Page 20: Using Smartphones to Research Daily Life
Page 21: Using Smartphones to Research Daily Life

Emotion Sense Sensors

LocationTexting Logs

Call LogsAccelerometer

MicrophoneScreen On/Off Samples

Wi-FiBattery Levels

Page 22: Using Smartphones to Research Daily Life

● How can we keep users engaged in a seemingly repetitive task?

● Surveys are “too long” … “too obtrusive” .. “too repetitive”

● ESM experiments “don't beneft me” … “too boring”

Design Challenges

Page 23: Using Smartphones to Research Daily Life

A “Non”-Game designed like a game

Page 24: Using Smartphones to Research Daily Life

How many questions to ask...?

When the user is “volunteering” a response (10)

vs.

When the user is responding to a notification (3)

Page 25: Using Smartphones to Research Daily Life

Limited feedback – avoiding judging

Page 26: Using Smartphones to Research Daily Life

How are people interacting?

– 12,000 interacting users;– 650,000+ survey responses– ~6% answer only 1 survey– ~800 daily user responses– Average of 60+ days responding to surveys per user– ~15% users > 3 months– App demographics ~ published Android user demographics

Page 27: Using Smartphones to Research Daily Life
Page 28: Using Smartphones to Research Daily Life

angry anxious lonely

relaxedenthusiasticcalm

Page 29: Using Smartphones to Research Daily Life
Page 30: Using Smartphones to Research Daily Life
Page 31: Using Smartphones to Research Daily Life

Emotion Sense: Ongoing Work

– Making sense of noisy sensor data: various devices, time zones, participation lengths

– Analysing quality, content of survey responses

– Investigating the future of these tools: generalising (for researchers) vs. specialising (for a particular context).

Page 32: Using Smartphones to Research Daily Life

Easy M:

Can I run a study like Emotion Sense?

(Without going back to the drawing board)

Generalised sensor-enhanced experience sampling tool.

Page 33: Using Smartphones to Research Daily Life

Easy M Basics:

(a) Enter a “participant code” to join an experiment; app reconfigures itself (with timeout)

(b) Receive notifications that ask you to complete your researchers' survey

(c) Volunteer additional responses

Page 34: Using Smartphones to Research Daily Life

Easy M Basics:

Allows for both “momentary” and “volunteered” survey types.

Questions include all the same types as Emotion Sense.

User feedback is limited to response time and compliance.

Page 35: Using Smartphones to Research Daily Life

Where could Easy M be used?

Page 36: Using Smartphones to Research Daily Life

Using Smartphones to Research Daily Life

Dr. Neal LathiaComputer Laboratory, University of [email protected]

http://emotionsense.org/http://www.cl.cam.ac.uk/~nkl25/easym/