cdiLect7 - The University of Edinburgh · 2013-10-07 · 2 HRI State-of-the-art (JO) Tutorial Towards JAMES (JO) 3 HRI JAMES (RP) Tutorial JAMES (RP) 4 HDI Quantified selves (JO)

10/7/13

1

Memory 2

Case Studies in Design Informatics 1 Jon Oberlander

Lecture 7: Quantified Selves

http://www.inf.ed.ac.uk/teaching/courses/cdi1/

2

Course Timetable

Week Topic Mon Wed Thu Submit 16:00 Thu

1 HRI Intro (JO) Designing a robot (JO)

2 HRI State-of-the-art (JO) Tutorial Towards JAMES (JO)

3 HRI JAMES (RP) Tutorial JAMES (RP)

4 HDI Quantified selves (JO) Tutorial <COLLIDER> A1

5 HDI Quantified problems (JO) Tutorial LPE (JM)

6 HDI LPE (AV) Tutorial Strategic behaviour (SR) A2-draft

7 HDI Actigraphy (MW) Tutorial* Life logging (TBC)

8 HDI Light logging (TBC) Tutorial <COLLIDER> A2

9 Reflection (JO) Tutorial Reflection (JO)

10 Tutorial

11 (Tutorial) A3

3

Structure of the lecture

1.   The quan6fied self: defini6ons and uptake today

2.   Gary Wolf's 2010 manifesto

3.   QS in the health industry: Swan 2009 and Singer 2011

4.   Varie6es of device: Swan 2012 5.   GeKng past the novelty

  The link: –  Social robots are des6ned for domes6c uses

–  A tool or an agent?

10/7/13

2

1. The quan6fied self: defini6ons

  Gary Wolf: Quan6fied Self is "Self-‐knowledge through numbers."

  Or "… the macroscope applied to the individual human.

  This might seem like a contradic6on: how does a tool for collec6ng data from many different 6mes and places in nature work on a single individual?

  The answer, of course, is that an individual life can be seen as a collec6on of countless moments, behaviors, and loca6ons.

  Within the "n=1" of the individual is an "n=[infinity]" of 6mes, ac6ons, and places."

5 Quoting from Wolf's website

OK, so what is the macroscope?

  Wolf cites relevant sources (as well as some other, unconnected historical uses): –  Gilman Tolle: "a technological system that radically increases our ability to

gather data in nature, and to analyze it for meaning.” •  e.g. A Macroscope in the Redwoods: a sensor network in a forest, using the data

to monitor the micro-‐climate and gather data that could do dense temporal and spacial monitoring.

–  See also Jesse Ausubel: Telescopes, Microscopes, Macroscopes, and DNA Barcodes.

–  And see also John Thackara: "anything that helps us calibrate our small ac6ons in light of the big picture".

  hbp://aether.com/quan6fiedself

  hbp://aether.com/themacroscope

6 Quoting from Wolf's website

Swan (2009)’s defini6on

  An underlying assump6on for many self-‐trackers is that data is an objec6ve resource that can bring visibility, informa6on and ac6on to a situa6on quickly, and psychologically there may be an element of empowerment and control.

  Quan6fied self-‐tracking is being applied to a variety of life areas including   6me management, travel and social communica6ons

  [QS] is the regular collec6on of any data that can be measured about the self such as biological, physical, behavioral or environmental informa6on. –  Addi6onal aspects may include the graphical display of the data and a feedback

loop of introspec6on and self-‐experimenta6on. –  Health aspects that are not obviously quan6ta6ve such as mood can be

recorded with qualita6ve words that can be stored as text or in a tag cloud, mapped to a quan6ta6ve scale, or ranked rela6ve to other measures such as yesterday’s ra6ng.

–  Many health self-‐trackers are recording measurements daily or even more frequently (blood pressure for example).

7 Quoting from Shaw (2009)

The quan6fied self: uptake today

  Thorin Klosowski (2013)

  What's the Deal with Self-‐Tracking? Is It Really Beneficial?

  hbp://lifehacker.com/whats-‐the-‐deal-‐with-‐self-‐tracking-‐is-‐it-‐really-‐benefi-‐1263894371

8 Quoting from lifehacker.com

10/7/13

3

Tracking Your Health and Exercise Pushes You To Make Changes

  Get some feedback on ac6vi6es and progress towards goals –  Some evidence that logging ac6vity increases awareness.

–  Monitor consistency vs change.

  Monitor long terms condi6on (health, wellbeing) –  diseases, health indicators, and effec6veness of care. –  consumerises health monitoring.

•  e.g. "According to one Pew study people are using self-‐tracking apps to track indicators for everything from weight to headaches, sleep pa=erns, and more."

  Does it work? –  depends whether you're mo6vated by goals, and whether seeing metrics

makes you more likely to con6nue improving your health.


Health: Fitbit


Health: Fuelband


Our Memories Suck and Tracking Apps Help

  You can easily keep tabs on where you've been. –  looking at where you've been on a map

–  turns your movement into a journal

  Examples –  Saga -‐ graphs based on how much 6me to spend somewhere, how you get

there, and plenty more. –  Moves -‐ tracks where you go throughout the day and how you get there.

–  Narrato -‐ injectd data from what Moves collects into your social network updates.

  See also   hbp://lifehacker.com/5907870/five-‐best-‐fitness-‐tracking-‐appliances


10/7/13

4

Memory: Moves


Memory 2


2. Gary Wolf's 2010 manifesto

  Gary Wolf (2010).

  The Data-‐Driven Life.

  The New York Times Magazine.

  hbp://www.ny6mes.com/2010/05/02/magazine/02self-‐measurement-‐t.html?pagewanted=all

  Humans make errors. –  We make errors of fact and errors of judgment.

–  We have blind spots in our field of vision and gaps in our stream of aben6on.

  We make decisions with par6al informa6on. –  We are forced to steer by guesswork.

  That is, some of us do. Others use data. –  Once you know the facts, you can live by them.

15 Quoting from Wolf (2010)

QS: Why it seemed wrong

  Mark Carranza … has been keeping a detailed, searchable archive of all the ideas he has had since he was 21. –  That was in 1984. –  I realize that this seems impossible.

–  But I have seen his archive, with its million plus entries, and observed him using it.

  [And these people know they are "Gradgrinds":] –  They are outliers. Geeks. –  But why does what they are doing seem so strange?

–  In other contexts, it is normal to seek data.

  Nonetheless, –  In science, in business and in the more reasonable sectors of government,

numbers have won fair and square. –  In the cozy confines of personal life, we rarely used the power of numbers.

–  A journal was respectable. A spreadsheet was creepy.


10/7/13

5

QS: What’s happening now

  Sleep, exercise, sex, food, mood, loca6on, alertness, produc6vity, even spiritual well-‐being are being tracked and measured, shared and displayed.

  On MedHelp, one of the largest Internet forums for health informa6on, more than 30,000 new personal tracking projects are started by users every month.

  Foursquare, a geo-‐tracking applica6on with about one million users, keeps a running tally of how many 6mes players "check in" at every locale, automa6cally building a detailed diary of movements and habits; many users publish these data widely.


QS: Discovery not (just) efficiency

  [But] an emphasis on efficiency missed something important. –  Efficiency implies rapid progress toward a known goal.

–  For many self-‐trackers, the goal is unknown.

–  numbers hold secrets that they can’t afford to ignore, including answers to ques6ons they have not yet thought to ask.

  the dominant forms of self-‐explora6on assume that the road to knowledge lies through words. –  Trackers are exploring an alternate route. –  Instead of interroga6ng their inner worlds through talking and wri6ng, they

are using numbers.

–  They are construc6ng a quan6fied self.


QS: How did we get here?

  First, electronic sensors got smaller and beber.

  Second, people started carrying powerful compu6ng devices, typically disguised as mobile phones.

  Third, social media made it seem normal to share everything.

  And fourth, we began to get an inkling of the rise of a global superintelligence known as the cloud.


Four factors

  1) Sensing –  [With] sensors that monitor our behavior automa6cally, the process of self-‐tracking

becomes both more alluring and more meaningful. –  Automated sensors do more than give us facts; they also remind us that our ordinary

behavior contains obscure quan6ta6ve signals that can be used to inform our behavior, once we learn to read them.

  2) Signal processing –  "The real exper6se you need is signal processing and sta6s6cal analysis," says James

Park, the chief execu6ve and co-‐founder of Fitbit …

  3) Sharing –  At the center of this personal laboratory is the mobile phone.

–  Sharing became the term for the quick post to a social network ...

–  Personal data are ideally suited to a social life of sharing.

–  You might not always have something to say, but you always have a number to report.

  4) Clouding –  the phone already envelops us in a cloud of compu6ng.

–  [we can] access our private data from any Internet connec6on.


10/7/13

6

Example

  [Seth] Roberts told me about his own method of measuring mental changes, a quick test he programmed on his computer that involves 32 easy arithme6c problems. –  The test takes about three minutes, and he has found that it can detect

small changes in cogni6ve performance.

  He has used his self-‐tracking system to adjust his diet, learning that three tablespoons daily of flaxseed oil reliably decreases the amount of 6me it takes him to do math. –  Consuming a lot of buber also seems to have a good effect.


Provisos

  Not clinical trials. –  The goal isn’t to figure out something about human beings generally but to

discover something about yourself.

–  Their validity may be narrow, but it is beau6fully relevant.

  It is easy to mistake a transient effect for a permanent one, or miss some hidden factor that is influencing your data and confounding your conclusions. –  But once you start gathering data, recording the dates, toggling the

condi6ons back and forth while keeping careful records of the outcome, you gain a tremendous advantage over the normal human prac6ce of making no valid effort whatsoever.


Further Examples

  Shaun Rance started tracking his drinking two years ago … –  Having a record of every drink he took sharpened his awareness and

increased his feeling of self-‐mastery — and reduced his drinking.

–  Because his tally is held by a machine, he doesn’t feel any of the social shame that might make him, consciously or not, underes6mate his drinking.

–  "I don’t lie to the diary," he says   Margaret Morris, a clinical psychologist and a researcher at Intel,

recently ran a series of field trials using a mobile phone for tracking emo6on. –  At random 6mes, the phone rang and quizzed its owner about his or her

mood. –  A man in one of Morris’s studies reviewed the trends in his data and

no6ced that his foul mood began at the same 6me every day.


Lessons

  When we quan6fy ourselves, there isn’t the impera6ve to see through our daily existence into a truth buried at a deeper level. –  Instead, the self of our most trivial thoughts and ac6ons, the self that,

without technical help, we might barely no6ce or recall, is understood as the self we ought to get to know.

  We lack both the physical and the mental apparatus to take stock of ourselves. –  We need help from machines.


10/7/13

7

The importance of sharing

  Cousins built a self-‐tracking system to help manage his feelings, which he called Moodscope; –  now used by about 1,000 others, Moodscope automa6cally sends e-‐mail

with mood-‐tracking scores to a few select friends.

  "My life was changed radically," …

  Some6mes, aver he records a low score, a friend might simply e-‐mail: "?".

  Cousins replies, and that act alone makes him feel beber.


Lessons

  Self-‐tracking can some6mes appear narcissis6c, but it also allows people to connect with one another in new ways.

  We leave traces of ourselves with our numbers, like insects puKng down a trail of pheromones, and in 6mes of crisis, these signals can lead us to others who share our concerns and care enough to help.

  The dream of a quan6fied self resembles therapeu6c ideas of self-‐actualiza6on

  Self-‐tracking, in this way, is not really a tool of op6miza6on but of discovery, and if tracking regimes that we would once have thought bizarre are becoming normal, one of the most interes6ng effects may be to make us re-‐evaluate what "normal" means.


3. QS in the health industry: Swan 2009

  Melanie Swan (2009)

  Emerging Pa6ent-‐Driven Health Care Models: An Examina6on of Health Social Networks, Consumer Personalized Medicine and Quan6fied Self-‐Tracking.

  Int. J. Environ. Res. Public Health 2009, 6, 492-‐525.

  In the health space, over twenty health social networks have launched in the last few years including –  Pa6entsLikeMe, CureTogether, DailyStrength, MedHelp, HealthChapter,

MDJunc6on, Experience Project, peoplejam, and OrganizedWisdom

  Services provided by health social networks: –  Emo6onal support and informa6on sharing

–  Physician Q&A –  Quan6fied self-‐tracking –  Clinical trials access

27 Quoting from Swan (2009)

Beyond personal monitoring

  In addi6on to tracking biomarkers and behavior, one’s environment is the next logical area to monitor for personal health, resource u6liza6on and other reasons.

  A side benefit of environmental tracking may be that individuals are encouraged to take responsibility on a larger scale.

  As with behavioral tracking, there is an interes6ng array of vendor-‐provided and consumer-‐invented tools to facilitate the monitoring process.

  The main characteris6c of the evolving health care delivery model is that it is star6ng to become more collabora6ve; moving to a co-‐diagnosis, co-‐care model between physicians, pa6ents and other par6es


10/7/13

8

QS in the health industry: Singer 2011

  Emily Singer (2011)

  The Measured Life.

  MIT Technology Review.

  hbp://www.technologyreview.com/featuredstory/424390/the-‐measured-‐life/

  Examples –  CureTogether –  Pa6entsLikeMe

CureTogether

  In 2004, Alexandra Carmichael, a long6me migraine sufferer, iden6fied dairy and gluten as the triggers for her headaches aver extensively tracking her pain and correla6ng it with diet and other factors.

  Founded CureTogether, a social-‐�networking site where pa6ents can list their symptoms, the treatments they have tried, and the results they’ve observed.

  Aggrega6ng and analyzing the informa6on has begun to reveal broader trends. –  e.g. people who experience ver6go with their migraines are four 6mes

more likely to see their pain increase than decrease if they take Imitrex, a migraine medica6on that constricts blood vessels.

30 Quoting from Singer (2011)

Pa6entsLikeMe

  Pa6entsLikeMe, a social-‐networking site that provides users with tools to track their health status and communicate with other pa6ents, has gathered a wealth of data on its 105,000 members.

  (The site makes money by anonymizing the data and selling it to pharmaceu6cal companies and other customers.)


Pa6entsLikeMe 1

32

10/7/13

9

Pa6entsLikeMe 2

33

Pa6entsLikeMe 3

34

Pa6entsLikeMe: QS disrup6ve?

  In 2008, aver a small Italian study … suggested that lithium could delay the progression of ALS, … a small group of the ALS pa6ents … began taking the drug, and the company rolled out a number of tools to help them track their symptoms, their respiratory capacity, their dosage and blood levels of lithium, and any side effects they observed.

  Because the pa6ents had collected so much data on themselves before star6ng the drug, researchers could analyze how their symptoms changed in the 12 months before they began taking it as well studying any changes that came aver -‐ something that’s not possible in the typical clinical trial.

  The company published a study based on its data in April.

  The drug, unfortunately, was found to have no effect.


4. Swan (2012)

  Sensor Mania! The Internet of Things, Wearable Compu6ng, Objec6ve Metrics, and the Quan6fied Self 2.0.

  J. Sens. Actuator Netw. 2012, 1, 217-‐253

  Some of the standard sensors include –  movement (via accelerometer), sound, light, electrical poten6al (via poten6ometer),

temperature, moisture, loca6on (via GPS), heart rate and heart rate variability, and GSR (galvanic skin response or skin conduc6vity).

  Other sensors include –  ECG/EKG (electrocardiography to record the electrical ac6vity of the heart), EMG

(electromyography to measure the electrical ac6vity of muscles), EEG (electroencephalography to read electrical ac6vity along the scalp), and PPG (photoplethysmography to measure blood flow volume).

  Some recognized first-‐genera6on quan6fied tracking devices and applica6ons include –  the Fitbit, myZeo, BodyMedia, MapMyRun, RunKeeper, MoodPanda, Nike Fuelband,

The Eatery, Luminosity’s Brain Trainer, and the NeuroSky and Emo6v brain-‐computer interfaces (BCI).

Quoting from Swan (2012)

10/7/13

10

Wristband sensors

  Current examples con6nue to feature accelerometry and include –  the Nike Fuelband ($149, monitoring steps taken),

–  the Jawbone UP wristband and iPhone app ($99, tracking steps taken, distance, calories burned, pace, intensity level, ac6ve versus inac6ve 6me, and GPS),

–  the Adidas MiCoach ($70, providing heart rate monitoring, real 6me digital coaching, interac6ve training, and post-‐workout analysis of pace, distance, and stride rate).

  Three next-‐genera6on products add new func6onality to the standard metrics of total steps taken, distance, and calories. –  The Mio Ac6ve ($119, hbp://www.mioglobal.com/) adds heart rate, either with or

without a chest strap. –  The LarkLife ($149, hbp://www.lark.com/) iden6fies type of ac6vity, allows single-‐

bubon press diet tracking, measures sleep, and uses the combined metrics to make personalized recommenda6ons about changes a user can make to feel beber.

–  The Amiigo ($119, hbp://www.amiigo.co/) wristband and shoe clip also measure the type of exercise, plus body temperature and blood oxygen levels through an infrared sensor


Smartwatches

  This new genera6on of programmable device includes: –  The Pebble watch provides Internet-‐connected applica6ons like no6fica6on of

incoming calls, email, and message alerts using Bluetooth to connect to smartphones. –  The Basis watch (preorder: $199, hbps://mybasis.com/) is a quan6fied self-‐tracking

watch, a mul6-‐sensor pla}orm with a 3D accelerometer, heart rate monitor, temperature sensor, and GSR sensor. Like the Fitbit, it does not sync in real-‐6me but only when connected to a computer.

–  Wimm Labs intends to provide an open-‐pla}orm Android opera6ng system-‐based alterna6ve to the Pebble watch. The Wimm Labs Contour Watch (~$200, hbp://www.wimm.com/) is envisioned to enable a wide range of mobile, sports, health, fashion, finance, consumer electronics, and other applica6ons.

–  The Sony SmartWatch, offering Twiber, email, music, and weather informa6on is currently available ($175, hbp://www.sonymobile.com/gb/products/accessories/smartwatch/).

–  In a poten6al extension of … Project Glass … Google has patented smartwatch technology for an augmented reality smartwatch with two flip-‐up screens, a touchpad, and wireless connec6vity


Smartwatches


Disposables

  Another new product category that could quickly become commonplace is wearable sensors, low-‐cost disposable patches that are worn con6nuously for days at a 6me and then discarded.

  Classic use cases for wearable patches is the con6nuous glucose monitor (CGM) worn by diabe6cs and other self-‐trackers.

  New developments mean that the current state-‐of-‐the-‐art technology is available in several CGM solu6ons where an under-‐the-‐skin con6nuous glucose monitor uses a sensor and transmits glucose readings every 1-‐5 minutes to an external receiver or insulin pump

  Con6nuous monitoring and connected real-‐6me data transmission, ideally with real-‐6me feedback and personalized recommenda6ons


10/7/13

11

Disposables


Brain computer interfaces (BCIs)

  There could be numerous useful applica6ons from this, for example mental performance op6miza6on techniques and a variety of emo6on reading, mapping, and management programs.

  An early sensor technology for obtaining brain data is the consumer EEG (also called the brain-‐computer interface (BCI)).

  Some of the first-‐genera6on consumer EEG rigs are pictured in Figure 7 and include –  the 14-‐node EEG Emo6v ($299, hbp://www.emo6v.com),

–  the single-‐node EEG NeuroSky ($99, hbp://www.neurosky.com/), and –  the sleep quality tracker myZeo, also essen6ally an EEG ($99,

hbp://www.myzeo.com/).


Brain computer interfaces (BCIs)


BCIs: do they work?

  The Emo6v and the NeuroSky have been used for different applica6ons such as improving aben6on and medita6on, and video game performance.

  At least one academic study has validated the performance of consumer EEGs, finding that for 6 of 8 par6cipants, the responses to the tradi6onal EEG and the Emo6v were similar ...

  Emo6ons were mapped to a standard four quadrant diagram of arousal and valence (reflec6ng the intensity and posi6ve or nega6ve charge of the experience).

  An established image research library (IAPS) was employed, although the researchers noted that both methods were s6ll close to baseline error rates, in other words that emo6on mapping remains a challenging problem.


10/7/13

12

5. GeKng past the novelty: How do product designers keep users engaged?

  One issue with IOT devices so far is lack of sustainable usage.

  Eager early adopters purchase solu6ons and try them briefly but do not find them enduringly useful and they become shelfware (e.g., stored unused on a shelf).


Singer (2011)

  The favored strategy of the moment is to weave together self-‐tracking tools with social networks and gaming, using the lessons of behavioral economics to keep users mo6vated enough to meet any health goals they’ve set for themselves.

  Basis: "We want to create an engaging device that makes people want to make beber health choices … We do that by tracking data and showing it on the Web and on mobile devices, and by sharing it with friends.”

Quoting from Singer (2011)

Swan (2012)

  One way to avoid this [giving up] could be completely redefining the no6on of consumer products, now conceptualizing products and services, and the vendor rela6onship as an ongoing dialogue rather than a one-‐off purchase.

  One example of harnessing financial incen6ves in the IOT economy for behavioral change is GymPact … an applica6on in the RunKeeper suite of ac6vity tracking applica6ons …

–  Users commit a monetary amount for planned gym workouts ahead of 6me which are later confirmed by mobile check-‐ins at athle6c facili6es.

–  The site claimed that 90% of the 45,000 GymPact users as of August 2012 had been successful in going to the gym on commibed days …

–  Financial rewards are paid to those that complete workouts from the pool of money generated by those that do not, averaging $0.50-‐$0.75 per workout per the company’s website.

  [An] example is the SMS group messaging interven6ons delivered by Infield Health over the Twilio pla}orm …in areas such as smoking cessa6on and improved cardio health.


Last word (for now):

  Singer (2011) asks Wolf an interesting question:

  Singer: –  What problems does self-tracking solve?

  Wolf: –  "How to eat, how to sleep, how to learn, how to work,

how to be happy."


Documents

cdiLect7 - The University of Edinburgh · 2013-10-07 · 2 HRI State-of-the-art (JO) Tutorial Towards JAMES (JO) 3 HRI JAMES (RP) Tutorial JAMES (RP) 4 HDI Quantified selves (JO)