94
Quantifying UX The lab versus the real world

Quantifying User Experience (UX)

Embed Size (px)

DESCRIPTION

Presentation about measuring the user experience and remote usability testing at UX Israel, December 21th 2010.

Citation preview

Page 1: Quantifying User Experience (UX)

Quantifying UXThe lab versus the real world

Page 2: Quantifying User Experience (UX)

How did I end up here?

Page 3: Quantifying User Experience (UX)

2003-2010 Tilburg University

Design of Business Communication

Page 4: Quantifying User Experience (UX)

2000-2010Design, communication, research, and consulting

Page 6: Quantifying User Experience (UX)

!"#$%&#"'$!()%#*+,+!-

Page 7: Quantifying User Experience (UX)

‘Plus-minus method for text evaluation’

Page 8: Quantifying User Experience (UX)

+ -

Page 9: Quantifying User Experience (UX)
Page 10: Quantifying User Experience (UX)
Page 11: Quantifying User Experience (UX)

</commercial>

Page 12: Quantifying User Experience (UX)

eighties

Page 13: Quantifying User Experience (UX)
Page 14: Quantifying User Experience (UX)
Page 15: Quantifying User Experience (UX)

Observing users.

Page 16: Quantifying User Experience (UX)

Pen & paper

Page 17: Quantifying User Experience (UX)

Stopwatch.

Page 18: Quantifying User Experience (UX)
Page 19: Quantifying User Experience (UX)

Nothing changed?

Page 20: Quantifying User Experience (UX)
Page 21: Quantifying User Experience (UX)
Page 22: Quantifying User Experience (UX)

How do we observe behavior?

Page 23: Quantifying User Experience (UX)

1995 Web ‘analytics’

Page 24: Quantifying User Experience (UX)

2005 Google Analytics

Page 25: Quantifying User Experience (UX)
Page 26: Quantifying User Experience (UX)

2007 Clicktale, CrazyEgg, Kampyle

Page 27: Quantifying User Experience (UX)
Page 28: Quantifying User Experience (UX)

2009 Remote Usability Year

Page 29: Quantifying User Experience (UX)

2009 UserTesting

Page 30: Quantifying User Experience (UX)
Page 31: Quantifying User Experience (UX)

2009 FeedbackArmy

Page 32: Quantifying User Experience (UX)
Page 33: Quantifying User Experience (UX)

2009 UserZoom

Page 34: Quantifying User Experience (UX)
Page 35: Quantifying User Experience (UX)

2009 OpenHallway

Page 36: Quantifying User Experience (UX)
Page 37: Quantifying User Experience (UX)

2009 Userfly

Page 38: Quantifying User Experience (UX)
Page 39: Quantifying User Experience (UX)

2009 OptimalSort

Page 40: Quantifying User Experience (UX)

2009 ChalkMark

Page 41: Quantifying User Experience (UX)

2009 Treejack

Page 42: Quantifying User Experience (UX)
Page 43: Quantifying User Experience (UX)

2009 Userlytics

Page 44: Quantifying User Experience (UX)
Page 45: Quantifying User Experience (UX)

2009 Loop11

Page 46: Quantifying User Experience (UX)
Page 47: Quantifying User Experience (UX)

2009 Websort

Page 48: Quantifying User Experience (UX)
Page 49: Quantifying User Experience (UX)

2009 Ethnio

Page 50: Quantifying User Experience (UX)
Page 51: Quantifying User Experience (UX)

2009 TrymyUI

Page 52: Quantifying User Experience (UX)
Page 53: Quantifying User Experience (UX)

2009 Usabilla

Page 54: Quantifying User Experience (UX)
Page 55: Quantifying User Experience (UX)

More?

Great overview: http://remoteusability.com

Page 56: Quantifying User Experience (UX)
Page 57: Quantifying User Experience (UX)

Quantitative

QualitativeC

onc

rete

Co

nceptual

Page 58: Quantifying User Experience (UX)

Quantitative

QualitativeC

onc

rete

Co

nceptual

Google Analytics

Clicktale

CrazyEgg

UserTesting

TryMyUI

Websort

Treejack

Chalkmark

Usabilla

Loop11

Userlytics

Userfly

OpenHallway

Kampyle

Optimalsort

Page 59: Quantifying User Experience (UX)

Source: Nate Bolt, Bolt | Peters / Ethnio - http://boltpeters.com

Page 60: Quantifying User Experience (UX)

Source: Nate Bolt, Bolt | Peters / Ethnio - http://boltpeters.com

Page 61: Quantifying User Experience (UX)

Behavior vs Attitude

Page 62: Quantifying User Experience (UX)

Behavior vs Attitude

Page 63: Quantifying User Experience (UX)

Behavior vs Attitude

Source: the narrow minded usability consultant.

Page 64: Quantifying User Experience (UX)

efficiencyeffectiveness

Usability

Page 65: Quantifying User Experience (UX)

efficiencyeffectiveness

Usability

satisfaction

Page 66: Quantifying User Experience (UX)

efficiencyeffectiveness satisfaction

behavior = objective

Page 67: Quantifying User Experience (UX)

efficiencyeffectiveness satisfaction

behavior = objective attitude = subjective

Page 68: Quantifying User Experience (UX)
Page 69: Quantifying User Experience (UX)

Valuable Credible

DesirableFindable Accessible

Usable

User Experience

Page 70: Quantifying User Experience (UX)
Page 71: Quantifying User Experience (UX)

Valuable Credible

DesirableFindable Accessible

Usable

User Experience

Page 72: Quantifying User Experience (UX)

‘self reported data’ hoax

Some background: http://www.creative-wisdom.com/teaching/WBI/memory.shtml

Page 73: Quantifying User Experience (UX)
Page 74: Quantifying User Experience (UX)

Soft data

Page 75: Quantifying User Experience (UX)

Hard data

Page 76: Quantifying User Experience (UX)
Page 77: Quantifying User Experience (UX)

Hardcore

Behavior:Conversion rates, task performance, time on

task, bounce rate, error rates, click-through rate, shares, bookmarks, etc

Page 78: Quantifying User Experience (UX)

Shell

Attitude:Satisfaction, ratings, credibility, sentiment

analysis, feedback, trust, like / dislike, etc

Soft

Page 79: Quantifying User Experience (UX)

So, what’s next?

Page 80: Quantifying User Experience (UX)

Booming.

Page 81: Quantifying User Experience (UX)

Build your toolbox.

Page 82: Quantifying User Experience (UX)
Page 83: Quantifying User Experience (UX)
Page 84: Quantifying User Experience (UX)
Page 85: Quantifying User Experience (UX)
Page 86: Quantifying User Experience (UX)

Mobile?

Page 87: Quantifying User Experience (UX)

The most touch friendly survey!"#$%&#"'$!()%#*+,+!-

Commercial break

Page 88: Quantifying User Experience (UX)

Data.

Page 89: Quantifying User Experience (UX)

Data.

Page 90: Quantifying User Experience (UX)

Data.

Page 91: Quantifying User Experience (UX)

Dashboards

Page 92: Quantifying User Experience (UX)
Page 93: Quantifying User Experience (UX)