Embed Size (px)
Citation preview
UX Research
Agile
Anna Witteman Head of UX Lab
IceMobile
Copyright © A. Witteman & R. van den Oever, All Rights Reserved.
• Amsterdam based company (& office in Hong Kong, Toronto)
• 120 employees
• over 30 nationalities
• Either a foodie, code king, design nerd, beer brewer or unicorn
IceMobile Amsterdam
Context ChatPulse UX Testing
Cultural relevant research
Experience Mapping
THE MARSHMALLOW CHALLENGE
Orient Plan Build Ta-da!
Business (wo)men
Kindergarten students
0 18 Minutes
Uh-oh!
Agile teams
Product Backlog
Sprint Backlog
Potentially Shippable Product
2-3 weeks
24 hours
Daily Scrum Meeting
Design
Development
Q/A Testing
the problem
Ta-da!
Previous Usability Testing
Iterative Usability Testing
0 Time
Uh-oh!
Involve users
Agile teams
Product Backlog
Sprint Backlog
Potentially Shippable Product
2-3 weeks
24 hours
Daily Scrum Meeting
Design
Development
Q/A Testing
Usability testing
findings do not stick
mismatch
no visible value
Transfer information effectiveThe team should learn most of the user test, not the UX researcher
Fit the user into the processDo testing so that it is not ‘extra work’
Make results visibleValue should be clear and measurable
We wanted to find a way to:
HOW?
Which practice proved its value?
Individuals and interactions
Working software
Customer collaboration
Responding to change
over
over
over
over
processes and tools
comprehensive documentation
contract negotiation
following a plan
Agile Manifesto
Source: Nielsen, Jakob, and Landauer, Thomas K.: "A mathematical model of the finding of usability problems," Proceedings of ACM INTERCHI'93 Conference (1993), pp. 206-213.
Usability Testing is an iterative process!
Iteration is the heartbeat of agile & user testing
use it!
Product = Prototype
• Write a scenario
• Create a prototype
• Recruit users
• Pilot test
• Conduct Tests
• Edit videos
• Analyze video
• Write report
• Present results
User test = Report
Our setup is a combination of simple tools
Our setup is a combination of simple tools
More evaluators = more issues identified
Source: Herttzum, M., Jacobsen, N. (2001). The evaluator’s effect: A chilling fact about usability evaluation methods. International Journal of Human-Computer Interaction, vol. 13, pp.421-443.
Ratio benefits to costs of # evaluators4 = ideal # evaluators
Source: Herttzum, M., Jacobsen, N. (2001). The evaluator’s effect: A chilling fact about usability evaluation methods. International Journal of Human-Computer Interaction, vol. 13, pp.421-443.
Chapter title
How to keep track of the findings?
# user that did this task
# user that had this problem
time stamps of this issue
on video
description of issue
How to keep track of the findings?
Pulse: iterative User Involvement
•Prioritize: test important part(s) most extensive
•Frequent: reliable results, also test improvements
•Empathize: learn what matters to users
•Optimize: learn to test
Allow responding to change
'I have not failed. I've just found 10000 ways that won't work.’
Sir Thomas Edison
Pulse UX TestingTraditional UX testing
Iterative UX testing: every 2 weeks
UX testing (near) the end of a project
Continuous testingSingle test
Small sessionsBig session
Performed by the teams: the team members learn most
Performed by researchers: the researchers learn most
Changes early in the process; thus less costly
Changes late in the process; thus very costly
Rise in ‘first time right’ of features
Few ‘first time right’ of features
120% end-result in 80% of the time
Difficult to measure success
Transfer information effectivelyThe team learns most of the user test, not the UX researcher
Fit the user into the processDo testing so that it is not ‘extra work’
Make results visibleValue should be clear and measurable
What we achieved:
We are hiring. icemobile.com/jobs
IceMobileAmsterdam @icemobile@icemobile
