Reto Lämmler • UXCamp Hamburg 2015@rlaemmler @testingtime
Blind Dates – Or the right choice of test users
Why do I want to talk about this?
The UX industry still designs too much based on
assumptions.
Talking to a user is worth more than a thousand
assumptions.
• From Zurich, Switzerland• Co-Founder & CEO of www.testingtime.com• MAS Human Computer Interaction Design• VP Product Management at Doodle.com• BS Computer Science
About meTest early, test often.
Why user testing?
Designer UI UserMental Model
Blind Date
Test SubjectCollaboration platform for architects, naval engineers etc.
“There are some times when it’s important to test your product with your exact market, and other times when users from any demographic can give you the feedback you need.”
Source: www.usertesting.com/blog/2015/02/09/demographics
Testing with Exact DemographicsWhen to Use Them and When to Lose Them
User Testing
Hallway Testing
Extreme User InterviewsIDEO Method Cards
What does Jacob think?
Jacob Nielsen About simplified User Testing
The three main rules:1. Get representative users2. Ask them to perform representative tasks with the
design 3. Shut up and let the users do the talking.
The last thing you want to hear during a usability study session is a participant saying, “I don’t use this kind of [system],” or “I never do that [task] for my job.” That person cannot help you discover the problems with that system or how well the system supports users’ tasks.
Jacob Nielsen About representative Users
The right choice of test users
Recruit Test Users by
Category
Test Users by CategoryConsumers vs Experts
Consumers• Shopping• News• Travel• Social• Entertainment• …
Experts• Medical• Engineering• Architecture• Finance• Legal• …
Experts are also ConsumersBut Consumers are not always Experts.
Expert
Consumer
Everyone can be potentially recruited to test a consumer application.
E.g. A neuro scientist uses www.travel.ch
Only Experts from the field can be recruited to test an Expert application.
E.g. A neuro scientist uses NemoDevices.
Recruit Test Users byPersonas & Scenarios
Test Users by PersonasPrimary vs. Secondary vs. Other Personas
PrimarySecondar
y or Supportiv
eNon-
Personas
Primary and Secodary PersonasWith some example scenarios in mind
Primary Personas• Experienced Kiter who wants to purchase a new
Kite• Newbie Kiter who wants to find a beginners course• …
Secondary Personas• A worried parent who wants to learn about the
sport• Godfather who wants to find a gift for a godchild• …
Supportive and Non-PersonasWith some example scenarios in mind
Supportive• Site Manager who maintains the inventory• Human Resources maintaining job listings• …
Non-Personas• …?
Recruit Test Users by Test Object
Website, App, DocumentationTest objects
Website / App
Navigation
Content
Accessibility
Task Completion
…
…
Devices
Packaging, Food, DevicesTest objects
Food…
Packaging…
Recruiting service for UX people
DACH Panel20‘000+
When do you blind date and when do you choose
carefully?
My LearningsAnd recommendations
• It’s still better to test with anyone, than no testing at all
There is always something you can learn.
• Choose smaller tests over extensive studiesBut iterate as often as necessary
• UX is not a project, it’s an ongoing processSo don’t excuse it with «I’m not ready yet.»
Test early.Test often.
[email protected]@rlaemmler @testingtime