24
Dr Nikiforos Karamanis Senior User Experience Designer European Bioinformatics Institute [email protected] Usability testing on steroids How to get feedback from more people in less time @technorasis

European Bioinformatics Institute Senior User … - Nikiforos...Dr Nikiforos Karamanis Senior User Experience Designer European Bioinformatics Institute [email protected] Usability testing

  • Upload
    others

  • View
    13

  • Download
    0

Embed Size (px)

Citation preview

Page 1: European Bioinformatics Institute Senior User … - Nikiforos...Dr Nikiforos Karamanis Senior User Experience Designer European Bioinformatics Institute niki@ebi.ac.uk Usability testing

Dr Nikiforos Karamanis

Senior User Experience Designer

European Bioinformatics Institute

[email protected]

Usability testing on steroidsHow to get feedback from more people in less time

@technorasis

Page 2: European Bioinformatics Institute Senior User … - Nikiforos...Dr Nikiforos Karamanis Senior User Experience Designer European Bioinformatics Institute niki@ebi.ac.uk Usability testing

What is usability testing?

Page 3: European Bioinformatics Institute Senior User … - Nikiforos...Dr Nikiforos Karamanis Senior User Experience Designer European Bioinformatics Institute niki@ebi.ac.uk Usability testing

Traditional usability testing

“Usability tests are about watching one person at a time try to use something (whether it’s a website, a prototype, or some sketches of a new design) to do typical tasks so you can detect and fix the things that confuse or frustrate them.”

Steve Krughttps://goo.gl/images/1dSqmG

Page 5: European Bioinformatics Institute Senior User … - Nikiforos...Dr Nikiforos Karamanis Senior User Experience Designer European Bioinformatics Institute niki@ebi.ac.uk Usability testing

Traditional usability testing• A one-to-one session, one participant at a time giving

you feedback about your product.

• Typically takes about 60 to 90 minutes per participant.

• Feedback from 3 to 10 participants over a couple of days.

• Need to ask for feedback early and often!

Page 6: European Bioinformatics Institute Senior User … - Nikiforos...Dr Nikiforos Karamanis Senior User Experience Designer European Bioinformatics Institute niki@ebi.ac.uk Usability testing

What if you...• Have the opportunity to get feedback from several

participants...

• But only have 60-90 minutes with the whole group?

Page 7: European Bioinformatics Institute Senior User … - Nikiforos...Dr Nikiforos Karamanis Senior User Experience Designer European Bioinformatics Institute niki@ebi.ac.uk Usability testing

Group usability testing(testing on steroids)

Page 8: European Bioinformatics Institute Senior User … - Nikiforos...Dr Nikiforos Karamanis Senior User Experience Designer European Bioinformatics Institute niki@ebi.ac.uk Usability testing
Page 9: European Bioinformatics Institute Senior User … - Nikiforos...Dr Nikiforos Karamanis Senior User Experience Designer European Bioinformatics Institute niki@ebi.ac.uk Usability testing

We’re not testing you!

“There are no right or wrong answers. We are testing our website, not you. Please give us your honest feedback as this is the best way for us to see the website through your eyes.”

Page 10: European Bioinformatics Institute Senior User … - Nikiforos...Dr Nikiforos Karamanis Senior User Experience Designer European Bioinformatics Institute niki@ebi.ac.uk Usability testing

Please think aloud!

“As you are trying it out, please think aloud. Tell your partner what you’re trying to do and what’s going through your mind.”

Page 11: European Bioinformatics Institute Senior User … - Nikiforos...Dr Nikiforos Karamanis Senior User Experience Designer European Bioinformatics Institute niki@ebi.ac.uk Usability testing
Page 12: European Bioinformatics Institute Senior User … - Nikiforos...Dr Nikiforos Karamanis Senior User Experience Designer European Bioinformatics Institute niki@ebi.ac.uk Usability testing

Probing the participant without leading

Page 13: European Bioinformatics Institute Senior User … - Nikiforos...Dr Nikiforos Karamanis Senior User Experience Designer European Bioinformatics Institute niki@ebi.ac.uk Usability testing

Probing the participant without leading• “What goes through your mind when you look at this?”

• “What would you do if you were doing this on your own?”

• “What would you do to…?”

• “What are you looking for?”

• “What do you expect to happen next?”

• “Mmmm” and “huh” instead of “Great” and “Good job”

• “So what…” [trail into silence]

Page 14: European Bioinformatics Institute Senior User … - Nikiforos...Dr Nikiforos Karamanis Senior User Experience Designer European Bioinformatics Institute niki@ebi.ac.uk Usability testing

Give it a go!Form pairs:

• One person is the participant, the other is the facilitator.

• Participant:You need to go to London immediately after this session. Use your phone to find out when is the next train from Cambridge to Kings Cross.

• Facilitator helps participant to think aloud and takes notes.

Page 15: European Bioinformatics Institute Senior User … - Nikiforos...Dr Nikiforos Karamanis Senior User Experience Designer European Bioinformatics Institute niki@ebi.ac.uk Usability testing
Page 16: European Bioinformatics Institute Senior User … - Nikiforos...Dr Nikiforos Karamanis Senior User Experience Designer European Bioinformatics Institute niki@ebi.ac.uk Usability testing
Page 17: European Bioinformatics Institute Senior User … - Nikiforos...Dr Nikiforos Karamanis Senior User Experience Designer European Bioinformatics Institute niki@ebi.ac.uk Usability testing
Page 18: European Bioinformatics Institute Senior User … - Nikiforos...Dr Nikiforos Karamanis Senior User Experience Designer European Bioinformatics Institute niki@ebi.ac.uk Usability testing
Page 19: European Bioinformatics Institute Senior User … - Nikiforos...Dr Nikiforos Karamanis Senior User Experience Designer European Bioinformatics Institute niki@ebi.ac.uk Usability testing

Give it a go!In each table:

• Review the feedback on each post-it.

• Organise the post-its into themes.

• Give names to the themes.

Page 20: European Bioinformatics Institute Senior User … - Nikiforos...Dr Nikiforos Karamanis Senior User Experience Designer European Bioinformatics Institute niki@ebi.ac.uk Usability testing

Group usability testing: Pros• Great way for our team to collaborate before, during and

after the session.

• Team gets exposed to more feedback in less time.

• Participants get exposed to each other’s views:• Helps us spot common issues vs individual preferences.

• Participants loved it!• Became integral part of our project’s quarterly meetings.• Some participants later became facilitators.

Page 21: European Bioinformatics Institute Senior User … - Nikiforos...Dr Nikiforos Karamanis Senior User Experience Designer European Bioinformatics Institute niki@ebi.ac.uk Usability testing

Group usability testing: Tips• Initial pairing helps capture individual feedback and avoid

groupthink.

• Up to 5 pairs in 60 to 90 minutes works best.

• Combine it with• user research to better understand people’s motivations

and• traditional usability testing for more in-depth feedback.

• Works best with trained facilitators!

Page 22: European Bioinformatics Institute Senior User … - Nikiforos...Dr Nikiforos Karamanis Senior User Experience Designer European Bioinformatics Institute niki@ebi.ac.uk Usability testing

Group usability testing: VerdictEnabled us to:

• Do a couple of days work within a couple of hours.

• Leverage user feedback without compromising on its quality.

Page 23: European Bioinformatics Institute Senior User … - Nikiforos...Dr Nikiforos Karamanis Senior User Experience Designer European Bioinformatics Institute niki@ebi.ac.uk Usability testing

Thanks

• Our participants

• My colleagues and management at EMBL-EBI

Page 24: European Bioinformatics Institute Senior User … - Nikiforos...Dr Nikiforos Karamanis Senior User Experience Designer European Bioinformatics Institute niki@ebi.ac.uk Usability testing

Questions?

[email protected]

@technorasis