UX-Research 3 Scenarios IAM v2019 - HS Augsburg john/IAM-UX/Material/...آ  UX Research test scenarios

Embed Size (px)

Text of UX-Research 3 Scenarios IAM v2019 - HS Augsburg john/IAM-UX/Material/...آ  UX Research test...

  • UX Research 
 test scenarios

    KP Ludwig John

    UX Research
 test scenarios

  • UX Research 
 test scenarios

    KP Ludwig John

    Before we start Delivery

    Hypothesis + Description of MVP

  • UX Research 
 test scenarios

    KP Ludwig John

    Hypothesis + Description of MVP Criteria

    Description of individual Functions 
 • specific and detailed
 • testable (Put it In or Leave it Out)

    Clearly related to the needs and goals
 of one or more of your Personas

    Traceable (measurable) measurements

    based on a clear research question?
 Which one?

    Simplicity of the MVP 
 focussed on research question / hypothesis

    MVP

    Hypothesis

  • UX Research 
 test scenarios

    KP Ludwig John

    Feedback

    • Hypothesis functions:
 specific, detailed, testable (Put it In or Leave it Out)

    • Measurements traceable?

    • Research question clear, focussed and understandable?

    • Simplicity of the MVP 
 Could it be done even simpler?

    MVP

    Hypothesis

    Provide your fellow students with
 Recommendations and Suggestions

  • UX Research 
 test scenarios

    KP Ludwig John

    Delivery

    Hypothesis + Description of MVP

    PDF per E-Mail

    Deadline: Tonight midnight

  • UX Research 
 test scenarios

    KP Ludwig John

    Usability Test Preconditions

    Already existing

    • Personas
 Definition of target groups


    • Context of use
 where, when, how long, equipment


    • Test goals
 What do we want to learn?!

  • UX Research 
 test scenarios

    KP Ludwig John

    • What do you want to learn by the test?
 Which elements of the IA design have been discussed controversial?
 Which elements seam to be critical for the general success of the application?


    • Which elements of your application have to be covered
 Main functions / use cases
 Crucial functions of the application
 Use Cases with many Alternate Flows

    Usability-Test Predefinitions Test goal

  • UX Research 
 test scenarios

    KP Ludwig John

    Usability-Test

    Comparison of 3 print Layouts Brochure with information about companies

    IMS.UX - 2017

    Test goal

    Source: Team UXperts, IMS.UX 2017

    Which Layout is best?

  • UX Research 
 test scenarios

    KP Ludwig John

    Usability-Test

    Source: Team UXperts, IMS.UX 2017

    Aspects to consider

    Extracting Information 
 How easy is it to get the information? 
 What information can you get?


    Memorizing Information
 Can you memorize the information after reading? Is it easy to remember


    Clarity
 Is the structure obvious to the user? (Naming, Positioning, Design of elements)


    Comprehensibility
 Does the user understand the content?


    Readability - Is the text easy to follow?


    Look & Feel - How is the first impression? 
 Do you have a good feeling reading the paper?

    Which Layout is best?

  • UX Research 
 test scenarios

    KP Ludwig John

    Usability-Test

    Source: Team „Group Title“, IMS.UX 2017

    Aspects to consider

    How well is information communicated?

    Which Layout is best?

    How fast can information 
 be perceived and processed?

    How much attention does relevant information get?

    Measuring units!

    Related questions

  • UX Research 
 test scenarios

    KP Ludwig John

    Usability-Test

    Source: Team „Group Title“, IMS.UX 2017

    Aspects to consider

    How well is information communicated?

    Which Layout is best?

    How fast can information 
 be perceived and processed?

    How much attention does relevant information get?

    Measuring unit: 
 Time to complete tasks.

    Measuring unit: 
 Time a test subject’s focus rests on relevant information.

    Measuring unit: 
 Amount of misunderstandings and missed information

    Measuring units

  • UX Research 
 test scenarios

    KP Ludwig John

    paper based software based

    Usability-Test

    • Which functionality has your prototype to provide
 in order serve your test goals?

    Predefinitions Test object

    • What kind of Prototype is needed 
 in order serve your test goals

  • UX Research 
 test scenarios

    KP Ludwig John

    Usability-Test

    • Diary study (remote) • Thinking aloud (with note taking) • Video observation • Screen recording • Eye tracking • Post test interview

    Predefinitions Test method Which test method do you want to apply?

  • UX Research 
 test scenarios

    KP Ludwig John

    Usability-Test

    • What kind of equipment serves best the test goals? • Consider testing under of real context of use conditions

    (Screen size, Space, time, mobile, distraction, sound)

    Predefinitions Test equipment

  • UX Research 
 test scenarios

    KP Ludwig John

    Usability-Test Predefinitions Test scenario

    Create a test scenario which defines
 each single step of the test in detail,
 


    including

    •Introduction •Tasks •and Expression of Thanks

  • UX Research 
 test scenarios

    KP Ludwig John

    Test location • Where do you want to test? • Availability, Influence of Weather or Light?

    Usability-Test Predefinitions Test space

    Test equipment • Where do you get it? • How to handle it?

  • UX Research 
 test scenarios

    KP Ludwig John

    • Test conductor 
 • Technical
 manager 
 • Observer 
 • Analyst

    Usability-Test Preparation Test team

  • UX Research 
 test scenarios

    KP Ludwig John

    • Where can the test persons be recruited from?
 (do they represent the target group, are they available (time) ?) 
 • Do they get some expense allowance 
 (Aufwandsentschädigung)?
 (which?) 
 • recruit test persons

    Usability-Test Preparation Test persons

    Find test persons 
 make appointments and a test schedule

    • How many Test persons are needed?
 (about 7-8 per Test version (!) )

  • UX Research research methods

    overview

    KP Ludwig John

    Usability
 Test persons

  • UX Research 
 test scenarios

    KP Ludwig John

    It’s best to test with representatives of your main target group.
 But don’t be obsessed about it!
 If its difficult to recruit them, 
 test with people you can get hold of. 
 Take it in account when evaluating the test results:
 Would our users have that problem? 
 Or was it only a problem because the participant wasn’t familiar with the field?

    Rather few but frequently
 start early in the development process
 and repeat and repeat and repeat

    Who do the test with?

    Usability Test Test persons

    How many test persons?

  • UX Research 
 test scenarios

    KP Ludwig John

    reference:Nielsen (2000) https://www.nngroup.com/articles/why-you-only-need-to-test-with-5-users/

    Test personsUsability Test How many test persons?

    The best results come from testing no more than 5 users 
 and running as many small tests as you can afford.

  • UX Research 
 test scenarios

    KP Ludwig John reference:Nielsen 2018: https://www.youtube.com/watch?time_continue=31&v=RhgUirqki50

    Test personsUsability Test

    Jacob Nielsen N/N Group

  • UX Research 
 test scenarios

    KP Ludwig John

    Reference: Steve Krug, Don‘t make me think! Redline, 2006

    Test personsUsability Test

    Test with 8 users
 found problems: 5 major ones

    How many test persons?

  • UX Research 
 test scenarios

    KP Ludwig John

    Test personsUsability Test How many test persons?

    2 Tests with 3 users each = 6 Test persons
 found problems: 5 major + 4 minor = 9 problems

    Reference: Steve Krug, Don‘t make me think! Redline, 2006

  • UX Research 
 test scenarios

    KP Ludwig John

    Wen testen?

    Datenquelle: Faulkner (2003): Beyond the five-user assumption: Benefits of increased sample sizes in usability testing; 
 in Sarodnik/Braun: Methoden der Usability Evaluation (Huber Verlag 2011)

    Test personsUsability Test

  • UX Research 
 test scenarios

    KP Ludwig John

    Test personsUsability Test

    source: www.nngroup.com/reports/how-to-conduct-eyetracking-studies PDF, page 19

    http://www.nngroup.com/reports/how-to-conduct-eyetracking-studies

  • UX Research 
 test scenarios

    KP Ludwig John

    Most significant problems will be discovered 
 by small number of test users already.

    Finding three participants is easy to handle:
 test and debrief (Nachbesprechen) the same day! 
 Design small tests with focussed tasks.
 Learn, move on and test again.

    Test personsUsability Test

    Reference: Steve Krug: „Rocket Surgery Made Easy“, New Riders 2010, chapter 5

    How many test persons?

    Can you use the same participants again? Not for t