UX-Research 2c methods Questionnaire - HS Augsburg john/IMS-UX/Material/... UX Research Questionnaires

Embed Size (px)

Text of UX-Research 2c methods Questionnaire - HS Augsburg john/IMS-UX/Material/... UX Research...

  • UX Research
 Questionnaires / Surveys

    KP Ludwig John

    UX Research
 methods 
 Questionnaire

  • UX Research
 Questionnaires / Surveys

    KP Ludwig John

    Research Methods

    Qualitative Quantitative •describes the qualities or characteristics of something


    •provide details about human behavior, emotion, and personality characteristics 


    •helps to understand why people do the things they do

    •any research that 
 can be measured 


    •provide data that can be expressed in numbers


    •answers questions like 
 “How many people clicked here”

    Reference: http://www.uxmatters.com/mt/archives/2012/09/strengths-and-weaknesses-of-quantitative-and-qualitative-research.php

    Questionnaire?

    Approaches

    http://www.uxmatters.com/mt/archives/2012/09/strengths-and-weaknesses-of-quantitative-and-qualitative-research.php

  • UX Research
 Questionnaires / Surveys

    KP Ludwig John

    Reference: http://www.fao.org/docrep/w3241e/w3241e05.htm

    Questionnaire Approaches

    Example: Interviewing the head of the household 
 to find out how decisions are made within the family 
 when purchasing breakfast foodstuffs 


    A formal questionnaire may restrict the discussion and prevent 
 a full exploration of the processes. 


    Prepare a brief guide, listing perhaps ten major open-ended questions, 
 with appropriate probes/prompts listed under each.

    Exploratory questionnaire: 
 • collection of qualitative data • no statistically evaluation • probably no formal questionnaire needed

    http://www.fao.org/docrep/w3241e/w3241e05.htm

  • UX Research
 Questionnaires / Surveys

    KP Ludwig John

    Reference: https://chaione.com/blog/ux-research-standardizing-usability-questionnaires/

    Questionnaire Approaches

    Benefits: 
 Quantification: Standardized measurements 


    Generalization: generalizing a finding 
 from a sample to the greater population. 


    Communication: easier to communicate 
 findings by referring to standardized metrics. 


    Quick Comparisons: 
 easy to compare different iterations throughout the development process.

    Formal standardized questionnaire: 
 • to test and quantify hypothesis • to be analyzed statistically

    https://chaione.com/blog/ux-research-standardizing-usability-questionnaires/

  • UX Research
 Questionnaires / Surveys

    KP Ludwig John

    Standardized
 Questionnaires

  • UX Research
 Questionnaires / Surveys

    KP Ludwig John

    System Usability Scale (SUS)

    https://en.wikipedia.org/wiki/System_usability_scale

    Developed by John Brook in 1986 
 at Digital Equipment Corporation (UK) 
 as a tool in usability engineering of electronic office systems

    simple, ten-item attitude test
 giving a global view of subjective assessments of usability

    Likert scale

    Summed up in form of a

    https://en.wikipedia.org/wiki/United_Kingdom https://en.wikipedia.org/wiki/Usability_engineering https://en.wikipedia.org/wiki/Electronic_office https://en.wikipedia.org/wiki/Usability

  • UX Research
 Questionnaires / Surveys

    KP Ludwig John

    System Usability Scale (SUS)

    https://en.wikipedia.org/wiki/Likert_scale

    Respondents specify their level of agreement or disagreement 
 on a symmetric agree-disagree scale for a series of statements.

    bipolar scaling method, 
 measuring either positive or negative response to a statement

    Likert scale named after its inventor, psychologist Rensis Likert (1903 - 1981)

    Five response options for respondents; 
 from Strongly agree to Strongly disagree.

    SUS: Question 1


    I think I would like to use
 this system frequently

    http://www.usabilitest.com/sus

  • UX Research
 Questionnaires / Surveys

    KP Ludwig John

    System Usability Scale (SUS) The 10 template questions 
 which you can adapt:

    1. I think that I would like to use this system frequently. 2. I found the system unnecessarily complex. 3. I thought the system was easy to use. 4. I think that I would need the support of a technical person 


    to be able to use this system. 5. I found the various functions in this system were well integrated. 6. I thought there was too much inconsistency in this system. 7. I would imagine that most people would learn to use 


    this system very quickly. 8. I found the system very cumbersome to use. 9. I felt very confident using the system. 10. I needed to learn a lot of things 


    before I could get going with this system.

    https://usabilitygeek.com/how-to-use-the-system-usability-scale-sus-to-evaluate-the-usability-of-your-website/

  • UX Research
 Questionnaires / Surveys

    KP Ludwig John

    System Usability Scale (SUS) Calculate the Score Users have ranked 
 each of the 10 templates questions from 1 to 5

    • For each of the odd numbered questions, 
 subtract 1 from the score.

    • For each of the even numbered questions, 
 subtract their value from 5.

    • Take these new values which you have found, 
 and add up the total score. Then multiply this by 2.5.

    The result is your score out of 100. 
 (This is NOT a percentage!)

    https://usabilitygeek.com/how-to-use-the-system-usability-scale-sus-to-evaluate-the-usability-of-your-website/

    What does the score tell?

  • UX Research
 Questionnaires / Surveys

    KP Ludwig John

    System Usability Scale (SUS)

    https://usabilitygeek.com/how-to-use-the-system-usability-scale-sus-to-evaluate-the-usability-of-your-website/

    Interpret the Score Translated into notes:

    https://measuringu.com/sus/

    • 80.3 or higher is an A. People love your site and
 will recommend it to their friends

    More details at:

    • 51 or under 
 gets you a big fat F. 
 Make usability 
 your priority now 
 and fix this fast.

    • 68 or thereabouts 
 gets you a C. 
 You’re doing OK 
 but could improve

    SUS scores from about 500 surveys, conducted by Jeff Sauro
 Average SUS score = 68

  • UX Research
 Questionnaires / Surveys

    KP Ludwig John

    User Experience Questionnaire (UEQ)

    http://www.cheval-lab.ch/was-ist-usability/usabilitymethoden/frageboegen/user-experience-questionnaire/

    Originally developed at SAP
 freely accessible since 2006

    Explores the following six factors:

    Used to measure the user experience of software products 
 Takes into account classic aspects of Usability (Efficiency) 
 as well as of User Experience (Attractiveness)

  • UX Research
 Questionnaires / Surveys

    KP Ludwig John

    User Experience Questionnaire (UEQ)

    http://www.ueq-online.org/

    (Attraktivität)
 Overall Impression of the product.


    Do users like or dislike this?

    Explores the following six factors:

    (Verständlichkeit)
 Is it easy to get familiar


    with the product?

    (Effektivität)
 Can users solve their tasks


    with the product 
 without unnecessary effort?

    (Verlässlichkeit)
 Does the user feel in control


    of the interaction?

    (Stimulation)
 Is it exciting and motivating


    to use the product?

    (Originalität)
 Is the product


    innovative and creative?

  • UX Research
 Questionnaires / Surveys

    KP Ludwig John

    User Experience Questionnaire (UEQ) http://www.ueq-online.org/ Explores the following six factors:

    Attractiveness
 is a pure valence (Wertigkeit) dimension

    Perspicuity, Efficiency, Dependability 
 pragmatic quality aspects 


    (goal-directed)

    Stimulation, Novelty 
 hedonic (Sinnengenuss) quality aspects 


    (not goal-directed)

    Grouped in categories

  • UX Research
 Questionnaires / Surveys

    KP Ludwig John

    User Experience Questionnaire (UEQ)

    26 pairs of contrasting attributes that may apply to the product

    http://www.ueq-online.org/

    Questionnaire

  • UX Research
 Questionnaires / Surveys

    KP Ludwig John

    User Experience Questionnaire (UEQ)

    Please decide spontaneously. Don’t think too long about your decision to 
 make sure that you convey your original impression

    Tick a circle in every line. It is your personal opinion that counts.

    http://www.ueq-online.org/

    Procedure

  • UX Research
 Questionnaires / Surveys

    KP Ludwig John

    User Experience Questionnaire (UEQ) Typical applications

    http://www.ueq-online.org/

    Compare the UX of two products

    However, if you want to draw conclusions on this (especially if your sample is small) you have to check if the differences are significant.

    Version A shows for all scales, with the exception of Novelty better values than version B.

  • UX Research
 Questionnaires / Surveys

    KP Ludwig John

    User Experience Questionnaire (UEQ) Typical applications

    General UX Evaluation of a product

    http://www.ueq-online.org/

    Haptic Interface

    Research Topics:
 Do Users understand 
 how to interact / what to do?

    Interactive Mirror

    Research Topics:
 Dimension, Observer Distance
 Observer Posi