Usability Testing Materials

  • View
    511

  • Download
    0

Embed Size (px)

Text of Usability Testing Materials

  • 1. Usability TestingWednesday, February 29, 12

2. Usability is mostly common sense.Wednesday, February 29, 12 3. notWednesday, February 29, 12 4. Wednesday, February 29, 12 5. notWednesday, February 29, 12 6. Wednesday, February 29, 12 7. But you still need a plan.Wednesday, February 29, 12 8. Test MaterialsWednesday, February 29, 12 9. Guidelines for observers Orientation script Background questionnaire Data collection instruments Agreement & consent forms Pre-test questionnaire Task scenarios Post-test questionnaire Debrieng guideWednesday, February 29, 12 10. Guidelines for observersWednesday, February 29, 12 11. what to donot to doWednesday, February 29, 12 12. Introduce yourself Find out what they need? Anxious? Let them know what theyre in for. protocols testing methods testing reasonsWednesday, February 29, 12 13. Orientation ScriptWednesday, February 29, 12 14. Guidelines (p. 156-57)Wednesday, February 29, 12 15. Guidelines (p. 156-57) Tone Length VerbatimWednesday, February 29, 12 16. Demonstrate neutrality.Wednesday, February 29, 12 17. Wednesday, February 29, 12 18. you areWednesday, February 29, 12 19. Wednesday, February 29, 12 20. but you do need to care about them.Wednesday, February 29, 12 21. Wednesday, February 29, 12 22. Wednesday, February 29, 12 23. The act of observing peoplecant help but affect the results.Wednesday, February 29, 12 24. Background QuestionnaireWednesday, February 29, 12 25. classiers from screening processWednesday, February 29, 12 26. why?Wednesday, February 29, 12 27. Wednesday, February 29, 12 28. data collectionWednesday, February 29, 12 29. What data will addressthe problem statement/research question?Wednesday, February 29, 12 30. How will you collect the data?Wednesday, February 29, 12 31. Who is going to do what?Wednesday, February 29, 12 32. Performance DataWednesday, February 29, 12 33. objective measures ofbehavior, such as error rates,time, and counts of observedbehavior elementsWednesday, February 29, 12 34. Preference dataWednesday, February 29, 12 35. more subjective data thatmeasures the participantsfeelings or opinions of theproduct.Wednesday, February 29, 12 36. Performance Data:Wednesday, February 29, 12 37. number of errors % of tasks completed successfully # and type of hints/prompts needed # of omitted steps or procedures Scores on comprehension testsWednesday, February 29, 12 38. Time to...complete a taskrecover from an errorachieve a criterion level of competencespent reading v workingWednesday, February 29, 12 39. Preference DataWednesday, February 29, 12 40. Preference between versions Suggestions for improvement Number of negative references to product Rationales for performance Ratings or rankings of productWednesday, February 29, 12 41. (see pgs 166 - 167)Wednesday, February 29, 12 42. What type of information will you collect?Wednesday, February 29, 12 43. Wednesday, February 29, 12 44. Listen to the client. Pay attention to your site.Wednesday, February 29, 12 45. First things rst:Wednesday, February 29, 12 46. Where are you going to test?Wednesday, February 29, 12 47. These documents are used in varying contexts.Wednesday, February 29, 12 48. Wednesday, February 29, 12 49. Wednesday, February 29, 12 50. Wednesday, February 29, 12 51. Ideally, testing is done in the context the document will be used in.Wednesday, February 29, 12 52. How are you going torecord data?Wednesday, February 29, 12 53. Wednesday, February 29, 12 54. MoraeWednesday, February 29, 12 55. Manual data collectionWednesday, February 29, 12 56. Observe and take notes on every action.Wednesday, February 29, 12 57. Develop a code.Wednesday, February 29, 12 58. You might write T when the subject stopsreading and does not perform any action tosignify that they were thinking You might write F when the subject ipsback and forth to locate something You might write W when the subjectwanders around.Wednesday, February 29, 12 59. To use this method, start a tablewith the elapsed time in onecolumn and the action which occursin the other.Wednesday, February 29, 12 60. By carefully noting what the subject does ateach stage, you can locate the difcult parts.Wednesday, February 29, 12 61. Nondisclosure FormsRecording PermissionInformed Consent FormWednesday, February 29, 12 62. Pre-test QuestionnairesInterviewsWednesday, February 29, 12 63. Task ScenariosWednesday, February 29, 12 64. Results they will strive to achieve Motives for performing the work Actual data/names rather than generalities State of system when task is initiated Any other materials they need to completethe taskWednesday, February 29, 12 65. be realisticprovide motivationWednesday, February 29, 12 66. sequence tasksWednesday, February 29, 12 67. Wednesday, February 29, 12 68. Determine levels ofinteractionWednesday, February 29, 12 69. The difference between strictlyobserving a person navigating adocument or using a productand participating in what theydo is signicant.Wednesday, February 29, 12 70. But it is also a matter of degree decide in advance just how much you will interact with your test subjects.Wednesday, February 29, 12 71. Wednesday, February 29, 12 72. silent observationWednesday, February 29, 12 73. talk-aloud protocolsWednesday, February 29, 12 74. Post-test QuestionsWednesday, February 29, 12 75. Major items related to specic researchquestions Items related to trends/patterns amongparticipants Items related to things you cant directlyobserveWednesday, February 29, 12 76. Question Forms/FormatsWednesday, February 29, 12 77. Likert ScaleWednesday, February 29, 12 78. Semantic DifferentialsWednesday, February 29, 12 79. Debrieng GuideWednesday, February 29, 12