Informal Guerilla User Study

  • Published on

  • View

  • Download

Embed Size (px)


Informal Guerilla User Study: How to get quick and useful feedback on your app. ID for Devz at Hacker Dojo


<ul><li> 1. Informal Guerilla User Study How to get quick and useful feedback on your app ID for Devz at Hacker Dojo Nilo Sarraf January 2011 </li> <li> 2. We see what we want to see! </li> <li> 3. <ul><li>Assumptions </li></ul><ul><li><ul><li>In research do NOT assume! </li></ul></li></ul><ul><li><ul><li>Researcher bias: I know the results before I even go into the lab! </li></ul></li></ul><ul><li>Even top researchers are biased </li></ul><ul><li>Humans are complex machines </li></ul></li> <li> 4. Get Divorced! <ul><li>Divorce your app </li></ul><ul><li>Be objective </li></ul><ul><li>Get stupid when doing research on your app! </li></ul></li> <li> 5. Know Thy User Even when they look totally alien to you <ul><li>Body language/body gestures </li></ul><ul><li>Tone of voice </li></ul><ul><li>Personality types </li></ul><ul><li>Context/Environment </li></ul><ul><li>Mood swings </li></ul></li> <li> 6. The Observer Effect <ul><li>Physics </li></ul><ul><li><ul><li>Changes that the act of observation will make on the phenomenon being observed </li></ul></li></ul><ul><li>Information Technology </li></ul><ul><li><ul><li>The potential impact of the act of observing a process output while the process is running </li></ul></li></ul><ul><li>Psychology </li></ul><ul><li><ul><li>A form of reactivity, in which a researcher's cognitive bias causes them to subconsciously influence the participants of an experiment </li></ul></li></ul></li> <li> 7. How to Observe Users <ul><li>Observational techniques </li></ul><ul><li><ul><li><ul><li>Behavioral </li></ul></li></ul></li></ul><ul><li><ul><li><ul><li>Facial muscles </li></ul></li></ul></li></ul><ul><li><ul><li><ul><li>Body gestures </li></ul></li></ul></li></ul><ul><li><ul><li><ul><li>Voice pitch </li></ul></li></ul></li></ul><ul><li><ul><li><ul><li>Choice of words </li></ul></li></ul></li></ul></li> <li> 8. </li> <li> 9. Source: Elsevier 2010 </li> <li> 10. Voice and Choice of Words Know Thy User <ul><li>High or low pitch </li></ul><ul><li>Energetic or tired </li></ul><ul><li>Fast or slow </li></ul><ul><li>Pauses between words </li></ul><ul><li>Choice of words </li></ul></li> <li> 11. Personality Types (Psychology) <ul><li>Openness to Experience : the tendency to be imaginative, independent, and interested in variety vs. practical, conforming, and interested in routine </li></ul><ul><li>Conscientiousness : the tendency to be organized, careful, and disciplined vs. disorganized, careless, and impulsive </li></ul><ul><li>Extraversion : the tendency to be sociable, fun-loving, and affectionate vs. retiring, somber, and reserved </li></ul><ul><li>Agreeableness : the tendency to be softhearted, trusting, and helpful vs. ruthless, suspicious, and uncooperative </li></ul><ul><li>Neuroticism : the tendency to be calm, secure, and self-satisfied vs. anxious, insecure, and self-pitying </li></ul></li> <li> 12. Personality Types Know Thy User <ul><li>Type "A </li></ul><ul><li><ul><li>Is a highly independent and driven personality, typically representing the leaders in business </li></ul></li></ul><ul><li>Type "B" </li></ul><ul><li><ul><li>Represents highly extroverted people who love the spotlight </li></ul></li></ul><ul><li>Type "C" </li></ul><ul><li><ul><li>The antithesis of Type "B"; they are introverted detailists as represented by such people as accountants, programmers, and engineers </li></ul></li></ul><ul><li>Type "D" Personality </li></ul><ul><li><ul><li>Is best characterized as those people who resist any form of change and prefer the tedium of routine, such as in clerical assignments </li></ul></li></ul></li> <li> 13. Type A <ul><li>Independent </li></ul><ul><li>Go-getters </li></ul><ul><li>Aggressive </li></ul><ul><li>Driven personality </li></ul><ul><li>Leaders in business </li></ul></li> <li> 14. Type B <ul><li>Highly extroverted </li></ul><ul><li>Gregarious </li></ul><ul><li>Love the spotlight </li></ul><ul><li>Attractive </li></ul></li> <li> 15. Type C <ul><li>The antithesis of Type "B </li></ul><ul><li><ul><li>Dont like the spot light </li></ul></li></ul><ul><li>Introverted detailists </li></ul><ul><li>Accountants, </li></ul><ul><li>Programmers </li></ul><ul><li>Engineers </li></ul></li> <li> 16. Type D <ul><li>Resist any form of change </li></ul><ul><li>Prefer the tedium of routine </li></ul><ul><li>Clerical assignments </li></ul></li> <li> 17. </li> <li> 18. Environment Know Thy User <ul><li>Familiar or unfamiliar location </li></ul><ul><li>At the Caf next door or at a usability lab </li></ul><ul><li>Do you know the user personally? </li></ul></li> <li> 19. Mood Swings Know Thy User <ul><li>Weather </li></ul><ul><li><ul><li>Sunny or rainy </li></ul></li></ul><ul><li>Time of the day </li></ul><ul><li><ul><li>Morning or evening </li></ul></li></ul><ul><li>Time of the week </li></ul><ul><li><ul><li>Monday or Friday </li></ul></li></ul></li> <li> 20. Lets Get Practical <ul><li>Informal User Study </li></ul><ul><li><ul><li>aka Guerilla testing, Dry run, and Hallway testing </li></ul></li></ul><ul><li>A quick and easy test </li></ul><ul><li>Should take no more than 15 min </li></ul></li> <li> 21. Before User Study <ul><li>Roughly speaking </li></ul><ul><li><ul><li>What is your objective? </li></ul></li></ul><ul><li><ul><li>What do you want to find out? </li></ul></li></ul><ul><li><ul><li>Who is your target audience? </li></ul></li></ul><ul><li><ul><li>Do you have paper or full-fledge prototype? </li></ul></li></ul></li> <li> 22. During User Study <ul><li>Its not you. Its me! </li></ul><ul><li><ul><li>We are not testing the users but the app </li></ul></li></ul><ul><li><ul><li>We are here to create a better app. So, we need you! </li></ul></li></ul><ul><li>Reassuring the user </li></ul><ul><li>Make them feel at ease </li></ul><ul><li><ul><li> At ease does not mean comfortable but just relaxed enough to give good insights </li></ul></li></ul></li> <li> 23. During User Study <ul><li>Listen - needs self-training </li></ul><ul><li>Observe - needs self-training </li></ul><ul><li>Have users talk aloud </li></ul><ul><li>Do NOT prompt users </li></ul><ul><li>Do NOT ask for design advise </li></ul><ul><li>Have fixed questions/objectives that you want to find answers to </li></ul></li> <li> 24. Take Notes <ul><li>Tape recording </li></ul><ul><li>Take notes </li></ul></li> <li> 25. Your Own Body Language <ul><li>Users can tell if you are very attached to your app </li></ul><ul><li>Be curious </li></ul><ul><li><ul><li>Show: Im here to learn from you! </li></ul></li></ul><ul><li>Friendly poker face </li></ul><ul><li>Show openness </li></ul></li> <li> 26. Safe Questions <ul><li> What do you think/believe this button means/does? </li></ul><ul><li> Is this what you expected to see? </li></ul><ul><li> If you were to click on this tab, what would you expect to happen? What would you expect to see? </li></ul><ul><li> What do you think the app is trying to do/accomplish? </li></ul><ul><li> Who do you think may find this app useful/beneficial/interesting/handy? </li></ul><ul><li> What is your overall feeling/understanding of this app? </li></ul><ul><li> Where do you think this app would be used? </li></ul><ul><li> At this point, what would you do? </li></ul></li> <li> 27. Safe Questions <ul><li> Taking a quick look, what do you think this app is about? What do you think it does? </li></ul><ul><li> What would be the first youd do? </li></ul><ul><li> Where would you go about exploring? </li></ul><ul><li> What peeks your interest at this point? </li></ul><ul><li> What is your overall feeling/understanding of this app? </li></ul><ul><li> Any final comments youd like to add? </li></ul></li> <li> 28. Pause <ul><li>Dont be afraid to interrupt the user </li></ul><ul><li>Sometimes users go fast and all over the place </li></ul><ul><li><ul><li>Stop the user </li></ul></li></ul><ul><li><ul><li>So, lets pause for a moment here </li></ul></li></ul><ul><li><ul><li><ul><li>What are you thinking? </li></ul></li></ul></li></ul><ul><li><ul><li><ul><li>How are you deciding your next steps? </li></ul></li></ul></li></ul><ul><li><ul><li><ul><li>What are you seeing? </li></ul></li></ul></li></ul></li> <li> 29. After User Study <ul><li>Talk about your findings with </li></ul><ul><li><ul><li>People in your industry </li></ul></li></ul><ul><li><ul><li>People in other industries </li></ul></li></ul><ul><li><ul><li>Researchers, if you know any </li></ul></li></ul><ul><li>Draw possible conclusions </li></ul><ul><li>Work on your app </li></ul><ul><li>Decide if you need any follow-up refined studies </li></ul></li> <li> 30. One Last Thing <ul><li>User study is NOT about testing a hypothesis </li></ul><ul><li>User study is about uncovering new things that you did not know before </li></ul></li> <li> 31. </li> </ul>