45
USER RESEARCH: FROM FULL FAT TO LEAN BEN BYWATER

User research full fat to lean

Embed Size (px)

DESCRIPTION

Reporting on how user researchers are working and how this may have changed over the last 5 years Presented at Collaborate Bristol on 12/11/14

Citation preview

Page 1: User research full fat to lean

USER RESEARCH: FROM FULL FAT TO LEAN BEN BYWATER

Page 2: User research full fat to lean

INPUTS 10 INTERVIEWS 30 SURVEY RESPONDENTS

(me) Client-side

Agency-side

75% had 10+ years experience.

6 survey respondents were also interviewees.

Page 3: User research full fat to lean

FORCES AT PLAY AGILE SQUEEZING TIME MORE ‘IN HOUSE’ UX MORE COLLABORATION CONTINOUS DELIVERY LEAN UX MINDSET MORE MOBILE NEW TECH & PACE OF CHANGE MORE DATA

Page 4: User research full fat to lean

HOW WE’RE RESPONDING BEING MORE PRAGMATIC HUSTLING FOR THE BIG PICTURE ADAPTING SERVICE OFFERINGS USING MORE INP[UTS MEASURING UX MORE GETTING OUT OF THE LAB & MAKING SENSE OF THE DATA SOCIALISING & MANAGING INSIGHTS BETTER

Page 5: User research full fat to lean

BEING MORE PRAGMATIC

http://blog.mailchimp.com/remote-usability-testing-on-mobile-devices/

Page 6: User research full fat to lean

BEING MORE PRAGMATIC

 INSIGHT    RESOURCE  

http://blog.mailchimp.com/remote-usability-testing-on-mobile-devices/

Page 7: User research full fat to lean

BEING MORE PRAGMATIC THINKING  ABOUT  5  YEARS  AGO,  IS  THERE  MORE,  LESS  OR  THE  SAME  AMOUNT  OF  TIME  TO  DO  THE  RESEARCH?    

MORE  

LESS  

SAME  

0%   50%   100%  

http://blog.mailchimp.com/remote-usability-testing-on-mobile-devices/

Page 8: User research full fat to lean

BEING MORE PRAGMATIC THINKING  ABOUT  THE  LAST  5  YEARS,  ARE  YOU  HAVING  MORE,  LESS  OR  THE  SAME  AMOUNT  OF  INFLUENCE  ON  THE  FINAL  PRODUCT  OR  SERVICE?  

MORE  

LESS  

SAME  

0%   50%   100%  

http://blog.mailchimp.com/remote-usability-testing-on-mobile-devices/

Page 9: User research full fat to lean

BEING MORE PRAGMATIC

I  FIND  MYSELF  PUSHING  PEOPLE  TO  BE  A  BIT  LESS  IDEALISTIC  AND  A  BIT  MORE  PRAGMATIC  ABOUT  WHAT  THEIR  TIME  IS  BEST  SPENT  ON.  

RESEARCH  MANAGER,  CLIENT-­‐SIDE  

“  

http://blog.mailchimp.com/remote-usability-testing-on-mobile-devices/

Page 10: User research full fat to lean

BEING MORE PRAGMATIC

THE  LEAN  MOVEMENT  HAS  DRASTICALLY  CHANGED  ATTITUDES.  WE  ARE  ALL  MORE  ‘TRY  AND  LEARN’  THAN  5  YEARS  AGO  WHEN  WE  WANTED  TO  LEARN,  THEN  CAREFULLY  LEARN.  THE  ADVENT  OF  THE  MVP  IS  CAUSING  US  TO  EVOLVE.  

RESEARCH  MANAGER,  AGENCY-­‐SIDE  

“  

http://blog.mailchimp.com/remote-usability-testing-on-mobile-devices/

Page 11: User research full fat to lean

BEING MORE PRAGMATIC

LEAN  START-­‐UP  IS  THE  BANE  OF  MY  LIFE!  RESEARCH  MANAGER,  CLIENT-­‐SIDE  

“  

http://blog.mailchimp.com/remote-usability-testing-on-mobile-devices/

Page 12: User research full fat to lean

BEING MORE PRAGMATIC

BEST  PRAGMATIC  METHOD  AWARD:  USER  TESTING!  

http://blog.mailchimp.com/remote-usability-testing-on-mobile-devices/

Page 13: User research full fat to lean

HUSTLING FOR THE BIG PICTURE

http://1hdwallpapers.com/wallpapers/big_city_view.jpg

Page 14: User research full fat to lean

HUSTLING FOR THE BIG PICTURE

http://1hdwallpapers.com/wallpapers/big_city_view.jpg

THINKING  ABOUT  THE  LAST  5  YEARS,  ARE  YOU  DOING  MORE,  LESS  OR  THE  SAME  AMOUNT  OF  STRATEGIC    ‘UP-­‐STREAM’  TYPE  RESEARCH?  

MORE  

LESS  

SAME  

0%   50%   100%  

Page 15: User research full fat to lean

HUSTLING FOR THE BIG PICTURE

http://1hdwallpapers.com/wallpapers/big_city_view.jpg

CASE  STUDY:  A  REVOLT  

Page 16: User research full fat to lean

HUSTLING FOR THE BIG PICTURE

http://1hdwallpapers.com/wallpapers/big_city_view.jpg

WE  REBELLED!  AND  IN  THE  END  THE  PRODUCT  OWNER  TOLD  THE  HEAD  OF  DIGITAL  “WE  JUST  CAN’T  DO  IT  LIKE  THAT.  IT  DOESN’T  WORK…  BASICALLY  F*@%  OFF  WITH  YOUR  THEORY”…  AND  HE’S  A  NICE  GUY  SO  HE  SAID  “DO  IT  HOW  YOU  WANT  IF  IT  WORKS  BETTER”.  SO  WE  DID  A  ‘THIN  SLICE’...  TO  MAKE  SURE  THE  END  TO  END  WORKED  AND  NOW  WE  ARE  GOING  INTO  DEEP  DIVES.    

USER  RESEARCHER,  CLIENT-­‐SIDE  

“  

Page 17: User research full fat to lean

HUSTLING FOR THE BIG PICTURE

http://1hdwallpapers.com/wallpapers/big_city_view.jpg

CASE  STUDY:  FIELD  STUDIO  

Page 18: User research full fat to lean

HUSTLING FOR THE BIG PICTURE

http://1hdwallpapers.com/wallpapers/big_city_view.jpg

BEST  BIG  PICTURE  APPROACH  AWARD:  LEAN  SLICES  

Page 19: User research full fat to lean

ADAPTING SERVICE OFFERINGS

PIC BY TIM GEOGHEGAN

Page 20: User research full fat to lean

ADAPTING SERVICE OFFERINGS

PIC BY TIM GEOGHEGAN

AS  COMPANIES  HAVE  GOTTEN  SMARTER  ABOUT  DESIGN,  AND  RECOGNISED  IT’S  A  COMPETENCY  THEY  NEED  INTERNALLY,  THEY’VE  BECOME  LESS  COMFORTABLE  OUTSOURCING  IT.    

“  PETER  MERLHOLZ,  ADAPTIVE  PATH  CO-­‐FOUNDER  

Page 21: User research full fat to lean

ADAPTING SERVICE OFFERINGS

PIC BY TIM GEOGHEGAN

AS  COMPANIES  HAVE  GOTTEN  SMARTER  ABOUT  DESIGN,  AND  RECOGNISED  IT’S  A  COMPETENCY  THEY  NEED  INTERNALLY,  THEY’VE  BECOME  LESS  COMFORTABLE  OUTSOURCING  IT.    

“  PETER  MERLHOLZ,  ADAPTIVE  PATH  CO-­‐FOUNDER  

(IN  SILICON  VALLEY,  ANYWAY)  

Page 22: User research full fat to lean

ADAPTING SERVICE OFFERINGS

PIC BY TIM GEOGHEGAN

CASE  STUDY:  COACHING  BY  AN  AGENCY  

Page 23: User research full fat to lean

ADAPTING SERVICE OFFERINGS

PIC BY TIM GEOGHEGAN

I  CAN  LEAVE  [THE  CLIENT  TEAM]  TO  IRON  OUT  THE  INTERFACE  LEVEL  USABILITY  THINGS,  HAVING  GOT  THE  BIGGER  ISSUES  OUT  OF  THE  WAY...  USABILITY  IS  BEING  COMMODITISED.  

“  USER  RESEARCH,  AGENCY-­‐SIDE  

Page 24: User research full fat to lean

ADAPTING SERVICE OFFERINGS

PIC BY TIM GEOGHEGAN

BEST  ADAPTATION  AWARD:  COACHING  IN  HOUSE  UX  

Page 25: User research full fat to lean

USING MORE INPUTS

http://conwaycustom.com.au/workshop/586/

Page 26: User research full fat to lean

USING MORE INPUTS

http://conwaycustom.com.au/workshop/586/

I  TEND  TO  HAVE  TO  CONSIDER  MORE  RESEARCH  SOURCES  PER  PROJECT  [THESE  DAYS].  FOR  EXAMPLE,  STATS,  ANALYTICS,  MARKET  RESEARCH  DATA  MINING,  UX  RESEARCH,  DESK  RESEARCH,  INTERVIEWS  WITH  OTHER  AGENCIES,  TEAMS  AND  SOURCES.  

“  USER  RESEARCHER,  AGENCY-­‐SIDE  

Page 27: User research full fat to lean

USING MORE INPUTS

http://conwaycustom.com.au/workshop/586/

THINKING  ABOUT  THE  LAST  5  YEARS,  ARE  YOU  DOING  MORE,  FEWER  OR  THE  SAME  NUMBER  OF  RESEARCH  METHODS  AND  INPUTS?      

MORE  

LESS  

SAME  

0%   50%   100%  

Page 28: User research full fat to lean

USING MORE INPUTS

http://conwaycustom.com.au/workshop/586/

MY  PERCEPTION  IS  THAT  USER  RESEARCH  AND  CONSUMER  INSIGHT  OR  MARKET  RESEARCH  ARE  GOOD  AT  DIFFERENT  THINGS  AT  THE  MOMENT…  WHAT  I  AM  EXCITED  ABOUT  AT  THE  MOMENT  IS  THERE  IS  A  LOT  OF  STUFF  THAT  IS  CUTTING  EDGE  IN  CONSUMER  INSIGHT  THAT  I  AM  NOT  HEARING  ABOUT  IN  USER  RESEARCH  BUT  IS  ENTIRELY  APPLICABLE.    

“  USER  RESEARCHER,  AGENCY-­‐SIDE  

Page 29: User research full fat to lean

USING MORE INPUTS

http://conwaycustom.com.au/workshop/586/

CASE  STUDY:  CAMPFIRE  (LONG  TERM  COMMUNITIES)  

Page 30: User research full fat to lean

USING MORE INPUTS

http://conwaycustom.com.au/workshop/586/

BEST  NEW  INPUT  AWARD:  LONG  TERM  COMMUNITIES  

Page 31: User research full fat to lean

MEASURING UX MORE

http://www.prodality.com/measurement-the-key-to-startup-success/

Page 32: User research full fat to lean

MEASURING UX MORE

http://www.prodality.com/measurement-the-key-to-startup-success/

THE  MEASUREMENT  OF  UX  EFFECTIVENESS  WITH  ANALYTICS  IS  BIG  NOW.  

“  USER  RESERCHER,  FREELANCE  

Page 33: User research full fat to lean

MEASURING UX MORE

http://www.prodality.com/measurement-the-key-to-startup-success/

CASE  STUDY:  BOARD  ROOM  CATNIP  

Page 34: User research full fat to lean

MEASURING UX MORE

http://www.prodality.com/measurement-the-key-to-startup-success/

IT  WAS  LIKE    TOTAL  CATNIP  TO  THEM  BECAUSE  …  IT  LET  US  JUMP  FROM  THE  BIG  PICTURE  OF  ‘THIS  SERVICE  HAS  THIS  ONE  BIG  CHALLENGE’  TO  THE  MINUTE  DETAIL  OF  [HOW  WE  WERE  FIXING  IT].  

“  USER  RESERCHER,  FREELANCE  

Page 35: User research full fat to lean

GETTING OUT OF THE LAB & MAKING SENSE OF THE DATA

http://www.travelization.net/wp-content/uploads/2012/07/elephant-going-trought-jungle-wallpapers-1366x768.jpg

Page 36: User research full fat to lean

GETTING OUT OF THE LAB & MAKING SENSE OF THE DATA

http://www.travelization.net/wp-content/uploads/2012/07/elephant-going-trought-jungle-wallpapers-1366x768.jpg

IF  THE  COST  OF  EXTRACTING  OUTWEIGHS  THE  VALUE  OF  EXTRACTION  YOU’RE  NOT  GOING  TO  BOTHER.  I  PREDICT  A  DOUBLING  DOWN  OF  QUALITATIVE  AS  THE  MORE  HOLISTIC  APPROCH  THAT  GIVES  YOU  MOST  OF  WHAT  YOU  WANT  IN  A  WAY  THAT’S  ACTIONABLE…  IN  THE  SHORT  AND  MEDIUM  TERM  I  PREDICT  A  GOLDEN  AGE  OF  ETHNOGRAPHY.    

“  HEAD  OF  RESEARCH,  AGENCY-­‐SIDE  

Page 37: User research full fat to lean

GETTING OUT OF THE LAB & MAKING SENSE OF THE DATA

http://www.travelization.net/wp-content/uploads/2012/07/elephant-going-trought-jungle-wallpapers-1366x768.jpg

CASE  STUDY:  MORE  DATA  =  MORE  ETHNO  

Page 38: User research full fat to lean

SOCIALISING AND MANAGING INSIGHTS BETTER

http://www.bowmast.com/case-study-craft-brewing/

Page 39: User research full fat to lean

SOCIALISING AND MANAGING INSIGHTS BETTER

http://www.bowmast.com/case-study-craft-brewing/

THE  CORE  RESEARCH  PRACTICES  ARE  EXACTLY  THE  SAME  [AS  THEY  WERE  5  YEARS  AGO].  IT’S  THE  ANCILLARY  STUFF  THAT  HAS  CHANGED…  THE  BIG  THING  IS  MAKING  IS  HAPPEN  IN  THE  TEAM  &  KEEPING  IT  USER-­‐CENTRED.  75%  OF  MY  JOB  IS  COMMUNICATION.  

“  HEAD  OF  RESEARCH,  CLIENT-­‐SIDE  

Page 40: User research full fat to lean

SOCIALISING AND MANAGING INSIGHTS BETTER

http://www.bowmast.com/case-study-craft-brewing/

WHAT  TAKES  MOST  OF  YOUR  TIME  AND  ENERGY  WITH  USER  RESEARCH?  

ELICITING  RESEARCH  NEEDS  FROM  CLIENTS  AND  STAKEHOLDERS  

PLANNING  AND  CONDUCTING  THE  RESEARCH  

5  YEARS  AGO  TODAY  

COMMUNICATING  AND  SOCIALISING  THE  INSIGHTS  FROM  THE  RESEARCH  

0%   50%   100%  

Page 41: User research full fat to lean

SOCIALISING AND MANAGING INSIGHTS BETTER

http://www.bowmast.com/case-study-craft-brewing/

THINKING  ABOUT  THE  LAST  5  YEARS,  ARE  YOU  GETTING  BETTER,  WORSE  OR  IS  THERE  NO  CHANGE  IN  ‘MANAGING  INSIGHT’?  

BETTER  

WORSE  

SAME  

0%   50%   100%  

Page 42: User research full fat to lean

SOCIALISING AND MANAGING INSIGHTS BETTER

http://www.bowmast.com/case-study-craft-brewing/ 0%   50%   100%  

THE  BEST  WAY  TO  MANAGE  INSIGHT  IS  TO  MAKE  SURE  THAT  LOTS  OF  PEOPLE  TAKE  PART  IN  THE  RESEARCH  SO  THAT  THEY  ALL  GET  IT  .  “  

HEAD  OF  RESEARCH,  CLIENT-­‐SIDE  

Page 43: User research full fat to lean

SOCIALISING AND MANAGING INSIGHTS BETTER

http://www.bowmast.com/case-study-craft-brewing/ 0%   50%   100%  

THE  BEST  REPORT  IS  NO  REPORT…  THE  BEST  RESEARCH  PROJECT  IS  NOT  HAVING  TO  DO  THE  RESEARCH  PROJECT.  “  

HEAD  OF  RESEARCH,  AGENCY-­‐SIDE  

Page 44: User research full fat to lean

SOCIALISING AND MANAGING INSIGHTS BETTER

http://www.bowmast.com/case-study-craft-brewing/ 0%   50%   100%  

BEST  ‘INSIGHT  HOLDER’  (OTHER  THAN  PEOPLE):  VIDEO!  

Page 45: User research full fat to lean

THANKS @JAMMINJARJAM