Embed Size (px)
Citation preview
Understanding Development Methods From Other Industries to Improve the Design of
Consumer Health IT
Enid Montague, PhD
Agency for Healthcare Research and Quality
Task Order No. 10
Contract No. HHSA2902009000231
Project Oversight
AHRQ Task Order Officer: Teresa Zayas-Cabán
AHRQ Alternate Task Order Officer: Kevin Chaney
Project Director: Enid Montague
Project Team
Jennifer Crafts (Westat) David Damico (Westat) Patricia Flatley Brennan (University of Wisconsin- Madison) Enid Montague (Northwestern University)
Ritu Agarwal, Center for Health Information and Decision Systems (CHIDS) (U of MD)
P.K. Kannan, Center for Health Information and Decision Systems (CHIDS) (U of MD)
Kenyon Crowley, Center for Health Information and Decision Systems (CHIDS) (U of MD)
Background and Impetus for Project
Slow adoption of consumer health IT
New user-centered design approaches for development of consumer products are emerging in a variety of industries
Success of product development approaches, methods, and philosophies in other industries could generalize to personal health care
Project Objectives
Identify new and emerging practices for developing consumer products that may generalize to designing consumer health IT applications. 1. Conduct environmental scan and grey literature review
to Identify relevant tools and design methods
2. Interview key informants about design processes
Objective One
Conduct environmental scan and grey literature review to Identify relevant tools and design methods
Implications for the Design of Consumer
Health IT Applications
The Domain of Design: Design,
Philosophy, Process, Methods
Design Methods (18) for Consumer Products and their
Classification
Successful Digital Consumer Products
(24)Design Methods
used for Successful Digital Consumer
Products
Categories of Consumer Health IT
Applications
Recommended Design Methods for Categories of Consumer Health IT
Applications
Environmental Scan and Grey Literature Review: Method Overview
Considerable variety in methods used across products; common themes are captured
Choice of method(s) likely influenced by the nature of the consumer health IT application Development of a hybrid product (integrated physical device and digital
component as a single product from the manufacturer, e.g. Fitbit) vs. development of a purely digital product (e.g., WebMD)
Limitations of study: Design method is just one of many factors in product success Focus of review was design methods using an engineering
approach
Environmental Scan and Grey Lit Review: Findings
Environmental Scan and Grey Lit Review: Overview of Findings
Observed many methods used by successful products; applying, disseminating and incentivizing use of good design may be key point
Generally for all consumer products: Used methods that incorporate high levels of user
involvement and iteration Used one or more of the most frequently used design
methods Design teams contained medium breadth with regard to size
and skill-sets Engaged human factors experts Strived to “Keep it simple” – parsimonious feature set Paid careful attention to user characteristics
Environmental Scan and Grey Lit Review: Overview of Findings (cont’d)
Used multiple design methods
Used prototypes and consumer feedback based on their use
• Additional design considerations for hybrid consumer products:
Objective Two
Interview key informants about design processes
Key Informant Interviews: Approach and Challenges
Approach
Challenges Company restrictions on employees’ participation in
research Availability of all original key informants Rapid turnover within consumer design field
Developed interview guide
Identified successful consumer products
Identified potential key informants
Conducted interviews
Identified emerging themes from interviews
Key Informant Interviews:Selection Criteria
Recognized market success, as determined
by:
Consumer Reports publication
Rated best and most successful products of the
year
Received awards from product design
Number of users or unique visitors
Key informants who could speak knowledgeably about the product or
design process:
Founders
Designers involved with product development
Senior management
Product features relevant for consumer health IT:
Storing, archiving, and retrieving information
Monitoring health-related information
Searching for information
Supporting task completion such as logging
activities, making comparisons, and making
decisions
Key Informants’ Products and Companies
Product Category Product Name Brief Product Description Company Name
Communication Peek Mobile DeviceSends and receives unlimited email from anywhere in the U.S.
IDEO
Communication AT&T UverseMobile, home integrated communication system
AT&T
Information storage, archival, and retrieval
EasyShare SoftwareSoftware for photo storage, retrieval and tagging
Kodak
Logging and recording activities or measures
Nokia 1100 Cell phone Nokia
Logging and recording activities or measures
Red Laser Tag scanning application Occipital
Monitoring health-related information
Xbox Kinect Game console Microsoft
Monitoring health-related information
4Home Energy System
Energy consumption monitoring system
4Home
Searching for information and making comparisons
Quicken Health Expense Tracker
Web-based application that tracks health care expenses
Intuit
Searching for information and making comparisons Medicare.gov Web site for adults
MITRE corporation
Key Informants Interviewed
Company size range: 4 – 50,000 Roles and titles
Design, User Experience, or Human Factors User Interaction Designer Senior Designer Senior User Interaction Designer Human Factors Engineer User Research Lead
Management Senior VP of Product and Program Management CEO and Founder Director, Innovation and Advanced Technology Co-founder
Methods
Used interview guide to conduct interviews
Recorded and transcribed interviews
Analyzed transcripts using NVivo software and a thematic analysis method Coded interviews based on the key elements in
the interview guide (idea generation, identifying end users, concept development, testing, usefulness, strategies influencing commercial success)
Analyzed transcripts for overall themes
Key Informant Interviews:Overview of Primary Themes
Idea Generation• Generating ideas for successful consumer products involves a mixture of intuition and in-depth
understanding from the market and users. • This process used in successful products is one that includes both creativity and user and
market research.
Identify End Users• Identifying end users and user needs involves understanding user experiences in the real
world, and observing their successes and frustrations with existing products. • It also involves conducting research with users and translating these research outcomes into
measures of product success and user profiles.
Concept Development• Understanding user needs driven by definition of usefulness, market segmentation
approaches, and prototyping.• Prototyping is widely used in the design process. Multiple prototyping techniques are used with
an emphasis on low fidelity methods. • New design methods include releasing imperfect products into the market and providing
updates, conducting in-depth observations of human behavior to inform design, and employing rapid prototyping and evaluation techniques.
Key Informant Interviews: Overview of Primary Themes (cont’d)
Role of Testing• Testing should take place throughout the design process and facilitate
iterative design of prototypes.
Defining Usefulness and Ease of Use• Informants believe ease of use to be important in their design activities,
but definitions and measures of the construct vary.• Usefulness is considered important, but is more loosely defined.
Strategies Influencing Commercial Success• Many techniques are used to influence success, ranging from the
product’s design, to marketing strategies, to customer support services. • Without usability, products are not likely to achieve success. • However, it takes more than a usable product to achieve product
success.
Key Informant Interviews: Secondary Themes
Secondary themes: Designing for entertainment and experience versus
usability and functionality
Leveraging people relationships in product design or
business strategies
Areas for Future Research
Building evidence base of effective consumer health IT application design methods may be addressed by:
Comparing alternative levels of user involvement and iteration for different types of consumer health IT applications.
Isolating design processes currently in use for consumer health IT applications.
Developing case studies retrospectively documenting design processes of market leaders of consumer health IT applications.
Identifying contingencies that may affect the efficacy of different design methods for different user populations.
Investigating user response to products that are modular in nature.
• http://healthit.ahrq.gov/developmentmethodsbackgroundreport
• http://healthit.ahrq.gov/developmentmethodskeyinformantinterviewsreport
For More Information
Acknowledgements
Technical Expert Panel members:
Tony Andre (Interface Analysis Associates) Deborah A. Boehm-Davis (George Mason University) Sara Czaja (University of Miami, CREATE) Judith Gregory (IIT Institute of Design) Seth Howard (Epic) Tony Hu (American Innovative, LLC) Rita Kukafka (Columbia University)
THANK YOU!
For additional information
please feel free to contact me or visit
http://healthit.ahrq.gov/
www.enidmontague.com
