Prototyping and Designing New Assistive Technologies for People
with Disabilities Shaun Kane Human-Centered Computing @ UMBC
http://umbc.edu/people/skane @shaunkane
Slide 2
Today An overview of accessible prototyping and design at UMBC
Two projects Accessible touch screens for blind people Smarter
communication tools for people with aphasia 2
Slide 3
Prototyping and Design at UMBC 3
Slide 4
What weve made 4 Touch screens for blind people Braille entry
for smartphones Communication technologies Tactile graphics
Slide 5
Our research partners 5 National Federation of the Blind Snyder
Center for Aphasia Life Enhancement Maryland State Library for the
Blind and Physically Handicapped Charlestown Senior Living
Slide 6
Design approach Participatory design: work for extended periods
with population who will benefit from technology Ability-based
design: Measure users abilities to interact with technology;
develop new ways of interacting with technology that leverages
these abilities 6
Slide 7
Two projects Access Overlays: Accessible touch screens for
blind people TalkAbout: Communication tools for people with aphasia
7
Slide 8
Two projects Access Overlays: Accessible touch screens for
blind people TalkAbout: Communication tools for people with aphasia
8
Slide 9
Challenge: How to make a touch screen accessible to a blind
person? 9
Slide 10
Yeah. I was at the social security office enquiring about
getting a new Social Security card. You have to get a number at the
office, and the security guard was on a smoke break, and it was a
touch screen, and I couldn't use it and it was a big hassle. Some
sighted guy came in and helped me but it drew way too much
attention to me. I think it's kind of weird that an agency that's
supposed to assist the disabled doesn't have accessibility things,
that's kind of stupid. 10 Inaccessible touch screens
Slide 11
Flat screens without a grida real tangible grid are difficult
for blind people I think that flat screens are not really
accessible. (Kane et al., 2008) 11
Slide 12
12 But touch is often how blind people interact with books,
maps, and their physical environment.
Slide 13
Exploring touch screens Important applications: maps, diagrams,
documents, games Location and spatial layout important How to find
objects on screen? How to understand spatial relations? 13
Slide 14
Formative research Interviewed 8 blind office workers (4m,4f)
Discussed organization and search strategies Where they put things;
how they found them 14
Slide 15
How to do it Appropriate output Speech and audio Appropriate
input How do users touch the device? Screen layout Usable, reliable
gestures 15
Slide 16
Examples Mobile phone: http://www.youtube.com/watch?v=496IAx6
_xys http://www.youtube.com/watch?v=496IAx6 _xys Large touch
screen: http://www.youtube.com/watch?v=acTwW RcUlSk
http://www.youtube.com/watch?v=acTwW RcUlSk 16
Slide 17
Two projects Access Overlays: Accessible touch screens for
blind people TalkAbout: Communication tools for people with aphasia
17
Slide 18
Aphasia center Serves ~40 adults with reading, comprehension,
and speech difficulties caused by stroke Many use tablet
communication software (but dont like it) 18
Slide 19
We created a location-aware communication tool for people with
aphasia Make it smarter: use context to determine what the user
might want to say (e.g., talk about medicine when the user I at the
doctors office) 19 TalkAbout (Kane et al., 2012)
Slide 20
Designing TalkAbout How to design with people who have
difficulty communicating? Multiple approaches Created a design team
of diverse users Worked closely with staff and instructors Used
multiple forms of prototyping (diagrams, acting, interactive
prototypes), and collecting feedback (paper forms, conversation) 20
Our design team preferred our new prototype to their existing
tools.
Slide 21
Takeaways We can redesign existing devices to make them more
accessible Software easier to fix than hardware by involving future
users in design Adaptations become device features Sometimes even
our design methods must be flexible 21
Slide 22
Thanks! Shaun Kane [email protected] http://umbc.edu/people/skane
http://twitter.com/shaunkane http://umbcpad.com UMBC Prototyping
and Design Lab
Slide 23
Who benefits? About 25 million people in the US have some
visual impairment (National Health Interview Survey 2008) As many
as 25% of computer users may benefit from visual accessibility
tools (Microsoft 2004) 23
Slide 24
Barriers to everyday activities 24 Can I ski 60 miles an hour
downhill? Yes. Use a flat panel microwave? No. Mike May, Sendero
Group (2009)
Slide 25
Principles of Ability-Based Design (Wobbrock, Kane et al.,
2010) AbilityFocus on ability, not dis-ability. Take advantage of
all that users can do. AccountabilityRespond to poor user
performance by changing the system, not the user. :When possible,
utilize low-cost everyday input devices. PerformanceMeasure, model,
monitor, and/or predict user performance. ContextProactively sense
context and anticipate its effects on a users abilities.
AdaptationProvide adaptable or adaptive user interfaces tailored to
a users abilities. TransparencyGive users the awareness of
adaptations and the means to inspect, override, store, retrieve,
preview, and test- drive them. 25