Design, Writing, & Development for Touch and
Voice Applications and Devices
Joe Welinske
Twitter: welinske
A Major Inflection Point
• New interactions with the UI…
• …require new techniques and processes
• Proprietary interactions…
• …make software development harder
• Uniquely customized UIs…
• …require decisions about language
Touch Today
• SmartPhones
• Tablets: iPad / Kindle Fire / Google Nexus
• Mac OSx Trackpad
• Windows 7 Touchpad
• Automotive Dash
• and now, Windows 8 desktop and tablets
Multi-touch Controls
• Multi-touch controls are not easily discoverable
• Multi-touch gestures to trigger certain features.
Quickoffice PhotoPad AccuTerra
x x
Tablet dimensions: allow for more
activity which can mean a complex
touch UI
The Ultimate Touch Easter Egg
The Language of Gestures
• Individual word choices are extremely important
• It is worth testing with users to find the best words.
• Word choices may change depending on the mobile platform
Gesture Language in UA
ToonPAINT Weightbot AutoCAD
x x
Gesture Language in UA
Convertbot Calvetica eBay
x x
Gesture Resources
Touch Gesture Reference Guide
www.lukew.com/ff/entry.asp?1071
• iOS
• Android
• Windows Phone
• Mac
• Windows
• Others
Gesture Comparison by Platform/Device
Gesture Comparison by Platform/Device
Translation Issues for Gesture Terms
Single-sourcing for Multiple Device Types
• Conditional Text• Based on device type• Based on UI type
• HTML5 / CSS / Media Query
• Authoring Tools
Device-specific instructions using conditional text
Device-specific instructions
Laptop
Phone
TV
Interaction-specific instructions
Tablet
Phone
TV
Car
Laptop
Windows 8
DesktopTablet
Phone
Car Dash
Home Ent.
NFC
Other UI Elements
Gallery of Android button bars
Sony Xperia Play
• Device-specific controls need consideration
iPhone User Guide
x
x
Use of iconsSupplemental
language
Set…
Turn…
Focus…
Zoom
Custom Language Choices
a. b. c.
x x
Select Edit Share
Double tap, hold and drag to select
Drag your finger while holding
Custom Language Choices – Windows Phone
Fantasia Paint Office Word
x
Photo Collage Tasks Anywhere
x
Voice Today
• iOS Siri
• Office ?
• Android Google Voice
• Ford Sync
Design, Writing, & Development for Touch and
Voice Applications and Devices
Joe Welinske
Twitter: welinske
Recommended
