Mobile & Wearables Games for Health 2014 Tutorial

Mobile Games & Wearables

Human JoysticksT U R N I N G R E A L - W O R L D H U M A N A C T I V I T Y & D E C I S I O N S I N T O I N P U T S T H A T D R I V E G A M E S Y O U P L A Y A S Y O U G O A B O U T Y O U R D A Y Y O U R A C T I O N S A R E T H E J O Y S T I C K

Mobile Games

connected sensors

mobile phones laptops iPods

wireless smartphones tabletshandheld

videogames

connected device

feature phoneswearables I

(wrist/watch/jewelry)

“wearables” II (lumo back, GeckoCap)

Summary

• Smartphones is a 3 group race

• Apple vs. Google vs. Everyone Else

• Wearables is total Chess Game

• Gamification vs. Game

• Other Devices (Sensors, iBeacons, Etc.)

• Still Early but Speeding Up

Mobile Ascendency

Platforms

• Smartphones

• Tablets

• Wearables

• Other Devices (Sensors, iBeacons, Etc.)

Platforms

• iOS*

• Android*

• Windows Phone

• Tizen, Mozilla, Etc.

Behind The Numbers

• Doesn’t include iPod Touch

• What about by # of Installed Apps?

• Paid vs. Free Apps Share?

• What about Games?

App Store Stats...Everything is trending toward free applications with in-app purchases

1/5 users spent less than $5

1/6 users spend between $5-$10

Women slightly more likely to download apps

Tablets

• iPad

• Android

• Windows Surface

Mobile Ascendency

Bulk Tablet Deployments

Mobile Game Systems

• Nintendo 2DS/3DS [the big daddy]

• Sony

• Leapster [kids/closed]

• Others... [linux hybrids out of Asia]

Chess Game...• Jawbone Acqui-Hires Massive Health & Visere

• Jawbone Acquires BodyMedia

• Patents

Who’s Who? What’s What

• Apple

• Jawbone

• Nike

• FitBit

• Others...

Where’s Everyone Else?

• Sony, Samsung, LG, etc. (i.e. Japan/Korea)

• Microsoft / Amazon / Google

Watches / Wrists?

Readying for Wearables

Quick ComparisonMobile Modality

Functional Profile

User(s) Application Structures

Smartphones HighlyEmail

Games/Media Productivity

Single with some Sharing @ Home

iPhone OS/Objective C

Java

Phones Highly but Limited Functionality

Calls SMS/Texting

Games

Single w/some sharing in

emerging markets

J2ME or Server Based SMS

Tablets On-the-GoMedia

Consumption Productivity

Games

SharediPhone OS/

Java

Consoles Home & GoGames / Some

MediaSingle / Some

Sharing C++

Wearables

• Interaction Extension

• Always on accelerometer

• Biometric Sensor Package

• VERY Early

• Big Chess Game…

Big Picture

Building on Mobile Building for Mobile

Building on Mobile

Building an app that runs on a mobile device platform, or is accessible via mobile platform browsers...

Building for Mobile

The art of creating an application that takes advantage of the mobility of a platform

Building for Mobile IISmall

Moments of Time

Communication

Interuptive

Different

Parts of the

Day

Different Input Systems

One hand

Building for Mobile II

Geolocation

Camera

Microphone

Proximity to Person or Object

Accelerometer

Other Sensors

Lit 2 Quit

Building for Wearables

Geolocation

Blood Sugar

Microphone?

Proximity to Person or Object

Accelerometer

Heart Rate

Inactivity/

SleepTemperature

NEAT-o-Games

Ideas are Easy?

• The majority of mobile apps are apps on mobile platforms

• It’s easy to say I’d like to do this on a mobile device

• It’s much harder to develop a uniquely mobile experience

• The many devices make it harder…

Understanding Mobility

• “Mobile Sensor Platform”

• What is the future of these sensors (e.g. light sensors)

• Interacting with the surrounding environment?

• The associated psychology and situational play

Discussion...

• What are your goals & needs?

• What makes a serious mobile game vs. just one for entertainment?

• What design patterns exist for mobile games?

• How will wearables & biometrics change everything?

• Discovery / biz models issues

The Platforms...

iPhone

• 6+ Models Released Since 2007

• iPhone, iPhone 3G, iPhone 3GS, iPhone 4/4s, 5/5c/5s, 6?

• 100’s million shipped worldwide

• iPod Touch: Same OS & Core Specs

• App Store

• iWatch? & Continuity (2014)

iPod Touch

• Sells a lot of units... and is important in terms of youth audiences

• 4 Models overall... speed increases, microphone support, bluetooth support…

• No upgrade last cycle? Does Apple keep it going?

iOS 8

• Biggest change since original iOS

• Interapp communication, helper apps

• Lots of game changes

• Health and Health Kit

• Better tools for everything

Android

• Android is an open source OS built by Google to power mobile phones & devices

• So Many Flavors; MANY models...

• Android vs. FireOS vs. Chrome OS vs. Samsung

• Fragmentation drives us dev costs significantly

• Health Kit/Health App also coming Google Fit

Windows Phone

• Small but growing

• Decently reviewed

• Tool chain isn’t bad

• Nokia deal changes some things but not as much

• Slowly becoming relevant

Everything Else...

• A mish-mash to say the least...

• J2ME systems still out there

• SMS key “app”

• Target device?, carrier, region, global, or socio-economic demographic

• Other systems : Tizen, Mozilla OS

• What does Samsung Do?

Tablets

iPad

• Key... how does the screen affect what you can (and should/should not) do?

• Different user and usage scenarios…

• Enterprise & Schools are big differentiators

• Does Apple start to hone the differentiated experience?

• How does is differentiate in health?

Android Tablets

• So many various vendors...

• Kindle is the biggest Share

• Galaxy (Samsung)

• Then literally dozens

• Many are low-cost overseas “video tablets”

• How does pricing affect installed-base but when do these “cheapies” become bona-fide app platforms especially overseas?

Kindle...

• Older reader models have several million units, with some app capacity but being overtaken by newer Kindles that are essentially Android

Windows Surface

• First gen was a mess

• Second gen selling better

• Future gens should pick up speed

• Really become “windows” tablet as key selling point

• Heavy…

• Enterprise?

Issues

• It’s a two-system race until further notice

• iPhone has best gamut control so far...

• Java vs. Objective C vs. Web(HTML5+JS+Cloud) (AND now Swift…)

• Cross Platform vs. Cross Model

• Connected Play vs. App on Phone

• What do wearables do?

Development Approaches

• Native Development (Objective C or Java)

• Cross Platform Virtual Machines? (Flash?)

• Browser and/or HTML Widget

Across the Board

iPhone Android Windows Other

Browser Webkit/Safari Webkit IE All over...

Native Objective C/Swift

Java/Flash... C#/C++ J2ME

X-Platform PhoneGap, HTML5, Web vs. Encapsulated App

Design & Development

Mini-Agenda

• Design Context & Patterns : A Discussion

• Development in General

• Light Specifics by Platform

• Discussion

Mobile Serious Games Context

• Game

• Second screen pattern

• Support for Game on Other Platform…

• TV

• Physical experience

• Web Game

• Biometric Game

• ARG

Development Paths...

• Browser Based Apps (specialized)

• or packaged HTML5

• Native Code

• Adobe Air

Browser

• Various systems for browser-based development

• Javascript + Special Hooks

• PhoneGap/Cordova

• Native Code is winning…

jQtouch

• jQuery meets iPhone

• Easy to use (if you know jQuery & Javascript)

• Web apps will continue to gain strength... don’t be fooled into just Objective C

• Also Sensa, PhoneGap Plugins, etc.

3D Graphics

• OpenGL ES

• Metal on iOS8 but not all systems

• Standards Based going to specialized base…

Middleware

• Unity Game Engine

• Unreal Game Engine

• GameSalad/Stencyl/Marmalade, Others

• Variety of Engines (See List)

• Adobe Air

PhoneGap

• Open source x-platform Web app framework for mobile devices

• Cordova (baseline/Apache) PhoneGap (Adobe)

• Strong support, continues to add features

• Have to design for what it is…

Distribution

App Store Approval

• “The World May Never Know”

• Apple inspects your app... Yay or Nay

• Fix and/or Appeal

• Approval...

• Updates...

• Periodic Reviews...

How Does it Work?

• During Development > Mobile Provisioning File

• After Development > Submit Content for Approval

• After Approval > Release to Store / Manage Distribution & Re-submission for Updates

During Development

• Emulators

• Limits - can’t test accelerometer

• Pros - can test different screen types

• Apple: Small number for earliest testing, 1000+ for beta/sharing, recently revamped significantly

Submission

• Be a registered developer - you will want a “publisher” account

• Fill out a form...[what do you need!?]

• Then wait...for approval

• Descriptions...

What Will Nix You...

• Human Interface Guidelines

• Unauthorized API usage

• Simulating Failures (e.g. cracked screens)

• Apple standard buttons

• Bandwidth Usage During Play

• Network Detection

What Will Nix You...

• Political Lampooning

• App description to App Store

• What’s New Descriptions Too Long

• OS Compatibility

• Trademark & Copyright Issues

• Giveaways/Prizes/Contests

What Will Nix You...

• Analytics Disclosure

• Jokes Relevant to Interface Guidelines

• Objectionable Content

• Simply Doesn’t Work

• Don’t Include Price in Your Description

• http://www.mobileorchard.com/avoiding-iphone-app-rejection-part-2/

App Store Behaviors...

• Reviews

• Free games get lower reviews...Why?

• Pricing Strategies...

• Paid vs. Free

• Debut Price?

• Moving Down, Going Free, Moving Up

• Chart MomentumOf course it might get positive reviews too, but ranking seems to go down as you price too low. DuckDuckDuck went from ~4 stars to ~2 stars after the two week $0.99 -> free offer.

App Store Help...

• App Store Analytics: Flurry, Distimo, AppAnnie, Google Analytics, iTunes Connect

Other Issues

Legal Issues...

• Patent Lawsuits

• EULAs

• Exercise...

• Inducement and Geolocation

• Medical Device / FDA

Lawsuits...

Your Own Analytics...

• Posting out your own data...

• Not the same as most analytics software...

• Apple’s issues with analytics…

• Google Analytics

• Storing if no internet (Sampling)

Advertising...

• Admob/Google

• iAd

• So many others… TapJoy, etc.

Design Discussion

• What’s special about being mobile?

• What categories can we identify

• How can we integrate with other mobile features, and the viral nature of mobile lifestyles

• Integration with the real-world

Mobile Barcode

• QR codes, Data Matrix, Cool-Data-Matrix, Aztec, Upcode, Trillcode, Quickmark, shotcode, mCode and Beetagg

iBeacon

Promotion & Marketing

Promotion

• The Biggest Issue: App Store Discovery, Promotion, Driving Installs, Driving spending

• Chain…

• hear about/see me, click to me, install me, spend $$ with me

Marketing 101

• Marketing is more then critical - it’s everything

• Many apps bought from the phone; how do you breakthrough

• Long tail?

• Dedicated resources?

• Expectations

Product Design…

Health, Unique, Mobile?

• What could be done?

• Walking App?

• Avoid the Bank Step Model of Play

• Integrate Game & Walking

• Push Strategic Decisisions into the Foreground and Walking into the Background

Wearables

• Started as either extension of phones, or (mostly) singular always on biometric

• These two modes of use will fuse

• Always on sensor package

• Phone as hub

• Phone is still a big “wearable” of it’s own

Wearables Battle…

• 2014 year Google vs. Apple in wearables begins to unfold

• What happens to Jawbone, FitBit, others?

• What commodifies, what doesn’t?

• What x-wearable strategies and processes emerge, if necessary

• Health vs. wearable experience?

Wearables & Health

• Do the native iOS / Android SDKs and UIs take over vs. specialized apps?

• Are they floors, hubs, or parallels?

• Where does the 3rd party experience shift-to?

• Acquisition frenzy?

Drivers of Wearables Battle

• Battery life; Battery life; Battery life

• Data frequency model

• Input/interaction model

• Standalone usage capacity

• Fashion

Data Frequency Model

• Cumulative end-of-day experience (night or morning)

• Periodic intra-day experience (every 60-120 minutes, 4-8x daily)

• Spot real-time experience (real time for X minutes, 1x-2x day)

• High frequency experience (every 10 minutes)

• 24/7 RealTime

Input Interaction Model

• User download initiated

• Automatic Background (see data model)

• Realtime interactions (buttons and/or Touch)

• Proximity (i.e. iBeacon)

• Self-contained, or networked-to-phone/computer?

Designing for Wearables

• Simplicity for many reasons

• Is it just a data slave?

• Is it a feeder to a larger phone experience?

• Is it biometric or interactive or both?

• Always with/on me vs. phone?

• What are the truly NOVEL experiences???

Lets not forget devices

• Home Devices (lights, sound, thermostat)

• Scales

• Inhalers, glucose monitors, blood pressure cuff

• Exercise equipment

• Cameras / Kinect / Etc.

• iBeacons

PhonesAll Day

WearablesSometimes Wearables

With us Devices ME In-Home

Devices

Laptops EnvironmentOut-of-Home

Devices

Designing for Wearables

• Human Joysticks

• Biometric for Health

• Biometric for Interaction

• Ease of Interaction

• Eyes free use

• Frequency of feedback

Designing for Wearables II

• Screen? - This will become bigger deal

• Force Feedback / Glanceable

• Headphones or not?

• Phone vs. No Phone

• Connected Experience

• Multiplayer

Avoiding Visuals

Responding to Environments

User Ask?

• Moving about daily life? (i.e. walking around)

• Specific activity/behavior & equipment? (inhaler, exercise bike)

• Environment & environment context (e.g. shopping/iBeacon)

The Original Mobile Pattern

• Banked

• Iterative Interrupts

• Real-time (periodic vs. 24/7)

M E I L I 1 . 0

• Cross-platform framework for mobile games featuring input from physical activity and sensors

• GPS features enable environmental sensing & fencing

• Outputs multi-channel audio, force-feedback

• “Glanceable” UI for non-distracted gameplay

M O B I L E A C T I V I T I E S E N G I N E

“ G A M E S Y O U P L A Y W H I L E M O V I N G A R O U N D ”

F E AT U R E S E T 1 . 0

• Built in software pedometer

• Detects “vigorous activity” jumping, dancing, shaking

• Detects gestures on phone screen (tap, double-tap, hold, swipe)

• Multi-channel audio

• Variables & operations, conditionals, event driven architecture

Output

Activity &

GestureEngine

Gestural

Activity

OneHanded“Blind”Inputs

Other

Environmental& Device

Camera

GPS

MicTime/Date

Input

Screen

Tilt

Game Engine

Structured Data

JSON

Aural

Background

Speech

MusicSFX Screen

& Device

Screen Color LED

ForceFeedback

Log

Web services

in

Webservices

outITTT

Twitter/FB

TXTsPhotos

Weather

PushNotification

Battery

Meili Engine Status

mobile-tutorial-sg