Mobile AR SDK Tutorial - Augmented World Expo New York 2014

Preview:

DESCRIPTION

A tutorial on how to develop using the latest mobile AR SDK's. This is an updated version of the talk from Augmented World Expo 2013, that I gave at the Augmented World Expo New York in March, 2014.

Citation preview

Mobile AR SDK Tutorial

Augmented World Expo, NY, March 25, 2014

Patrick O’Shaughnessey

@patchedrealitypatrick@patchedreality.com http://patchedreality.com

Patched Reality

Custom Augmented Realityand Digital Eyewear Apps

http://patchedreality.com

Patched Reality

Using Best-in-Breed Technologies

http://patchedreality.com

Video and Slides from AWE 2013

http://bit.ly/SDKTutorialAWE2013

Notable Features Since June

Some Highlights:• Extended tracking• CAD model-based training• Text recognition and tracking• Digital eyewear support

What’s the purpose of an AR SDK?

Simplifies one or more of:• Recognition – What to track• Tracking – Where it is (3D pose)• Content rendering – Your Interesting Stuff

Tracking Types

• GPS + Compass + Gyro + Accelerometer• Marker (Fiduciary, frame, etc)• NFT (2D images)

• Pre-trained• Cloud recognized• User-defined

• 3D (Pre-trained point cloud)• Live 3D (SLAM)• Face, Fingers, Body• Robot

Mobile AR SDKs Short ListSDK Purpose Tracking Platform Graphics Cloud GPS License

QualcommVuforia

2D Images,Cylinders, Markers,Text

NFT+Ext,Cylinder, Marker,Text

iOS, Android Unity3D & Alt.

yes no Free$99-499/mo Cloud

MetaioSDK

2D Images, 3D, GEO,QR

NFT+Ext, GPS,3D, SLAM

iOS, Android, Eyewear

Unity3D & Proprietary

yes yes $0-5,500$235-680/mo Cloud

Total Imm. D’fusion

2D Images, Faces

NFT, Face iOS, AndroidDev: MS only

Proprietary no no $0-7,800

Wikitude SDK

2D Images,GEO

GPS, NFT iOS, Android, Blackberry, Eyewear

HTML, Proprietary

yes yes $0-2,300

Layar SDK 2D images,Geo

NFT, QR iOS, Android Proprietary yes no $3,250/app/yr + $60/page

AR Toolkit 2D Images, Markers

NFT,Marker

iOS, Android Unity3D &Proprietary

no no $1,500 / seat

Mobile AR SDKs Short ListSDK Purpose Tracking Platform Graphics Cloud GPS License

13th Lab Point Cloud

2D Images,3D, Anywhere

NFT, 3D,SLAM

iOS, Android Unity3D & Alt.

no no 0-$5,000

HPAurasma SDK

VFX, Videos on 2D Images

NFT iOS, Android Proprietary yes yes Per click

Obvious Engine

2D images, Cylinders

NFT,Cyl.

iOS, Android Unity3D & Alt.

no no $8000/app/plaform

String Framed 2D images

Framed Image

iOS Unity3D & Alt.

no no $499-$8000/app/year

Orbotix Robotic AR Sphero iOS, Android Unity3D no no Free

catchoom 2D Images NFT iOS Proprietary yes no $0-2000 +$135-835/mo

SDK Development On Ramp

1) Set up Dev Environment• Xcode (iOS)• Eclipse (Android)• Android SDK• Android NDK• Unity 3D

2) Download SDK3) Install and run samples

SDK Development with Unity

1) Create Project2) Wire up SDK - camera setup, licensing, etc3) Set up recognition and tracking configuration4) Add scene content and interactions5) Build, Run, Test6) Repeat 3-57) Ship

NFT Setup - Vuforia

1) Import Unity package2) Create target using “Target Manager” at

developer.vuforia.com 3) Download and Import target package4) Replace MainCamera with ARCamera prefab5) Add ImageTarget prefab 6) Add content to ImageTarget7) Enable Data Set load on ARCamera8) Select Data Set and Image Target on ImageTarget9) Build and Run

NFT Setup - Vuforia

Extended Tracking

Extended Tracking

SLAM Setup - metaio

1) Import metaioSDK.unitypackage2) Add metaioSDK prefab to scene3) Delete Main Camera4) Generate app signature

(mobiledeveloperportal.ar-live.de)5) Add app signature to metaioSDK6) Add metaioTracker prefab to scene7) Add scene root to metaioTracker object

SLAM Setup - metaio

1) Add GUI and script that calls metaio.MetaioSDKUnity.startInstantTracking("INSTANT_3D", "");

2) Add metaioCallback subclass (InstantTrackingCallback from TutorialInstantTracking) and replace the one on metaioSDK GameObject

3) Build and run4) Add missing libraries to Xcode project

SLAM Setup - metaio

Missing Libraries:metaiosdklibxml2.dylibAVFoundationSecurity

SLAM Setup - metaiohttps://mobiledeveloperportal.ar-live.de/index.php

SLAM Setup - metaio

Tools for Non-Programmerswww.metaio.com/products/creator/

Tools for Non-Programmerswww.layar.com/creator

Tools for Non-Programmersstudio.wikitude.com

Tools for Non-Programmersstudio.aurasma.com

Tools for Non-Programmershttp://catchoom.com

Tools for Non-Programmerswww.ar-code.it

Cloud Campaign Editor

Thank You!

Patrick O’Shaughnessey

@patchedrealitypatrick@patchedreality.com http://patchedreality.com

Recommended