34
Prof. dr. ing. JELLE SALDIEN AUGMENTED REALITY : THE PERFECT UI ? Iron Man, Marvel (2010)

AUGMENTED REALITY : THE PERFECT UI · AUGMENTED REALITY Augmenting the reality or the real world with extra layers of (digital) information ARreduces&head&and&eye&movement ARreducesthecost

  • Upload
    others

  • View
    8

  • Download
    0

Embed Size (px)

Citation preview

Page 1: AUGMENTED REALITY : THE PERFECT UI · AUGMENTED REALITY Augmenting the reality or the real world with extra layers of (digital) information ARreduces&head&and&eye&movement ARreducesthecost

Prof.  dr.  ing.  JELLE  SALDIEN  

AUGMENTED REALITY :THE PERFECT UI ?

Iron  Man,  Marvel  (2010)  

Page 2: AUGMENTED REALITY : THE PERFECT UI · AUGMENTED REALITY Augmenting the reality or the real world with extra layers of (digital) information ARreduces&head&and&eye&movement ARreducesthecost

AUGMENTED REALITY

Augmenting the reality or the real world with extra layers of (digital) information

 AR  reduces  head  and  eye  movement

AR  reduces  the  cost  of  aFenGon  switching

AR  supports  spaGal  cogniGon  and  mental  transformaGon

HUD  2020,  Honeywell  (2005)      

HUD: HEAD UP DISPLAYS

Page 3: AUGMENTED REALITY : THE PERFECT UI · AUGMENTED REALITY Augmenting the reality or the real world with extra layers of (digital) information ARreduces&head&and&eye&movement ARreducesthecost

AUGMENTED REALITY

Iron  Man,  Marvel  (2010)  

HUD: HEAD UP DISPLAYS

Page 4: AUGMENTED REALITY : THE PERFECT UI · AUGMENTED REALITY Augmenting the reality or the real world with extra layers of (digital) information ARreduces&head&and&eye&movement ARreducesthecost

AUGMENTED REALITY

Iron  Man,  Marvel  (2010)  

HUD: HEAD UP DISPLAYS

Page 5: AUGMENTED REALITY : THE PERFECT UI · AUGMENTED REALITY Augmenting the reality or the real world with extra layers of (digital) information ARreduces&head&and&eye&movement ARreducesthecost

AUGMENTED REALITY

Augmenting the reality or the real world with extra layers of (digital) information

 AR  REDUCES  HEAD  AND  EYE  MOVEMENT

AR  REDUCES  THE  COST  OF  ATTENTION  SWITCHING

AR  SUPPORTS  SPATIAL  COGNITION  AND  MENTAL  TRANSFORMATION

1  

2  

3  

Page 6: AUGMENTED REALITY : THE PERFECT UI · AUGMENTED REALITY Augmenting the reality or the real world with extra layers of (digital) information ARreduces&head&and&eye&movement ARreducesthecost

AUGMENTED REALITY

“overlaying  3D  instrucGons  on  the  actual  work  pieces  REDUCED  THE  ERROR  RATE  for  an  assembly  task  BY  82%,  parGcularly  diminishing  cumulaGve  errors”

Tang  et  al.  (2003)  

Page 7: AUGMENTED REALITY : THE PERFECT UI · AUGMENTED REALITY Augmenting the reality or the real world with extra layers of (digital) information ARreduces&head&and&eye&movement ARreducesthecost

AR IN (FLEMISH) INDUSTRY

1.0 ▲  mechatronics ▲  product development methods ▲  advanced manufacturing technologies

It is our mission to strengthen the long-term international competitiveness of the Flemish manufacturing industry by performing excellent, industry-driven, pre-competitive research in the following domains:

Page 8: AUGMENTED REALITY : THE PERFECT UI · AUGMENTED REALITY Augmenting the reality or the real world with extra layers of (digital) information ARreduces&head&and&eye&movement ARreducesthecost

AR IN (FLEMISH) INDUSTRY

Track  1  Turning  operators  into  knowledge  workers    

Track  2  Assis6ng  humans  with  robots  

RP8 AGILE AND HUMAN CENTERED PRODUCTION AND ROBOTIC SYSTEMS

WAGE  GAP  WITH  OTHER  COUNTRIES

AGING  WORKFORCE

HIGER  CUSTOMIZED  PRODUCTS  WITH  LIMITED  VOLUMES

PRODUCTS  SHORTER  LIFETIME

PRESSURE  ON  PERFORMANCE  AND  FIRST  TIME  RIGHT

Page 9: AUGMENTED REALITY : THE PERFECT UI · AUGMENTED REALITY Augmenting the reality or the real world with extra layers of (digital) information ARreduces&head&and&eye&movement ARreducesthecost

AR IN (FLEMISH) INDUSTRY

1.0

TURNING OPERATORS INTO KNOWLEDGE WORKERS

1: “PRESENTING THE RIGHT INFORMATION IN THE RIGHT FORMAT AT THE RIGHT TIME”

2: “CAPTURING OPERATOR KNOWLEDGE FOR TRAINING, PRODUCT DESIGN AND MANUFACTURING PROCESSES”

USING  AUGMENTED  REALITY

USING  VIRTUAL  REALITY

Page 10: AUGMENTED REALITY : THE PERFECT UI · AUGMENTED REALITY Augmenting the reality or the real world with extra layers of (digital) information ARreduces&head&and&eye&movement ARreducesthecost

VIRTUAL REALITYAUGMENTED REALITY

Virtual  Content:    textual,  2D  graphical  informaGon(images),    

3D  geometry,  videos,  and  2D  or  3D  animaGons    or  interacGve  icons/elements  

Alignment  with  the  real  world  (e.g.  using  trackers)  

A  phantom  model  of  parts  of  the  real  world  (to  avoid  occlusion)  

Changing  viewpoint  (e.g.  using  IMU)  

Virtual  model  of  the  world  

AR / VR TECHNOLOGY

Page 11: AUGMENTED REALITY : THE PERFECT UI · AUGMENTED REALITY Augmenting the reality or the real world with extra layers of (digital) information ARreduces&head&and&eye&movement ARreducesthecost

TURNING OPERATORS INTO KNOWLEDGE WORKERS

1.  Head  Mounted  Interfaces  

3.  Workpiece  projecGon  

2.  Wrist/arm  worn  Interfaces  

Page 12: AUGMENTED REALITY : THE PERFECT UI · AUGMENTED REALITY Augmenting the reality or the real world with extra layers of (digital) information ARreduces&head&and&eye&movement ARreducesthecost

AUGMENTED REALITYHMD: HEAD MOUNTED DISPLAYS

PRO

CON

•  Handsfree  •  Wearable  •  Personal  

•  Human  adaptaDon  •  SDgma  and  image  •  BaGery  life  •  Available  soJware  and  SDKs  

Page 13: AUGMENTED REALITY : THE PERFECT UI · AUGMENTED REALITY Augmenting the reality or the real world with extra layers of (digital) information ARreduces&head&and&eye&movement ARreducesthecost

AUGMENTED REALITYTABLETS / SMART PHONES

I-Mechanic, ARMedia (2013)

Page 14: AUGMENTED REALITY : THE PERFECT UI · AUGMENTED REALITY Augmenting the reality or the real world with extra layers of (digital) information ARreduces&head&and&eye&movement ARreducesthecost

AUGMENTED REALITYHMD: ORDER PICKING

KiSoft Vision, KNAPP (2011)

Page 15: AUGMENTED REALITY : THE PERFECT UI · AUGMENTED REALITY Augmenting the reality or the real world with extra layers of (digital) information ARreduces&head&and&eye&movement ARreducesthecost

AUGMENTED REALITY

Smartpick, TNT (2015)

HMD: ORDER PICKING

Page 16: AUGMENTED REALITY : THE PERFECT UI · AUGMENTED REALITY Augmenting the reality or the real world with extra layers of (digital) information ARreduces&head&and&eye&movement ARreducesthecost

AUGMENTED REALITYHMD: EPSON SCOPE AR

Epson BT-200, Scope AR (2014)

Page 17: AUGMENTED REALITY : THE PERFECT UI · AUGMENTED REALITY Augmenting the reality or the real world with extra layers of (digital) information ARreduces&head&and&eye&movement ARreducesthecost

MOVIE  PREDICTION:  TONY  STARK  

AUGMENTED REALITY + 3D GESTURES

Iron  Man,  Marvel  (2010)  

Page 18: AUGMENTED REALITY : THE PERFECT UI · AUGMENTED REALITY Augmenting the reality or the real world with extra layers of (digital) information ARreduces&head&and&eye&movement ARreducesthecost

HMD:  WEARABLE  3D  HOLOGRAMS  

AUGMENTED REALITY + 3D GESTURES

Meta 1, Meta Company (2014)

Page 19: AUGMENTED REALITY : THE PERFECT UI · AUGMENTED REALITY Augmenting the reality or the real world with extra layers of (digital) information ARreduces&head&and&eye&movement ARreducesthecost

AUGMENTED REALITY + 3D GESTURES

Meta 1, Meta Company (2014)

HMD:  WEARABLE  3D  HOLOGRAMS  

Page 20: AUGMENTED REALITY : THE PERFECT UI · AUGMENTED REALITY Augmenting the reality or the real world with extra layers of (digital) information ARreduces&head&and&eye&movement ARreducesthecost

AUGMENTED REALITY + 3D GESTURES

Hololens, Microsoft (2014)

HMD:  WEARABLE  3D  HOLOGRAMS  

Page 21: AUGMENTED REALITY : THE PERFECT UI · AUGMENTED REALITY Augmenting the reality or the real world with extra layers of (digital) information ARreduces&head&and&eye&movement ARreducesthecost

AUGMENTED REALITYPROJECTION ON SURFACES

Sixth Sense, MIT (2009)

+ 2D GESTURES

Page 22: AUGMENTED REALITY : THE PERFECT UI · AUGMENTED REALITY Augmenting the reality or the real world with extra layers of (digital) information ARreduces&head&and&eye&movement ARreducesthecost

AUGMENTED REALITYPROJECTION ON OBJECTS

Werklicht Pro, EXTEND3D

Page 23: AUGMENTED REALITY : THE PERFECT UI · AUGMENTED REALITY Augmenting the reality or the real world with extra layers of (digital) information ARreduces&head&and&eye&movement ARreducesthecost

AUGMENTED REALITY = THE FUTURE?

YES if

WE  MAKE  IT  MORE  

TANGIBLE  

TANGIBLE AUGMENTED REALITY ?

Page 24: AUGMENTED REALITY : THE PERFECT UI · AUGMENTED REALITY Augmenting the reality or the real world with extra layers of (digital) information ARreduces&head&and&eye&movement ARreducesthecost

Hiroshi Ishii, MIT (2012)

TANGIBLE USER INTERFACE

Page 25: AUGMENTED REALITY : THE PERFECT UI · AUGMENTED REALITY Augmenting the reality or the real world with extra layers of (digital) information ARreduces&head&and&eye&movement ARreducesthecost

TANGIBLE USER INTERFACEinFORM – TANGIBLE MEDIA GROUP

+ PROJECTION

Tangible Media Group, MIT (2013)

Page 26: AUGMENTED REALITY : THE PERFECT UI · AUGMENTED REALITY Augmenting the reality or the real world with extra layers of (digital) information ARreduces&head&and&eye&movement ARreducesthecost

TANGIBLE AUGMENTED RALITYAIREAL:  INTERACTIVE  TACTILE  EXPERIENCES  IN  FREE  AIR  

Disney Research (2013)

Page 27: AUGMENTED REALITY : THE PERFECT UI · AUGMENTED REALITY Augmenting the reality or the real world with extra layers of (digital) information ARreduces&head&and&eye&movement ARreducesthecost

TANGIBLE AUGMENTED RALITYDEXMO:  WEARABLE  MECHANICAL  EXOSKELETON  

Dexta Robotics (2015)

Page 28: AUGMENTED REALITY : THE PERFECT UI · AUGMENTED REALITY Augmenting the reality or the real world with extra layers of (digital) information ARreduces&head&and&eye&movement ARreducesthecost

TANGIBLE AUGMENTED RALITYDEXMO:  WEARABLE  MECHANICAL  EXOSKELETON  

Dexta Robotics (2015)

Page 29: AUGMENTED REALITY : THE PERFECT UI · AUGMENTED REALITY Augmenting the reality or the real world with extra layers of (digital) information ARreduces&head&and&eye&movement ARreducesthecost

AUGMENTED REALITY – WHAT IS NEXT?

MEDIATED REALITY

AUGMENT  

DIMINISH  

ENHANCE  

MODIFY  

Page 30: AUGMENTED REALITY : THE PERFECT UI · AUGMENTED REALITY Augmenting the reality or the real world with extra layers of (digital) information ARreduces&head&and&eye&movement ARreducesthecost

MEDIATED REALITY

Steve Mann, MIT (1990)Steve Mann, MIT (1980)

EYETAP  

Page 31: AUGMENTED REALITY : THE PERFECT UI · AUGMENTED REALITY Augmenting the reality or the real world with extra layers of (digital) information ARreduces&head&and&eye&movement ARreducesthecost

MEDIATED REALITY

MEDIATED REALITY

AUGMENT  

DIMINISH  

ENHANCE  

MODIFY  

EYETAP  

Steve Mann, MIT (2010)

Page 32: AUGMENTED REALITY : THE PERFECT UI · AUGMENTED REALITY Augmenting the reality or the real world with extra layers of (digital) information ARreduces&head&and&eye&movement ARreducesthecost

HUMANISTIC INTELLIGENCEMindmesh  :  Seeing  and  remembering  beGer  

Steve Mann, MIT (2014)

Page 33: AUGMENTED REALITY : THE PERFECT UI · AUGMENTED REALITY Augmenting the reality or the real world with extra layers of (digital) information ARreduces&head&and&eye&movement ARreducesthecost

HUMANISTIC INTELLIGENCE = CYBORG

Robocop (2014)

Page 34: AUGMENTED REALITY : THE PERFECT UI · AUGMENTED REALITY Augmenting the reality or the real world with extra layers of (digital) information ARreduces&head&and&eye&movement ARreducesthecost

THANK YOU

Prof.  dr.  ing.  JELLE  SALDIEN  

[email protected]