Mixed Reality met Microsoft HoloLens

©2016 Avanade Inc. All Rights Reserved.

Mixed Reality & HoloLens

WHAT IS DIFFERENT WITH MIXED REALITY?

VIRTUAL REALITY (VR) AUGMENTED REALITY (AR) MIXED REALITY (MR)

Virtual reality is a digitally immersive

experience, created using purely real-world

content, synthetic content,

or a hybrid of both.

Augmented reality is an overlay of data or

information over an existing physical

environment. The content is not anchored to

or part of it.

Mixed reality is an overlay of digital content

on an existing physical environment that is

anchored to and interacts with the real

world. The key characteristic of MR is that

the digital content and the real-world

content are able to react to each other in real

time.

©2016 Avanade Inc. All Rights Reserved.©2016 Avanade Inc. All Rights Reserved.

The Device


RICH INTERACTIONS IN A SPACE

Gaze

Gesture

Ink

Speech

Identity

Text

Holograms

Audio

Tangible

EmotionalINPUT

OUTPUT


Gaze

Key Gestures

Air tapBloom


Experiences

6 KEY EXPERIENCE AREAS FOR MIXED REALITY

DATA OVERLAYS

REMOTE VIEWING

TRAINING

SIMULATIONS & VISUALIZATIONS

COLLABORATION

GAMING & ENTERTAINMENT

HoloLens seamlessly blends

holograms and the real world.

Here are six high-level

experience areas that offer rich

possibilities for enterprise

scenarios. Solutions may

combine several experiences.

6 KEY EXPERIENCE AREAS FOR MIXED REALITY: DATA OVERLAYS

DATA OVERLAYS

Users can project overlays that display

important associated information, helping

them gain a clearer understanding of the

project or activity at hand.

6 KEY EXPERIENCE AREAS FOR MIXED REALITY: REMOTE VIEWING

REMOTE VIEWING

Users can receive real-time guidance or

support from experts in various fields to

complete a task they are dealing with in

their own physical environment.

6 KEY EXPERIENCE AREAS FOR MIXED REALITY: TRAINING

TRAINING

Full holographic representations of objects and

processes enable training to be far more effective as

users explore and interact in scenarios that look and

respond as if they were the real thing.

A study by Miami’s Children's Hospital found that VR

training achieved 80% retention after 1 year whereas

traditional learning had 20% retention after 1 week.

6 KEY EXPERIENCE AREAS FOR MIXED REALITY: SIMULATIONS & VISUALIZATIONS

SIMULATIONS & VISUALIZATIONS

Holographic renderings of a

product, building, or any other

object, can placed, sized and

manipulated in a mix of real world

and virtual environments.

6 KEY EXPERIENCE AREAS FOR MIXED REALITY: COLLABORATION

COLLABORATION

HoloLens enables colleagues from around

the world to collaborate in the same

environment or with the same objects,

interacting with one another and sharing

the experience as if they were together.

6 KEY EXPERIENCE AREAS FOR MIXED REALITY: GAMING & ENTERTAINMENT

GAMING & ENTERTAINMENT

HoloLens can be an entertainment device – and it

allows real world spaces and objects to be the

canvas on which to place or project interactive

games, movies, television, and music services.


Developing for HoloLens


Development options

2D UWP Apps3D Holographic AppsUnity3D or DirectX


• Visual Studio 2015 Update 2

• HoloLens or Emulator

• Unity HoloLens Technical Preview + UWP Runtime

• Win10 recommended

Required for HoloLens Unity development


HoloLens Emulator


Development flow with Unity


Best Practices for Development


• Testing in Unity editor

• Testing in HoloLens/Emulator

• Test everywhere – colosseum to closet

• Test with everyone

• Deployment issues

• HoloLens bugs – settings, weak WiFi

Development best practices & gotchas


• Black is invisible

• Contrast

• Pure white is too sharp (R235 G235 B235)

• Warm colors jump to the foreground

Color


• Guide users to content• Arrows

• Light trails

• Particles

• Spatial sound

• Tag-along

• Fade, don’t cut

Field of view


• Cursor and Gaze

• Voice

• Spatial Sound

• Spatial Mapping

• Environment

• Speed & Framerate

Other design considerations


• HoloLens companion app

• HoloLens development portal

• Framerate restrictions

• Battery impact

Streaming Mixed Reality


The Future

Technology

Mixed Reality met Microsoft HoloLens