Creating a Virtual Reality in Unity - by Unity Evangelist Kelvin Lo

COPYRIGHT 2014 @ UNITY TECHNOLOGIES

CREATING A VIRTUAL REALITY IN UNITY

Kelvin Lo, Product Evangelist at Unity Technologies

COPYRIGHT 2014 @ UNITY TECHNOLOGIESCOPYRIGHT 2014 @ UNITY TECHNOLOGIES

UNITY 5.1+ VR


Text Styles

between levels

Level 1 = Bullet 24 pt. Level 2 = Bullet 24 pt. Level 3 = Bullet 20 pt. Level 4 = Bullet 18 pt. Level 5 = Bullet 16 pt.

again, use SHIFT + TAB

Alternatively,

UNITY

Oculus Rift

MS Hololens

Gear VR

Playstation VR

Unity

SDK, Runtime Dirver

SDK


WINDOWS MAC OCULUS VR



Text Styles

between levels



Alternatively,



Text Styles

between levels



Alternatively,

GEAR VR• Android SDK • (osig) • https://developer.oculus.com/osig/ • Project/Assets/Plugins/Android/assets/

https://developer.oculus.com/osig/


Text Styles

between levels



Alternatively,

UNITYMobile VR

PC

Mobile VR Google Cardboard

SDK Oculus Mobile SDK Mobile VR

VR

SDK Unity (

HTC Vive )

Insert Image

icon in the middle placeholder

2. Insert the desired picture 3. Click Crop to change focus of the image / size


Text Styles

between levels



Alternatively,

BUILD SETTINGSBUILD

• Texture compression •

• ETC2 (GLES 3.0) • Orientation •

• Landscape left (mobile) • V-Sync

• Do Not Sync • Enable Multi-threading • 4.5+

• Fixed Time step

• 0.01666 ( 60 fps)

• 0.01333 (PC 75 or 90 fps)

• Anti-Aliasing •

• 2x max


Text Styles

between levels



Alternatively,

• Runtime不能降FPS • 使⽤LOD，遮擋剔除，批次運算 • 減少物體數量,減少物體曲⾯ • 多⽤靜態物體,採⽤烘焙光照 • 使Draw Call保持100左右 • ⼩於100k的三⾓⾯ • 可以採⽤⾼解析的紋理來彌補 • 使⽤物理引擎來避免CPU消耗過⼤

MOBILE PERFORMANCE


VR JAM 1. 2. 3. 4. ASSET STORE


HOW HUMANS WORK


Text Styles

between levels



Alternatively,

FOVEATED RENDERING


Text Styles

between levels



Alternatively,

FOVEATED RENDERING•

Insert Image




Text Styles

between levels



Alternatively,

HUMAN HEARING

•

•

•

•

•


Text Styles

between levels



Alternatively,

HUMANS GET SICK

•

•

•

•

•

•

•

•

•


VR 1.FPS > 75 2. < 20MS


Text Styles

between levels



Alternatively,

HUMAN VISIONField Of View (FOV) of 210º horizontally by 160º vertically (with neck movement), * 135 pixels per angle = 5.76E


DESIGNING FOR HUMANS


Text Styles

between levels



Alternatively,

HUMANS LIKE REALITY…才怪


Text Styles

between levels



Alternatively,

HUMANS LIKE REALITY


Text Styles

between levels



Alternatively,

HUMANS GET SCARED

• VR

•

•

•

•


Text Styles

between levels



Alternatively,

HUMANS GET TIRED

•

•

•

•

• 2 5

• VR 5 30


Text Styles

between levels



Alternatively,

HUMANS CAN EMPATHIZE

• VR

•

•

•

•


DESIGNING FOR VIRTUAL INTERACTIONS


Text Styles

between levels



Alternatively,

• UI

•

•

•

•


Text Styles

between levels



Alternatively,

•

• •

•

•

•


Text Styles

between levels



Alternatively,

•

•

•

•

•

• You really want to read this…

•


UNITY VR ROADMAP UNITY VR


Text Styles

between levels



Alternatively,

Camera Camera

Camera

API

Culling x 2, Shadow Draw x 2, Drawcall x 2, Render State x 2

GRAPHICS PIPELINE

Set Textures Set Transforms Set Geometry State Draw




Update View to Other Eye


Text Styles

between levels



Alternatively,

Camera Camera

Object

Camera Viewport Transform

Drawcall x 2

GRAPHICS PIPELINE

Set Textures Set Transforms Set Geometry State Draw Set View State Draw




Text Styles

between levels



Alternatively,

之後的圖形流⽔線-其他⽅案

渲染場景時，只檢查⼀次場景，每個Object送出⼀次，建⽴兩個Command

List來分別渲染(需要硬體⽀援,Ex: DX11) 渲染場景時，只檢查⼀次場景，使⽤Instancing技術來double所渲染的物體(不⽀援OpenGL ES 2.0)

⽀持多GPU

GRAPHICS PIPELINE


Text Styles

between levels



Alternatively,


Text Styles

between levels



Alternatively,


VR


Text Styles

between levels



Alternatively,

VR AR

2015


Text Styles

between levels



Alternatively,

VR

Virtual Boy 1995 Oculus Rift 2012Google Cardboard 2014


Text Styles

between levels



Alternatively,

截⽌2017年，累計的VR 設備總數會達到1320萬台

預計到2020會有2600萬台相關設備

在2020年VR 設備累計總數會達到6600萬

99%的復合增⻑率

2020年HMD市場價值為30億美元



VR - 720 VR


A VR DEMO MADE BY MAKOTO ITO

Insert Image



Insert Image



Insert Image




Text Styles

between levels



Alternatively,

+

COMBINE 6 GO-PRO CAMERAS WITH A QUADROTOR

Or… buy a Panorama Camera


HOW IT WORKS?


CREATING A AUGMENTED REALITY IN UNITY

Kelvin Lo, Unity Technologies


AR DEMO


PROJECT DEMO 1.Vuforia 5 SDK for Unity 2.Target Dataset Unity 3.







Text Styles

between levels



Alternatively,

• https://bitbucket.org/Unity-Technologies/2ddemos

https://bitbucket.org/Unity-Technologies/2ddemos

[email protected]

Technology

Creating a Virtual Reality in Unity - by Unity Evangelist Kelvin Lo