AAA Stereo 3D

Preview:

DESCRIPTION

Talk given at GDC Europe in Cologne, NEM 2010 in Barcelona and 3D In Your Face in Bradford UK by Jens Schobel and Francesco Carucci.

Citation preview

CRYTEK

© 2010 Crytek GmbH

AAA Stereo-3D in CryEngine 3Jens Schobel (jenss@crytek.de) , Francesco Carucci (francesco@carucci.org)

CRYTEK

© 2010 Crytek GmbH 2

Research project

CRYTEK

© 2010 Crytek GmbH 3

Research project

CRYTEK

© 2010 Crytek GmbH 4

Depth Perception

Research project

CRYTEK

© 2010 Crytek GmbH 5

Popping out of the screen

Research project

CRYTEK

© 2010 Crytek GmbH

Popping out of the screen

6

Your health is important

CRYTEK

© 2010 Crytek GmbH

Popping out of the screen

7

Your health is important

CRYTEK

© 2010 Crytek GmbH

Case study: HUD

8

WHERE do we place it?

CRYTEK

© 2010 Crytek GmbH

Case study: HUD

• Feels natural• Depth violations

Inside the screen

9

CRYTEK

© 2010 Crytek GmbH

Case study: HUD

• Feels cool• More tiring for the eyes

OUT OF the screen

10

CRYTEK

© 2010 Crytek GmbH

CASE STUDY: CONVEYING MOOD

• Color palette• Depth of field• Atmospheric effects

IN A 2D WORLD

11

CRYTEK

© 2010 Crytek GmbH

CASE STUDY: CONVEYING MOOD

• Stereo effect strength• Convergence distance

IN A STEREO 3D WORLD

12

CRYTEK

© 2010 Crytek GmbH

CASE STUDY: CONVEYING MOOD

• Stereo effect strength• Convergence distance• Change depth perception

IN A STEREO 3D WORLD

13

CRYTEK

© 2010 Crytek GmbH

CASE STUDY: Conveying mood

14

STEREO 3D AS ACOMMUNICATION TOOL

CRYTEK

© 2010 Crytek GmbH 15

VS

CRYTEK

© 2010 Crytek GmbH 16

1.5%

CRYTEK

© 2010 Crytek GmbH

• 30 fps per Eye for acceptable quality

Rendering Twice

17

STEREO IMAGE GENERATION

CRYTEK

© 2010 Crytek GmbH

• 30 fps per Eye for acceptable quality• dramatically reduced quality

Rendering Twice

18

STEREO IMAGE GENERATION

CRYTEK

© 2010 Crytek GmbH

• 30 fps per Eye for acceptable quality• dramatically reduced quality• lower resolution• less special effects

Rendering Twice

19

STEREO IMAGE GENERATION

CRYTEK

© 2010 Crytek GmbH

Rendering Twice

20

STEREO IMAGE GENERATION

Not an option

CRYTEK

© 2010 Crytek GmbH

STEREO IMAGE GENERATION

Screen space re-projection

21

• single pass pixel shader

CRYTEK

© 2010 Crytek GmbH

STEREO IMAGE GENERATION

Screen space re-projection

22

• single pass pixel shader• fully gather-based approach• no warped grid• no point sampling

CRYTEK

© 2010 Crytek GmbH

STEREO IMAGE GENERATION

Screen space re-projection

23

• single pass pixel shader• fully gather-based approach• no warped grid• no point sampling

• surprising depth strength possible

CRYTEK

© 2010 Crytek GmbH

STEREO IMAGE GENERATION

Screen space re-projection

24

• single pass pixel shader• fully gather-based approach• no warped grid• no point sampling

• surprising depth strength possible• full implementation by Nicolas Shulz (RnD)

CRYTEK

© 2010 Crytek GmbH

SCREEN SPACE RE-PROJECTION

High Level

25

• re-project pixel into left/right camera

CRYTEK

© 2010 Crytek GmbH

SCREEN SPACE RE-PROJECTION

High Level

26

• re-project pixel into left/right camera• in screen space

CRYTEK

© 2010 Crytek GmbH

SCREEN SPACE RE-PROJECTION

High Level

27

• re-project pixel into left/right camera• in screen space• offset based on pixel depth

CRYTEK

© 2010 Crytek GmbH

SCREEN SPACE RE-PROJECTION

High Level

28

• re-project pixel into left/right camera• in screen space• offset based on pixel depth• stereo parameters for adjusting

CRYTEK

© 2010 Crytek GmbH

SCREEN SPACE RE-PROJECTION

High Level

29

• re-project pixel into left/right camera• in screen space• offset based on pixel depth• stereo parameters for adjusting• resample backbuffer with bilinear filtering

CRYTEK

© 2010 Crytek GmbH

SCREEN SPACE RE-PROJECTION

30

• great quality with positive parallax

does it look good?

CRYTEK

© 2010 Crytek GmbH

SCREEN SPACE RE-PROJECTION

31

• great quality with positive parallax• no artifacts for opaque objects• transparent objects look acceptable• slight stretching at screen edges (easy to solve)

does it look good?

CRYTEK

© 2010 Crytek GmbH

SCREEN SPACE RE-PROJECTION

32

• good quality for negative parallax (popping out)

does it look good?

CRYTEK

© 2010 Crytek GmbH

SCREEN SPACE RE-PROJECTION

33

• good quality for negative parallax (popping out)• if no steep parallax gradient (no parallax change)

does it look good?

CRYTEK

© 2010 Crytek GmbH

SCREEN SPACE RE-PROJECTION

34

• good quality for negative parallax (popping out)• if no steep parallax gradient (no parallax change)

• artifacts for steep parallax gradient

does it look good?

CRYTEK

© 2010 Crytek GmbH

SCREEN SPACE RE-PROJECTION

does it look good?

35

• good quality for negative parallax (popping out)• if no steep parallax gradient (no parallax change)

• artifacts for steep parallax gradient• smooth out depth to solve

CRYTEK

© 2010 Crytek GmbH

SCREEN SPACE RE-PROJECTION

36

CRYTEK

© 2010 Crytek GmbH

STEREO IMAGE GENERATION

Outputting left/right

37

• PS3 Native HDMI 1.4 support

CRYTEK

© 2010 Crytek GmbH

SCREEN SPACE RE-PROJECTION

Outputting left/right

38

• PS3 Native HDMI 1.4 support• XBOX360 no native stereo support frame-compatible format (SBS, LBL, ...)

encode output format in a final pass

CRYTEK

© 2010 Crytek GmbH

SCREEN SPACE RE-PROJECTION

AUTOSTEREOSCOPIC

39

• Natively supported!• Output color and depth separation buffers

CRYTEK

© 2010 Crytek GmbH

• Nicolas Schulz - RnD• Michael Kopietz - RnD• Marco Corbetta - Crysis 2

THANKS TO…

CRYTEK

© 2010 Crytek GmbH

STEREO IMAGE GENERATION

Questions ?

41

ASK NOW

Recommended