CRYTEK
© 2010 Crytek GmbH
AAA Stereo-3D in CryEngine 3Jens Schobel ([email protected]) , Francesco Carucci ([email protected])
CRYTEK
© 2010 Crytek GmbH 2
Research project
CRYTEK
© 2010 Crytek GmbH 3
Research project
CRYTEK
© 2010 Crytek GmbH 4
Depth Perception
Research project
CRYTEK
© 2010 Crytek GmbH 5
Popping out of the screen
Research project
CRYTEK
© 2010 Crytek GmbH
Popping out of the screen
6
Your health is important
CRYTEK
© 2010 Crytek GmbH
Popping out of the screen
7
Your health is important
CRYTEK
© 2010 Crytek GmbH
Case study: HUD
8
WHERE do we place it?
CRYTEK
© 2010 Crytek GmbH
Case study: HUD
• Feels natural• Depth violations
Inside the screen
9
CRYTEK
© 2010 Crytek GmbH
Case study: HUD
• Feels cool• More tiring for the eyes
OUT OF the screen
10
CRYTEK
© 2010 Crytek GmbH
CASE STUDY: CONVEYING MOOD
• Color palette• Depth of field• Atmospheric effects
IN A 2D WORLD
11
CRYTEK
© 2010 Crytek GmbH
CASE STUDY: CONVEYING MOOD
• Stereo effect strength• Convergence distance
IN A STEREO 3D WORLD
12
CRYTEK
© 2010 Crytek GmbH
CASE STUDY: CONVEYING MOOD
• Stereo effect strength• Convergence distance• Change depth perception
IN A STEREO 3D WORLD
13
CRYTEK
© 2010 Crytek GmbH
CASE STUDY: Conveying mood
14
STEREO 3D AS ACOMMUNICATION TOOL
CRYTEK
© 2010 Crytek GmbH 15
VS
CRYTEK
© 2010 Crytek GmbH 16
1.5%
CRYTEK
© 2010 Crytek GmbH
• 30 fps per Eye for acceptable quality
Rendering Twice
17
STEREO IMAGE GENERATION
CRYTEK
© 2010 Crytek GmbH
• 30 fps per Eye for acceptable quality• dramatically reduced quality
Rendering Twice
18
STEREO IMAGE GENERATION
CRYTEK
© 2010 Crytek GmbH
• 30 fps per Eye for acceptable quality• dramatically reduced quality• lower resolution• less special effects
Rendering Twice
19
STEREO IMAGE GENERATION
CRYTEK
© 2010 Crytek GmbH
Rendering Twice
20
STEREO IMAGE GENERATION
Not an option
CRYTEK
© 2010 Crytek GmbH
STEREO IMAGE GENERATION
Screen space re-projection
21
• single pass pixel shader
CRYTEK
© 2010 Crytek GmbH
STEREO IMAGE GENERATION
Screen space re-projection
22
• single pass pixel shader• fully gather-based approach• no warped grid• no point sampling
CRYTEK
© 2010 Crytek GmbH
STEREO IMAGE GENERATION
Screen space re-projection
23
• single pass pixel shader• fully gather-based approach• no warped grid• no point sampling
• surprising depth strength possible
CRYTEK
© 2010 Crytek GmbH
STEREO IMAGE GENERATION
Screen space re-projection
24
• single pass pixel shader• fully gather-based approach• no warped grid• no point sampling
• surprising depth strength possible• full implementation by Nicolas Shulz (RnD)
CRYTEK
© 2010 Crytek GmbH
SCREEN SPACE RE-PROJECTION
High Level
25
• re-project pixel into left/right camera
CRYTEK
© 2010 Crytek GmbH
SCREEN SPACE RE-PROJECTION
High Level
26
• re-project pixel into left/right camera• in screen space
CRYTEK
© 2010 Crytek GmbH
SCREEN SPACE RE-PROJECTION
High Level
27
• re-project pixel into left/right camera• in screen space• offset based on pixel depth
CRYTEK
© 2010 Crytek GmbH
SCREEN SPACE RE-PROJECTION
High Level
28
• re-project pixel into left/right camera• in screen space• offset based on pixel depth• stereo parameters for adjusting
CRYTEK
© 2010 Crytek GmbH
SCREEN SPACE RE-PROJECTION
High Level
29
• re-project pixel into left/right camera• in screen space• offset based on pixel depth• stereo parameters for adjusting• resample backbuffer with bilinear filtering
CRYTEK
© 2010 Crytek GmbH
SCREEN SPACE RE-PROJECTION
30
• great quality with positive parallax
does it look good?
CRYTEK
© 2010 Crytek GmbH
SCREEN SPACE RE-PROJECTION
31
• great quality with positive parallax• no artifacts for opaque objects• transparent objects look acceptable• slight stretching at screen edges (easy to solve)
does it look good?
CRYTEK
© 2010 Crytek GmbH
SCREEN SPACE RE-PROJECTION
32
• good quality for negative parallax (popping out)
does it look good?
CRYTEK
© 2010 Crytek GmbH
SCREEN SPACE RE-PROJECTION
33
• good quality for negative parallax (popping out)• if no steep parallax gradient (no parallax change)
does it look good?
CRYTEK
© 2010 Crytek GmbH
SCREEN SPACE RE-PROJECTION
34
• good quality for negative parallax (popping out)• if no steep parallax gradient (no parallax change)
• artifacts for steep parallax gradient
does it look good?
CRYTEK
© 2010 Crytek GmbH
SCREEN SPACE RE-PROJECTION
does it look good?
35
• good quality for negative parallax (popping out)• if no steep parallax gradient (no parallax change)
• artifacts for steep parallax gradient• smooth out depth to solve
CRYTEK
© 2010 Crytek GmbH
SCREEN SPACE RE-PROJECTION
36
CRYTEK
© 2010 Crytek GmbH
STEREO IMAGE GENERATION
Outputting left/right
37
• PS3 Native HDMI 1.4 support
CRYTEK
© 2010 Crytek GmbH
SCREEN SPACE RE-PROJECTION
Outputting left/right
38
• PS3 Native HDMI 1.4 support• XBOX360 no native stereo support frame-compatible format (SBS, LBL, ...)
encode output format in a final pass
CRYTEK
© 2010 Crytek GmbH
SCREEN SPACE RE-PROJECTION
AUTOSTEREOSCOPIC
39
• Natively supported!• Output color and depth separation buffers
CRYTEK
© 2010 Crytek GmbH
• Nicolas Schulz - RnD• Michael Kopietz - RnD• Marco Corbetta - Crysis 2
THANKS TO…
CRYTEK
© 2010 Crytek GmbH
STEREO IMAGE GENERATION
Questions ?
41
ASK NOW
Recommended
