3dtv

.at

Stereoscopic Player andStereoscopic Multiplexer

S3D-Today

27. - 28. November 2006

Munich, Germany

Peter Wimmer - 3dtv.at 2

Overview

Part 1 – Stereoscopic Player

3D playback on PCs Encoding 3D movies Stereoscopic Player features

Part 2 – Stereoscopic Multiplexer

Stereoscopic Multiplexer concepts Fields of application

Peter Wimmer - 3dtv.at 3

About 3dtv.at

Focus

Stereoscopic video playback Stereoscopic video recording

Products

Stereoscopic Player

Stereoscopic Multiplexer

Location

Linz, Austria www.3dtv.at

Timeline

Development started 2001

Completed diploma thesis in June 2004

Company founded in 2005

Peter Wimmer - 3dtv.at 4

3D Video Playback

The questions

Why do we need 3D playback software? Why not use any 2D video player?

The challenges

There are many 3D viewing methods Different resolutions are required to

accommodate to hardware performance

The solution

Real-time format conversion 3D playback software

?!

Peter Wimmer - 3dtv.at 5

Real-time Format Conversion

Real-time format conversion …

… avoids vast number of files … requires full color left and right views … gives best quality

Suitable source formats

Over/UnderSide-by-Side

Interlaced(Field Sequential)

L RLRLR

Dual Files

Peter Wimmer - 3dtv.at 6

Dual Files, Dual Streams

Dual files

Efficient use of multi processor systems Circumvent codec limitations Playback synchronization is prone to errors Performance problems when located on same media

Dual streams

Avoid performance problem of separate files 2D video players show the left video stream only Only available for Windows Media format

Peter Wimmer - 3dtv.at 7

Format Selection

Stereoscopic Player asks for the format when opening a new video

Stereoscopic Player remembers settings for each file in the built-in video library

Peter Wimmer - 3dtv.at 8

Stereoscopic Metadata

Fundamental idea

It is hard for users to find out the proper layout The content creator knows the proper layout Ship video files + format description (= metadata)

Stereoscopic Player …

… reads embedded metadata in Windows Media files … reads metadata file in same folder as the video file … contacts metadata server

The official metadata server is maintained by 3dtv.at and provides settings for most commercial 3D-DVDs and some popular video files.

Peter Wimmer - 3dtv.at 9

Creating Stereoscopic Metadata

Use the Windows Media Stereo Attribute Editor to embed metadata in Windows Media files (available for download on the 3dtv.at website)

Click File > Export in Stereoscopic Player to create a separate metadata file (for all other formats than Windows Media)

Improve user experience – deliver your movies with metadata!

Peter Wimmer - 3dtv.at 10

Creating a 3D-DVD

Side-by-side or over/under file

2x PAL/NTSC resolution or better Embedded metadata or stereoscopic metafile

Field-sequential version for legacy 3D system

50/60 Hz TVs + shutter glasses Hardware demultiplexer + two projectors

Anaglyph version

No stereo hardware required Limited color reproduction 4:2:0 color subsampling reduces quality

VideoSection

ROMSection

Peter Wimmer - 3dtv.at 11

Stereoscopic Player Viewing Methods

Anaglyphs

Shutter glasses

Polarized projection

Native supportAny graphics card, any display

Software pageflipping (ATI and Intel)NVIDIA stereo driver / OpenGL

Native dual screen output supportNVIDIA stereo driver / OpenGL

And many more…

Peter Wimmer - 3dtv.at 12

Stereoscopic Player Viewing Methods

Autostereoscopic displays (dual view)

Native support for horizontally interlaced output Native support for Sharp 3D displays

Autostereoscopic displays (multi view)

More than two views are required Image acquisition difficult Interpolation of images is CPU-intensive and not perfect Not supported in Stereoscopic Player yet

Peter Wimmer - 3dtv.at 13

NVIDIA Stereo Driver Configuration

Stereo driver

Install NVIDIA consumerstereo driver

Version number ofgraphics and stereodriver must match

Configure and activatethe stereo driver

Stereoscopic Player

Select ‘NVIDIA Stereo Driver’ viewing method

Peter Wimmer - 3dtv.at 14

Pageflipping via Stereo Driver

Peter Wimmer - 3dtv.at 15

Native Dual Screen Output

1. 2.

Peter Wimmer - 3dtv.at 16

Dual Screen Output via Stereo Driver

Graphics driver set to clone mode Normal 2D operation possible

Peter Wimmer - 3dtv.at 17

Stereoscopic Player Features

General features

File playback 3D-DVD playback Capture device support Intuitive user interface IR remote control support

Integration features

Command line control OLE Automation Customization tool available

Windows Media features

Web stream playback Digital Rights Management Multi-channel audio Multiple audio languages

Peter Wimmer - 3dtv.at 18

Stereoscopic Multiplexer Concept

Right stream Left stream

R L

Combined video stream

R L

Peter Wimmer - 3dtv.at 19

Fields of Applications

Live preview during recording

Stereoscopic Multiplexer loaded in Stereoscopic Player

Live broadcasts

Stereoscopic Multiplexer selected as capture device in Windows Media Encoder, running on the server

Stereoscopic Player running on the client

Watching 3D recording

Transferring left and right tape to hard disk not required Stereoscopic Multiplexer synchronizes tape drives

Peter Wimmer - 3dtv.at 20

Supported Hardware

Camcorders

DV camcorders HDV camcorders (next version)

Digital cameras

Industrial Firewire cameras Industrial USB cameras Webcams

Others

Analog cameras via frame grabbers Many other WDM-compatible capture devices

Peter Wimmer - 3dtv.at 21

Thanks for Your Attention

Q&A

Visit us at http://www.3dtv.at!