18. Februar 2010 © Fraunhofer HHI, Ulrich Leiner, confidential
Dr.
Ulri
ch L
eine
r
Slide 1
Fraunhofer Institute for Telecommunications - Heinrich-Hertz-Institut
Einsteinufer 37 10587 Berlinwww.hhi.fraunhofer.de
3D, Interactive Devices and Innovative Applications
Dr. Ulrich LeinerFraunhofer Heinrich-Hertz-Institut
18. Februar 2010 © Fraunhofer HHI, Ulrich Leiner, confidential
Dr.
Ulri
ch L
eine
r
Slide 2
Fraunhofer Association: Applied research in Germany60 Institutes, 17000 Scientists, 1.7 Bil Budget
Heinrich-Hertz-Institut (HHI)telecommunication, photonics, image processing270 Scientists, 26 Mio. Budget
What do we do?
DepartmentInteractive Media –Human Factors25 Scientists
18. Februar 2010 © Fraunhofer HHI, Ulrich Leiner, confidential
Dr.
Ulri
ch L
eine
r
Slide 3
The virtual museum is getting real
• Many peaces of art are currently scanned• and reconstructed as high resolution 3D-objects• Monuments, books, figures, vases, statues, buildings
• Soon, there will be extremely realistic 3D-models of everything „important“ to mankind
• Virtual museums will make millions of artifacts available for watching, studying, comparing, creativity
• The download story for these models is just to come
Historic Artifacts in 3D
18. Februar 2010 © Fraunhofer HHI, Ulrich Leiner, confidential
Dr.
Ulri
ch L
eine
r
Slide 4
Historic Artifacts in 3D
November 09 we installed a 3D-book presenter at the Bavarian State Library• Books are still stored locally, since there are rather few scanned 3D models yet• But there are about 100.000.000 to come
• Noteworthy, we addeda touchless interactionsystem
• This magic inputdevice allows completely new interaction paradigms
18. Februar 2010 © Fraunhofer HHI, Ulrich Leiner, confidential
Dr.
Ulri
ch L
eine
r
Slide 5
3D Content should be seen in 3D!
If a proof for the success of movies was still needed, Avatar gave it to the full extend
• 3D-movies will spread out through the internet• Their resolution will be at least HD/eye
• Currently, real convincing 3D-displays are still lacking• Either, you have to wear glasses• Or compromise in the resolution
• HHI is successfully working on autostereoscopic3D-displays
• The virtual museum will also benefit from real 3D-displays
18. Februar 2010 © Fraunhofer HHI, Ulrich Leiner, confidential
Dr.
Ulri
ch L
eine
r
Slide 6
3D Content should be seen in 3D!
Based on lenticular beam splitters and real time eye-tracking,
• we can provide each eye with a HD/2 resolution
• No glasses are needed
• Again, touchless interaction is shown as preferred input method
• It’s not yet possibleto show 3D on this beamer
Video
18. Februar 2010 © Fraunhofer HHI, Ulrich Leiner, confidential
Dr.
Ulri
ch L
eine
r
Slide 7
Videoconferencing will realize in real time
• Multi-user auto stereoscopic display technology• Depth estimation with combination of narrow baseline, trifocal and wide baseline
camera setup
• Conversion to suitable layered video-plus-depth (LDV) format
• Each terminal receives eight LDV streams, one for eachview, two for each display
• Terminal decodes LDV and converts it to multiple views required by auto-stereoscopic display
Real Video-Conferences should be in 3D!
18. Februar 2010 © Fraunhofer HHI, Ulrich Leiner, confidential
Dr.
Ulri
ch L
eine
r
Slide 8
3D City Navigation Systems
Not only pottery is modeled as virtual 3D objectsAll cities get their virtual counterpart
• Berlin city models presents nearly each building inzoomable levels of detail
• Realtime navigation and interaction is requested
• Points of information will be installed
• At home, applications will also become popular
• Combination with 2D images can be expected
25.02.2010 © Fraunhofer HHIFolie 8
18. Februar 2010 © Fraunhofer HHI, Ulrich Leiner, confidential
Dr.
Ulri
ch L
eine
r
Slide 9
Remote Surveillance and Retrieval
Not necessarily a 3D-application, but one, which collects and transfers TeraPetabytes of data
• Demand for private and public security is rising
• Number of cameras, resolution and framerate will be increased
• Location of cameras, location of storage and location of surveillants are absolutely independent of each other
• We are currently working on optimal retrieval system, including object recognition and tracing
18. Februar 2010 © Fraunhofer HHI, Ulrich Leiner, confidential
Dr.
Ulri
ch L
eine
r
Slide 10
Fraunhofer Heinrich-Hertz-Institut
Thanks and
Way more info at www.hhi.fraunhofer.de/im