Upload
yogesh-yadav
View
220
Download
0
Embed Size (px)
Citation preview
8/8/2019 Real-Time 3d Human Capture System _Sreevidhya@Students
1/33
Real-time 3d human
capture system for
mixed-reality art and
entertainment
8/8/2019 Real-Time 3d Human Capture System _Sreevidhya@Students
2/33
contents:-
Abstract
Index terms
Introduction
Hardware and system description
Software components
Magic land
User study of the magic land system
conclusion
8/8/2019 Real-Time 3d Human Capture System _Sreevidhya@Students
3/33
8/8/2019 Real-Time 3d Human Capture System _Sreevidhya@Students
4/33
INDEX TERMS
3d view point
Mixed reality
tangible interaction
Art
Entertainment
8/8/2019 Real-Time 3d Human Capture System _Sreevidhya@Students
5/33
8/8/2019 Real-Time 3d Human Capture System _Sreevidhya@Students
6/33
Hardware system description Hardware
System setup
8/8/2019 Real-Time 3d Human Capture System _Sreevidhya@Students
7/33
Hardware
8/8/2019 Real-Time 3d Human Capture System _Sreevidhya@Students
8/33
SYSTEM SETUP
In order to generate the novel view of the subject from any
angle/position of the virtual view point, the zoom level, position of
each dragonfly camera must be adjusted .
The system is very sensitive to the cameras intrinsic and extrinsicparameters .
Visual hull construction alg.
Both the Unibrain camera attached to the HMD and the dragonfly
cameras which capture the subject have to be calibrated.
Standard routines.
Standard routines from Intels OpenCV library.
Relative tranformation
8/8/2019 Real-Time 3d Human Capture System _Sreevidhya@Students
9/33
SOFTWARE COMPONENTS
1.Overview
2.Image processing module
3.Synchronization 4.Results
8/8/2019 Real-Time 3d Human Capture System _Sreevidhya@Students
10/33
OVERVIEW
8/8/2019 Real-Time 3d Human Capture System _Sreevidhya@Students
11/33
IMAGE PROCESSING MODULE
The image processing module processes the raw captured image in
three steps:
1.Background subtraction.
2.Radial distortion compensation.
3.Image size reduction.
8/8/2019 Real-Time 3d Human Capture System _Sreevidhya@Students
12/33
BACKGROUND SUBTRACTION
The result of visual hull construction in the rendering module largelydepends on the output of the background subtraction step.
This is more crucial step to determine the quality of the final 3d
model. Simple statistical method.
Modified method.
Main purpose of this method.
The pixel properties calculated here are chromaticity and brightness,
Which is obtained from a new model of pixel color. Each pixel is divided into 4 types, they are
8/8/2019 Real-Time 3d Human Capture System _Sreevidhya@Students
13/33
8/8/2019 Real-Time 3d Human Capture System _Sreevidhya@Students
14/33
These modifications reduce the complexity of the formula and quite
drastically increase the calculation speed ,but produce misclassified
pixels than original alg.
8/8/2019 Real-Time 3d Human Capture System _Sreevidhya@Students
15/33
FILTERING
Morphological operators.
8/8/2019 Real-Time 3d Human Capture System _Sreevidhya@Students
16/33
DATA SIZE FOR REAL TIME NETWORK
CONSTRAINTS
TO OPTIMIZE THE DATA WE CAN USE 2 METHODS.
1.Reducing the image size by only storing the smallest rectangular
region containing the foreground objects.
2.Using Bayer format
8/8/2019 Real-Time 3d Human Capture System _Sreevidhya@Students
17/33
RESULTS
8/8/2019 Real-Time 3d Human Capture System _Sreevidhya@Students
18/33
SYNCHRONIZATION
8/8/2019 Real-Time 3d Human Capture System _Sreevidhya@Students
19/33
The purpose of synchronization
8/8/2019 Real-Time 3d Human Capture System _Sreevidhya@Students
20/33
RENDERING
8/8/2019 Real-Time 3d Human Capture System _Sreevidhya@Students
21/33
MAGICLAND
8/8/2019 Real-Time 3d Human Capture System _Sreevidhya@Students
22/33
8/8/2019 Real-Time 3d Human Capture System _Sreevidhya@Students
23/33
SYSTEM CONCEPT AND HARDWARE
COMPONENTS
8/8/2019 Real-Time 3d Human Capture System _Sreevidhya@Students
24/33
8/8/2019 Real-Time 3d Human Capture System _Sreevidhya@Students
25/33
8/8/2019 Real-Time 3d Human Capture System _Sreevidhya@Students
26/33
8/8/2019 Real-Time 3d Human Capture System _Sreevidhya@Students
27/33
SOFTWARE COMPONENTS
8/8/2019 Real-Time 3d Human Capture System _Sreevidhya@Students
28/33
ARTISTIC INTENTION
8/8/2019 Real-Time 3d Human Capture System _Sreevidhya@Students
29/33
FUTURE WORK
8/8/2019 Real-Time 3d Human Capture System _Sreevidhya@Students
30/33
MAGIC LANDS RELATIONSHIP TO
MIXED REALITY GAMES
8/8/2019 Real-Time 3d Human Capture System _Sreevidhya@Students
31/33
8/8/2019 Real-Time 3d Human Capture System _Sreevidhya@Students
32/33
USER STUDY OF THE MAGIC LAND
SYSTEM Aim of this study
Design and procedures
Results of this study Conclusions of the user study
8/8/2019 Real-Time 3d Human Capture System _Sreevidhya@Students
33/33