3D Scene Virtualization Based on Face Tracking

Final Presentation for EE7700 DVP

Shenghua Wan and Kang zhangMay, 2012

3D View Simulation Based on Face TrackingMotivationMulti-touch User InterfacePhysical MotionVirtual Environment

Motion Sensing Game ConsolesWiiKinect

Infrared sensor barInfrared LEDInfrared projector and camera

ObjectiveFace MotionTrackingTranslationsZoom

Virtual 3D Scene Explore3D scenee.g. a Cube with 8 points with different depthvalues.View Simulation

Methodology-Face Tracking 1Haar Cascade Classifier (Viola & Jones 2001)Haar-like featuresIntegral ImageAdaBoost (Freund & Schapire 1995)Cascading

ImplementationOpenCVTrained ClassifierSome Untuned Parameters

Methodology-Face Tracking 2CAMShift( Continuously Adaptive Mean-Shift )AssumptionImage histogram of foreground object is time-invariant.Back ProjectionMean Shift AlgorithmLocate new search window and goto 2ImplementationOpenCVMethodology-Face Tracking 2(cont)Some comments on CAMShiftSensitive and fastNot Robusttend to be interfered by objects with similar color distribution.

facearmfingerseven notebook!Experimental ResultsHuman face moves in real-worldViewpoint moves in the simulated 3D scene as if we are looking at the real-world objects.

Thank you!