PRESENTATION ONPRESENTATION ON

NOUSE TECHNOLOGYNOUSE TECHNOLOGY

PRESENTED BY:-PRESENTED BY:-

Rohit MankotiaRohit Mankotia

CFS 005CFS 005

NIIT/Ynr.NIIT/Ynr.

TYPES OF FACE TRACKINGTYPES OF FACE TRACKING

IMAGE BASEDIMAGE BASED

FEATURE BASEDFEATURE BASED

IMAGE BASED F.T.IMAGE BASED F.T.

ADVANTAGES:-ADVANTAGES:- USE GLOBAL FACIAL CUESUSE GLOBAL FACIAL CUES ROBUST TO HEAD MOTIONROBUST TO HEAD MOTION DON’T REQUIRE HIGH QUALITY DON’T REQUIRE HIGH QUALITY

IMAGESIMAGES DISADVANTAGE:-DISADVANTAGE:- LACK OF PRECISIONLACK OF PRECISION

FEATURE BASED F.TFEATURE BASED F.T..

ADVANTAGES:-ADVANTAGES:- BASED ON TRACKING INDIVISUAL FACIAL BASED ON TRACKING INDIVISUAL FACIAL

FEATURESFEATURES PRECISE AND SMOOTH FACE TRACKINGPRECISE AND SMOOTH FACE TRACKING

DISADVANTAGES:-DISADVANTAGES:- NOT ROBUSTNOT ROBUST REQUIRED HIGH QUALITY CAMERAS REQUIRED HIGH QUALITY CAMERAS

DESIRED PROPERTIESDESIRED PROPERTIES

UNIQUENESSUNIQUENESS

ROBUSTNESSROBUSTNESS

CONTINUTYCONTINUTY

CONVEX SHAPECONVEX SHAPE

RESULTS IN NOUSE TECH.

STAGESSTAGES

INITIALIZATIONINITIALIZATION TRACKING

Zero initialization of Nouse Using Nouse for Painting

Performance: Robustness &Performance: Robustness & Precision Precision

The range of head motion tracked

‘No’ motion

‘Yes’ motion

Robustness to rotation Robustness to scale

Test: The user rotates his head only! (the shoulders do not move)

For humansFor humans: : it isit is much easier to track with two eyes than with one much easier to track with two eyes than with one eye.eye.

. Not only extends tracking from 2D to 3D,. Not only extends tracking from 2D to 3D, but also makes tracking more precise and robust!but also makes tracking more precise and robust!

On Importance of Two On Importance of Two CamerasCameras

APPLICATIONAPPLICATION

A user plays an aim-n-shoot Bubble-Frenzy game aiming the turret by pointing with her nose.(slight rotation of head allows to aim precisely in 180 degree range)

1. AIM-n-SHOOT BUBBLE FRENZY GAME

2.NOUSE PONG2.NOUSE PONG

Two users play a virtual ping-pong game, bouncing the ball with their heads. Image-based Two users play a virtual ping-pong game, bouncing the ball with their heads. Image-based tracking allows one to track heads, however it doesn’t allow one to pin-point with head.tracking allows one to track heads, however it doesn’t allow one to pin-point with head.

CONCLUSIONCONCLUSION

Nose is a very unique feature. Nose is a very unique feature. Humans are lucky to have it!Humans are lucky to have it!

Nose allows us to track a face very Nose allows us to track a face very robustly and preciselyrobustly and precisely

Pointing with Nose is natural. Pointing with Nose is natural.