View
220
Download
0
Tags:
Embed Size (px)
Citation preview
University of São Paulo
Institute of Mathematics and Statistics
Department of Computer Science
Locating and Tracking Facial Landmarks Locating and Tracking Facial Landmarks with Gabor Wavelet Networkswith Gabor Wavelet Networks
Rogério Schmidt Feris
Roberto Marcondes Cesar Junior{rferis,cesar}@ime.usp.br
OutlineOutline
Motivation
Face Representation Using GWNs
Locating and Tracking Facial Landmarks
Experimental Results
Conclusions
MotivationMotivation
Face Recognition from Video Sequences
Problem Assumptions
Gabor Wavelet NetworksGabor Wavelet Networks
)2()2
1exp()( xusinxxx TT
Wavelet Networks
Mother Wavelet: Odd-Gabor Function
f x w xi ni
M
i
~
( ) ( )
1
Face Representation Using GWNsFace Representation Using GWNs
cossin
sin-cos RRotation
ysDilation
0
0sS
x
y
x
c
cc nTranslatio
))(()( cxSRxn
},...,,{21 Mnnn
),,,,( yxyx ssccn
Face Representation Using GWNsFace Representation Using GWNs2
,)(min
i
niiwn
fwfEi
ii
Original Image Wavelet Representation
Wavelet parameters are chosen from the continuous parameters space !!
Face Representation Using GWNsFace Representation Using GWNs
Progressive Attention
Interest32, 52, 100 and 320 wavelets
Direct Calculation of Weights
Face Representation Using GWNsFace Representation Using GWNs
GWN Reparametrization
Face Representation Using GWNsFace Representation Using GWNs
Superwavelet
))(()( cxSRwxi
nin i
),,,,,( xyyxyx sssccn
y
xyx
s
ssS
0
Reparametrization
2min n
ngE
Locating Facial LandmarksLocating Facial Landmarks
Reparametrization in Different Individuals
Optimization Using a Mean Face (Small Databases)
Locating Facial Landmarks
Yale Face Database
Locating Facial LandmarksLocating Facial Landmarks
Tracking Facial LandmarksTracking Facial Landmarks
Reparametrization in each Frame
Overall Face Geometry is Considered
Robustness and Efficiency
2min
tt
ntn
JE
Experimental ResultsExperimental Results
Face Detection Positioning of Facial Landmarks Tracking of Face and Facial Landmarks
http://www.ime.usp.br/~rferis
ConclusionsConclusions
Method Efficient and Robust
Limitations
Future Work
Improve Positioning of Facial Landmarks
3D Wavelet Model