8/16/99
Computer Vision and ModelingComputer Vision and Modeling
8/16/99
Principal Components with SVDPrincipal Components with SVD
8/16/99
Linear Dimension Reduction:Linear Dimension Reduction:
High-dimensionalInput Space
8/16/99
Linear Subspace:Linear Subspace:
+=
+ 1.7=
8/16/99
Linear Subspace:Linear Subspace:
8/16/99
Principal Components Analysis:Principal Components Analysis:
xWy ~
N
nT mnys
1
22 )][(
TN
nT xxS )~()~(
1
TTT WWSs 2
m
8/16/99
Examples:Examples:
Data:
Kirby, Weisser, Dangelmayer 1993
8/16/99
Examples:Examples:
Data:
PCA
New Basis Vectors
8/16/99
Examples:Examples:
Data:
PCA
EigenLips
8/16/99
Examples:Examples:
Face Recognition with Eigenfaces (Turk+Pentland, ):
8/16/99
Examples:Examples:
Face Recognition System (Moghaddam+Pentland):
8/16/99
Examples: Visual CortexExamples: Visual Cortex
Hubel
8/16/99
Examples: Visual CortexExamples: Visual Cortex
Hubel
8/16/99
Examples: Receptive FieldsExamples: Receptive Fields
Hubel
8/16/99
Examples: Receptive FieldsExamples: Receptive Fields
Hancock et al: The principal components of natural images
8/16/99
Examples: Receptive FieldsExamples: Receptive Fields
Hancock et al: The principal components of natural images
8/16/99
Examples:Examples:
Active Appearance Models (AAM): (Cootes et al)
8/16/99
Examples:Examples:
Active Appearance Models (AAM): (Cootes et al)
8/16/99
Examples:Examples:
Active Appearance Models (AAM): (Cootes et al)
8/16/99
Examples:Examples:
3D Morphable Models (Blanz+Vetter)
8/16/99
Examples:Examples:
3D Morphable Models (Blanz+Vetter)
8/16/99
ReviewReview
E(V)V V
Constrain-
Analytically derived:Affine, Twist/Exponential Map
Learned:Linear/non-linear
Sub-Spaces
8/16/99
S = (p ,…,p )
E(S) Constrain
1 n
Non-Rigid Constrained Spaces
8/16/99
Non-Rigid Constrained Spaces
Nonlinear Manifolds:
Linear Subspaces:
• Small Basis Set
• Principal Components Analysis
Mixture Models
8/16/99
Examples:Examples:
Eigen Tracking (Black and Jepson)
8/16/99
Examples:Examples:
Shape Models for tracking:
8/16/99
More generic Feature/Shape Models:
Visual Motion Contours:Blake, Isard, Reynard
8/16/99
More generic Feature/Shape Models:
Visual Motion Contours:Blake, Isard, Reynard
8/16/99
Linear Discriminant Analysis:Linear Discriminant Analysis:
8/16/99
Fisher’s linear discriminant:Fisher’s linear discriminant:
21
))(())(( 1111Cn
Tnn
Cn
TnnW xxxxS T
BS ))(( 1212
wSw
WSwJ
WT
BT
KCn
nK
k xN
1
)( 121
WSw
8/16/99
Example: Eigenfaces vs FisherfacesExample: Eigenfaces vs Fisherfaces
Glasses or not Glasses ?
8/16/99
Example: Eigenfaces vs FisherfacesExample: Eigenfaces vs Fisherfaces
Input New Axis
Belhumeur, Hespanha, Kriegman 1997
8/16/99
Nonlinear Manifolds
Nonlinear Manifolds:
Linear Subspaces:
• Small Basis Set
• Principal Components Analysis
Mixture Models