98
Mapping & Warping shapes Geometry Acquisition Zheng Hanlin 2011.07.05 -- Summer Seminar

Mapping & Warping shapes Geometry Acquisition Zheng Hanlin 2011.07.05 -- Summer Seminar

Embed Size (px)

Citation preview

Page 1: Mapping & Warping shapes Geometry Acquisition Zheng Hanlin 2011.07.05 -- Summer Seminar

Mapping & Warping shapesGeometry Acquisition

Zheng Hanlin2011.07.05

-- Summer Seminar

Page 2: Mapping & Warping shapes Geometry Acquisition Zheng Hanlin 2011.07.05 -- Summer Seminar

Papers• Bounded Biharmonic Weight for Real-Time Deformation (SIG11)• Biharmonic Distance (TOG11)• Blended Intrinsic Maps (SIG11)• Photo-Inspired Model-Driven 3D Object Modeling (SIG11)

• Style-Content Separation by Anisotropic Part Scales (SIGA10)• L1-Sparse Reconstruction of Sharp Point Set Surfaces (TOG)• GlobFit: Consistently Fitting Primitives by Discovering Global Relations

(SIG11)• Data-Driven Suggestions for Creativity Support in 3D Modeling (SIGA10)

Page 3: Mapping & Warping shapes Geometry Acquisition Zheng Hanlin 2011.07.05 -- Summer Seminar

Bounded Biharmonic Weight for Real-Time Deformation

Sig11

Page 4: Mapping & Warping shapes Geometry Acquisition Zheng Hanlin 2011.07.05 -- Summer Seminar

Authors

• Alec Jacobson– Ph.D. Candidate

Page 5: Mapping & Warping shapes Geometry Acquisition Zheng Hanlin 2011.07.05 -- Summer Seminar

Authors

• Ilya Baran– Postdoc.– Disney Research in Zurich

Page 6: Mapping & Warping shapes Geometry Acquisition Zheng Hanlin 2011.07.05 -- Summer Seminar

Authors

Olga SorkineAssistant ProfessorETH Zurich

Page 7: Mapping & Warping shapes Geometry Acquisition Zheng Hanlin 2011.07.05 -- Summer Seminar

The Main Idea

• Shape deformation– Work freely with the most convenient

combination of handle types

bone

cage

points

Page 8: Mapping & Warping shapes Geometry Acquisition Zheng Hanlin 2011.07.05 -- Summer Seminar

Motivation(Video)

• Typical flow for deformation– Bind the object to handles (bind time)– Manipulate the handles (pose time)

• Different handle types have different advantages and disadvantages

• Design the weights for a linear blending scheme• Real-time responce

Page 9: Mapping & Warping shapes Geometry Acquisition Zheng Hanlin 2011.07.05 -- Summer Seminar

Motivations

Deformation Type

Free-form Skeleton-based

Generalized barycentric coordinate

Advantage Nature control for rigid limbs

Provide smooth weights

automatically

Disadvantage Require regular structure

Less convenient for flexible regions

Need (nearly) closed cages

Page 10: Mapping & Warping shapes Geometry Acquisition Zheng Hanlin 2011.07.05 -- Summer Seminar

Algorithm

• Linear blending:

Affine transformation of handle HjNew position

Old position

Handle size

Weight function

Bounded biharmonic weights

Page 11: Mapping & Warping shapes Geometry Acquisition Zheng Hanlin 2011.07.05 -- Summer Seminar

Algorithm

• Bounded biharmonic weights:

Page 12: Mapping & Warping shapes Geometry Acquisition Zheng Hanlin 2011.07.05 -- Summer Seminar

Algorithm

• Bounded biharmonic weights:– Properties:• Smoothness• Non-negativity• Shape-awareness• Partition of unity• Locality and sparsity• No local maxima

Page 13: Mapping & Warping shapes Geometry Acquisition Zheng Hanlin 2011.07.05 -- Summer Seminar

Algorithm

• Bounded v.s. Unbounded

Page 14: Mapping & Warping shapes Geometry Acquisition Zheng Hanlin 2011.07.05 -- Summer Seminar

Results & Comparison

Page 15: Mapping & Warping shapes Geometry Acquisition Zheng Hanlin 2011.07.05 -- Summer Seminar

Results

Page 16: Mapping & Warping shapes Geometry Acquisition Zheng Hanlin 2011.07.05 -- Summer Seminar

Results

Page 17: Mapping & Warping shapes Geometry Acquisition Zheng Hanlin 2011.07.05 -- Summer Seminar

Results

Page 18: Mapping & Warping shapes Geometry Acquisition Zheng Hanlin 2011.07.05 -- Summer Seminar

Results

Page 19: Mapping & Warping shapes Geometry Acquisition Zheng Hanlin 2011.07.05 -- Summer Seminar

Performance

Page 20: Mapping & Warping shapes Geometry Acquisition Zheng Hanlin 2011.07.05 -- Summer Seminar

Limitation

• The optimization is not fast enough– Bind-time

• This weights do NOT have the linear precision property

Page 21: Mapping & Warping shapes Geometry Acquisition Zheng Hanlin 2011.07.05 -- Summer Seminar

Conclusion

• Unify all popular types of control armatures

• Intuitive design of real-time blending deformation

Page 22: Mapping & Warping shapes Geometry Acquisition Zheng Hanlin 2011.07.05 -- Summer Seminar

Biharmonic Distance

TOG11

Page 23: Mapping & Warping shapes Geometry Acquisition Zheng Hanlin 2011.07.05 -- Summer Seminar

Authors

Yaron Lipman Raif M. Rustamov Thomas Funkhouser

Page 24: Mapping & Warping shapes Geometry Acquisition Zheng Hanlin 2011.07.05 -- Summer Seminar

The Main Idea

• A new distance measure based on the biharmonic differential operator

Page 25: Mapping & Warping shapes Geometry Acquisition Zheng Hanlin 2011.07.05 -- Summer Seminar

Motivation• The most important properties for a distance– metric– smooth– Locally isotropic– Globally shape-aware– Isometry invariant– Insensitive to noise– Small topology changes– Parameter free– Practical to compute on a discrete mesh– …

Does there exist a measure cover all these properties?

Page 26: Mapping & Warping shapes Geometry Acquisition Zheng Hanlin 2011.07.05 -- Summer Seminar

Related works

• Geodesic distance– Not smooth, insensitive to topology

• Diffusion distance– Not locally isotropic– Not global shape-aware– Depending on parameter

• Commute-time distance (Graph)– Cannot define on surfaces– Depending on the conformal structure

Page 27: Mapping & Warping shapes Geometry Acquisition Zheng Hanlin 2011.07.05 -- Summer Seminar

Algorithm

• Continuous cases:

• Biharmonic:

Green’s function

Page 28: Mapping & Warping shapes Geometry Acquisition Zheng Hanlin 2011.07.05 -- Summer Seminar

Algorithm

• Discrete cases

• Can be proved:

Conformal discrete laplacian

Page 29: Mapping & Warping shapes Geometry Acquisition Zheng Hanlin 2011.07.05 -- Summer Seminar

Results & Comparisons

Page 30: Mapping & Warping shapes Geometry Acquisition Zheng Hanlin 2011.07.05 -- Summer Seminar

Results & Comparisons

Page 31: Mapping & Warping shapes Geometry Acquisition Zheng Hanlin 2011.07.05 -- Summer Seminar

Applications

• Function interpolation on surfaces

Page 32: Mapping & Warping shapes Geometry Acquisition Zheng Hanlin 2011.07.05 -- Summer Seminar

Applications

• Surface matching

Page 33: Mapping & Warping shapes Geometry Acquisition Zheng Hanlin 2011.07.05 -- Summer Seminar

Performances

Page 34: Mapping & Warping shapes Geometry Acquisition Zheng Hanlin 2011.07.05 -- Summer Seminar

Conclusions

• A novel surface distance– Has good properties

Page 35: Mapping & Warping shapes Geometry Acquisition Zheng Hanlin 2011.07.05 -- Summer Seminar

Blended Intrinsic Maps

Sig11

Page 36: Mapping & Warping shapes Geometry Acquisition Zheng Hanlin 2011.07.05 -- Summer Seminar

Authors

• Vladimir G. Kim– Ph.D. Candidate– Princeton Univ.

– He has Canadian and Kyrgyz citizenships.

Page 37: Mapping & Warping shapes Geometry Acquisition Zheng Hanlin 2011.07.05 -- Summer Seminar

Authors

• Yaron Lipman • Thomas Funkhouser

Page 38: Mapping & Warping shapes Geometry Acquisition Zheng Hanlin 2011.07.05 -- Summer Seminar

The Main Idea

• Find the maps between two genus 0 surfaces

Page 39: Mapping & Warping shapes Geometry Acquisition Zheng Hanlin 2011.07.05 -- Summer Seminar

Related Works

• Inter-surface mapping• Finding sparse correspondences• Iterative closest points• Finding dense correspondences• Surface embedding• Exploring Mobius Transformations

Page 40: Mapping & Warping shapes Geometry Acquisition Zheng Hanlin 2011.07.05 -- Summer Seminar

Algorithm

• Blended map

Candidate maps

Smooth blending weights

Page 41: Mapping & Warping shapes Geometry Acquisition Zheng Hanlin 2011.07.05 -- Summer Seminar

Algorithm

• Generating maps (candidate conformal maps)• Defining confidence weights– How much distorting is induced

• Finding consistency weights– Lower values for incorrect matches

• Blend map

Page 42: Mapping & Warping shapes Geometry Acquisition Zheng Hanlin 2011.07.05 -- Summer Seminar

More Details

• Finding Consistency Weights– Objective Function

– Similarity measure

– Optimizing

Page 43: Mapping & Warping shapes Geometry Acquisition Zheng Hanlin 2011.07.05 -- Summer Seminar

Results & Comparisons

Page 44: Mapping & Warping shapes Geometry Acquisition Zheng Hanlin 2011.07.05 -- Summer Seminar

Results & Comparisons

Page 45: Mapping & Warping shapes Geometry Acquisition Zheng Hanlin 2011.07.05 -- Summer Seminar

Results & Performances

Page 46: Mapping & Warping shapes Geometry Acquisition Zheng Hanlin 2011.07.05 -- Summer Seminar

Results & Performances

Page 47: Mapping & Warping shapes Geometry Acquisition Zheng Hanlin 2011.07.05 -- Summer Seminar

Limitation & Conclusion

• Limitations:– Not guaranteed to work in case of partial near-isometric

matching– Only for genus zero surfaces now

• An automatic method for finding a map between surfaces (including non-isometric surfaces)

Page 48: Mapping & Warping shapes Geometry Acquisition Zheng Hanlin 2011.07.05 -- Summer Seminar

Photo-Inspired Model-Driven 3D Object Modeling

Sig11

Page 49: Mapping & Warping shapes Geometry Acquisition Zheng Hanlin 2011.07.05 -- Summer Seminar

The Main Idea

• Modeling– From single photo

Page 50: Mapping & Warping shapes Geometry Acquisition Zheng Hanlin 2011.07.05 -- Summer Seminar

Workflow

Page 51: Mapping & Warping shapes Geometry Acquisition Zheng Hanlin 2011.07.05 -- Summer Seminar

Algorithm

• Model-driven object analysis– Part-based retrieval

• Silhouette-guided structure-preserving deformation– Controller construction– Structure-preserving controller optimization

Page 52: Mapping & Warping shapes Geometry Acquisition Zheng Hanlin 2011.07.05 -- Summer Seminar

Algorithm

• Model-driven object analysis– Part-based retrieval

• Silhouette-guided structure-preserving deformation– Controller construction– Structure-preserving controller optimization

Page 53: Mapping & Warping shapes Geometry Acquisition Zheng Hanlin 2011.07.05 -- Summer Seminar

Results

Page 54: Mapping & Warping shapes Geometry Acquisition Zheng Hanlin 2011.07.05 -- Summer Seminar

Results

Page 55: Mapping & Warping shapes Geometry Acquisition Zheng Hanlin 2011.07.05 -- Summer Seminar

Limitations

• Limitations:– Candidate sets: new geometric variations but not new

structure– Only considered reflectional symmetry

Page 56: Mapping & Warping shapes Geometry Acquisition Zheng Hanlin 2011.07.05 -- Summer Seminar

Future works

• More effective means of structure modification and editing fine-detailed features

• Using model-driven approach to allow more reusability

• More means to inspire the user in creative 3D modeling

Page 57: Mapping & Warping shapes Geometry Acquisition Zheng Hanlin 2011.07.05 -- Summer Seminar

Style-Content Separation by Anisotropic Part Scales

SigA10

Page 58: Mapping & Warping shapes Geometry Acquisition Zheng Hanlin 2011.07.05 -- Summer Seminar

The Main Idea

Page 59: Mapping & Warping shapes Geometry Acquisition Zheng Hanlin 2011.07.05 -- Summer Seminar

Workflow

Page 60: Mapping & Warping shapes Geometry Acquisition Zheng Hanlin 2011.07.05 -- Summer Seminar

Results

Page 61: Mapping & Warping shapes Geometry Acquisition Zheng Hanlin 2011.07.05 -- Summer Seminar

Results

Page 62: Mapping & Warping shapes Geometry Acquisition Zheng Hanlin 2011.07.05 -- Summer Seminar

Limitations & Conclusions

• Limitation– Input set should be in the same semantic class– The initial segmentation should be sufficiently meaningful– The synthesis method limits itself to creating new

variations of an existing example model

• Analyze a set of 3D objects belonging to the same class while exhibiting significant shape variations, particularly in part scale

Page 63: Mapping & Warping shapes Geometry Acquisition Zheng Hanlin 2011.07.05 -- Summer Seminar

L1-Sparse Reconstruction of Sharp Point Set Surfaces

Haim AvronTel-Aviv

Univ.

Andrei SharfUC-Davis

Chen GreifUniv. of British

Columbia

Daniel Cohen-OrTel-Aviv Univ.

TOG11

Page 64: Mapping & Warping shapes Geometry Acquisition Zheng Hanlin 2011.07.05 -- Summer Seminar

Authors

• Haim Avron– Postdoctoral Researcher

@IBM T.J. Watson Research Center

– Research field:• Numerical linear algebra• High performance

computing

Page 65: Mapping & Warping shapes Geometry Acquisition Zheng Hanlin 2011.07.05 -- Summer Seminar

Authors

• Chen Greif– Associate Professor– Scientific Computing Laboratory

Department of Computer Science @ UBC

– Research Interests:• Iterative solvers• Saddle-point linear systems• Preconditioning techniques• PageRank

Page 66: Mapping & Warping shapes Geometry Acquisition Zheng Hanlin 2011.07.05 -- Summer Seminar

The Main Idea

• Reconstruction

Page 67: Mapping & Warping shapes Geometry Acquisition Zheng Hanlin 2011.07.05 -- Summer Seminar

Motivation

• L1-sparsity paradigm avoid the pitfalls such as least squares, namely smoothed out error– L2 norm tends to severely penalize outliers and propagate

the residual in the objective function uniformly

• Sharp features– Outliers are not excessively penalized– Objective function is expected to be more concentrated

near the sharp features.

Page 68: Mapping & Warping shapes Geometry Acquisition Zheng Hanlin 2011.07.05 -- Summer Seminar

Related Works

• 3D Surface Reconstruction

• Sparse Signal Reconstruction

continuous signal basis functions

Page 69: Mapping & Warping shapes Geometry Acquisition Zheng Hanlin 2011.07.05 -- Summer Seminar

Workflow

• Orientation Reconstruction

• Position Reconstruction

Page 70: Mapping & Warping shapes Geometry Acquisition Zheng Hanlin 2011.07.05 -- Summer Seminar

More Details

• Orientation Reconstruction– Assume the surface can be approximated well by

local planes

Page 71: Mapping & Warping shapes Geometry Acquisition Zheng Hanlin 2011.07.05 -- Summer Seminar

More Details

• Position Reconstruction

Second-Order Cone Problem(SOCP)Slover: CVX [Grant and Boyd 2009]

Page 72: Mapping & Warping shapes Geometry Acquisition Zheng Hanlin 2011.07.05 -- Summer Seminar

Results

Page 73: Mapping & Warping shapes Geometry Acquisition Zheng Hanlin 2011.07.05 -- Summer Seminar

Results

Page 74: Mapping & Warping shapes Geometry Acquisition Zheng Hanlin 2011.07.05 -- Summer Seminar

Results & Comparisons

Page 75: Mapping & Warping shapes Geometry Acquisition Zheng Hanlin 2011.07.05 -- Summer Seminar

Results & Comparisons

Page 76: Mapping & Warping shapes Geometry Acquisition Zheng Hanlin 2011.07.05 -- Summer Seminar

Performance

Page 77: Mapping & Warping shapes Geometry Acquisition Zheng Hanlin 2011.07.05 -- Summer Seminar

Limitation & Conclusion

• Limitations:– Difficult to correctly project points lying exactly on edge

singularities.

– High computational cost

• A l1-sparse approach for reconstruction of point set surface with sharp features

Page 78: Mapping & Warping shapes Geometry Acquisition Zheng Hanlin 2011.07.05 -- Summer Seminar

GlobFit: Consistently Fitting Primitives by Discovering Global Relations

Sig11

Page 79: Mapping & Warping shapes Geometry Acquisition Zheng Hanlin 2011.07.05 -- Summer Seminar

Authors

• Yangyan Li (李扬彦 )– Ph.D. Candidate– Visual Computing Center of SIAT– Chinese Academy of Sciences

• Xiaokun Wu (吴晓堃 )

Page 80: Mapping & Warping shapes Geometry Acquisition Zheng Hanlin 2011.07.05 -- Summer Seminar

Authors• Yiorgos Chrysanthou– Associate Professor– Univ. of Syprus– The head of the Graphics Lab @

the University of Cyprus

– His current research interests:• real-time rendering• visibility, crowd rendering and

simulation• virtual and augmented reality and

applications to cultural heritage.

Page 81: Mapping & Warping shapes Geometry Acquisition Zheng Hanlin 2011.07.05 -- Summer Seminar

Authors

• Andrei Sharf– Computer Science Department– Ben-Gurion Univ.

– Research interests:• Geometry processing and 3D

modeling• Interactive techniques• Topology, parallel data structures on

the GPU• Large scale 3D urban modeling

Page 82: Mapping & Warping shapes Geometry Acquisition Zheng Hanlin 2011.07.05 -- Summer Seminar

Authors

• Daniel Cohen-Or • Niloy J. Mitra

Page 83: Mapping & Warping shapes Geometry Acquisition Zheng Hanlin 2011.07.05 -- Summer Seminar

The Main Idea

• Recover the global mutual relations

Page 84: Mapping & Warping shapes Geometry Acquisition Zheng Hanlin 2011.07.05 -- Summer Seminar

Related Works

• Surface Reconstruction• Feature Detection• Reverse engineering• …

Page 85: Mapping & Warping shapes Geometry Acquisition Zheng Hanlin 2011.07.05 -- Summer Seminar

The Workflow

Page 86: Mapping & Warping shapes Geometry Acquisition Zheng Hanlin 2011.07.05 -- Summer Seminar

Main Contributions

• A global approach to constrain and optimize the local RANSAC based primitives

Page 87: Mapping & Warping shapes Geometry Acquisition Zheng Hanlin 2011.07.05 -- Summer Seminar

More Details

• Greedy v.s. Global

Page 88: Mapping & Warping shapes Geometry Acquisition Zheng Hanlin 2011.07.05 -- Summer Seminar

More Details

• re-RANSAC

Page 89: Mapping & Warping shapes Geometry Acquisition Zheng Hanlin 2011.07.05 -- Summer Seminar

Evaluation

• Synthetic datasets– Compare face normals and distances

• Scanned datasets

Page 90: Mapping & Warping shapes Geometry Acquisition Zheng Hanlin 2011.07.05 -- Summer Seminar

Results

Page 91: Mapping & Warping shapes Geometry Acquisition Zheng Hanlin 2011.07.05 -- Summer Seminar

Results

Page 92: Mapping & Warping shapes Geometry Acquisition Zheng Hanlin 2011.07.05 -- Summer Seminar

Results

Page 93: Mapping & Warping shapes Geometry Acquisition Zheng Hanlin 2011.07.05 -- Summer Seminar

Limitations

• Noise will make the results bad

Page 94: Mapping & Warping shapes Geometry Acquisition Zheng Hanlin 2011.07.05 -- Summer Seminar

Conclusion

• A method for incorporating global relations for man-made objects.

Page 95: Mapping & Warping shapes Geometry Acquisition Zheng Hanlin 2011.07.05 -- Summer Seminar

Data-Driven Suggestions for Creativity Support in 3D Modeling

Page 96: Mapping & Warping shapes Geometry Acquisition Zheng Hanlin 2011.07.05 -- Summer Seminar

Authors

• Siddhartha Chaudhuri– Ph.D. Student– CS @ Stanford Univ.

– Research area:• Richer tools for 3D content creation

Page 97: Mapping & Warping shapes Geometry Acquisition Zheng Hanlin 2011.07.05 -- Summer Seminar

Authors

• Vladlen Koltun– Assistant Prof.– CS @ Stanford Univ.

– Research area:• Computer graphics• Interactive techniques

Page 98: Mapping & Warping shapes Geometry Acquisition Zheng Hanlin 2011.07.05 -- Summer Seminar

Thanks!