42
Sketching, Scaffolding, and Inking: A Visual History for Interactive 3D Modeling Ryan Schmidt Karan Singh Tobias Isenberg Pauline Jepp Brian Wyvill

Sketching, Scaffolding, and Inking - unknownroad.com · Sketching, Scaffolding, and Inking: ... Comic Art Pipeline ... Mesh is dynamic Can’t precompute! Silhouettes

Embed Size (px)

Citation preview

Page 1: Sketching, Scaffolding, and Inking - unknownroad.com · Sketching, Scaffolding, and Inking: ... Comic Art Pipeline ... Mesh is dynamic Can’t precompute! Silhouettes

Sketching, Scaffolding, and Inking:

A Visual History for Interactive 3D Modeling

Ryan SchmidtKaran Singh

Tobias IsenbergPauline Jepp

Brian Wyvill

Page 2: Sketching, Scaffolding, and Inking - unknownroad.com · Sketching, Scaffolding, and Inking: ... Comic Art Pipeline ... Mesh is dynamic Can’t precompute! Silhouettes

10,000-Foot View

How can we better support the design process in 3D modeling software?

Sketch-Based Modeling

Improve3D modelunderstanding

Page 3: Sketching, Scaffolding, and Inking - unknownroad.com · Sketching, Scaffolding, and Inking: ... Comic Art Pipeline ... Mesh is dynamic Can’t precompute! Silhouettes

Production sketch

Visual Representations

Design sketch

Page 4: Sketching, Scaffolding, and Inking - unknownroad.com · Sketching, Scaffolding, and Inking: ... Comic Art Pipeline ... Mesh is dynamic Can’t precompute! Silhouettes
Page 5: Sketching, Scaffolding, and Inking - unknownroad.com · Sketching, Scaffolding, and Inking: ... Comic Art Pipeline ... Mesh is dynamic Can’t precompute! Silhouettes

Production sketch Design sketch

Page 6: Sketching, Scaffolding, and Inking - unknownroad.com · Sketching, Scaffolding, and Inking: ... Comic Art Pipeline ... Mesh is dynamic Can’t precompute! Silhouettes
Page 7: Sketching, Scaffolding, and Inking - unknownroad.com · Sketching, Scaffolding, and Inking: ... Comic Art Pipeline ... Mesh is dynamic Can’t precompute! Silhouettes

Goals

Figure out how to simulate design sketching

Integrate w/ production sketch rendering

Implement in an interactive 3Dsurface modeler

Page 8: Sketching, Scaffolding, and Inking - unknownroad.com · Sketching, Scaffolding, and Inking: ... Comic Art Pipeline ... Mesh is dynamic Can’t precompute! Silhouettes

Design Sketches

© Enes Canay http://www.carbodydesign.com/archive/2006/08/10-audi-sportscoupe-concept/

Page 9: Sketching, Scaffolding, and Inking - unknownroad.com · Sketching, Scaffolding, and Inking: ... Comic Art Pipeline ... Mesh is dynamic Can’t precompute! Silhouettes
Page 10: Sketching, Scaffolding, and Inking - unknownroad.com · Sketching, Scaffolding, and Inking: ... Comic Art Pipeline ... Mesh is dynamic Can’t precompute! Silhouettes

© Stan Lee and John Buscema

Page 11: Sketching, Scaffolding, and Inking - unknownroad.com · Sketching, Scaffolding, and Inking: ... Comic Art Pipeline ... Mesh is dynamic Can’t precompute! Silhouettes

Comic Art Pipeline

Sketching / Penciling Inking Coloring

Images © Jerry Holkins, taken from http://pennyarcade.blogspot.com

Page 12: Sketching, Scaffolding, and Inking - unknownroad.com · Sketching, Scaffolding, and Inking: ... Comic Art Pipeline ... Mesh is dynamic Can’t precompute! Silhouettes

Sketching / Penciling

Iterative refinement

High-throughput

Consistency

© Stan Lee and John Buscema

Page 13: Sketching, Scaffolding, and Inking - unknownroad.com · Sketching, Scaffolding, and Inking: ... Comic Art Pipeline ... Mesh is dynamic Can’t precompute! Silhouettes

Visual Scaffolding

Temporary artist-created design aids

“Construction lines/shapes”, “trace lines”, “guide lines”, etc…

Image © Jerry Holkins © Wizard Entertianment, Inc

Page 14: Sketching, Scaffolding, and Inking - unknownroad.com · Sketching, Scaffolding, and Inking: ... Comic Art Pipeline ... Mesh is dynamic Can’t precompute! Silhouettes

Geometric Massing

Architectural Massing Models

Helps with form,perspective

Well-suited for SBM (model-by-part)

© Disney Entertainment, Inc© Wizard Entertianment, Inc

Page 15: Sketching, Scaffolding, and Inking - unknownroad.com · Sketching, Scaffolding, and Inking: ... Comic Art Pipeline ... Mesh is dynamic Can’t precompute! Silhouettes

Geometric Massing

Coarse geometricshapes

Partial “shape axes”

Varying occlusion

Lots of overdraw

© Wizard Entertianment, Inc

© Disney Entertainment, Inc

Page 16: Sketching, Scaffolding, and Inking - unknownroad.com · Sketching, Scaffolding, and Inking: ... Comic Art Pipeline ... Mesh is dynamic Can’t precompute! Silhouettes

Algorithm

Fit bounding box

Contours from plane intersections

Random perturbation

Fade in/out based on viewing angle

Page 17: Sketching, Scaffolding, and Inking - unknownroad.com · Sketching, Scaffolding, and Inking: ... Comic Art Pipeline ... Mesh is dynamic Can’t precompute! Silhouettes
Page 18: Sketching, Scaffolding, and Inking - unknownroad.com · Sketching, Scaffolding, and Inking: ... Comic Art Pipeline ... Mesh is dynamic Can’t precompute! Silhouettes
Page 19: Sketching, Scaffolding, and Inking - unknownroad.com · Sketching, Scaffolding, and Inking: ... Comic Art Pipeline ... Mesh is dynamic Can’t precompute! Silhouettes
Page 20: Sketching, Scaffolding, and Inking - unknownroad.com · Sketching, Scaffolding, and Inking: ... Comic Art Pipeline ... Mesh is dynamic Can’t precompute! Silhouettes
Page 21: Sketching, Scaffolding, and Inking - unknownroad.com · Sketching, Scaffolding, and Inking: ... Comic Art Pipeline ... Mesh is dynamic Can’t precompute! Silhouettes

Erasing vs Deleting

Deleted parts “disappear”

Can’t learn from them

No “mistakes” in design sketching !!!

Exploring alternatives

Not an artifact of paper

Image © Jerry Holkins

Page 22: Sketching, Scaffolding, and Inking - unknownroad.com · Sketching, Scaffolding, and Inking: ... Comic Art Pipeline ... Mesh is dynamic Can’t precompute! Silhouettes
Page 23: Sketching, Scaffolding, and Inking - unknownroad.com · Sketching, Scaffolding, and Inking: ... Comic Art Pipeline ... Mesh is dynamic Can’t precompute! Silhouettes

Eraser Marks

Page 24: Sketching, Scaffolding, and Inking - unknownroad.com · Sketching, Scaffolding, and Inking: ... Comic Art Pipeline ... Mesh is dynamic Can’t precompute! Silhouettes
Page 25: Sketching, Scaffolding, and Inking - unknownroad.com · Sketching, Scaffolding, and Inking: ... Comic Art Pipeline ... Mesh is dynamic Can’t precompute! Silhouettes
Page 26: Sketching, Scaffolding, and Inking - unknownroad.com · Sketching, Scaffolding, and Inking: ... Comic Art Pipeline ... Mesh is dynamic Can’t precompute! Silhouettes

“Real-World” Application

Have design sketch “look”

Geometric Massing

Eraser Marks

Composite w/ productionsketch techniques

Pen & Ink

Now to integrate rendererinto an interactive modeling system…

Page 27: Sketching, Scaffolding, and Inking - unknownroad.com · Sketching, Scaffolding, and Inking: ... Comic Art Pipeline ... Mesh is dynamic Can’t precompute! Silhouettes

Integration

Page 28: Sketching, Scaffolding, and Inking - unknownroad.com · Sketching, Scaffolding, and Inking: ... Comic Art Pipeline ... Mesh is dynamic Can’t precompute! Silhouettes

Practical Limitations

Free-form modeling

NURBS, SubD, Implicit

Interactivity is critical

Meshes are low-res

Ugly contours

Mesh is dynamic

Can’t precompute!

Page 29: Sketching, Scaffolding, and Inking - unknownroad.com · Sketching, Scaffolding, and Inking: ... Comic Art Pipeline ... Mesh is dynamic Can’t precompute! Silhouettes
Page 30: Sketching, Scaffolding, and Inking - unknownroad.com · Sketching, Scaffolding, and Inking: ... Comic Art Pipeline ... Mesh is dynamic Can’t precompute! Silhouettes
Page 31: Sketching, Scaffolding, and Inking - unknownroad.com · Sketching, Scaffolding, and Inking: ... Comic Art Pipeline ... Mesh is dynamic Can’t precompute! Silhouettes
Page 32: Sketching, Scaffolding, and Inking - unknownroad.com · Sketching, Scaffolding, and Inking: ... Comic Art Pipeline ... Mesh is dynamic Can’t precompute! Silhouettes

Silhouettes

Sub-Poly Contours

on Base Mesh

Project Refine

Page 33: Sketching, Scaffolding, and Inking - unknownroad.com · Sketching, Scaffolding, and Inking: ... Comic Art Pipeline ... Mesh is dynamic Can’t precompute! Silhouettes
Page 34: Sketching, Scaffolding, and Inking - unknownroad.com · Sketching, Scaffolding, and Inking: ... Comic Art Pipeline ... Mesh is dynamic Can’t precompute! Silhouettes
Page 35: Sketching, Scaffolding, and Inking - unknownroad.com · Sketching, Scaffolding, and Inking: ... Comic Art Pipeline ... Mesh is dynamic Can’t precompute! Silhouettes

Caveats

Need functional surface normals

Base mesh needs to capture topology of surface

Page 36: Sketching, Scaffolding, and Inking - unknownroad.com · Sketching, Scaffolding, and Inking: ... Comic Art Pipeline ... Mesh is dynamic Can’t precompute! Silhouettes

Hidden Line Removal & Stippling

Surfel approach (“tiny canvasses”)

Cover base mesh w/ surfels

Project to surface

Hierarchical culling, lazy generation

base mesh as spatial data structure

Page 37: Sketching, Scaffolding, and Inking - unknownroad.com · Sketching, Scaffolding, and Inking: ... Comic Art Pipeline ... Mesh is dynamic Can’t precompute! Silhouettes

Surfel Distribution

“As-uniform-as-possible”

Take surface curvatureinto account

Page 38: Sketching, Scaffolding, and Inking - unknownroad.com · Sketching, Scaffolding, and Inking: ... Comic Art Pipeline ... Mesh is dynamic Can’t precompute! Silhouettes

Wins

Visual Scaffolding Geometric Massing,

Eraser Marks

Real-Time Pen & Ink on dynamic surfaces Implicit, NURBS, SubDs

Fully object-space

Supports incremental refinement

Frame-coherent as long as base mesh triangles do not change

Smoother-looking surfaceat equivalent interactiveframerate!

Page 39: Sketching, Scaffolding, and Inking - unknownroad.com · Sketching, Scaffolding, and Inking: ... Comic Art Pipeline ... Mesh is dynamic Can’t precompute! Silhouettes

The Future

Other visual scaffolding types

Interactive Scaffolding

“Conjecturing” scaffolding?

www.shapeshop3d.com(Under “Downloads” -> “Extras”)

Enes Canay http://www.carbodydesign.com/archive/2006/08/10-audi-sportscoupe-concept/

Page 40: Sketching, Scaffolding, and Inking - unknownroad.com · Sketching, Scaffolding, and Inking: ... Comic Art Pipeline ... Mesh is dynamic Can’t precompute! Silhouettes

Surfel Rasterization

Page 41: Sketching, Scaffolding, and Inking - unknownroad.com · Sketching, Scaffolding, and Inking: ... Comic Art Pipeline ... Mesh is dynamic Can’t precompute! Silhouettes

Surfel Distribution

“As-uniform-as-possible”

Take surface curvatureinto account

View-dependent density

Page 42: Sketching, Scaffolding, and Inking - unknownroad.com · Sketching, Scaffolding, and Inking: ... Comic Art Pipeline ... Mesh is dynamic Can’t precompute! Silhouettes

Sketching Videos

Eyes: http://www.youtube.com/watch?v=GAi7cHiaf-U Superman: http://www.youtube.com/watch?v=EZZtXKUHUyU Jim Lee: http://www.youtube.com/watch?v=Ys5UmSx9rfA Great quick sketches http://www.youtube.com/watch?v=kygMLl60Bt4 Wolverine! http://www.youtube.com/watch?v=v_kB6GzzCkU Stewie http://www.youtube.com/watch?v=-AH4Zrw7MwM Drawing a head http://www.youtube.com/watch?v=erKzKlSJxxk Hand http://www.youtube.com/watch?v=p2-aheNqhRM Geometric Massing http://www.youtube.com/watch?v=rRj5CaMjTNs Spongebob Squarepants http://www.youtube.com/watch?v=m6MfGYwsy80 Adam Hughes

http://www.youtube.com/watch?v=UvaG1EZ9shM

http://www.youtube.com/watch?v=mAO3sUyg-Bw (talks about construction lines!)