51
SIGGRAPH 2012 Frank Crow/ Philipp Slusallek Intel Labs Intel Corporation August 8 th , 2012 Future of Visual Computing as viewed by Intel Visual Computing Research Centers http://ucoweb01.intel-research.net/

Future of Visual Computing as viewed by Intel Visual ... · PDF fileFuture of Visual Computing as viewed by Intel Visual Computing Research Centers ... Justin Rattner Intel Science

Embed Size (px)

Citation preview

Page 1: Future of Visual Computing as viewed by Intel Visual ... · PDF fileFuture of Visual Computing as viewed by Intel Visual Computing Research Centers ... Justin Rattner Intel Science

SIGGRAPH 2012

Frank Crow Philipp Slusallek

Intel Labs Intel Corporation August 8th 2012

Future of Visual Computing as viewed by Intel Visual Computing Research Centers

httpucoweb01intel-researchnet

Intel Visual Computing Centers 2

Intel Labs Justin Rattner

Intel Science and Technology

Center for Visual Computing Engaging Academic Thought Leaders Within

North America and Europe to Drive Visual

Computing Advancement

Saarland

Intel Visual Computing Institute

SIGGRAPH IMPACT

~ 25 of Siggraph 2012 technical papers authored by participants in

one of the Visual Computing centers

3 httpvisualstanfordedublog

4 4 Intel Science and Technology Center for Visual Computing Stanford (Levoy Levis Hanrahan Fedkiw Koltun Horowitz Ousterhout Rosenblum )

UC Davis (Owens) UC Berkeley

(Agrawala Ramamoorthi OrsquoBrien Malik Shewchuk Zakhor)

Harvard (Pfister)

UWash (Popovic Seitz Curless Mones)

Cornell (D James Snavely Bala Marschner Greenberg)

Princeton (Funkhouser Rusinkeiwicz Finkelstein Freedman)

Content Creation Theme lead M Agrawala

1 ndash Data-Driven Modeling lead Vladlen Koltun

2 - Game-driven Creation lead Zoran Popovic

3 ndashRapid Animation lead Maneesh Agrawala

Graphics Systems Theme lead John Owens

1 ndash Computational Photography lead Marc Levoy

2 ndash Heterogeneous Pipelines lead John Owens

3 ndash Cloud-Scale Visual Game Support lead Philip Levis

4 ndash Exascale Visualization lead Hanspeter Pfister

Simulation Theme lead Doug James

1 ndash Scalable Visual Rendering lead R Ramamoorthi K Bala

2 ndash Real-time Physical Simulation lead Ron Fedkiw

3 ndash Physically Based Sound lead Doug James

4 ndash Simulated Virtual Characters a Appearance ndash lead Marschner b Performance - lead Koltun c Integration ndash lead OrsquoBrien

Perception Theme lead S Seitz

1 ndash Interior Capture and Modeling lead Noah Snavely

2 ndash Urban Semantic Capture Modeling lead Tom Funkhouser

3 ndash People Poses in Photos lead Jitendra Malik

4 ndash People Actions in Video lead Deva Ramanan

UC Irvine (Ramanan)

httpvisualstanfordedu

SIMULATED VIRTUAL CHARACTERS

bull Goal Dramatically advance the fidelity and behavior of virtual characters so that they look and perform believably in real-time simulated environments

bull Currently attacking two aspects bull Appearance (skin hair clothing) bull Control (autonomous motion

reaction interaction)

ISTC-VC website visualstanfordedu

Appearance of Virtual Characters Knit Woven Clothing

- Goal Build up physical model of cloth to support physically correct appearance and motion - PIs Steve Marschner Kavita Bala Doug James (Cornell) James OrsquoBrien (Berkeley)

Siggraph 2012 Papers - Stitch Meshes for Modeling Knitted Clothing With Yarn-level Detail Yuksel et al - Structure-Aware Synthesis for Predictive Woven Fabric Appearance Zhao et al

httpvisualstanfordedu

Appearance of Virtual Characters Knit Woven Clothing

Siggraph 2012 Papers - Stitch Meshes for Modeling Knitted Clothing With Yarn-level Detail Yuksel et al - Structure-Aware Synthesis for Predictive Woven Fabric Appearance Zhao et al

- Goal Build up physical model of cloth to support physically correct appearance and motion - PIs Steve Marschner Kavita Bala Doug James (Cornell) James OrsquoBrien (Berkeley)

httpvisualstanfordedu

Control of Virtual Characters Autonomous Behavior

- Goal Automate low-level actions such as walking carrying things dealing with obstacles etc - PIs Vladlen Koltun (Stanford) Zoran Popovic (UW)

Siggraph 2012 Papers - Optimizing Locomotion Controllers Using Biologically-Based Actuators and Objectives Wang et al - Discovery of Complex Behaviors through Contact-Invariant Optimization Mordatch et al

httpvisualstanfordedu

Control of Virtual Characters Autonomous Behavior

- Goal Automate low-level actions such as walking carrying things dealing with obstacles etc - Investigators Vladlen Koltun (Stanford) Zoran Popovic (UW)

Siggraph 2012 Papers - Optimizing Locomotion Controllers Using Biologically-Based Actuators and Objectives Wang et al - Discovery of Complex Behaviors through Contact-Invariant Optimization Mordatch et al - Continuous Character Control With Low-Dimensional Embeddings Levine et al

httpvisualstanfordedu

Physically-Based Sound

Widely reported in popular scientific media (NPR Science Friday BBC hellip)

bull Goal automatically generate sounds due to object interactions in the physical simulation of a virtual environment

bull PI Doug James (Cornell)

Siggraph 2012 Papers - Motion-Driven Concatenative Synthesis of Cloth Sounds An et al - Precomputed Acceleration Noise for Improved Rigid-Body Sound Chadwick et al

Data-Driven Modeling

Siggraph 2012 Papers - A Probabilistic Model for Component-Based Shape Synthesis Kalogerakis et al - An Algebraic Model for Parameterized Shape Editing Bokeloh et al

httpvisualstanfordedu

- Goal Capture the nature of a chair or an animal by analyzing large databases of similar objects to allow working with parts rather than polygons Make tools that enable users of all skill levels to produce custom high-quality content for virtual worlds - PIs Vladlen Koltun (Stanford) Tom Funkhouser (Princeton) Pat Hanrahan (Stanford)

Data-Driven Modeling

Siggraph 2012 Papers - A Probabilistic Model for Component-Based Shape Synthesis Kalogerakis et al - An Algebraic Model for Parameterized Shape Editing Bokeloh et al

httpvisualstanfordedu

- Goal Capture the nature of a chair or an animal by analyzing large databases of similar objects to allow working with parts rather than polygons Make tools that enable users of all skill levels to produce custom high-quality content for virtual worlds - PIs Vladlen Koltun (Stanford) Tom Funkhouser (Princeton) Pat Hanrahan (Stanford)

Intel Visual Computing Institute

httpswwwintel-university-collaborationnetpage_id=998

Saarbruumlcken Germany

An Open Collaborative Research Institute at the Saarland Campus

Multimodal

Computing

and

Interaction

IVCI Mission Facilitate the progress of Visual Computing research and be a driver towards highest

quality image real-time processing and interactive visualization

Virtual Worlds (Model-based)

Multimodal Scene Analysis amp Interaction

Real Worlds (Sample-based)

Intel VCI Vision Scalable Algorithms for

Real Time Realistic

Rendering

Compiler Support for

High Performance

Graphics

Collaborative Distributed Molecular

Modeling and Visualization

Efficient High Quality

Rendering Using Sample-based

Representations

Scalable Hybrid Rendering for

Large Scale Visualization

Marker-free Performance

Capture

Algorithms for Low Cost Depth

Imaging

Visualization and editing of light

transport

Internet Transport and Coding for 3D

HD-TV

Software- innovation for the Digital Enterprise

Kusanagi Coding and

Interaction for Networked Games

Multi Touch Interaction

Techniques for Mixed 2D and 3D Graphics Displays

Advanced Ray Tracing and Data-Flow

Processing for the 3D Internet

Intel VCI Projects-Based Organization

ECOUSS Efficient and open Compiler-

Framework for parallel Simulations

SCENE Novel Scene Representations for Rich

Networked Media

VERVE Vanquishing fear and apathy

through E-inclusion

Large Scale Visualization in the Internet of Displays

User-centric Video

Processing

Local Dimming for Edge-lit LED LCD-Monitors

SCI Institute Utah USA

Stanford University California USA

Research Collaboration

Consortium Members

User-Centric Video Processing Jan Kautz Christian Theobalt

bull Objective ndash Create new user experiences for capturing

editing and browsing

ndash Targets amateur video creators

bull Approach ndash Automatically identify spationdashtemporal and

semantic relationships withinbetween videos

ndash Leverage graph of these to drive UI and video processing

bull Expected results Capturing automatic stabilization and

enhancement

Editing edit semantic objects in videos

Browsing find semantically related videos

Remove the person in white

Video Inpainting in Dynamic Scenes amp Videoscape for moving through Internet Videos

Efficient High-Quality Rendering Using Sample-based Representations Elmar Eisemann

bull Realistic Rendering ndash Lens Flare [Siggraphrsquo11]

ndash Depth-of-field [Eurographics lsquo11]

ndash Global Illumination [PGrsquo11]

bull Perceptual Rendering ndash Stereo

ndash High Dynamic Range

bull Alternative representations ndash Voxel Data

ndash Height Fields

3D Internet Interactive 3D Content on the Web Philipp Slusallek

bull XML3D Scene Description ndash HTML-5 extension for interactive graphics

ndash JS implementation amp built into the browser

ndash Reuses Web Technology (DOM CSS JS)

bull XFLOW Parallel Processing ndash Data-parallel flowgraph for XML3D

ndash Animations image amp geometry processing

ndash Configuration within the DOM

bull Results ndash W3C standardization ldquoDeclarative 3D for the Webrdquo

ndash Rich media apps for BMW SLS-Museum hellip

3D-Internet Apps SLS-Museum 3D-Installation amp Museum with Interactive Virtual Characters

3D-Internet Apps Using OpenStreetMap-3D as Shared Virtual Worlds

Fully automatically generated from OpenStreet Map Taking semantic data into acount

Marker-free Performance Capture Christian Theobalt

bull Reconstruction of detailed human animation models ndash In Multi-view video without markers

ndash Out Detailed motion shape and appearance

ndash General clothing modifiable performances new animations

bull Real-time performance capture ndash Fast full-body motion estimation from depth

cameras

ndash Interaction

ndash Collaboration with Intel Magic Mirror project

[ICCV 2011]

[SIGGRAPH Asia 2010]

Markerless Motion Capture of Interacting Characters Using Multi-view Image Segmentation

Articulated Models Input silhouettes Segmentation Contour labels Estimated surface Estimated 3D models

Handling Intersections

Improved segmentation with 3D shape priors Excellent performance when evaluated against marker-based system

bull Interactive inspection of light transport in virtual scenes ndash You can only manipulate what you see

ndash First prototypal light manipulation tools

bull Efficient global illumination ndash Otherwise no interactive

visualization nor manipulation

ndash Improvements on many-lights methods and progressive photon mapping

bull Results ndash Demonstrator Maya plugin ndash Collaboration with local film academy

Visualization and Editing of Light Transport Carsten Dachsbacher

Advanced Real-Time Ray Tracing Techniques Philipp Slusallek

bull Perfect importance sampling and caching ndash Sparse but perfect importance sampling

ndash Caching and interpolation [Eurographics`12]

bull Unifying Photon-Mapping amp Monte-Carlo ndash Formulating PM as a MC process

ndash Per pixel combination using MIS

bull Data-parallel implementations

ndash Efficiency and performance

bull Integration into XML3D

ndash Provide ldquocorrectrdquo results by default

Vertex Merging with Multiple Importance Sampling Photon-Mapping as a Monte-Carlo Process

BPT

PPM Progressive Photon-Mapping (PPM)

Bidirectional Path Tracing (BPT)

bull Whole-Function Vectorization ndash Restore scalar computations

ndash LLVM platform-independent

ndash RenderMan frontend OpenCL driver

bull Vector Programming ndash Formalized C extension for portable

effective SIMD programming

ndash Type system triggers vectorization

ndash Data layout adaption

bull New Programming Models for High-Performance Graphics

bull Results ndash Demonstrators for shaders and HPC code

ndash CC++-Extensions (with Intel)

ndash OpenCL compiler (CPU)

Compiler Support for High-Performance Graphics Sebastian Hack

bull Hybrid Rendering ndash Client amp Server Model

ndash Smartphone to Mainframe

bull Large Data Processing ndash Scalable Hierarchical

RW Data Structures

bull Results ndash ZAPP displaywall demonstrator

ndash ImageVis3D (Mobile) demonstrator

ndash Practically use in hospitals

Scalable Hybrid Rendering for Large Scale Visualization Jens Kruumlger

Displays as a Service Large Scale Visualization Alexander Loumlffler

bull Virtualization of Displays ndash Virtual Framebuffer and Displays exposed to Internet

ndash Replacing cables by switched IP network

ndash Internet standards for video encoding and streaming

bull Fully Synchronized ndash 120 Hz active stereo sync over IP

ndash Accuracy of ~100us in software

ndash Drives GPU displays output

bull Results ndash 20-screen wall demonstrator

ndash 3-screen wall (thin-bezel)

ndash CE4100 based SW synchronization

SIGGRAPH 2012

Backup

The Intel Science and Technology Center (ISTC) and Intel Collaborative Research Institute (ICRI) Programs

35

The modern economy is an information economy and one that is driven by innovations that enhance productivity as well as create new modes of entertainment We need to invest in the basic research that will inspire future products and services and ensure long term health of our information economy Government and private foundations are helping but corporate America needs to step up and increase commitments to university research - Justin Rattner ndash Intel CTO

$140M investment over 5 years announced by Intel in 2011 and 2012

Centers of Excellence bull Each ISTC and ICRI will focus on one

research area eg visual computing secure computing

bull The ISTCs and ICRIs are meant to bring the best and brightest researchers across the US together

bull Each ISTC and ICRI will be led by a host university and will include thought leaders from other schools

Breaking Barriers to Collaboration

bull Open IP models and open source software to encourage free information exchange (In most of the Centers)

bull Favor projects that span multiple institutions to encourage collaboration among universities

bull Intel researches per center assigned to work on-campus to encourage collaboration between Intel and academia

Greater Impact to Future Tech bull Center research themes to

address essential needs of computing technology

bull Research agendas jointly defined and co-led by an Intel and a University Principal Investigator

bull After completing 3-5 year charters new ISTCs and ICRIs can be formed to respond to changing tech environment

httpfolditportal

Serious Gaming pplied to Content Creation

Highlighted by President Obama Winner of most-significant new visualization tool (NSF)

Goal Create high-quality content by casting creation activities as games in which large numbers of people are incentivized to perform simple tasks which in combination yield sophisticated content PIs Zoran Popovic (UW) Noah Snavely (Cornell) Maneesh Agrawala(Berkeley)

Determining the structure of retroviral protease (HIV)

Video Frank to add Papers Frank to add

Extracting Structure and Semantics

CAD Model Points

Structures

People

Goals Enable context aware computing and automated content creation through the capture analysis and manipulation of real-world visual data PIs Steve Seitz (UW) Noah Snavely (Cornell) Tom Funkhouser (Princeton) Vladlen Koltun (Stanford) Jitendra Malik (Berkeley) Deva Ramanan (UV Irvine)

Video Frank to add Papers Frank to add

httpvisualstanfordedu

Computational Photography (Franken Camera)

Being adopted as a standard API for cellphone camera systems (Apple Android)

bull Goal Develop algorithms languages architectures and prototypes demonstrating the use of computation in the process of image capture and display

bull PIs Marc Levoy (Stanford) Mark Horowitz (Stanford) Pat Hanrahan (Stanford)

Video Frank to add Papers Frank to add

ISTC-VC SIGGRAPH Papers

Character Locomotion Monday 6 August 900 AM - 1030 AM Optimizing Locomotion Controllers Using Biologically Based Actuators and Objectives Jack M Wang Samuel R Hamner Scott L Delp Vladlen Koltun Continuous Character Control With Low-Dimensional Embeddings Sergey Levine Jack M Wang Alexis Haraux Zoran Popović Vladlen Koltun Shape Analysis Monday 6 August 900 AM - 1030 AM Schelling Points on 3D Surface Meshes Xiaobai Chen Abulhair Saparov Bill Pang Thomas Funkhouser Shape Transformation Wednesday 8 August 900 - 1030 AM An Algebraic Model for Parameterized Shape Editing Martin Bokeloh Michael Wand Hans-Peter Seidel Vladlen Koltun

42

ISTC-VC SIGGRAPH Papers

Image Processing Monday 6 August 2- 330 pm Decoupling Algorithms From Schedules for Easy Optimization of Image-Processing Pipelines Jonathan Ragan-Kelley Andrew Adams Sylvain Paris Marc Levoy Saman Amarasinghe Freacutedo Durand

Cloth

Monday 6 August 2-330 pm Specular Reflection From Woven Cloth Piti Irawan Steve Marschner Stitch Meshes for Modeling Knitted Clothing With Yarn-level Detail Cem Yuksel Jonathan M Kaldor Doug L James Steve Marschner

Appearance

Monday 6 August 345-535 pm Printing Spatially Varying Reflectance for Reproducing HDR Images Yue Dong Xin Tong Fabio Pellacini Baining Guo

43

ISTC-VC SIGGRAPH Papers (cont)

Hand Eye and Face Monday 6 August 345-535 pm Session Chair - Vladlen Koltun Discovery of Complex Behaviors through Contact-Invariant Optimization Igor Mordatch Emanuel Todorov Zoran Popovi1049029 Sketching Monday 6 August 345-535 pm HelpingHand Example-Based Stroke Stylization Jingwan Lu Fisher Yu Adam Finkelstein Stephen DiVerdi Fabrication Tuesday 7 August 9-1030 am Fabricating Articulated Characters From Skinned Meshes Moritz Baumlcher Bernd Bickel Doug L James Hanspeter Pfister

44

Sampling Reconstructing and Filtering Light Tuesday 7 August 1045 am-1215 pm A Theory of Monte Carlo Visibility Sampling Ravi Ramamoorthi John Anderson Mark Meyer Derek Nowrouzezahrai Reconstructing the Indirect Light Field for Global Illumination Jaakko Lehtinen Timo Aila Samuli Laine Freacutedo Durand

Geometry Reconstruction amp Tracking

Tuesday 7 August 1045 am-1215 pm Temporally Coherent Completion of Dynamic Shapes Hao Li Linjie Luo Daniel Vlasic Pieter Peers Jovan Popovic Mark Pauly Szymon Rusinkiewicz

Sets of Shapes

Tuesday 7 August 2-330 pm Exploring Collections of 3D Models Using Fuzzy Correspondence Vladimir G Kim Wilmot Li Niloy J Mitra Stephen DiVerdi Thomas Funkhouser A Probabilistic Model for Component-Based Shape Synthesis Evangelos Kalogerakis Siddhartha Chaudhuri Daphne Koller Vladlen Koltun

45

ISTC-VC SIGGRAPH Papers (cont)

Light Rays Tuesday 7 August 2-330 pm Manifold Exploration A Markov Chain Monte Carlo Technique for Rendering Scenes With Difficult Specular Transport Wenzel Jakob Steve Marschner Bidirectional Lightcuts Bruce Walter Pramook Khungurn Kavita Bala

Fun With Video

Tuesday 7 August 345-535 pm Session Chair Noah Snavely Video Deblurring for Hand-Held Cameras Using Patch-Based Synthesis Sunghyun Cho Jue Wang Seungyong Lee Eulerian Video Magnification for Revealing Subtle Changes in the World Hao-Yu Wu Michael Rubinstein Eugene Shih John Guttag Freacutedo Durand William T Freeman Selectively De-Animating Video Jiamin Bai Aseem Agarwala Maneesh Agrawala Ravi Ramamoorthi Tools for Placing Cuts and Transitions in Interview Video Floraine Berthouzoz Wilmot Li Maneesh Agrawala

46

ISTC-VC SIGGRAPH Papers (cont)

Noise and Texture Tuesday 7 August 345-535 pm Structure-Aware Synthesis for Predictive Woven Fabric Appearance Shuang Zhao Kavita Bala Steve Marschner Wenzel Jakob Symmetry-Guided Texture Synthesis and Manipulation Vladimir Kim Yaron Lipman Thomas Funkhouser

Shape Transformation Wednesday 8 August 900 - 1030 AM An Algebraic Model for Parameterized Shape Editing Martin Bokeloh Michael Wand Hans-Peter Seidel Vladlen Koltun

Stitching

Wednesday 8 August 1045 am-1215 pm Exposing Photo Manipulation With Inconsistent Reflections James F OrsquoBrien Hany Farid

47

ISTC-VC SIGGRAPH Papers (cont)

Maps Surfaces and Shapes

Wednesday 8 August 1045 am-1215 pm Simple Formulas For Quasiconformal Plane Deformations Yaron Lipman Vladimir G Kim Thomas Funkhouser

Interactive Systems amp Hardware Wednesday 8 August 2-330 pm Position-Correcting Tools for 2D Digital Fabrication Alec Rivers Ilan E Moyer Freacutedo Durand

48

ISTC-VC SIGGRAPH Papers (cont)

Collisions Wednesday 8 August 345-535 pm Energy-Based Self-Collision Culling for Arbitrary Mesh Deformations Changxi Zheng Doug L James

All About Images

Thursday 9 August 9-1030 am A Framework for Content-Adaptive Photo Manipulation Macros Application to Face Landscape and Global Manipulations Floraine Berthouzoz Wilmot Li Mira Dontcheva Maneesh Agrawala

Sound and Elements

Thursday 9 August 9-1030 am Motion-Driven Concatenative Synthesis of Cloth Sounds Steven S An Doug L James Steve Marschner Precomputed Acceleration Noise for Improved Rigid-Body Sound Jeffrey N Chadwick Changxi Zheng Doug L James Interactive Sound Propagation Using Compact Acoustic Transfer Operators Lakulish Antani Anish Chandak Lauri Savioja Dinesh Manocha Updated Sparse Cholesky Factors for Corotational Elastodynamics Florian Hecht Yeon Jin Lee Jonathan R Shewchuk James F OrsquoBrien

49

ISTC-VC SIGGRAPH Papers (cont)

Geometry amp Viewing Thursday 9 August 2-330 pm Perceptual Models of Viewpoint Preference Adrian Secordm Jingwan Lu Adam Finkelstein Manish Singh Andrew Nealen

Faces and Hair [Closing Session]

Thursday 9 August 345-515 pm Coupled 3D Reconstruction of Sparse Facial Hair and Skin Thabo Beeler Bernd Bickel Gioacchino Noris Paul Beardsley Steve Marschner Robert W Sumner Markus Gross Physical Face Cloning Bernd Bickel Peter Kaufmann Melina Skouras Bernhard Thomaszewski Derek Bradley Thabo Beeler Philip Jackson Steve Marschner Wojciech Matusik Markus Gross

50

ISTC-VC SIGGRAPH Papers (cont)

Siggraph Courses Optimizing Realistic Rendering With Many-Light Methods Sunday 5 August 2-515 pm Jaroslav Krivanek Milos Hasan Adam Arbree Carsten Dachsbacher Alexander Keller Bruce Walter State of the Art in Photon-Density Estimation Thursday 9 August 2-515 pm Toshiya Hachisuka Wojciech Jarosz Guillaume Bouchard Per Christensen Jeppe Revall Frisvad Wenzel Jakob Henrik Wann Jensen Jared M Johnson Michael Kaschalk Claude Knaus Andrew Selle Ben Spencer

Siggraph Talks

Silence Eliminate the Noise Thursday 9 August 9-1030 am Importance Sampling for Hair Scattering Jiawei Ou Feng Xie Parashar Krishnamachari Fabio Pellacini

Siggraph Exhibitor Sessions

Intel Corporation Wednesday 8 August 430-530 pm room 402B The Future of Visual Computing as Viewed by Intel Visual Computing Research Centers

51

Other ISTC-VC SIGGRAPH Participation

Page 2: Future of Visual Computing as viewed by Intel Visual ... · PDF fileFuture of Visual Computing as viewed by Intel Visual Computing Research Centers ... Justin Rattner Intel Science

Intel Visual Computing Centers 2

Intel Labs Justin Rattner

Intel Science and Technology

Center for Visual Computing Engaging Academic Thought Leaders Within

North America and Europe to Drive Visual

Computing Advancement

Saarland

Intel Visual Computing Institute

SIGGRAPH IMPACT

~ 25 of Siggraph 2012 technical papers authored by participants in

one of the Visual Computing centers

3 httpvisualstanfordedublog

4 4 Intel Science and Technology Center for Visual Computing Stanford (Levoy Levis Hanrahan Fedkiw Koltun Horowitz Ousterhout Rosenblum )

UC Davis (Owens) UC Berkeley

(Agrawala Ramamoorthi OrsquoBrien Malik Shewchuk Zakhor)

Harvard (Pfister)

UWash (Popovic Seitz Curless Mones)

Cornell (D James Snavely Bala Marschner Greenberg)

Princeton (Funkhouser Rusinkeiwicz Finkelstein Freedman)

Content Creation Theme lead M Agrawala

1 ndash Data-Driven Modeling lead Vladlen Koltun

2 - Game-driven Creation lead Zoran Popovic

3 ndashRapid Animation lead Maneesh Agrawala

Graphics Systems Theme lead John Owens

1 ndash Computational Photography lead Marc Levoy

2 ndash Heterogeneous Pipelines lead John Owens

3 ndash Cloud-Scale Visual Game Support lead Philip Levis

4 ndash Exascale Visualization lead Hanspeter Pfister

Simulation Theme lead Doug James

1 ndash Scalable Visual Rendering lead R Ramamoorthi K Bala

2 ndash Real-time Physical Simulation lead Ron Fedkiw

3 ndash Physically Based Sound lead Doug James

4 ndash Simulated Virtual Characters a Appearance ndash lead Marschner b Performance - lead Koltun c Integration ndash lead OrsquoBrien

Perception Theme lead S Seitz

1 ndash Interior Capture and Modeling lead Noah Snavely

2 ndash Urban Semantic Capture Modeling lead Tom Funkhouser

3 ndash People Poses in Photos lead Jitendra Malik

4 ndash People Actions in Video lead Deva Ramanan

UC Irvine (Ramanan)

httpvisualstanfordedu

SIMULATED VIRTUAL CHARACTERS

bull Goal Dramatically advance the fidelity and behavior of virtual characters so that they look and perform believably in real-time simulated environments

bull Currently attacking two aspects bull Appearance (skin hair clothing) bull Control (autonomous motion

reaction interaction)

ISTC-VC website visualstanfordedu

Appearance of Virtual Characters Knit Woven Clothing

- Goal Build up physical model of cloth to support physically correct appearance and motion - PIs Steve Marschner Kavita Bala Doug James (Cornell) James OrsquoBrien (Berkeley)

Siggraph 2012 Papers - Stitch Meshes for Modeling Knitted Clothing With Yarn-level Detail Yuksel et al - Structure-Aware Synthesis for Predictive Woven Fabric Appearance Zhao et al

httpvisualstanfordedu

Appearance of Virtual Characters Knit Woven Clothing

Siggraph 2012 Papers - Stitch Meshes for Modeling Knitted Clothing With Yarn-level Detail Yuksel et al - Structure-Aware Synthesis for Predictive Woven Fabric Appearance Zhao et al

- Goal Build up physical model of cloth to support physically correct appearance and motion - PIs Steve Marschner Kavita Bala Doug James (Cornell) James OrsquoBrien (Berkeley)

httpvisualstanfordedu

Control of Virtual Characters Autonomous Behavior

- Goal Automate low-level actions such as walking carrying things dealing with obstacles etc - PIs Vladlen Koltun (Stanford) Zoran Popovic (UW)

Siggraph 2012 Papers - Optimizing Locomotion Controllers Using Biologically-Based Actuators and Objectives Wang et al - Discovery of Complex Behaviors through Contact-Invariant Optimization Mordatch et al

httpvisualstanfordedu

Control of Virtual Characters Autonomous Behavior

- Goal Automate low-level actions such as walking carrying things dealing with obstacles etc - Investigators Vladlen Koltun (Stanford) Zoran Popovic (UW)

Siggraph 2012 Papers - Optimizing Locomotion Controllers Using Biologically-Based Actuators and Objectives Wang et al - Discovery of Complex Behaviors through Contact-Invariant Optimization Mordatch et al - Continuous Character Control With Low-Dimensional Embeddings Levine et al

httpvisualstanfordedu

Physically-Based Sound

Widely reported in popular scientific media (NPR Science Friday BBC hellip)

bull Goal automatically generate sounds due to object interactions in the physical simulation of a virtual environment

bull PI Doug James (Cornell)

Siggraph 2012 Papers - Motion-Driven Concatenative Synthesis of Cloth Sounds An et al - Precomputed Acceleration Noise for Improved Rigid-Body Sound Chadwick et al

Data-Driven Modeling

Siggraph 2012 Papers - A Probabilistic Model for Component-Based Shape Synthesis Kalogerakis et al - An Algebraic Model for Parameterized Shape Editing Bokeloh et al

httpvisualstanfordedu

- Goal Capture the nature of a chair or an animal by analyzing large databases of similar objects to allow working with parts rather than polygons Make tools that enable users of all skill levels to produce custom high-quality content for virtual worlds - PIs Vladlen Koltun (Stanford) Tom Funkhouser (Princeton) Pat Hanrahan (Stanford)

Data-Driven Modeling

Siggraph 2012 Papers - A Probabilistic Model for Component-Based Shape Synthesis Kalogerakis et al - An Algebraic Model for Parameterized Shape Editing Bokeloh et al

httpvisualstanfordedu

- Goal Capture the nature of a chair or an animal by analyzing large databases of similar objects to allow working with parts rather than polygons Make tools that enable users of all skill levels to produce custom high-quality content for virtual worlds - PIs Vladlen Koltun (Stanford) Tom Funkhouser (Princeton) Pat Hanrahan (Stanford)

Intel Visual Computing Institute

httpswwwintel-university-collaborationnetpage_id=998

Saarbruumlcken Germany

An Open Collaborative Research Institute at the Saarland Campus

Multimodal

Computing

and

Interaction

IVCI Mission Facilitate the progress of Visual Computing research and be a driver towards highest

quality image real-time processing and interactive visualization

Virtual Worlds (Model-based)

Multimodal Scene Analysis amp Interaction

Real Worlds (Sample-based)

Intel VCI Vision Scalable Algorithms for

Real Time Realistic

Rendering

Compiler Support for

High Performance

Graphics

Collaborative Distributed Molecular

Modeling and Visualization

Efficient High Quality

Rendering Using Sample-based

Representations

Scalable Hybrid Rendering for

Large Scale Visualization

Marker-free Performance

Capture

Algorithms for Low Cost Depth

Imaging

Visualization and editing of light

transport

Internet Transport and Coding for 3D

HD-TV

Software- innovation for the Digital Enterprise

Kusanagi Coding and

Interaction for Networked Games

Multi Touch Interaction

Techniques for Mixed 2D and 3D Graphics Displays

Advanced Ray Tracing and Data-Flow

Processing for the 3D Internet

Intel VCI Projects-Based Organization

ECOUSS Efficient and open Compiler-

Framework for parallel Simulations

SCENE Novel Scene Representations for Rich

Networked Media

VERVE Vanquishing fear and apathy

through E-inclusion

Large Scale Visualization in the Internet of Displays

User-centric Video

Processing

Local Dimming for Edge-lit LED LCD-Monitors

SCI Institute Utah USA

Stanford University California USA

Research Collaboration

Consortium Members

User-Centric Video Processing Jan Kautz Christian Theobalt

bull Objective ndash Create new user experiences for capturing

editing and browsing

ndash Targets amateur video creators

bull Approach ndash Automatically identify spationdashtemporal and

semantic relationships withinbetween videos

ndash Leverage graph of these to drive UI and video processing

bull Expected results Capturing automatic stabilization and

enhancement

Editing edit semantic objects in videos

Browsing find semantically related videos

Remove the person in white

Video Inpainting in Dynamic Scenes amp Videoscape for moving through Internet Videos

Efficient High-Quality Rendering Using Sample-based Representations Elmar Eisemann

bull Realistic Rendering ndash Lens Flare [Siggraphrsquo11]

ndash Depth-of-field [Eurographics lsquo11]

ndash Global Illumination [PGrsquo11]

bull Perceptual Rendering ndash Stereo

ndash High Dynamic Range

bull Alternative representations ndash Voxel Data

ndash Height Fields

3D Internet Interactive 3D Content on the Web Philipp Slusallek

bull XML3D Scene Description ndash HTML-5 extension for interactive graphics

ndash JS implementation amp built into the browser

ndash Reuses Web Technology (DOM CSS JS)

bull XFLOW Parallel Processing ndash Data-parallel flowgraph for XML3D

ndash Animations image amp geometry processing

ndash Configuration within the DOM

bull Results ndash W3C standardization ldquoDeclarative 3D for the Webrdquo

ndash Rich media apps for BMW SLS-Museum hellip

3D-Internet Apps SLS-Museum 3D-Installation amp Museum with Interactive Virtual Characters

3D-Internet Apps Using OpenStreetMap-3D as Shared Virtual Worlds

Fully automatically generated from OpenStreet Map Taking semantic data into acount

Marker-free Performance Capture Christian Theobalt

bull Reconstruction of detailed human animation models ndash In Multi-view video without markers

ndash Out Detailed motion shape and appearance

ndash General clothing modifiable performances new animations

bull Real-time performance capture ndash Fast full-body motion estimation from depth

cameras

ndash Interaction

ndash Collaboration with Intel Magic Mirror project

[ICCV 2011]

[SIGGRAPH Asia 2010]

Markerless Motion Capture of Interacting Characters Using Multi-view Image Segmentation

Articulated Models Input silhouettes Segmentation Contour labels Estimated surface Estimated 3D models

Handling Intersections

Improved segmentation with 3D shape priors Excellent performance when evaluated against marker-based system

bull Interactive inspection of light transport in virtual scenes ndash You can only manipulate what you see

ndash First prototypal light manipulation tools

bull Efficient global illumination ndash Otherwise no interactive

visualization nor manipulation

ndash Improvements on many-lights methods and progressive photon mapping

bull Results ndash Demonstrator Maya plugin ndash Collaboration with local film academy

Visualization and Editing of Light Transport Carsten Dachsbacher

Advanced Real-Time Ray Tracing Techniques Philipp Slusallek

bull Perfect importance sampling and caching ndash Sparse but perfect importance sampling

ndash Caching and interpolation [Eurographics`12]

bull Unifying Photon-Mapping amp Monte-Carlo ndash Formulating PM as a MC process

ndash Per pixel combination using MIS

bull Data-parallel implementations

ndash Efficiency and performance

bull Integration into XML3D

ndash Provide ldquocorrectrdquo results by default

Vertex Merging with Multiple Importance Sampling Photon-Mapping as a Monte-Carlo Process

BPT

PPM Progressive Photon-Mapping (PPM)

Bidirectional Path Tracing (BPT)

bull Whole-Function Vectorization ndash Restore scalar computations

ndash LLVM platform-independent

ndash RenderMan frontend OpenCL driver

bull Vector Programming ndash Formalized C extension for portable

effective SIMD programming

ndash Type system triggers vectorization

ndash Data layout adaption

bull New Programming Models for High-Performance Graphics

bull Results ndash Demonstrators for shaders and HPC code

ndash CC++-Extensions (with Intel)

ndash OpenCL compiler (CPU)

Compiler Support for High-Performance Graphics Sebastian Hack

bull Hybrid Rendering ndash Client amp Server Model

ndash Smartphone to Mainframe

bull Large Data Processing ndash Scalable Hierarchical

RW Data Structures

bull Results ndash ZAPP displaywall demonstrator

ndash ImageVis3D (Mobile) demonstrator

ndash Practically use in hospitals

Scalable Hybrid Rendering for Large Scale Visualization Jens Kruumlger

Displays as a Service Large Scale Visualization Alexander Loumlffler

bull Virtualization of Displays ndash Virtual Framebuffer and Displays exposed to Internet

ndash Replacing cables by switched IP network

ndash Internet standards for video encoding and streaming

bull Fully Synchronized ndash 120 Hz active stereo sync over IP

ndash Accuracy of ~100us in software

ndash Drives GPU displays output

bull Results ndash 20-screen wall demonstrator

ndash 3-screen wall (thin-bezel)

ndash CE4100 based SW synchronization

SIGGRAPH 2012

Backup

The Intel Science and Technology Center (ISTC) and Intel Collaborative Research Institute (ICRI) Programs

35

The modern economy is an information economy and one that is driven by innovations that enhance productivity as well as create new modes of entertainment We need to invest in the basic research that will inspire future products and services and ensure long term health of our information economy Government and private foundations are helping but corporate America needs to step up and increase commitments to university research - Justin Rattner ndash Intel CTO

$140M investment over 5 years announced by Intel in 2011 and 2012

Centers of Excellence bull Each ISTC and ICRI will focus on one

research area eg visual computing secure computing

bull The ISTCs and ICRIs are meant to bring the best and brightest researchers across the US together

bull Each ISTC and ICRI will be led by a host university and will include thought leaders from other schools

Breaking Barriers to Collaboration

bull Open IP models and open source software to encourage free information exchange (In most of the Centers)

bull Favor projects that span multiple institutions to encourage collaboration among universities

bull Intel researches per center assigned to work on-campus to encourage collaboration between Intel and academia

Greater Impact to Future Tech bull Center research themes to

address essential needs of computing technology

bull Research agendas jointly defined and co-led by an Intel and a University Principal Investigator

bull After completing 3-5 year charters new ISTCs and ICRIs can be formed to respond to changing tech environment

httpfolditportal

Serious Gaming pplied to Content Creation

Highlighted by President Obama Winner of most-significant new visualization tool (NSF)

Goal Create high-quality content by casting creation activities as games in which large numbers of people are incentivized to perform simple tasks which in combination yield sophisticated content PIs Zoran Popovic (UW) Noah Snavely (Cornell) Maneesh Agrawala(Berkeley)

Determining the structure of retroviral protease (HIV)

Video Frank to add Papers Frank to add

Extracting Structure and Semantics

CAD Model Points

Structures

People

Goals Enable context aware computing and automated content creation through the capture analysis and manipulation of real-world visual data PIs Steve Seitz (UW) Noah Snavely (Cornell) Tom Funkhouser (Princeton) Vladlen Koltun (Stanford) Jitendra Malik (Berkeley) Deva Ramanan (UV Irvine)

Video Frank to add Papers Frank to add

httpvisualstanfordedu

Computational Photography (Franken Camera)

Being adopted as a standard API for cellphone camera systems (Apple Android)

bull Goal Develop algorithms languages architectures and prototypes demonstrating the use of computation in the process of image capture and display

bull PIs Marc Levoy (Stanford) Mark Horowitz (Stanford) Pat Hanrahan (Stanford)

Video Frank to add Papers Frank to add

ISTC-VC SIGGRAPH Papers

Character Locomotion Monday 6 August 900 AM - 1030 AM Optimizing Locomotion Controllers Using Biologically Based Actuators and Objectives Jack M Wang Samuel R Hamner Scott L Delp Vladlen Koltun Continuous Character Control With Low-Dimensional Embeddings Sergey Levine Jack M Wang Alexis Haraux Zoran Popović Vladlen Koltun Shape Analysis Monday 6 August 900 AM - 1030 AM Schelling Points on 3D Surface Meshes Xiaobai Chen Abulhair Saparov Bill Pang Thomas Funkhouser Shape Transformation Wednesday 8 August 900 - 1030 AM An Algebraic Model for Parameterized Shape Editing Martin Bokeloh Michael Wand Hans-Peter Seidel Vladlen Koltun

42

ISTC-VC SIGGRAPH Papers

Image Processing Monday 6 August 2- 330 pm Decoupling Algorithms From Schedules for Easy Optimization of Image-Processing Pipelines Jonathan Ragan-Kelley Andrew Adams Sylvain Paris Marc Levoy Saman Amarasinghe Freacutedo Durand

Cloth

Monday 6 August 2-330 pm Specular Reflection From Woven Cloth Piti Irawan Steve Marschner Stitch Meshes for Modeling Knitted Clothing With Yarn-level Detail Cem Yuksel Jonathan M Kaldor Doug L James Steve Marschner

Appearance

Monday 6 August 345-535 pm Printing Spatially Varying Reflectance for Reproducing HDR Images Yue Dong Xin Tong Fabio Pellacini Baining Guo

43

ISTC-VC SIGGRAPH Papers (cont)

Hand Eye and Face Monday 6 August 345-535 pm Session Chair - Vladlen Koltun Discovery of Complex Behaviors through Contact-Invariant Optimization Igor Mordatch Emanuel Todorov Zoran Popovi1049029 Sketching Monday 6 August 345-535 pm HelpingHand Example-Based Stroke Stylization Jingwan Lu Fisher Yu Adam Finkelstein Stephen DiVerdi Fabrication Tuesday 7 August 9-1030 am Fabricating Articulated Characters From Skinned Meshes Moritz Baumlcher Bernd Bickel Doug L James Hanspeter Pfister

44

Sampling Reconstructing and Filtering Light Tuesday 7 August 1045 am-1215 pm A Theory of Monte Carlo Visibility Sampling Ravi Ramamoorthi John Anderson Mark Meyer Derek Nowrouzezahrai Reconstructing the Indirect Light Field for Global Illumination Jaakko Lehtinen Timo Aila Samuli Laine Freacutedo Durand

Geometry Reconstruction amp Tracking

Tuesday 7 August 1045 am-1215 pm Temporally Coherent Completion of Dynamic Shapes Hao Li Linjie Luo Daniel Vlasic Pieter Peers Jovan Popovic Mark Pauly Szymon Rusinkiewicz

Sets of Shapes

Tuesday 7 August 2-330 pm Exploring Collections of 3D Models Using Fuzzy Correspondence Vladimir G Kim Wilmot Li Niloy J Mitra Stephen DiVerdi Thomas Funkhouser A Probabilistic Model for Component-Based Shape Synthesis Evangelos Kalogerakis Siddhartha Chaudhuri Daphne Koller Vladlen Koltun

45

ISTC-VC SIGGRAPH Papers (cont)

Light Rays Tuesday 7 August 2-330 pm Manifold Exploration A Markov Chain Monte Carlo Technique for Rendering Scenes With Difficult Specular Transport Wenzel Jakob Steve Marschner Bidirectional Lightcuts Bruce Walter Pramook Khungurn Kavita Bala

Fun With Video

Tuesday 7 August 345-535 pm Session Chair Noah Snavely Video Deblurring for Hand-Held Cameras Using Patch-Based Synthesis Sunghyun Cho Jue Wang Seungyong Lee Eulerian Video Magnification for Revealing Subtle Changes in the World Hao-Yu Wu Michael Rubinstein Eugene Shih John Guttag Freacutedo Durand William T Freeman Selectively De-Animating Video Jiamin Bai Aseem Agarwala Maneesh Agrawala Ravi Ramamoorthi Tools for Placing Cuts and Transitions in Interview Video Floraine Berthouzoz Wilmot Li Maneesh Agrawala

46

ISTC-VC SIGGRAPH Papers (cont)

Noise and Texture Tuesday 7 August 345-535 pm Structure-Aware Synthesis for Predictive Woven Fabric Appearance Shuang Zhao Kavita Bala Steve Marschner Wenzel Jakob Symmetry-Guided Texture Synthesis and Manipulation Vladimir Kim Yaron Lipman Thomas Funkhouser

Shape Transformation Wednesday 8 August 900 - 1030 AM An Algebraic Model for Parameterized Shape Editing Martin Bokeloh Michael Wand Hans-Peter Seidel Vladlen Koltun

Stitching

Wednesday 8 August 1045 am-1215 pm Exposing Photo Manipulation With Inconsistent Reflections James F OrsquoBrien Hany Farid

47

ISTC-VC SIGGRAPH Papers (cont)

Maps Surfaces and Shapes

Wednesday 8 August 1045 am-1215 pm Simple Formulas For Quasiconformal Plane Deformations Yaron Lipman Vladimir G Kim Thomas Funkhouser

Interactive Systems amp Hardware Wednesday 8 August 2-330 pm Position-Correcting Tools for 2D Digital Fabrication Alec Rivers Ilan E Moyer Freacutedo Durand

48

ISTC-VC SIGGRAPH Papers (cont)

Collisions Wednesday 8 August 345-535 pm Energy-Based Self-Collision Culling for Arbitrary Mesh Deformations Changxi Zheng Doug L James

All About Images

Thursday 9 August 9-1030 am A Framework for Content-Adaptive Photo Manipulation Macros Application to Face Landscape and Global Manipulations Floraine Berthouzoz Wilmot Li Mira Dontcheva Maneesh Agrawala

Sound and Elements

Thursday 9 August 9-1030 am Motion-Driven Concatenative Synthesis of Cloth Sounds Steven S An Doug L James Steve Marschner Precomputed Acceleration Noise for Improved Rigid-Body Sound Jeffrey N Chadwick Changxi Zheng Doug L James Interactive Sound Propagation Using Compact Acoustic Transfer Operators Lakulish Antani Anish Chandak Lauri Savioja Dinesh Manocha Updated Sparse Cholesky Factors for Corotational Elastodynamics Florian Hecht Yeon Jin Lee Jonathan R Shewchuk James F OrsquoBrien

49

ISTC-VC SIGGRAPH Papers (cont)

Geometry amp Viewing Thursday 9 August 2-330 pm Perceptual Models of Viewpoint Preference Adrian Secordm Jingwan Lu Adam Finkelstein Manish Singh Andrew Nealen

Faces and Hair [Closing Session]

Thursday 9 August 345-515 pm Coupled 3D Reconstruction of Sparse Facial Hair and Skin Thabo Beeler Bernd Bickel Gioacchino Noris Paul Beardsley Steve Marschner Robert W Sumner Markus Gross Physical Face Cloning Bernd Bickel Peter Kaufmann Melina Skouras Bernhard Thomaszewski Derek Bradley Thabo Beeler Philip Jackson Steve Marschner Wojciech Matusik Markus Gross

50

ISTC-VC SIGGRAPH Papers (cont)

Siggraph Courses Optimizing Realistic Rendering With Many-Light Methods Sunday 5 August 2-515 pm Jaroslav Krivanek Milos Hasan Adam Arbree Carsten Dachsbacher Alexander Keller Bruce Walter State of the Art in Photon-Density Estimation Thursday 9 August 2-515 pm Toshiya Hachisuka Wojciech Jarosz Guillaume Bouchard Per Christensen Jeppe Revall Frisvad Wenzel Jakob Henrik Wann Jensen Jared M Johnson Michael Kaschalk Claude Knaus Andrew Selle Ben Spencer

Siggraph Talks

Silence Eliminate the Noise Thursday 9 August 9-1030 am Importance Sampling for Hair Scattering Jiawei Ou Feng Xie Parashar Krishnamachari Fabio Pellacini

Siggraph Exhibitor Sessions

Intel Corporation Wednesday 8 August 430-530 pm room 402B The Future of Visual Computing as Viewed by Intel Visual Computing Research Centers

51

Other ISTC-VC SIGGRAPH Participation

Page 3: Future of Visual Computing as viewed by Intel Visual ... · PDF fileFuture of Visual Computing as viewed by Intel Visual Computing Research Centers ... Justin Rattner Intel Science

SIGGRAPH IMPACT

~ 25 of Siggraph 2012 technical papers authored by participants in

one of the Visual Computing centers

3 httpvisualstanfordedublog

4 4 Intel Science and Technology Center for Visual Computing Stanford (Levoy Levis Hanrahan Fedkiw Koltun Horowitz Ousterhout Rosenblum )

UC Davis (Owens) UC Berkeley

(Agrawala Ramamoorthi OrsquoBrien Malik Shewchuk Zakhor)

Harvard (Pfister)

UWash (Popovic Seitz Curless Mones)

Cornell (D James Snavely Bala Marschner Greenberg)

Princeton (Funkhouser Rusinkeiwicz Finkelstein Freedman)

Content Creation Theme lead M Agrawala

1 ndash Data-Driven Modeling lead Vladlen Koltun

2 - Game-driven Creation lead Zoran Popovic

3 ndashRapid Animation lead Maneesh Agrawala

Graphics Systems Theme lead John Owens

1 ndash Computational Photography lead Marc Levoy

2 ndash Heterogeneous Pipelines lead John Owens

3 ndash Cloud-Scale Visual Game Support lead Philip Levis

4 ndash Exascale Visualization lead Hanspeter Pfister

Simulation Theme lead Doug James

1 ndash Scalable Visual Rendering lead R Ramamoorthi K Bala

2 ndash Real-time Physical Simulation lead Ron Fedkiw

3 ndash Physically Based Sound lead Doug James

4 ndash Simulated Virtual Characters a Appearance ndash lead Marschner b Performance - lead Koltun c Integration ndash lead OrsquoBrien

Perception Theme lead S Seitz

1 ndash Interior Capture and Modeling lead Noah Snavely

2 ndash Urban Semantic Capture Modeling lead Tom Funkhouser

3 ndash People Poses in Photos lead Jitendra Malik

4 ndash People Actions in Video lead Deva Ramanan

UC Irvine (Ramanan)

httpvisualstanfordedu

SIMULATED VIRTUAL CHARACTERS

bull Goal Dramatically advance the fidelity and behavior of virtual characters so that they look and perform believably in real-time simulated environments

bull Currently attacking two aspects bull Appearance (skin hair clothing) bull Control (autonomous motion

reaction interaction)

ISTC-VC website visualstanfordedu

Appearance of Virtual Characters Knit Woven Clothing

- Goal Build up physical model of cloth to support physically correct appearance and motion - PIs Steve Marschner Kavita Bala Doug James (Cornell) James OrsquoBrien (Berkeley)

Siggraph 2012 Papers - Stitch Meshes for Modeling Knitted Clothing With Yarn-level Detail Yuksel et al - Structure-Aware Synthesis for Predictive Woven Fabric Appearance Zhao et al

httpvisualstanfordedu

Appearance of Virtual Characters Knit Woven Clothing

Siggraph 2012 Papers - Stitch Meshes for Modeling Knitted Clothing With Yarn-level Detail Yuksel et al - Structure-Aware Synthesis for Predictive Woven Fabric Appearance Zhao et al

- Goal Build up physical model of cloth to support physically correct appearance and motion - PIs Steve Marschner Kavita Bala Doug James (Cornell) James OrsquoBrien (Berkeley)

httpvisualstanfordedu

Control of Virtual Characters Autonomous Behavior

- Goal Automate low-level actions such as walking carrying things dealing with obstacles etc - PIs Vladlen Koltun (Stanford) Zoran Popovic (UW)

Siggraph 2012 Papers - Optimizing Locomotion Controllers Using Biologically-Based Actuators and Objectives Wang et al - Discovery of Complex Behaviors through Contact-Invariant Optimization Mordatch et al

httpvisualstanfordedu

Control of Virtual Characters Autonomous Behavior

- Goal Automate low-level actions such as walking carrying things dealing with obstacles etc - Investigators Vladlen Koltun (Stanford) Zoran Popovic (UW)

Siggraph 2012 Papers - Optimizing Locomotion Controllers Using Biologically-Based Actuators and Objectives Wang et al - Discovery of Complex Behaviors through Contact-Invariant Optimization Mordatch et al - Continuous Character Control With Low-Dimensional Embeddings Levine et al

httpvisualstanfordedu

Physically-Based Sound

Widely reported in popular scientific media (NPR Science Friday BBC hellip)

bull Goal automatically generate sounds due to object interactions in the physical simulation of a virtual environment

bull PI Doug James (Cornell)

Siggraph 2012 Papers - Motion-Driven Concatenative Synthesis of Cloth Sounds An et al - Precomputed Acceleration Noise for Improved Rigid-Body Sound Chadwick et al

Data-Driven Modeling

Siggraph 2012 Papers - A Probabilistic Model for Component-Based Shape Synthesis Kalogerakis et al - An Algebraic Model for Parameterized Shape Editing Bokeloh et al

httpvisualstanfordedu

- Goal Capture the nature of a chair or an animal by analyzing large databases of similar objects to allow working with parts rather than polygons Make tools that enable users of all skill levels to produce custom high-quality content for virtual worlds - PIs Vladlen Koltun (Stanford) Tom Funkhouser (Princeton) Pat Hanrahan (Stanford)

Data-Driven Modeling

Siggraph 2012 Papers - A Probabilistic Model for Component-Based Shape Synthesis Kalogerakis et al - An Algebraic Model for Parameterized Shape Editing Bokeloh et al

httpvisualstanfordedu

- Goal Capture the nature of a chair or an animal by analyzing large databases of similar objects to allow working with parts rather than polygons Make tools that enable users of all skill levels to produce custom high-quality content for virtual worlds - PIs Vladlen Koltun (Stanford) Tom Funkhouser (Princeton) Pat Hanrahan (Stanford)

Intel Visual Computing Institute

httpswwwintel-university-collaborationnetpage_id=998

Saarbruumlcken Germany

An Open Collaborative Research Institute at the Saarland Campus

Multimodal

Computing

and

Interaction

IVCI Mission Facilitate the progress of Visual Computing research and be a driver towards highest

quality image real-time processing and interactive visualization

Virtual Worlds (Model-based)

Multimodal Scene Analysis amp Interaction

Real Worlds (Sample-based)

Intel VCI Vision Scalable Algorithms for

Real Time Realistic

Rendering

Compiler Support for

High Performance

Graphics

Collaborative Distributed Molecular

Modeling and Visualization

Efficient High Quality

Rendering Using Sample-based

Representations

Scalable Hybrid Rendering for

Large Scale Visualization

Marker-free Performance

Capture

Algorithms for Low Cost Depth

Imaging

Visualization and editing of light

transport

Internet Transport and Coding for 3D

HD-TV

Software- innovation for the Digital Enterprise

Kusanagi Coding and

Interaction for Networked Games

Multi Touch Interaction

Techniques for Mixed 2D and 3D Graphics Displays

Advanced Ray Tracing and Data-Flow

Processing for the 3D Internet

Intel VCI Projects-Based Organization

ECOUSS Efficient and open Compiler-

Framework for parallel Simulations

SCENE Novel Scene Representations for Rich

Networked Media

VERVE Vanquishing fear and apathy

through E-inclusion

Large Scale Visualization in the Internet of Displays

User-centric Video

Processing

Local Dimming for Edge-lit LED LCD-Monitors

SCI Institute Utah USA

Stanford University California USA

Research Collaboration

Consortium Members

User-Centric Video Processing Jan Kautz Christian Theobalt

bull Objective ndash Create new user experiences for capturing

editing and browsing

ndash Targets amateur video creators

bull Approach ndash Automatically identify spationdashtemporal and

semantic relationships withinbetween videos

ndash Leverage graph of these to drive UI and video processing

bull Expected results Capturing automatic stabilization and

enhancement

Editing edit semantic objects in videos

Browsing find semantically related videos

Remove the person in white

Video Inpainting in Dynamic Scenes amp Videoscape for moving through Internet Videos

Efficient High-Quality Rendering Using Sample-based Representations Elmar Eisemann

bull Realistic Rendering ndash Lens Flare [Siggraphrsquo11]

ndash Depth-of-field [Eurographics lsquo11]

ndash Global Illumination [PGrsquo11]

bull Perceptual Rendering ndash Stereo

ndash High Dynamic Range

bull Alternative representations ndash Voxel Data

ndash Height Fields

3D Internet Interactive 3D Content on the Web Philipp Slusallek

bull XML3D Scene Description ndash HTML-5 extension for interactive graphics

ndash JS implementation amp built into the browser

ndash Reuses Web Technology (DOM CSS JS)

bull XFLOW Parallel Processing ndash Data-parallel flowgraph for XML3D

ndash Animations image amp geometry processing

ndash Configuration within the DOM

bull Results ndash W3C standardization ldquoDeclarative 3D for the Webrdquo

ndash Rich media apps for BMW SLS-Museum hellip

3D-Internet Apps SLS-Museum 3D-Installation amp Museum with Interactive Virtual Characters

3D-Internet Apps Using OpenStreetMap-3D as Shared Virtual Worlds

Fully automatically generated from OpenStreet Map Taking semantic data into acount

Marker-free Performance Capture Christian Theobalt

bull Reconstruction of detailed human animation models ndash In Multi-view video without markers

ndash Out Detailed motion shape and appearance

ndash General clothing modifiable performances new animations

bull Real-time performance capture ndash Fast full-body motion estimation from depth

cameras

ndash Interaction

ndash Collaboration with Intel Magic Mirror project

[ICCV 2011]

[SIGGRAPH Asia 2010]

Markerless Motion Capture of Interacting Characters Using Multi-view Image Segmentation

Articulated Models Input silhouettes Segmentation Contour labels Estimated surface Estimated 3D models

Handling Intersections

Improved segmentation with 3D shape priors Excellent performance when evaluated against marker-based system

bull Interactive inspection of light transport in virtual scenes ndash You can only manipulate what you see

ndash First prototypal light manipulation tools

bull Efficient global illumination ndash Otherwise no interactive

visualization nor manipulation

ndash Improvements on many-lights methods and progressive photon mapping

bull Results ndash Demonstrator Maya plugin ndash Collaboration with local film academy

Visualization and Editing of Light Transport Carsten Dachsbacher

Advanced Real-Time Ray Tracing Techniques Philipp Slusallek

bull Perfect importance sampling and caching ndash Sparse but perfect importance sampling

ndash Caching and interpolation [Eurographics`12]

bull Unifying Photon-Mapping amp Monte-Carlo ndash Formulating PM as a MC process

ndash Per pixel combination using MIS

bull Data-parallel implementations

ndash Efficiency and performance

bull Integration into XML3D

ndash Provide ldquocorrectrdquo results by default

Vertex Merging with Multiple Importance Sampling Photon-Mapping as a Monte-Carlo Process

BPT

PPM Progressive Photon-Mapping (PPM)

Bidirectional Path Tracing (BPT)

bull Whole-Function Vectorization ndash Restore scalar computations

ndash LLVM platform-independent

ndash RenderMan frontend OpenCL driver

bull Vector Programming ndash Formalized C extension for portable

effective SIMD programming

ndash Type system triggers vectorization

ndash Data layout adaption

bull New Programming Models for High-Performance Graphics

bull Results ndash Demonstrators for shaders and HPC code

ndash CC++-Extensions (with Intel)

ndash OpenCL compiler (CPU)

Compiler Support for High-Performance Graphics Sebastian Hack

bull Hybrid Rendering ndash Client amp Server Model

ndash Smartphone to Mainframe

bull Large Data Processing ndash Scalable Hierarchical

RW Data Structures

bull Results ndash ZAPP displaywall demonstrator

ndash ImageVis3D (Mobile) demonstrator

ndash Practically use in hospitals

Scalable Hybrid Rendering for Large Scale Visualization Jens Kruumlger

Displays as a Service Large Scale Visualization Alexander Loumlffler

bull Virtualization of Displays ndash Virtual Framebuffer and Displays exposed to Internet

ndash Replacing cables by switched IP network

ndash Internet standards for video encoding and streaming

bull Fully Synchronized ndash 120 Hz active stereo sync over IP

ndash Accuracy of ~100us in software

ndash Drives GPU displays output

bull Results ndash 20-screen wall demonstrator

ndash 3-screen wall (thin-bezel)

ndash CE4100 based SW synchronization

SIGGRAPH 2012

Backup

The Intel Science and Technology Center (ISTC) and Intel Collaborative Research Institute (ICRI) Programs

35

The modern economy is an information economy and one that is driven by innovations that enhance productivity as well as create new modes of entertainment We need to invest in the basic research that will inspire future products and services and ensure long term health of our information economy Government and private foundations are helping but corporate America needs to step up and increase commitments to university research - Justin Rattner ndash Intel CTO

$140M investment over 5 years announced by Intel in 2011 and 2012

Centers of Excellence bull Each ISTC and ICRI will focus on one

research area eg visual computing secure computing

bull The ISTCs and ICRIs are meant to bring the best and brightest researchers across the US together

bull Each ISTC and ICRI will be led by a host university and will include thought leaders from other schools

Breaking Barriers to Collaboration

bull Open IP models and open source software to encourage free information exchange (In most of the Centers)

bull Favor projects that span multiple institutions to encourage collaboration among universities

bull Intel researches per center assigned to work on-campus to encourage collaboration between Intel and academia

Greater Impact to Future Tech bull Center research themes to

address essential needs of computing technology

bull Research agendas jointly defined and co-led by an Intel and a University Principal Investigator

bull After completing 3-5 year charters new ISTCs and ICRIs can be formed to respond to changing tech environment

httpfolditportal

Serious Gaming pplied to Content Creation

Highlighted by President Obama Winner of most-significant new visualization tool (NSF)

Goal Create high-quality content by casting creation activities as games in which large numbers of people are incentivized to perform simple tasks which in combination yield sophisticated content PIs Zoran Popovic (UW) Noah Snavely (Cornell) Maneesh Agrawala(Berkeley)

Determining the structure of retroviral protease (HIV)

Video Frank to add Papers Frank to add

Extracting Structure and Semantics

CAD Model Points

Structures

People

Goals Enable context aware computing and automated content creation through the capture analysis and manipulation of real-world visual data PIs Steve Seitz (UW) Noah Snavely (Cornell) Tom Funkhouser (Princeton) Vladlen Koltun (Stanford) Jitendra Malik (Berkeley) Deva Ramanan (UV Irvine)

Video Frank to add Papers Frank to add

httpvisualstanfordedu

Computational Photography (Franken Camera)

Being adopted as a standard API for cellphone camera systems (Apple Android)

bull Goal Develop algorithms languages architectures and prototypes demonstrating the use of computation in the process of image capture and display

bull PIs Marc Levoy (Stanford) Mark Horowitz (Stanford) Pat Hanrahan (Stanford)

Video Frank to add Papers Frank to add

ISTC-VC SIGGRAPH Papers

Character Locomotion Monday 6 August 900 AM - 1030 AM Optimizing Locomotion Controllers Using Biologically Based Actuators and Objectives Jack M Wang Samuel R Hamner Scott L Delp Vladlen Koltun Continuous Character Control With Low-Dimensional Embeddings Sergey Levine Jack M Wang Alexis Haraux Zoran Popović Vladlen Koltun Shape Analysis Monday 6 August 900 AM - 1030 AM Schelling Points on 3D Surface Meshes Xiaobai Chen Abulhair Saparov Bill Pang Thomas Funkhouser Shape Transformation Wednesday 8 August 900 - 1030 AM An Algebraic Model for Parameterized Shape Editing Martin Bokeloh Michael Wand Hans-Peter Seidel Vladlen Koltun

42

ISTC-VC SIGGRAPH Papers

Image Processing Monday 6 August 2- 330 pm Decoupling Algorithms From Schedules for Easy Optimization of Image-Processing Pipelines Jonathan Ragan-Kelley Andrew Adams Sylvain Paris Marc Levoy Saman Amarasinghe Freacutedo Durand

Cloth

Monday 6 August 2-330 pm Specular Reflection From Woven Cloth Piti Irawan Steve Marschner Stitch Meshes for Modeling Knitted Clothing With Yarn-level Detail Cem Yuksel Jonathan M Kaldor Doug L James Steve Marschner

Appearance

Monday 6 August 345-535 pm Printing Spatially Varying Reflectance for Reproducing HDR Images Yue Dong Xin Tong Fabio Pellacini Baining Guo

43

ISTC-VC SIGGRAPH Papers (cont)

Hand Eye and Face Monday 6 August 345-535 pm Session Chair - Vladlen Koltun Discovery of Complex Behaviors through Contact-Invariant Optimization Igor Mordatch Emanuel Todorov Zoran Popovi1049029 Sketching Monday 6 August 345-535 pm HelpingHand Example-Based Stroke Stylization Jingwan Lu Fisher Yu Adam Finkelstein Stephen DiVerdi Fabrication Tuesday 7 August 9-1030 am Fabricating Articulated Characters From Skinned Meshes Moritz Baumlcher Bernd Bickel Doug L James Hanspeter Pfister

44

Sampling Reconstructing and Filtering Light Tuesday 7 August 1045 am-1215 pm A Theory of Monte Carlo Visibility Sampling Ravi Ramamoorthi John Anderson Mark Meyer Derek Nowrouzezahrai Reconstructing the Indirect Light Field for Global Illumination Jaakko Lehtinen Timo Aila Samuli Laine Freacutedo Durand

Geometry Reconstruction amp Tracking

Tuesday 7 August 1045 am-1215 pm Temporally Coherent Completion of Dynamic Shapes Hao Li Linjie Luo Daniel Vlasic Pieter Peers Jovan Popovic Mark Pauly Szymon Rusinkiewicz

Sets of Shapes

Tuesday 7 August 2-330 pm Exploring Collections of 3D Models Using Fuzzy Correspondence Vladimir G Kim Wilmot Li Niloy J Mitra Stephen DiVerdi Thomas Funkhouser A Probabilistic Model for Component-Based Shape Synthesis Evangelos Kalogerakis Siddhartha Chaudhuri Daphne Koller Vladlen Koltun

45

ISTC-VC SIGGRAPH Papers (cont)

Light Rays Tuesday 7 August 2-330 pm Manifold Exploration A Markov Chain Monte Carlo Technique for Rendering Scenes With Difficult Specular Transport Wenzel Jakob Steve Marschner Bidirectional Lightcuts Bruce Walter Pramook Khungurn Kavita Bala

Fun With Video

Tuesday 7 August 345-535 pm Session Chair Noah Snavely Video Deblurring for Hand-Held Cameras Using Patch-Based Synthesis Sunghyun Cho Jue Wang Seungyong Lee Eulerian Video Magnification for Revealing Subtle Changes in the World Hao-Yu Wu Michael Rubinstein Eugene Shih John Guttag Freacutedo Durand William T Freeman Selectively De-Animating Video Jiamin Bai Aseem Agarwala Maneesh Agrawala Ravi Ramamoorthi Tools for Placing Cuts and Transitions in Interview Video Floraine Berthouzoz Wilmot Li Maneesh Agrawala

46

ISTC-VC SIGGRAPH Papers (cont)

Noise and Texture Tuesday 7 August 345-535 pm Structure-Aware Synthesis for Predictive Woven Fabric Appearance Shuang Zhao Kavita Bala Steve Marschner Wenzel Jakob Symmetry-Guided Texture Synthesis and Manipulation Vladimir Kim Yaron Lipman Thomas Funkhouser

Shape Transformation Wednesday 8 August 900 - 1030 AM An Algebraic Model for Parameterized Shape Editing Martin Bokeloh Michael Wand Hans-Peter Seidel Vladlen Koltun

Stitching

Wednesday 8 August 1045 am-1215 pm Exposing Photo Manipulation With Inconsistent Reflections James F OrsquoBrien Hany Farid

47

ISTC-VC SIGGRAPH Papers (cont)

Maps Surfaces and Shapes

Wednesday 8 August 1045 am-1215 pm Simple Formulas For Quasiconformal Plane Deformations Yaron Lipman Vladimir G Kim Thomas Funkhouser

Interactive Systems amp Hardware Wednesday 8 August 2-330 pm Position-Correcting Tools for 2D Digital Fabrication Alec Rivers Ilan E Moyer Freacutedo Durand

48

ISTC-VC SIGGRAPH Papers (cont)

Collisions Wednesday 8 August 345-535 pm Energy-Based Self-Collision Culling for Arbitrary Mesh Deformations Changxi Zheng Doug L James

All About Images

Thursday 9 August 9-1030 am A Framework for Content-Adaptive Photo Manipulation Macros Application to Face Landscape and Global Manipulations Floraine Berthouzoz Wilmot Li Mira Dontcheva Maneesh Agrawala

Sound and Elements

Thursday 9 August 9-1030 am Motion-Driven Concatenative Synthesis of Cloth Sounds Steven S An Doug L James Steve Marschner Precomputed Acceleration Noise for Improved Rigid-Body Sound Jeffrey N Chadwick Changxi Zheng Doug L James Interactive Sound Propagation Using Compact Acoustic Transfer Operators Lakulish Antani Anish Chandak Lauri Savioja Dinesh Manocha Updated Sparse Cholesky Factors for Corotational Elastodynamics Florian Hecht Yeon Jin Lee Jonathan R Shewchuk James F OrsquoBrien

49

ISTC-VC SIGGRAPH Papers (cont)

Geometry amp Viewing Thursday 9 August 2-330 pm Perceptual Models of Viewpoint Preference Adrian Secordm Jingwan Lu Adam Finkelstein Manish Singh Andrew Nealen

Faces and Hair [Closing Session]

Thursday 9 August 345-515 pm Coupled 3D Reconstruction of Sparse Facial Hair and Skin Thabo Beeler Bernd Bickel Gioacchino Noris Paul Beardsley Steve Marschner Robert W Sumner Markus Gross Physical Face Cloning Bernd Bickel Peter Kaufmann Melina Skouras Bernhard Thomaszewski Derek Bradley Thabo Beeler Philip Jackson Steve Marschner Wojciech Matusik Markus Gross

50

ISTC-VC SIGGRAPH Papers (cont)

Siggraph Courses Optimizing Realistic Rendering With Many-Light Methods Sunday 5 August 2-515 pm Jaroslav Krivanek Milos Hasan Adam Arbree Carsten Dachsbacher Alexander Keller Bruce Walter State of the Art in Photon-Density Estimation Thursday 9 August 2-515 pm Toshiya Hachisuka Wojciech Jarosz Guillaume Bouchard Per Christensen Jeppe Revall Frisvad Wenzel Jakob Henrik Wann Jensen Jared M Johnson Michael Kaschalk Claude Knaus Andrew Selle Ben Spencer

Siggraph Talks

Silence Eliminate the Noise Thursday 9 August 9-1030 am Importance Sampling for Hair Scattering Jiawei Ou Feng Xie Parashar Krishnamachari Fabio Pellacini

Siggraph Exhibitor Sessions

Intel Corporation Wednesday 8 August 430-530 pm room 402B The Future of Visual Computing as Viewed by Intel Visual Computing Research Centers

51

Other ISTC-VC SIGGRAPH Participation

Page 4: Future of Visual Computing as viewed by Intel Visual ... · PDF fileFuture of Visual Computing as viewed by Intel Visual Computing Research Centers ... Justin Rattner Intel Science

4 4 Intel Science and Technology Center for Visual Computing Stanford (Levoy Levis Hanrahan Fedkiw Koltun Horowitz Ousterhout Rosenblum )

UC Davis (Owens) UC Berkeley

(Agrawala Ramamoorthi OrsquoBrien Malik Shewchuk Zakhor)

Harvard (Pfister)

UWash (Popovic Seitz Curless Mones)

Cornell (D James Snavely Bala Marschner Greenberg)

Princeton (Funkhouser Rusinkeiwicz Finkelstein Freedman)

Content Creation Theme lead M Agrawala

1 ndash Data-Driven Modeling lead Vladlen Koltun

2 - Game-driven Creation lead Zoran Popovic

3 ndashRapid Animation lead Maneesh Agrawala

Graphics Systems Theme lead John Owens

1 ndash Computational Photography lead Marc Levoy

2 ndash Heterogeneous Pipelines lead John Owens

3 ndash Cloud-Scale Visual Game Support lead Philip Levis

4 ndash Exascale Visualization lead Hanspeter Pfister

Simulation Theme lead Doug James

1 ndash Scalable Visual Rendering lead R Ramamoorthi K Bala

2 ndash Real-time Physical Simulation lead Ron Fedkiw

3 ndash Physically Based Sound lead Doug James

4 ndash Simulated Virtual Characters a Appearance ndash lead Marschner b Performance - lead Koltun c Integration ndash lead OrsquoBrien

Perception Theme lead S Seitz

1 ndash Interior Capture and Modeling lead Noah Snavely

2 ndash Urban Semantic Capture Modeling lead Tom Funkhouser

3 ndash People Poses in Photos lead Jitendra Malik

4 ndash People Actions in Video lead Deva Ramanan

UC Irvine (Ramanan)

httpvisualstanfordedu

SIMULATED VIRTUAL CHARACTERS

bull Goal Dramatically advance the fidelity and behavior of virtual characters so that they look and perform believably in real-time simulated environments

bull Currently attacking two aspects bull Appearance (skin hair clothing) bull Control (autonomous motion

reaction interaction)

ISTC-VC website visualstanfordedu

Appearance of Virtual Characters Knit Woven Clothing

- Goal Build up physical model of cloth to support physically correct appearance and motion - PIs Steve Marschner Kavita Bala Doug James (Cornell) James OrsquoBrien (Berkeley)

Siggraph 2012 Papers - Stitch Meshes for Modeling Knitted Clothing With Yarn-level Detail Yuksel et al - Structure-Aware Synthesis for Predictive Woven Fabric Appearance Zhao et al

httpvisualstanfordedu

Appearance of Virtual Characters Knit Woven Clothing

Siggraph 2012 Papers - Stitch Meshes for Modeling Knitted Clothing With Yarn-level Detail Yuksel et al - Structure-Aware Synthesis for Predictive Woven Fabric Appearance Zhao et al

- Goal Build up physical model of cloth to support physically correct appearance and motion - PIs Steve Marschner Kavita Bala Doug James (Cornell) James OrsquoBrien (Berkeley)

httpvisualstanfordedu

Control of Virtual Characters Autonomous Behavior

- Goal Automate low-level actions such as walking carrying things dealing with obstacles etc - PIs Vladlen Koltun (Stanford) Zoran Popovic (UW)

Siggraph 2012 Papers - Optimizing Locomotion Controllers Using Biologically-Based Actuators and Objectives Wang et al - Discovery of Complex Behaviors through Contact-Invariant Optimization Mordatch et al

httpvisualstanfordedu

Control of Virtual Characters Autonomous Behavior

- Goal Automate low-level actions such as walking carrying things dealing with obstacles etc - Investigators Vladlen Koltun (Stanford) Zoran Popovic (UW)

Siggraph 2012 Papers - Optimizing Locomotion Controllers Using Biologically-Based Actuators and Objectives Wang et al - Discovery of Complex Behaviors through Contact-Invariant Optimization Mordatch et al - Continuous Character Control With Low-Dimensional Embeddings Levine et al

httpvisualstanfordedu

Physically-Based Sound

Widely reported in popular scientific media (NPR Science Friday BBC hellip)

bull Goal automatically generate sounds due to object interactions in the physical simulation of a virtual environment

bull PI Doug James (Cornell)

Siggraph 2012 Papers - Motion-Driven Concatenative Synthesis of Cloth Sounds An et al - Precomputed Acceleration Noise for Improved Rigid-Body Sound Chadwick et al

Data-Driven Modeling

Siggraph 2012 Papers - A Probabilistic Model for Component-Based Shape Synthesis Kalogerakis et al - An Algebraic Model for Parameterized Shape Editing Bokeloh et al

httpvisualstanfordedu

- Goal Capture the nature of a chair or an animal by analyzing large databases of similar objects to allow working with parts rather than polygons Make tools that enable users of all skill levels to produce custom high-quality content for virtual worlds - PIs Vladlen Koltun (Stanford) Tom Funkhouser (Princeton) Pat Hanrahan (Stanford)

Data-Driven Modeling

Siggraph 2012 Papers - A Probabilistic Model for Component-Based Shape Synthesis Kalogerakis et al - An Algebraic Model for Parameterized Shape Editing Bokeloh et al

httpvisualstanfordedu

- Goal Capture the nature of a chair or an animal by analyzing large databases of similar objects to allow working with parts rather than polygons Make tools that enable users of all skill levels to produce custom high-quality content for virtual worlds - PIs Vladlen Koltun (Stanford) Tom Funkhouser (Princeton) Pat Hanrahan (Stanford)

Intel Visual Computing Institute

httpswwwintel-university-collaborationnetpage_id=998

Saarbruumlcken Germany

An Open Collaborative Research Institute at the Saarland Campus

Multimodal

Computing

and

Interaction

IVCI Mission Facilitate the progress of Visual Computing research and be a driver towards highest

quality image real-time processing and interactive visualization

Virtual Worlds (Model-based)

Multimodal Scene Analysis amp Interaction

Real Worlds (Sample-based)

Intel VCI Vision Scalable Algorithms for

Real Time Realistic

Rendering

Compiler Support for

High Performance

Graphics

Collaborative Distributed Molecular

Modeling and Visualization

Efficient High Quality

Rendering Using Sample-based

Representations

Scalable Hybrid Rendering for

Large Scale Visualization

Marker-free Performance

Capture

Algorithms for Low Cost Depth

Imaging

Visualization and editing of light

transport

Internet Transport and Coding for 3D

HD-TV

Software- innovation for the Digital Enterprise

Kusanagi Coding and

Interaction for Networked Games

Multi Touch Interaction

Techniques for Mixed 2D and 3D Graphics Displays

Advanced Ray Tracing and Data-Flow

Processing for the 3D Internet

Intel VCI Projects-Based Organization

ECOUSS Efficient and open Compiler-

Framework for parallel Simulations

SCENE Novel Scene Representations for Rich

Networked Media

VERVE Vanquishing fear and apathy

through E-inclusion

Large Scale Visualization in the Internet of Displays

User-centric Video

Processing

Local Dimming for Edge-lit LED LCD-Monitors

SCI Institute Utah USA

Stanford University California USA

Research Collaboration

Consortium Members

User-Centric Video Processing Jan Kautz Christian Theobalt

bull Objective ndash Create new user experiences for capturing

editing and browsing

ndash Targets amateur video creators

bull Approach ndash Automatically identify spationdashtemporal and

semantic relationships withinbetween videos

ndash Leverage graph of these to drive UI and video processing

bull Expected results Capturing automatic stabilization and

enhancement

Editing edit semantic objects in videos

Browsing find semantically related videos

Remove the person in white

Video Inpainting in Dynamic Scenes amp Videoscape for moving through Internet Videos

Efficient High-Quality Rendering Using Sample-based Representations Elmar Eisemann

bull Realistic Rendering ndash Lens Flare [Siggraphrsquo11]

ndash Depth-of-field [Eurographics lsquo11]

ndash Global Illumination [PGrsquo11]

bull Perceptual Rendering ndash Stereo

ndash High Dynamic Range

bull Alternative representations ndash Voxel Data

ndash Height Fields

3D Internet Interactive 3D Content on the Web Philipp Slusallek

bull XML3D Scene Description ndash HTML-5 extension for interactive graphics

ndash JS implementation amp built into the browser

ndash Reuses Web Technology (DOM CSS JS)

bull XFLOW Parallel Processing ndash Data-parallel flowgraph for XML3D

ndash Animations image amp geometry processing

ndash Configuration within the DOM

bull Results ndash W3C standardization ldquoDeclarative 3D for the Webrdquo

ndash Rich media apps for BMW SLS-Museum hellip

3D-Internet Apps SLS-Museum 3D-Installation amp Museum with Interactive Virtual Characters

3D-Internet Apps Using OpenStreetMap-3D as Shared Virtual Worlds

Fully automatically generated from OpenStreet Map Taking semantic data into acount

Marker-free Performance Capture Christian Theobalt

bull Reconstruction of detailed human animation models ndash In Multi-view video without markers

ndash Out Detailed motion shape and appearance

ndash General clothing modifiable performances new animations

bull Real-time performance capture ndash Fast full-body motion estimation from depth

cameras

ndash Interaction

ndash Collaboration with Intel Magic Mirror project

[ICCV 2011]

[SIGGRAPH Asia 2010]

Markerless Motion Capture of Interacting Characters Using Multi-view Image Segmentation

Articulated Models Input silhouettes Segmentation Contour labels Estimated surface Estimated 3D models

Handling Intersections

Improved segmentation with 3D shape priors Excellent performance when evaluated against marker-based system

bull Interactive inspection of light transport in virtual scenes ndash You can only manipulate what you see

ndash First prototypal light manipulation tools

bull Efficient global illumination ndash Otherwise no interactive

visualization nor manipulation

ndash Improvements on many-lights methods and progressive photon mapping

bull Results ndash Demonstrator Maya plugin ndash Collaboration with local film academy

Visualization and Editing of Light Transport Carsten Dachsbacher

Advanced Real-Time Ray Tracing Techniques Philipp Slusallek

bull Perfect importance sampling and caching ndash Sparse but perfect importance sampling

ndash Caching and interpolation [Eurographics`12]

bull Unifying Photon-Mapping amp Monte-Carlo ndash Formulating PM as a MC process

ndash Per pixel combination using MIS

bull Data-parallel implementations

ndash Efficiency and performance

bull Integration into XML3D

ndash Provide ldquocorrectrdquo results by default

Vertex Merging with Multiple Importance Sampling Photon-Mapping as a Monte-Carlo Process

BPT

PPM Progressive Photon-Mapping (PPM)

Bidirectional Path Tracing (BPT)

bull Whole-Function Vectorization ndash Restore scalar computations

ndash LLVM platform-independent

ndash RenderMan frontend OpenCL driver

bull Vector Programming ndash Formalized C extension for portable

effective SIMD programming

ndash Type system triggers vectorization

ndash Data layout adaption

bull New Programming Models for High-Performance Graphics

bull Results ndash Demonstrators for shaders and HPC code

ndash CC++-Extensions (with Intel)

ndash OpenCL compiler (CPU)

Compiler Support for High-Performance Graphics Sebastian Hack

bull Hybrid Rendering ndash Client amp Server Model

ndash Smartphone to Mainframe

bull Large Data Processing ndash Scalable Hierarchical

RW Data Structures

bull Results ndash ZAPP displaywall demonstrator

ndash ImageVis3D (Mobile) demonstrator

ndash Practically use in hospitals

Scalable Hybrid Rendering for Large Scale Visualization Jens Kruumlger

Displays as a Service Large Scale Visualization Alexander Loumlffler

bull Virtualization of Displays ndash Virtual Framebuffer and Displays exposed to Internet

ndash Replacing cables by switched IP network

ndash Internet standards for video encoding and streaming

bull Fully Synchronized ndash 120 Hz active stereo sync over IP

ndash Accuracy of ~100us in software

ndash Drives GPU displays output

bull Results ndash 20-screen wall demonstrator

ndash 3-screen wall (thin-bezel)

ndash CE4100 based SW synchronization

SIGGRAPH 2012

Backup

The Intel Science and Technology Center (ISTC) and Intel Collaborative Research Institute (ICRI) Programs

35

The modern economy is an information economy and one that is driven by innovations that enhance productivity as well as create new modes of entertainment We need to invest in the basic research that will inspire future products and services and ensure long term health of our information economy Government and private foundations are helping but corporate America needs to step up and increase commitments to university research - Justin Rattner ndash Intel CTO

$140M investment over 5 years announced by Intel in 2011 and 2012

Centers of Excellence bull Each ISTC and ICRI will focus on one

research area eg visual computing secure computing

bull The ISTCs and ICRIs are meant to bring the best and brightest researchers across the US together

bull Each ISTC and ICRI will be led by a host university and will include thought leaders from other schools

Breaking Barriers to Collaboration

bull Open IP models and open source software to encourage free information exchange (In most of the Centers)

bull Favor projects that span multiple institutions to encourage collaboration among universities

bull Intel researches per center assigned to work on-campus to encourage collaboration between Intel and academia

Greater Impact to Future Tech bull Center research themes to

address essential needs of computing technology

bull Research agendas jointly defined and co-led by an Intel and a University Principal Investigator

bull After completing 3-5 year charters new ISTCs and ICRIs can be formed to respond to changing tech environment

httpfolditportal

Serious Gaming pplied to Content Creation

Highlighted by President Obama Winner of most-significant new visualization tool (NSF)

Goal Create high-quality content by casting creation activities as games in which large numbers of people are incentivized to perform simple tasks which in combination yield sophisticated content PIs Zoran Popovic (UW) Noah Snavely (Cornell) Maneesh Agrawala(Berkeley)

Determining the structure of retroviral protease (HIV)

Video Frank to add Papers Frank to add

Extracting Structure and Semantics

CAD Model Points

Structures

People

Goals Enable context aware computing and automated content creation through the capture analysis and manipulation of real-world visual data PIs Steve Seitz (UW) Noah Snavely (Cornell) Tom Funkhouser (Princeton) Vladlen Koltun (Stanford) Jitendra Malik (Berkeley) Deva Ramanan (UV Irvine)

Video Frank to add Papers Frank to add

httpvisualstanfordedu

Computational Photography (Franken Camera)

Being adopted as a standard API for cellphone camera systems (Apple Android)

bull Goal Develop algorithms languages architectures and prototypes demonstrating the use of computation in the process of image capture and display

bull PIs Marc Levoy (Stanford) Mark Horowitz (Stanford) Pat Hanrahan (Stanford)

Video Frank to add Papers Frank to add

ISTC-VC SIGGRAPH Papers

Character Locomotion Monday 6 August 900 AM - 1030 AM Optimizing Locomotion Controllers Using Biologically Based Actuators and Objectives Jack M Wang Samuel R Hamner Scott L Delp Vladlen Koltun Continuous Character Control With Low-Dimensional Embeddings Sergey Levine Jack M Wang Alexis Haraux Zoran Popović Vladlen Koltun Shape Analysis Monday 6 August 900 AM - 1030 AM Schelling Points on 3D Surface Meshes Xiaobai Chen Abulhair Saparov Bill Pang Thomas Funkhouser Shape Transformation Wednesday 8 August 900 - 1030 AM An Algebraic Model for Parameterized Shape Editing Martin Bokeloh Michael Wand Hans-Peter Seidel Vladlen Koltun

42

ISTC-VC SIGGRAPH Papers

Image Processing Monday 6 August 2- 330 pm Decoupling Algorithms From Schedules for Easy Optimization of Image-Processing Pipelines Jonathan Ragan-Kelley Andrew Adams Sylvain Paris Marc Levoy Saman Amarasinghe Freacutedo Durand

Cloth

Monday 6 August 2-330 pm Specular Reflection From Woven Cloth Piti Irawan Steve Marschner Stitch Meshes for Modeling Knitted Clothing With Yarn-level Detail Cem Yuksel Jonathan M Kaldor Doug L James Steve Marschner

Appearance

Monday 6 August 345-535 pm Printing Spatially Varying Reflectance for Reproducing HDR Images Yue Dong Xin Tong Fabio Pellacini Baining Guo

43

ISTC-VC SIGGRAPH Papers (cont)

Hand Eye and Face Monday 6 August 345-535 pm Session Chair - Vladlen Koltun Discovery of Complex Behaviors through Contact-Invariant Optimization Igor Mordatch Emanuel Todorov Zoran Popovi1049029 Sketching Monday 6 August 345-535 pm HelpingHand Example-Based Stroke Stylization Jingwan Lu Fisher Yu Adam Finkelstein Stephen DiVerdi Fabrication Tuesday 7 August 9-1030 am Fabricating Articulated Characters From Skinned Meshes Moritz Baumlcher Bernd Bickel Doug L James Hanspeter Pfister

44

Sampling Reconstructing and Filtering Light Tuesday 7 August 1045 am-1215 pm A Theory of Monte Carlo Visibility Sampling Ravi Ramamoorthi John Anderson Mark Meyer Derek Nowrouzezahrai Reconstructing the Indirect Light Field for Global Illumination Jaakko Lehtinen Timo Aila Samuli Laine Freacutedo Durand

Geometry Reconstruction amp Tracking

Tuesday 7 August 1045 am-1215 pm Temporally Coherent Completion of Dynamic Shapes Hao Li Linjie Luo Daniel Vlasic Pieter Peers Jovan Popovic Mark Pauly Szymon Rusinkiewicz

Sets of Shapes

Tuesday 7 August 2-330 pm Exploring Collections of 3D Models Using Fuzzy Correspondence Vladimir G Kim Wilmot Li Niloy J Mitra Stephen DiVerdi Thomas Funkhouser A Probabilistic Model for Component-Based Shape Synthesis Evangelos Kalogerakis Siddhartha Chaudhuri Daphne Koller Vladlen Koltun

45

ISTC-VC SIGGRAPH Papers (cont)

Light Rays Tuesday 7 August 2-330 pm Manifold Exploration A Markov Chain Monte Carlo Technique for Rendering Scenes With Difficult Specular Transport Wenzel Jakob Steve Marschner Bidirectional Lightcuts Bruce Walter Pramook Khungurn Kavita Bala

Fun With Video

Tuesday 7 August 345-535 pm Session Chair Noah Snavely Video Deblurring for Hand-Held Cameras Using Patch-Based Synthesis Sunghyun Cho Jue Wang Seungyong Lee Eulerian Video Magnification for Revealing Subtle Changes in the World Hao-Yu Wu Michael Rubinstein Eugene Shih John Guttag Freacutedo Durand William T Freeman Selectively De-Animating Video Jiamin Bai Aseem Agarwala Maneesh Agrawala Ravi Ramamoorthi Tools for Placing Cuts and Transitions in Interview Video Floraine Berthouzoz Wilmot Li Maneesh Agrawala

46

ISTC-VC SIGGRAPH Papers (cont)

Noise and Texture Tuesday 7 August 345-535 pm Structure-Aware Synthesis for Predictive Woven Fabric Appearance Shuang Zhao Kavita Bala Steve Marschner Wenzel Jakob Symmetry-Guided Texture Synthesis and Manipulation Vladimir Kim Yaron Lipman Thomas Funkhouser

Shape Transformation Wednesday 8 August 900 - 1030 AM An Algebraic Model for Parameterized Shape Editing Martin Bokeloh Michael Wand Hans-Peter Seidel Vladlen Koltun

Stitching

Wednesday 8 August 1045 am-1215 pm Exposing Photo Manipulation With Inconsistent Reflections James F OrsquoBrien Hany Farid

47

ISTC-VC SIGGRAPH Papers (cont)

Maps Surfaces and Shapes

Wednesday 8 August 1045 am-1215 pm Simple Formulas For Quasiconformal Plane Deformations Yaron Lipman Vladimir G Kim Thomas Funkhouser

Interactive Systems amp Hardware Wednesday 8 August 2-330 pm Position-Correcting Tools for 2D Digital Fabrication Alec Rivers Ilan E Moyer Freacutedo Durand

48

ISTC-VC SIGGRAPH Papers (cont)

Collisions Wednesday 8 August 345-535 pm Energy-Based Self-Collision Culling for Arbitrary Mesh Deformations Changxi Zheng Doug L James

All About Images

Thursday 9 August 9-1030 am A Framework for Content-Adaptive Photo Manipulation Macros Application to Face Landscape and Global Manipulations Floraine Berthouzoz Wilmot Li Mira Dontcheva Maneesh Agrawala

Sound and Elements

Thursday 9 August 9-1030 am Motion-Driven Concatenative Synthesis of Cloth Sounds Steven S An Doug L James Steve Marschner Precomputed Acceleration Noise for Improved Rigid-Body Sound Jeffrey N Chadwick Changxi Zheng Doug L James Interactive Sound Propagation Using Compact Acoustic Transfer Operators Lakulish Antani Anish Chandak Lauri Savioja Dinesh Manocha Updated Sparse Cholesky Factors for Corotational Elastodynamics Florian Hecht Yeon Jin Lee Jonathan R Shewchuk James F OrsquoBrien

49

ISTC-VC SIGGRAPH Papers (cont)

Geometry amp Viewing Thursday 9 August 2-330 pm Perceptual Models of Viewpoint Preference Adrian Secordm Jingwan Lu Adam Finkelstein Manish Singh Andrew Nealen

Faces and Hair [Closing Session]

Thursday 9 August 345-515 pm Coupled 3D Reconstruction of Sparse Facial Hair and Skin Thabo Beeler Bernd Bickel Gioacchino Noris Paul Beardsley Steve Marschner Robert W Sumner Markus Gross Physical Face Cloning Bernd Bickel Peter Kaufmann Melina Skouras Bernhard Thomaszewski Derek Bradley Thabo Beeler Philip Jackson Steve Marschner Wojciech Matusik Markus Gross

50

ISTC-VC SIGGRAPH Papers (cont)

Siggraph Courses Optimizing Realistic Rendering With Many-Light Methods Sunday 5 August 2-515 pm Jaroslav Krivanek Milos Hasan Adam Arbree Carsten Dachsbacher Alexander Keller Bruce Walter State of the Art in Photon-Density Estimation Thursday 9 August 2-515 pm Toshiya Hachisuka Wojciech Jarosz Guillaume Bouchard Per Christensen Jeppe Revall Frisvad Wenzel Jakob Henrik Wann Jensen Jared M Johnson Michael Kaschalk Claude Knaus Andrew Selle Ben Spencer

Siggraph Talks

Silence Eliminate the Noise Thursday 9 August 9-1030 am Importance Sampling for Hair Scattering Jiawei Ou Feng Xie Parashar Krishnamachari Fabio Pellacini

Siggraph Exhibitor Sessions

Intel Corporation Wednesday 8 August 430-530 pm room 402B The Future of Visual Computing as Viewed by Intel Visual Computing Research Centers

51

Other ISTC-VC SIGGRAPH Participation

Page 5: Future of Visual Computing as viewed by Intel Visual ... · PDF fileFuture of Visual Computing as viewed by Intel Visual Computing Research Centers ... Justin Rattner Intel Science

SIMULATED VIRTUAL CHARACTERS

bull Goal Dramatically advance the fidelity and behavior of virtual characters so that they look and perform believably in real-time simulated environments

bull Currently attacking two aspects bull Appearance (skin hair clothing) bull Control (autonomous motion

reaction interaction)

ISTC-VC website visualstanfordedu

Appearance of Virtual Characters Knit Woven Clothing

- Goal Build up physical model of cloth to support physically correct appearance and motion - PIs Steve Marschner Kavita Bala Doug James (Cornell) James OrsquoBrien (Berkeley)

Siggraph 2012 Papers - Stitch Meshes for Modeling Knitted Clothing With Yarn-level Detail Yuksel et al - Structure-Aware Synthesis for Predictive Woven Fabric Appearance Zhao et al

httpvisualstanfordedu

Appearance of Virtual Characters Knit Woven Clothing

Siggraph 2012 Papers - Stitch Meshes for Modeling Knitted Clothing With Yarn-level Detail Yuksel et al - Structure-Aware Synthesis for Predictive Woven Fabric Appearance Zhao et al

- Goal Build up physical model of cloth to support physically correct appearance and motion - PIs Steve Marschner Kavita Bala Doug James (Cornell) James OrsquoBrien (Berkeley)

httpvisualstanfordedu

Control of Virtual Characters Autonomous Behavior

- Goal Automate low-level actions such as walking carrying things dealing with obstacles etc - PIs Vladlen Koltun (Stanford) Zoran Popovic (UW)

Siggraph 2012 Papers - Optimizing Locomotion Controllers Using Biologically-Based Actuators and Objectives Wang et al - Discovery of Complex Behaviors through Contact-Invariant Optimization Mordatch et al

httpvisualstanfordedu

Control of Virtual Characters Autonomous Behavior

- Goal Automate low-level actions such as walking carrying things dealing with obstacles etc - Investigators Vladlen Koltun (Stanford) Zoran Popovic (UW)

Siggraph 2012 Papers - Optimizing Locomotion Controllers Using Biologically-Based Actuators and Objectives Wang et al - Discovery of Complex Behaviors through Contact-Invariant Optimization Mordatch et al - Continuous Character Control With Low-Dimensional Embeddings Levine et al

httpvisualstanfordedu

Physically-Based Sound

Widely reported in popular scientific media (NPR Science Friday BBC hellip)

bull Goal automatically generate sounds due to object interactions in the physical simulation of a virtual environment

bull PI Doug James (Cornell)

Siggraph 2012 Papers - Motion-Driven Concatenative Synthesis of Cloth Sounds An et al - Precomputed Acceleration Noise for Improved Rigid-Body Sound Chadwick et al

Data-Driven Modeling

Siggraph 2012 Papers - A Probabilistic Model for Component-Based Shape Synthesis Kalogerakis et al - An Algebraic Model for Parameterized Shape Editing Bokeloh et al

httpvisualstanfordedu

- Goal Capture the nature of a chair or an animal by analyzing large databases of similar objects to allow working with parts rather than polygons Make tools that enable users of all skill levels to produce custom high-quality content for virtual worlds - PIs Vladlen Koltun (Stanford) Tom Funkhouser (Princeton) Pat Hanrahan (Stanford)

Data-Driven Modeling

Siggraph 2012 Papers - A Probabilistic Model for Component-Based Shape Synthesis Kalogerakis et al - An Algebraic Model for Parameterized Shape Editing Bokeloh et al

httpvisualstanfordedu

- Goal Capture the nature of a chair or an animal by analyzing large databases of similar objects to allow working with parts rather than polygons Make tools that enable users of all skill levels to produce custom high-quality content for virtual worlds - PIs Vladlen Koltun (Stanford) Tom Funkhouser (Princeton) Pat Hanrahan (Stanford)

Intel Visual Computing Institute

httpswwwintel-university-collaborationnetpage_id=998

Saarbruumlcken Germany

An Open Collaborative Research Institute at the Saarland Campus

Multimodal

Computing

and

Interaction

IVCI Mission Facilitate the progress of Visual Computing research and be a driver towards highest

quality image real-time processing and interactive visualization

Virtual Worlds (Model-based)

Multimodal Scene Analysis amp Interaction

Real Worlds (Sample-based)

Intel VCI Vision Scalable Algorithms for

Real Time Realistic

Rendering

Compiler Support for

High Performance

Graphics

Collaborative Distributed Molecular

Modeling and Visualization

Efficient High Quality

Rendering Using Sample-based

Representations

Scalable Hybrid Rendering for

Large Scale Visualization

Marker-free Performance

Capture

Algorithms for Low Cost Depth

Imaging

Visualization and editing of light

transport

Internet Transport and Coding for 3D

HD-TV

Software- innovation for the Digital Enterprise

Kusanagi Coding and

Interaction for Networked Games

Multi Touch Interaction

Techniques for Mixed 2D and 3D Graphics Displays

Advanced Ray Tracing and Data-Flow

Processing for the 3D Internet

Intel VCI Projects-Based Organization

ECOUSS Efficient and open Compiler-

Framework for parallel Simulations

SCENE Novel Scene Representations for Rich

Networked Media

VERVE Vanquishing fear and apathy

through E-inclusion

Large Scale Visualization in the Internet of Displays

User-centric Video

Processing

Local Dimming for Edge-lit LED LCD-Monitors

SCI Institute Utah USA

Stanford University California USA

Research Collaboration

Consortium Members

User-Centric Video Processing Jan Kautz Christian Theobalt

bull Objective ndash Create new user experiences for capturing

editing and browsing

ndash Targets amateur video creators

bull Approach ndash Automatically identify spationdashtemporal and

semantic relationships withinbetween videos

ndash Leverage graph of these to drive UI and video processing

bull Expected results Capturing automatic stabilization and

enhancement

Editing edit semantic objects in videos

Browsing find semantically related videos

Remove the person in white

Video Inpainting in Dynamic Scenes amp Videoscape for moving through Internet Videos

Efficient High-Quality Rendering Using Sample-based Representations Elmar Eisemann

bull Realistic Rendering ndash Lens Flare [Siggraphrsquo11]

ndash Depth-of-field [Eurographics lsquo11]

ndash Global Illumination [PGrsquo11]

bull Perceptual Rendering ndash Stereo

ndash High Dynamic Range

bull Alternative representations ndash Voxel Data

ndash Height Fields

3D Internet Interactive 3D Content on the Web Philipp Slusallek

bull XML3D Scene Description ndash HTML-5 extension for interactive graphics

ndash JS implementation amp built into the browser

ndash Reuses Web Technology (DOM CSS JS)

bull XFLOW Parallel Processing ndash Data-parallel flowgraph for XML3D

ndash Animations image amp geometry processing

ndash Configuration within the DOM

bull Results ndash W3C standardization ldquoDeclarative 3D for the Webrdquo

ndash Rich media apps for BMW SLS-Museum hellip

3D-Internet Apps SLS-Museum 3D-Installation amp Museum with Interactive Virtual Characters

3D-Internet Apps Using OpenStreetMap-3D as Shared Virtual Worlds

Fully automatically generated from OpenStreet Map Taking semantic data into acount

Marker-free Performance Capture Christian Theobalt

bull Reconstruction of detailed human animation models ndash In Multi-view video without markers

ndash Out Detailed motion shape and appearance

ndash General clothing modifiable performances new animations

bull Real-time performance capture ndash Fast full-body motion estimation from depth

cameras

ndash Interaction

ndash Collaboration with Intel Magic Mirror project

[ICCV 2011]

[SIGGRAPH Asia 2010]

Markerless Motion Capture of Interacting Characters Using Multi-view Image Segmentation

Articulated Models Input silhouettes Segmentation Contour labels Estimated surface Estimated 3D models

Handling Intersections

Improved segmentation with 3D shape priors Excellent performance when evaluated against marker-based system

bull Interactive inspection of light transport in virtual scenes ndash You can only manipulate what you see

ndash First prototypal light manipulation tools

bull Efficient global illumination ndash Otherwise no interactive

visualization nor manipulation

ndash Improvements on many-lights methods and progressive photon mapping

bull Results ndash Demonstrator Maya plugin ndash Collaboration with local film academy

Visualization and Editing of Light Transport Carsten Dachsbacher

Advanced Real-Time Ray Tracing Techniques Philipp Slusallek

bull Perfect importance sampling and caching ndash Sparse but perfect importance sampling

ndash Caching and interpolation [Eurographics`12]

bull Unifying Photon-Mapping amp Monte-Carlo ndash Formulating PM as a MC process

ndash Per pixel combination using MIS

bull Data-parallel implementations

ndash Efficiency and performance

bull Integration into XML3D

ndash Provide ldquocorrectrdquo results by default

Vertex Merging with Multiple Importance Sampling Photon-Mapping as a Monte-Carlo Process

BPT

PPM Progressive Photon-Mapping (PPM)

Bidirectional Path Tracing (BPT)

bull Whole-Function Vectorization ndash Restore scalar computations

ndash LLVM platform-independent

ndash RenderMan frontend OpenCL driver

bull Vector Programming ndash Formalized C extension for portable

effective SIMD programming

ndash Type system triggers vectorization

ndash Data layout adaption

bull New Programming Models for High-Performance Graphics

bull Results ndash Demonstrators for shaders and HPC code

ndash CC++-Extensions (with Intel)

ndash OpenCL compiler (CPU)

Compiler Support for High-Performance Graphics Sebastian Hack

bull Hybrid Rendering ndash Client amp Server Model

ndash Smartphone to Mainframe

bull Large Data Processing ndash Scalable Hierarchical

RW Data Structures

bull Results ndash ZAPP displaywall demonstrator

ndash ImageVis3D (Mobile) demonstrator

ndash Practically use in hospitals

Scalable Hybrid Rendering for Large Scale Visualization Jens Kruumlger

Displays as a Service Large Scale Visualization Alexander Loumlffler

bull Virtualization of Displays ndash Virtual Framebuffer and Displays exposed to Internet

ndash Replacing cables by switched IP network

ndash Internet standards for video encoding and streaming

bull Fully Synchronized ndash 120 Hz active stereo sync over IP

ndash Accuracy of ~100us in software

ndash Drives GPU displays output

bull Results ndash 20-screen wall demonstrator

ndash 3-screen wall (thin-bezel)

ndash CE4100 based SW synchronization

SIGGRAPH 2012

Backup

The Intel Science and Technology Center (ISTC) and Intel Collaborative Research Institute (ICRI) Programs

35

The modern economy is an information economy and one that is driven by innovations that enhance productivity as well as create new modes of entertainment We need to invest in the basic research that will inspire future products and services and ensure long term health of our information economy Government and private foundations are helping but corporate America needs to step up and increase commitments to university research - Justin Rattner ndash Intel CTO

$140M investment over 5 years announced by Intel in 2011 and 2012

Centers of Excellence bull Each ISTC and ICRI will focus on one

research area eg visual computing secure computing

bull The ISTCs and ICRIs are meant to bring the best and brightest researchers across the US together

bull Each ISTC and ICRI will be led by a host university and will include thought leaders from other schools

Breaking Barriers to Collaboration

bull Open IP models and open source software to encourage free information exchange (In most of the Centers)

bull Favor projects that span multiple institutions to encourage collaboration among universities

bull Intel researches per center assigned to work on-campus to encourage collaboration between Intel and academia

Greater Impact to Future Tech bull Center research themes to

address essential needs of computing technology

bull Research agendas jointly defined and co-led by an Intel and a University Principal Investigator

bull After completing 3-5 year charters new ISTCs and ICRIs can be formed to respond to changing tech environment

httpfolditportal

Serious Gaming pplied to Content Creation

Highlighted by President Obama Winner of most-significant new visualization tool (NSF)

Goal Create high-quality content by casting creation activities as games in which large numbers of people are incentivized to perform simple tasks which in combination yield sophisticated content PIs Zoran Popovic (UW) Noah Snavely (Cornell) Maneesh Agrawala(Berkeley)

Determining the structure of retroviral protease (HIV)

Video Frank to add Papers Frank to add

Extracting Structure and Semantics

CAD Model Points

Structures

People

Goals Enable context aware computing and automated content creation through the capture analysis and manipulation of real-world visual data PIs Steve Seitz (UW) Noah Snavely (Cornell) Tom Funkhouser (Princeton) Vladlen Koltun (Stanford) Jitendra Malik (Berkeley) Deva Ramanan (UV Irvine)

Video Frank to add Papers Frank to add

httpvisualstanfordedu

Computational Photography (Franken Camera)

Being adopted as a standard API for cellphone camera systems (Apple Android)

bull Goal Develop algorithms languages architectures and prototypes demonstrating the use of computation in the process of image capture and display

bull PIs Marc Levoy (Stanford) Mark Horowitz (Stanford) Pat Hanrahan (Stanford)

Video Frank to add Papers Frank to add

ISTC-VC SIGGRAPH Papers

Character Locomotion Monday 6 August 900 AM - 1030 AM Optimizing Locomotion Controllers Using Biologically Based Actuators and Objectives Jack M Wang Samuel R Hamner Scott L Delp Vladlen Koltun Continuous Character Control With Low-Dimensional Embeddings Sergey Levine Jack M Wang Alexis Haraux Zoran Popović Vladlen Koltun Shape Analysis Monday 6 August 900 AM - 1030 AM Schelling Points on 3D Surface Meshes Xiaobai Chen Abulhair Saparov Bill Pang Thomas Funkhouser Shape Transformation Wednesday 8 August 900 - 1030 AM An Algebraic Model for Parameterized Shape Editing Martin Bokeloh Michael Wand Hans-Peter Seidel Vladlen Koltun

42

ISTC-VC SIGGRAPH Papers

Image Processing Monday 6 August 2- 330 pm Decoupling Algorithms From Schedules for Easy Optimization of Image-Processing Pipelines Jonathan Ragan-Kelley Andrew Adams Sylvain Paris Marc Levoy Saman Amarasinghe Freacutedo Durand

Cloth

Monday 6 August 2-330 pm Specular Reflection From Woven Cloth Piti Irawan Steve Marschner Stitch Meshes for Modeling Knitted Clothing With Yarn-level Detail Cem Yuksel Jonathan M Kaldor Doug L James Steve Marschner

Appearance

Monday 6 August 345-535 pm Printing Spatially Varying Reflectance for Reproducing HDR Images Yue Dong Xin Tong Fabio Pellacini Baining Guo

43

ISTC-VC SIGGRAPH Papers (cont)

Hand Eye and Face Monday 6 August 345-535 pm Session Chair - Vladlen Koltun Discovery of Complex Behaviors through Contact-Invariant Optimization Igor Mordatch Emanuel Todorov Zoran Popovi1049029 Sketching Monday 6 August 345-535 pm HelpingHand Example-Based Stroke Stylization Jingwan Lu Fisher Yu Adam Finkelstein Stephen DiVerdi Fabrication Tuesday 7 August 9-1030 am Fabricating Articulated Characters From Skinned Meshes Moritz Baumlcher Bernd Bickel Doug L James Hanspeter Pfister

44

Sampling Reconstructing and Filtering Light Tuesday 7 August 1045 am-1215 pm A Theory of Monte Carlo Visibility Sampling Ravi Ramamoorthi John Anderson Mark Meyer Derek Nowrouzezahrai Reconstructing the Indirect Light Field for Global Illumination Jaakko Lehtinen Timo Aila Samuli Laine Freacutedo Durand

Geometry Reconstruction amp Tracking

Tuesday 7 August 1045 am-1215 pm Temporally Coherent Completion of Dynamic Shapes Hao Li Linjie Luo Daniel Vlasic Pieter Peers Jovan Popovic Mark Pauly Szymon Rusinkiewicz

Sets of Shapes

Tuesday 7 August 2-330 pm Exploring Collections of 3D Models Using Fuzzy Correspondence Vladimir G Kim Wilmot Li Niloy J Mitra Stephen DiVerdi Thomas Funkhouser A Probabilistic Model for Component-Based Shape Synthesis Evangelos Kalogerakis Siddhartha Chaudhuri Daphne Koller Vladlen Koltun

45

ISTC-VC SIGGRAPH Papers (cont)

Light Rays Tuesday 7 August 2-330 pm Manifold Exploration A Markov Chain Monte Carlo Technique for Rendering Scenes With Difficult Specular Transport Wenzel Jakob Steve Marschner Bidirectional Lightcuts Bruce Walter Pramook Khungurn Kavita Bala

Fun With Video

Tuesday 7 August 345-535 pm Session Chair Noah Snavely Video Deblurring for Hand-Held Cameras Using Patch-Based Synthesis Sunghyun Cho Jue Wang Seungyong Lee Eulerian Video Magnification for Revealing Subtle Changes in the World Hao-Yu Wu Michael Rubinstein Eugene Shih John Guttag Freacutedo Durand William T Freeman Selectively De-Animating Video Jiamin Bai Aseem Agarwala Maneesh Agrawala Ravi Ramamoorthi Tools for Placing Cuts and Transitions in Interview Video Floraine Berthouzoz Wilmot Li Maneesh Agrawala

46

ISTC-VC SIGGRAPH Papers (cont)

Noise and Texture Tuesday 7 August 345-535 pm Structure-Aware Synthesis for Predictive Woven Fabric Appearance Shuang Zhao Kavita Bala Steve Marschner Wenzel Jakob Symmetry-Guided Texture Synthesis and Manipulation Vladimir Kim Yaron Lipman Thomas Funkhouser

Shape Transformation Wednesday 8 August 900 - 1030 AM An Algebraic Model for Parameterized Shape Editing Martin Bokeloh Michael Wand Hans-Peter Seidel Vladlen Koltun

Stitching

Wednesday 8 August 1045 am-1215 pm Exposing Photo Manipulation With Inconsistent Reflections James F OrsquoBrien Hany Farid

47

ISTC-VC SIGGRAPH Papers (cont)

Maps Surfaces and Shapes

Wednesday 8 August 1045 am-1215 pm Simple Formulas For Quasiconformal Plane Deformations Yaron Lipman Vladimir G Kim Thomas Funkhouser

Interactive Systems amp Hardware Wednesday 8 August 2-330 pm Position-Correcting Tools for 2D Digital Fabrication Alec Rivers Ilan E Moyer Freacutedo Durand

48

ISTC-VC SIGGRAPH Papers (cont)

Collisions Wednesday 8 August 345-535 pm Energy-Based Self-Collision Culling for Arbitrary Mesh Deformations Changxi Zheng Doug L James

All About Images

Thursday 9 August 9-1030 am A Framework for Content-Adaptive Photo Manipulation Macros Application to Face Landscape and Global Manipulations Floraine Berthouzoz Wilmot Li Mira Dontcheva Maneesh Agrawala

Sound and Elements

Thursday 9 August 9-1030 am Motion-Driven Concatenative Synthesis of Cloth Sounds Steven S An Doug L James Steve Marschner Precomputed Acceleration Noise for Improved Rigid-Body Sound Jeffrey N Chadwick Changxi Zheng Doug L James Interactive Sound Propagation Using Compact Acoustic Transfer Operators Lakulish Antani Anish Chandak Lauri Savioja Dinesh Manocha Updated Sparse Cholesky Factors for Corotational Elastodynamics Florian Hecht Yeon Jin Lee Jonathan R Shewchuk James F OrsquoBrien

49

ISTC-VC SIGGRAPH Papers (cont)

Geometry amp Viewing Thursday 9 August 2-330 pm Perceptual Models of Viewpoint Preference Adrian Secordm Jingwan Lu Adam Finkelstein Manish Singh Andrew Nealen

Faces and Hair [Closing Session]

Thursday 9 August 345-515 pm Coupled 3D Reconstruction of Sparse Facial Hair and Skin Thabo Beeler Bernd Bickel Gioacchino Noris Paul Beardsley Steve Marschner Robert W Sumner Markus Gross Physical Face Cloning Bernd Bickel Peter Kaufmann Melina Skouras Bernhard Thomaszewski Derek Bradley Thabo Beeler Philip Jackson Steve Marschner Wojciech Matusik Markus Gross

50

ISTC-VC SIGGRAPH Papers (cont)

Siggraph Courses Optimizing Realistic Rendering With Many-Light Methods Sunday 5 August 2-515 pm Jaroslav Krivanek Milos Hasan Adam Arbree Carsten Dachsbacher Alexander Keller Bruce Walter State of the Art in Photon-Density Estimation Thursday 9 August 2-515 pm Toshiya Hachisuka Wojciech Jarosz Guillaume Bouchard Per Christensen Jeppe Revall Frisvad Wenzel Jakob Henrik Wann Jensen Jared M Johnson Michael Kaschalk Claude Knaus Andrew Selle Ben Spencer

Siggraph Talks

Silence Eliminate the Noise Thursday 9 August 9-1030 am Importance Sampling for Hair Scattering Jiawei Ou Feng Xie Parashar Krishnamachari Fabio Pellacini

Siggraph Exhibitor Sessions

Intel Corporation Wednesday 8 August 430-530 pm room 402B The Future of Visual Computing as Viewed by Intel Visual Computing Research Centers

51

Other ISTC-VC SIGGRAPH Participation

Page 6: Future of Visual Computing as viewed by Intel Visual ... · PDF fileFuture of Visual Computing as viewed by Intel Visual Computing Research Centers ... Justin Rattner Intel Science

Appearance of Virtual Characters Knit Woven Clothing

- Goal Build up physical model of cloth to support physically correct appearance and motion - PIs Steve Marschner Kavita Bala Doug James (Cornell) James OrsquoBrien (Berkeley)

Siggraph 2012 Papers - Stitch Meshes for Modeling Knitted Clothing With Yarn-level Detail Yuksel et al - Structure-Aware Synthesis for Predictive Woven Fabric Appearance Zhao et al

httpvisualstanfordedu

Appearance of Virtual Characters Knit Woven Clothing

Siggraph 2012 Papers - Stitch Meshes for Modeling Knitted Clothing With Yarn-level Detail Yuksel et al - Structure-Aware Synthesis for Predictive Woven Fabric Appearance Zhao et al

- Goal Build up physical model of cloth to support physically correct appearance and motion - PIs Steve Marschner Kavita Bala Doug James (Cornell) James OrsquoBrien (Berkeley)

httpvisualstanfordedu

Control of Virtual Characters Autonomous Behavior

- Goal Automate low-level actions such as walking carrying things dealing with obstacles etc - PIs Vladlen Koltun (Stanford) Zoran Popovic (UW)

Siggraph 2012 Papers - Optimizing Locomotion Controllers Using Biologically-Based Actuators and Objectives Wang et al - Discovery of Complex Behaviors through Contact-Invariant Optimization Mordatch et al

httpvisualstanfordedu

Control of Virtual Characters Autonomous Behavior

- Goal Automate low-level actions such as walking carrying things dealing with obstacles etc - Investigators Vladlen Koltun (Stanford) Zoran Popovic (UW)

Siggraph 2012 Papers - Optimizing Locomotion Controllers Using Biologically-Based Actuators and Objectives Wang et al - Discovery of Complex Behaviors through Contact-Invariant Optimization Mordatch et al - Continuous Character Control With Low-Dimensional Embeddings Levine et al

httpvisualstanfordedu

Physically-Based Sound

Widely reported in popular scientific media (NPR Science Friday BBC hellip)

bull Goal automatically generate sounds due to object interactions in the physical simulation of a virtual environment

bull PI Doug James (Cornell)

Siggraph 2012 Papers - Motion-Driven Concatenative Synthesis of Cloth Sounds An et al - Precomputed Acceleration Noise for Improved Rigid-Body Sound Chadwick et al

Data-Driven Modeling

Siggraph 2012 Papers - A Probabilistic Model for Component-Based Shape Synthesis Kalogerakis et al - An Algebraic Model for Parameterized Shape Editing Bokeloh et al

httpvisualstanfordedu

- Goal Capture the nature of a chair or an animal by analyzing large databases of similar objects to allow working with parts rather than polygons Make tools that enable users of all skill levels to produce custom high-quality content for virtual worlds - PIs Vladlen Koltun (Stanford) Tom Funkhouser (Princeton) Pat Hanrahan (Stanford)

Data-Driven Modeling

Siggraph 2012 Papers - A Probabilistic Model for Component-Based Shape Synthesis Kalogerakis et al - An Algebraic Model for Parameterized Shape Editing Bokeloh et al

httpvisualstanfordedu

- Goal Capture the nature of a chair or an animal by analyzing large databases of similar objects to allow working with parts rather than polygons Make tools that enable users of all skill levels to produce custom high-quality content for virtual worlds - PIs Vladlen Koltun (Stanford) Tom Funkhouser (Princeton) Pat Hanrahan (Stanford)

Intel Visual Computing Institute

httpswwwintel-university-collaborationnetpage_id=998

Saarbruumlcken Germany

An Open Collaborative Research Institute at the Saarland Campus

Multimodal

Computing

and

Interaction

IVCI Mission Facilitate the progress of Visual Computing research and be a driver towards highest

quality image real-time processing and interactive visualization

Virtual Worlds (Model-based)

Multimodal Scene Analysis amp Interaction

Real Worlds (Sample-based)

Intel VCI Vision Scalable Algorithms for

Real Time Realistic

Rendering

Compiler Support for

High Performance

Graphics

Collaborative Distributed Molecular

Modeling and Visualization

Efficient High Quality

Rendering Using Sample-based

Representations

Scalable Hybrid Rendering for

Large Scale Visualization

Marker-free Performance

Capture

Algorithms for Low Cost Depth

Imaging

Visualization and editing of light

transport

Internet Transport and Coding for 3D

HD-TV

Software- innovation for the Digital Enterprise

Kusanagi Coding and

Interaction for Networked Games

Multi Touch Interaction

Techniques for Mixed 2D and 3D Graphics Displays

Advanced Ray Tracing and Data-Flow

Processing for the 3D Internet

Intel VCI Projects-Based Organization

ECOUSS Efficient and open Compiler-

Framework for parallel Simulations

SCENE Novel Scene Representations for Rich

Networked Media

VERVE Vanquishing fear and apathy

through E-inclusion

Large Scale Visualization in the Internet of Displays

User-centric Video

Processing

Local Dimming for Edge-lit LED LCD-Monitors

SCI Institute Utah USA

Stanford University California USA

Research Collaboration

Consortium Members

User-Centric Video Processing Jan Kautz Christian Theobalt

bull Objective ndash Create new user experiences for capturing

editing and browsing

ndash Targets amateur video creators

bull Approach ndash Automatically identify spationdashtemporal and

semantic relationships withinbetween videos

ndash Leverage graph of these to drive UI and video processing

bull Expected results Capturing automatic stabilization and

enhancement

Editing edit semantic objects in videos

Browsing find semantically related videos

Remove the person in white

Video Inpainting in Dynamic Scenes amp Videoscape for moving through Internet Videos

Efficient High-Quality Rendering Using Sample-based Representations Elmar Eisemann

bull Realistic Rendering ndash Lens Flare [Siggraphrsquo11]

ndash Depth-of-field [Eurographics lsquo11]

ndash Global Illumination [PGrsquo11]

bull Perceptual Rendering ndash Stereo

ndash High Dynamic Range

bull Alternative representations ndash Voxel Data

ndash Height Fields

3D Internet Interactive 3D Content on the Web Philipp Slusallek

bull XML3D Scene Description ndash HTML-5 extension for interactive graphics

ndash JS implementation amp built into the browser

ndash Reuses Web Technology (DOM CSS JS)

bull XFLOW Parallel Processing ndash Data-parallel flowgraph for XML3D

ndash Animations image amp geometry processing

ndash Configuration within the DOM

bull Results ndash W3C standardization ldquoDeclarative 3D for the Webrdquo

ndash Rich media apps for BMW SLS-Museum hellip

3D-Internet Apps SLS-Museum 3D-Installation amp Museum with Interactive Virtual Characters

3D-Internet Apps Using OpenStreetMap-3D as Shared Virtual Worlds

Fully automatically generated from OpenStreet Map Taking semantic data into acount

Marker-free Performance Capture Christian Theobalt

bull Reconstruction of detailed human animation models ndash In Multi-view video without markers

ndash Out Detailed motion shape and appearance

ndash General clothing modifiable performances new animations

bull Real-time performance capture ndash Fast full-body motion estimation from depth

cameras

ndash Interaction

ndash Collaboration with Intel Magic Mirror project

[ICCV 2011]

[SIGGRAPH Asia 2010]

Markerless Motion Capture of Interacting Characters Using Multi-view Image Segmentation

Articulated Models Input silhouettes Segmentation Contour labels Estimated surface Estimated 3D models

Handling Intersections

Improved segmentation with 3D shape priors Excellent performance when evaluated against marker-based system

bull Interactive inspection of light transport in virtual scenes ndash You can only manipulate what you see

ndash First prototypal light manipulation tools

bull Efficient global illumination ndash Otherwise no interactive

visualization nor manipulation

ndash Improvements on many-lights methods and progressive photon mapping

bull Results ndash Demonstrator Maya plugin ndash Collaboration with local film academy

Visualization and Editing of Light Transport Carsten Dachsbacher

Advanced Real-Time Ray Tracing Techniques Philipp Slusallek

bull Perfect importance sampling and caching ndash Sparse but perfect importance sampling

ndash Caching and interpolation [Eurographics`12]

bull Unifying Photon-Mapping amp Monte-Carlo ndash Formulating PM as a MC process

ndash Per pixel combination using MIS

bull Data-parallel implementations

ndash Efficiency and performance

bull Integration into XML3D

ndash Provide ldquocorrectrdquo results by default

Vertex Merging with Multiple Importance Sampling Photon-Mapping as a Monte-Carlo Process

BPT

PPM Progressive Photon-Mapping (PPM)

Bidirectional Path Tracing (BPT)

bull Whole-Function Vectorization ndash Restore scalar computations

ndash LLVM platform-independent

ndash RenderMan frontend OpenCL driver

bull Vector Programming ndash Formalized C extension for portable

effective SIMD programming

ndash Type system triggers vectorization

ndash Data layout adaption

bull New Programming Models for High-Performance Graphics

bull Results ndash Demonstrators for shaders and HPC code

ndash CC++-Extensions (with Intel)

ndash OpenCL compiler (CPU)

Compiler Support for High-Performance Graphics Sebastian Hack

bull Hybrid Rendering ndash Client amp Server Model

ndash Smartphone to Mainframe

bull Large Data Processing ndash Scalable Hierarchical

RW Data Structures

bull Results ndash ZAPP displaywall demonstrator

ndash ImageVis3D (Mobile) demonstrator

ndash Practically use in hospitals

Scalable Hybrid Rendering for Large Scale Visualization Jens Kruumlger

Displays as a Service Large Scale Visualization Alexander Loumlffler

bull Virtualization of Displays ndash Virtual Framebuffer and Displays exposed to Internet

ndash Replacing cables by switched IP network

ndash Internet standards for video encoding and streaming

bull Fully Synchronized ndash 120 Hz active stereo sync over IP

ndash Accuracy of ~100us in software

ndash Drives GPU displays output

bull Results ndash 20-screen wall demonstrator

ndash 3-screen wall (thin-bezel)

ndash CE4100 based SW synchronization

SIGGRAPH 2012

Backup

The Intel Science and Technology Center (ISTC) and Intel Collaborative Research Institute (ICRI) Programs

35

The modern economy is an information economy and one that is driven by innovations that enhance productivity as well as create new modes of entertainment We need to invest in the basic research that will inspire future products and services and ensure long term health of our information economy Government and private foundations are helping but corporate America needs to step up and increase commitments to university research - Justin Rattner ndash Intel CTO

$140M investment over 5 years announced by Intel in 2011 and 2012

Centers of Excellence bull Each ISTC and ICRI will focus on one

research area eg visual computing secure computing

bull The ISTCs and ICRIs are meant to bring the best and brightest researchers across the US together

bull Each ISTC and ICRI will be led by a host university and will include thought leaders from other schools

Breaking Barriers to Collaboration

bull Open IP models and open source software to encourage free information exchange (In most of the Centers)

bull Favor projects that span multiple institutions to encourage collaboration among universities

bull Intel researches per center assigned to work on-campus to encourage collaboration between Intel and academia

Greater Impact to Future Tech bull Center research themes to

address essential needs of computing technology

bull Research agendas jointly defined and co-led by an Intel and a University Principal Investigator

bull After completing 3-5 year charters new ISTCs and ICRIs can be formed to respond to changing tech environment

httpfolditportal

Serious Gaming pplied to Content Creation

Highlighted by President Obama Winner of most-significant new visualization tool (NSF)

Goal Create high-quality content by casting creation activities as games in which large numbers of people are incentivized to perform simple tasks which in combination yield sophisticated content PIs Zoran Popovic (UW) Noah Snavely (Cornell) Maneesh Agrawala(Berkeley)

Determining the structure of retroviral protease (HIV)

Video Frank to add Papers Frank to add

Extracting Structure and Semantics

CAD Model Points

Structures

People

Goals Enable context aware computing and automated content creation through the capture analysis and manipulation of real-world visual data PIs Steve Seitz (UW) Noah Snavely (Cornell) Tom Funkhouser (Princeton) Vladlen Koltun (Stanford) Jitendra Malik (Berkeley) Deva Ramanan (UV Irvine)

Video Frank to add Papers Frank to add

httpvisualstanfordedu

Computational Photography (Franken Camera)

Being adopted as a standard API for cellphone camera systems (Apple Android)

bull Goal Develop algorithms languages architectures and prototypes demonstrating the use of computation in the process of image capture and display

bull PIs Marc Levoy (Stanford) Mark Horowitz (Stanford) Pat Hanrahan (Stanford)

Video Frank to add Papers Frank to add

ISTC-VC SIGGRAPH Papers

Character Locomotion Monday 6 August 900 AM - 1030 AM Optimizing Locomotion Controllers Using Biologically Based Actuators and Objectives Jack M Wang Samuel R Hamner Scott L Delp Vladlen Koltun Continuous Character Control With Low-Dimensional Embeddings Sergey Levine Jack M Wang Alexis Haraux Zoran Popović Vladlen Koltun Shape Analysis Monday 6 August 900 AM - 1030 AM Schelling Points on 3D Surface Meshes Xiaobai Chen Abulhair Saparov Bill Pang Thomas Funkhouser Shape Transformation Wednesday 8 August 900 - 1030 AM An Algebraic Model for Parameterized Shape Editing Martin Bokeloh Michael Wand Hans-Peter Seidel Vladlen Koltun

42

ISTC-VC SIGGRAPH Papers

Image Processing Monday 6 August 2- 330 pm Decoupling Algorithms From Schedules for Easy Optimization of Image-Processing Pipelines Jonathan Ragan-Kelley Andrew Adams Sylvain Paris Marc Levoy Saman Amarasinghe Freacutedo Durand

Cloth

Monday 6 August 2-330 pm Specular Reflection From Woven Cloth Piti Irawan Steve Marschner Stitch Meshes for Modeling Knitted Clothing With Yarn-level Detail Cem Yuksel Jonathan M Kaldor Doug L James Steve Marschner

Appearance

Monday 6 August 345-535 pm Printing Spatially Varying Reflectance for Reproducing HDR Images Yue Dong Xin Tong Fabio Pellacini Baining Guo

43

ISTC-VC SIGGRAPH Papers (cont)

Hand Eye and Face Monday 6 August 345-535 pm Session Chair - Vladlen Koltun Discovery of Complex Behaviors through Contact-Invariant Optimization Igor Mordatch Emanuel Todorov Zoran Popovi1049029 Sketching Monday 6 August 345-535 pm HelpingHand Example-Based Stroke Stylization Jingwan Lu Fisher Yu Adam Finkelstein Stephen DiVerdi Fabrication Tuesday 7 August 9-1030 am Fabricating Articulated Characters From Skinned Meshes Moritz Baumlcher Bernd Bickel Doug L James Hanspeter Pfister

44

Sampling Reconstructing and Filtering Light Tuesday 7 August 1045 am-1215 pm A Theory of Monte Carlo Visibility Sampling Ravi Ramamoorthi John Anderson Mark Meyer Derek Nowrouzezahrai Reconstructing the Indirect Light Field for Global Illumination Jaakko Lehtinen Timo Aila Samuli Laine Freacutedo Durand

Geometry Reconstruction amp Tracking

Tuesday 7 August 1045 am-1215 pm Temporally Coherent Completion of Dynamic Shapes Hao Li Linjie Luo Daniel Vlasic Pieter Peers Jovan Popovic Mark Pauly Szymon Rusinkiewicz

Sets of Shapes

Tuesday 7 August 2-330 pm Exploring Collections of 3D Models Using Fuzzy Correspondence Vladimir G Kim Wilmot Li Niloy J Mitra Stephen DiVerdi Thomas Funkhouser A Probabilistic Model for Component-Based Shape Synthesis Evangelos Kalogerakis Siddhartha Chaudhuri Daphne Koller Vladlen Koltun

45

ISTC-VC SIGGRAPH Papers (cont)

Light Rays Tuesday 7 August 2-330 pm Manifold Exploration A Markov Chain Monte Carlo Technique for Rendering Scenes With Difficult Specular Transport Wenzel Jakob Steve Marschner Bidirectional Lightcuts Bruce Walter Pramook Khungurn Kavita Bala

Fun With Video

Tuesday 7 August 345-535 pm Session Chair Noah Snavely Video Deblurring for Hand-Held Cameras Using Patch-Based Synthesis Sunghyun Cho Jue Wang Seungyong Lee Eulerian Video Magnification for Revealing Subtle Changes in the World Hao-Yu Wu Michael Rubinstein Eugene Shih John Guttag Freacutedo Durand William T Freeman Selectively De-Animating Video Jiamin Bai Aseem Agarwala Maneesh Agrawala Ravi Ramamoorthi Tools for Placing Cuts and Transitions in Interview Video Floraine Berthouzoz Wilmot Li Maneesh Agrawala

46

ISTC-VC SIGGRAPH Papers (cont)

Noise and Texture Tuesday 7 August 345-535 pm Structure-Aware Synthesis for Predictive Woven Fabric Appearance Shuang Zhao Kavita Bala Steve Marschner Wenzel Jakob Symmetry-Guided Texture Synthesis and Manipulation Vladimir Kim Yaron Lipman Thomas Funkhouser

Shape Transformation Wednesday 8 August 900 - 1030 AM An Algebraic Model for Parameterized Shape Editing Martin Bokeloh Michael Wand Hans-Peter Seidel Vladlen Koltun

Stitching

Wednesday 8 August 1045 am-1215 pm Exposing Photo Manipulation With Inconsistent Reflections James F OrsquoBrien Hany Farid

47

ISTC-VC SIGGRAPH Papers (cont)

Maps Surfaces and Shapes

Wednesday 8 August 1045 am-1215 pm Simple Formulas For Quasiconformal Plane Deformations Yaron Lipman Vladimir G Kim Thomas Funkhouser

Interactive Systems amp Hardware Wednesday 8 August 2-330 pm Position-Correcting Tools for 2D Digital Fabrication Alec Rivers Ilan E Moyer Freacutedo Durand

48

ISTC-VC SIGGRAPH Papers (cont)

Collisions Wednesday 8 August 345-535 pm Energy-Based Self-Collision Culling for Arbitrary Mesh Deformations Changxi Zheng Doug L James

All About Images

Thursday 9 August 9-1030 am A Framework for Content-Adaptive Photo Manipulation Macros Application to Face Landscape and Global Manipulations Floraine Berthouzoz Wilmot Li Mira Dontcheva Maneesh Agrawala

Sound and Elements

Thursday 9 August 9-1030 am Motion-Driven Concatenative Synthesis of Cloth Sounds Steven S An Doug L James Steve Marschner Precomputed Acceleration Noise for Improved Rigid-Body Sound Jeffrey N Chadwick Changxi Zheng Doug L James Interactive Sound Propagation Using Compact Acoustic Transfer Operators Lakulish Antani Anish Chandak Lauri Savioja Dinesh Manocha Updated Sparse Cholesky Factors for Corotational Elastodynamics Florian Hecht Yeon Jin Lee Jonathan R Shewchuk James F OrsquoBrien

49

ISTC-VC SIGGRAPH Papers (cont)

Geometry amp Viewing Thursday 9 August 2-330 pm Perceptual Models of Viewpoint Preference Adrian Secordm Jingwan Lu Adam Finkelstein Manish Singh Andrew Nealen

Faces and Hair [Closing Session]

Thursday 9 August 345-515 pm Coupled 3D Reconstruction of Sparse Facial Hair and Skin Thabo Beeler Bernd Bickel Gioacchino Noris Paul Beardsley Steve Marschner Robert W Sumner Markus Gross Physical Face Cloning Bernd Bickel Peter Kaufmann Melina Skouras Bernhard Thomaszewski Derek Bradley Thabo Beeler Philip Jackson Steve Marschner Wojciech Matusik Markus Gross

50

ISTC-VC SIGGRAPH Papers (cont)

Siggraph Courses Optimizing Realistic Rendering With Many-Light Methods Sunday 5 August 2-515 pm Jaroslav Krivanek Milos Hasan Adam Arbree Carsten Dachsbacher Alexander Keller Bruce Walter State of the Art in Photon-Density Estimation Thursday 9 August 2-515 pm Toshiya Hachisuka Wojciech Jarosz Guillaume Bouchard Per Christensen Jeppe Revall Frisvad Wenzel Jakob Henrik Wann Jensen Jared M Johnson Michael Kaschalk Claude Knaus Andrew Selle Ben Spencer

Siggraph Talks

Silence Eliminate the Noise Thursday 9 August 9-1030 am Importance Sampling for Hair Scattering Jiawei Ou Feng Xie Parashar Krishnamachari Fabio Pellacini

Siggraph Exhibitor Sessions

Intel Corporation Wednesday 8 August 430-530 pm room 402B The Future of Visual Computing as Viewed by Intel Visual Computing Research Centers

51

Other ISTC-VC SIGGRAPH Participation

Page 7: Future of Visual Computing as viewed by Intel Visual ... · PDF fileFuture of Visual Computing as viewed by Intel Visual Computing Research Centers ... Justin Rattner Intel Science

Appearance of Virtual Characters Knit Woven Clothing

Siggraph 2012 Papers - Stitch Meshes for Modeling Knitted Clothing With Yarn-level Detail Yuksel et al - Structure-Aware Synthesis for Predictive Woven Fabric Appearance Zhao et al

- Goal Build up physical model of cloth to support physically correct appearance and motion - PIs Steve Marschner Kavita Bala Doug James (Cornell) James OrsquoBrien (Berkeley)

httpvisualstanfordedu

Control of Virtual Characters Autonomous Behavior

- Goal Automate low-level actions such as walking carrying things dealing with obstacles etc - PIs Vladlen Koltun (Stanford) Zoran Popovic (UW)

Siggraph 2012 Papers - Optimizing Locomotion Controllers Using Biologically-Based Actuators and Objectives Wang et al - Discovery of Complex Behaviors through Contact-Invariant Optimization Mordatch et al

httpvisualstanfordedu

Control of Virtual Characters Autonomous Behavior

- Goal Automate low-level actions such as walking carrying things dealing with obstacles etc - Investigators Vladlen Koltun (Stanford) Zoran Popovic (UW)

Siggraph 2012 Papers - Optimizing Locomotion Controllers Using Biologically-Based Actuators and Objectives Wang et al - Discovery of Complex Behaviors through Contact-Invariant Optimization Mordatch et al - Continuous Character Control With Low-Dimensional Embeddings Levine et al

httpvisualstanfordedu

Physically-Based Sound

Widely reported in popular scientific media (NPR Science Friday BBC hellip)

bull Goal automatically generate sounds due to object interactions in the physical simulation of a virtual environment

bull PI Doug James (Cornell)

Siggraph 2012 Papers - Motion-Driven Concatenative Synthesis of Cloth Sounds An et al - Precomputed Acceleration Noise for Improved Rigid-Body Sound Chadwick et al

Data-Driven Modeling

Siggraph 2012 Papers - A Probabilistic Model for Component-Based Shape Synthesis Kalogerakis et al - An Algebraic Model for Parameterized Shape Editing Bokeloh et al

httpvisualstanfordedu

- Goal Capture the nature of a chair or an animal by analyzing large databases of similar objects to allow working with parts rather than polygons Make tools that enable users of all skill levels to produce custom high-quality content for virtual worlds - PIs Vladlen Koltun (Stanford) Tom Funkhouser (Princeton) Pat Hanrahan (Stanford)

Data-Driven Modeling

Siggraph 2012 Papers - A Probabilistic Model for Component-Based Shape Synthesis Kalogerakis et al - An Algebraic Model for Parameterized Shape Editing Bokeloh et al

httpvisualstanfordedu

- Goal Capture the nature of a chair or an animal by analyzing large databases of similar objects to allow working with parts rather than polygons Make tools that enable users of all skill levels to produce custom high-quality content for virtual worlds - PIs Vladlen Koltun (Stanford) Tom Funkhouser (Princeton) Pat Hanrahan (Stanford)

Intel Visual Computing Institute

httpswwwintel-university-collaborationnetpage_id=998

Saarbruumlcken Germany

An Open Collaborative Research Institute at the Saarland Campus

Multimodal

Computing

and

Interaction

IVCI Mission Facilitate the progress of Visual Computing research and be a driver towards highest

quality image real-time processing and interactive visualization

Virtual Worlds (Model-based)

Multimodal Scene Analysis amp Interaction

Real Worlds (Sample-based)

Intel VCI Vision Scalable Algorithms for

Real Time Realistic

Rendering

Compiler Support for

High Performance

Graphics

Collaborative Distributed Molecular

Modeling and Visualization

Efficient High Quality

Rendering Using Sample-based

Representations

Scalable Hybrid Rendering for

Large Scale Visualization

Marker-free Performance

Capture

Algorithms for Low Cost Depth

Imaging

Visualization and editing of light

transport

Internet Transport and Coding for 3D

HD-TV

Software- innovation for the Digital Enterprise

Kusanagi Coding and

Interaction for Networked Games

Multi Touch Interaction

Techniques for Mixed 2D and 3D Graphics Displays

Advanced Ray Tracing and Data-Flow

Processing for the 3D Internet

Intel VCI Projects-Based Organization

ECOUSS Efficient and open Compiler-

Framework for parallel Simulations

SCENE Novel Scene Representations for Rich

Networked Media

VERVE Vanquishing fear and apathy

through E-inclusion

Large Scale Visualization in the Internet of Displays

User-centric Video

Processing

Local Dimming for Edge-lit LED LCD-Monitors

SCI Institute Utah USA

Stanford University California USA

Research Collaboration

Consortium Members

User-Centric Video Processing Jan Kautz Christian Theobalt

bull Objective ndash Create new user experiences for capturing

editing and browsing

ndash Targets amateur video creators

bull Approach ndash Automatically identify spationdashtemporal and

semantic relationships withinbetween videos

ndash Leverage graph of these to drive UI and video processing

bull Expected results Capturing automatic stabilization and

enhancement

Editing edit semantic objects in videos

Browsing find semantically related videos

Remove the person in white

Video Inpainting in Dynamic Scenes amp Videoscape for moving through Internet Videos

Efficient High-Quality Rendering Using Sample-based Representations Elmar Eisemann

bull Realistic Rendering ndash Lens Flare [Siggraphrsquo11]

ndash Depth-of-field [Eurographics lsquo11]

ndash Global Illumination [PGrsquo11]

bull Perceptual Rendering ndash Stereo

ndash High Dynamic Range

bull Alternative representations ndash Voxel Data

ndash Height Fields

3D Internet Interactive 3D Content on the Web Philipp Slusallek

bull XML3D Scene Description ndash HTML-5 extension for interactive graphics

ndash JS implementation amp built into the browser

ndash Reuses Web Technology (DOM CSS JS)

bull XFLOW Parallel Processing ndash Data-parallel flowgraph for XML3D

ndash Animations image amp geometry processing

ndash Configuration within the DOM

bull Results ndash W3C standardization ldquoDeclarative 3D for the Webrdquo

ndash Rich media apps for BMW SLS-Museum hellip

3D-Internet Apps SLS-Museum 3D-Installation amp Museum with Interactive Virtual Characters

3D-Internet Apps Using OpenStreetMap-3D as Shared Virtual Worlds

Fully automatically generated from OpenStreet Map Taking semantic data into acount

Marker-free Performance Capture Christian Theobalt

bull Reconstruction of detailed human animation models ndash In Multi-view video without markers

ndash Out Detailed motion shape and appearance

ndash General clothing modifiable performances new animations

bull Real-time performance capture ndash Fast full-body motion estimation from depth

cameras

ndash Interaction

ndash Collaboration with Intel Magic Mirror project

[ICCV 2011]

[SIGGRAPH Asia 2010]

Markerless Motion Capture of Interacting Characters Using Multi-view Image Segmentation

Articulated Models Input silhouettes Segmentation Contour labels Estimated surface Estimated 3D models

Handling Intersections

Improved segmentation with 3D shape priors Excellent performance when evaluated against marker-based system

bull Interactive inspection of light transport in virtual scenes ndash You can only manipulate what you see

ndash First prototypal light manipulation tools

bull Efficient global illumination ndash Otherwise no interactive

visualization nor manipulation

ndash Improvements on many-lights methods and progressive photon mapping

bull Results ndash Demonstrator Maya plugin ndash Collaboration with local film academy

Visualization and Editing of Light Transport Carsten Dachsbacher

Advanced Real-Time Ray Tracing Techniques Philipp Slusallek

bull Perfect importance sampling and caching ndash Sparse but perfect importance sampling

ndash Caching and interpolation [Eurographics`12]

bull Unifying Photon-Mapping amp Monte-Carlo ndash Formulating PM as a MC process

ndash Per pixel combination using MIS

bull Data-parallel implementations

ndash Efficiency and performance

bull Integration into XML3D

ndash Provide ldquocorrectrdquo results by default

Vertex Merging with Multiple Importance Sampling Photon-Mapping as a Monte-Carlo Process

BPT

PPM Progressive Photon-Mapping (PPM)

Bidirectional Path Tracing (BPT)

bull Whole-Function Vectorization ndash Restore scalar computations

ndash LLVM platform-independent

ndash RenderMan frontend OpenCL driver

bull Vector Programming ndash Formalized C extension for portable

effective SIMD programming

ndash Type system triggers vectorization

ndash Data layout adaption

bull New Programming Models for High-Performance Graphics

bull Results ndash Demonstrators for shaders and HPC code

ndash CC++-Extensions (with Intel)

ndash OpenCL compiler (CPU)

Compiler Support for High-Performance Graphics Sebastian Hack

bull Hybrid Rendering ndash Client amp Server Model

ndash Smartphone to Mainframe

bull Large Data Processing ndash Scalable Hierarchical

RW Data Structures

bull Results ndash ZAPP displaywall demonstrator

ndash ImageVis3D (Mobile) demonstrator

ndash Practically use in hospitals

Scalable Hybrid Rendering for Large Scale Visualization Jens Kruumlger

Displays as a Service Large Scale Visualization Alexander Loumlffler

bull Virtualization of Displays ndash Virtual Framebuffer and Displays exposed to Internet

ndash Replacing cables by switched IP network

ndash Internet standards for video encoding and streaming

bull Fully Synchronized ndash 120 Hz active stereo sync over IP

ndash Accuracy of ~100us in software

ndash Drives GPU displays output

bull Results ndash 20-screen wall demonstrator

ndash 3-screen wall (thin-bezel)

ndash CE4100 based SW synchronization

SIGGRAPH 2012

Backup

The Intel Science and Technology Center (ISTC) and Intel Collaborative Research Institute (ICRI) Programs

35

The modern economy is an information economy and one that is driven by innovations that enhance productivity as well as create new modes of entertainment We need to invest in the basic research that will inspire future products and services and ensure long term health of our information economy Government and private foundations are helping but corporate America needs to step up and increase commitments to university research - Justin Rattner ndash Intel CTO

$140M investment over 5 years announced by Intel in 2011 and 2012

Centers of Excellence bull Each ISTC and ICRI will focus on one

research area eg visual computing secure computing

bull The ISTCs and ICRIs are meant to bring the best and brightest researchers across the US together

bull Each ISTC and ICRI will be led by a host university and will include thought leaders from other schools

Breaking Barriers to Collaboration

bull Open IP models and open source software to encourage free information exchange (In most of the Centers)

bull Favor projects that span multiple institutions to encourage collaboration among universities

bull Intel researches per center assigned to work on-campus to encourage collaboration between Intel and academia

Greater Impact to Future Tech bull Center research themes to

address essential needs of computing technology

bull Research agendas jointly defined and co-led by an Intel and a University Principal Investigator

bull After completing 3-5 year charters new ISTCs and ICRIs can be formed to respond to changing tech environment

httpfolditportal

Serious Gaming pplied to Content Creation

Highlighted by President Obama Winner of most-significant new visualization tool (NSF)

Goal Create high-quality content by casting creation activities as games in which large numbers of people are incentivized to perform simple tasks which in combination yield sophisticated content PIs Zoran Popovic (UW) Noah Snavely (Cornell) Maneesh Agrawala(Berkeley)

Determining the structure of retroviral protease (HIV)

Video Frank to add Papers Frank to add

Extracting Structure and Semantics

CAD Model Points

Structures

People

Goals Enable context aware computing and automated content creation through the capture analysis and manipulation of real-world visual data PIs Steve Seitz (UW) Noah Snavely (Cornell) Tom Funkhouser (Princeton) Vladlen Koltun (Stanford) Jitendra Malik (Berkeley) Deva Ramanan (UV Irvine)

Video Frank to add Papers Frank to add

httpvisualstanfordedu

Computational Photography (Franken Camera)

Being adopted as a standard API for cellphone camera systems (Apple Android)

bull Goal Develop algorithms languages architectures and prototypes demonstrating the use of computation in the process of image capture and display

bull PIs Marc Levoy (Stanford) Mark Horowitz (Stanford) Pat Hanrahan (Stanford)

Video Frank to add Papers Frank to add

ISTC-VC SIGGRAPH Papers

Character Locomotion Monday 6 August 900 AM - 1030 AM Optimizing Locomotion Controllers Using Biologically Based Actuators and Objectives Jack M Wang Samuel R Hamner Scott L Delp Vladlen Koltun Continuous Character Control With Low-Dimensional Embeddings Sergey Levine Jack M Wang Alexis Haraux Zoran Popović Vladlen Koltun Shape Analysis Monday 6 August 900 AM - 1030 AM Schelling Points on 3D Surface Meshes Xiaobai Chen Abulhair Saparov Bill Pang Thomas Funkhouser Shape Transformation Wednesday 8 August 900 - 1030 AM An Algebraic Model for Parameterized Shape Editing Martin Bokeloh Michael Wand Hans-Peter Seidel Vladlen Koltun

42

ISTC-VC SIGGRAPH Papers

Image Processing Monday 6 August 2- 330 pm Decoupling Algorithms From Schedules for Easy Optimization of Image-Processing Pipelines Jonathan Ragan-Kelley Andrew Adams Sylvain Paris Marc Levoy Saman Amarasinghe Freacutedo Durand

Cloth

Monday 6 August 2-330 pm Specular Reflection From Woven Cloth Piti Irawan Steve Marschner Stitch Meshes for Modeling Knitted Clothing With Yarn-level Detail Cem Yuksel Jonathan M Kaldor Doug L James Steve Marschner

Appearance

Monday 6 August 345-535 pm Printing Spatially Varying Reflectance for Reproducing HDR Images Yue Dong Xin Tong Fabio Pellacini Baining Guo

43

ISTC-VC SIGGRAPH Papers (cont)

Hand Eye and Face Monday 6 August 345-535 pm Session Chair - Vladlen Koltun Discovery of Complex Behaviors through Contact-Invariant Optimization Igor Mordatch Emanuel Todorov Zoran Popovi1049029 Sketching Monday 6 August 345-535 pm HelpingHand Example-Based Stroke Stylization Jingwan Lu Fisher Yu Adam Finkelstein Stephen DiVerdi Fabrication Tuesday 7 August 9-1030 am Fabricating Articulated Characters From Skinned Meshes Moritz Baumlcher Bernd Bickel Doug L James Hanspeter Pfister

44

Sampling Reconstructing and Filtering Light Tuesday 7 August 1045 am-1215 pm A Theory of Monte Carlo Visibility Sampling Ravi Ramamoorthi John Anderson Mark Meyer Derek Nowrouzezahrai Reconstructing the Indirect Light Field for Global Illumination Jaakko Lehtinen Timo Aila Samuli Laine Freacutedo Durand

Geometry Reconstruction amp Tracking

Tuesday 7 August 1045 am-1215 pm Temporally Coherent Completion of Dynamic Shapes Hao Li Linjie Luo Daniel Vlasic Pieter Peers Jovan Popovic Mark Pauly Szymon Rusinkiewicz

Sets of Shapes

Tuesday 7 August 2-330 pm Exploring Collections of 3D Models Using Fuzzy Correspondence Vladimir G Kim Wilmot Li Niloy J Mitra Stephen DiVerdi Thomas Funkhouser A Probabilistic Model for Component-Based Shape Synthesis Evangelos Kalogerakis Siddhartha Chaudhuri Daphne Koller Vladlen Koltun

45

ISTC-VC SIGGRAPH Papers (cont)

Light Rays Tuesday 7 August 2-330 pm Manifold Exploration A Markov Chain Monte Carlo Technique for Rendering Scenes With Difficult Specular Transport Wenzel Jakob Steve Marschner Bidirectional Lightcuts Bruce Walter Pramook Khungurn Kavita Bala

Fun With Video

Tuesday 7 August 345-535 pm Session Chair Noah Snavely Video Deblurring for Hand-Held Cameras Using Patch-Based Synthesis Sunghyun Cho Jue Wang Seungyong Lee Eulerian Video Magnification for Revealing Subtle Changes in the World Hao-Yu Wu Michael Rubinstein Eugene Shih John Guttag Freacutedo Durand William T Freeman Selectively De-Animating Video Jiamin Bai Aseem Agarwala Maneesh Agrawala Ravi Ramamoorthi Tools for Placing Cuts and Transitions in Interview Video Floraine Berthouzoz Wilmot Li Maneesh Agrawala

46

ISTC-VC SIGGRAPH Papers (cont)

Noise and Texture Tuesday 7 August 345-535 pm Structure-Aware Synthesis for Predictive Woven Fabric Appearance Shuang Zhao Kavita Bala Steve Marschner Wenzel Jakob Symmetry-Guided Texture Synthesis and Manipulation Vladimir Kim Yaron Lipman Thomas Funkhouser

Shape Transformation Wednesday 8 August 900 - 1030 AM An Algebraic Model for Parameterized Shape Editing Martin Bokeloh Michael Wand Hans-Peter Seidel Vladlen Koltun

Stitching

Wednesday 8 August 1045 am-1215 pm Exposing Photo Manipulation With Inconsistent Reflections James F OrsquoBrien Hany Farid

47

ISTC-VC SIGGRAPH Papers (cont)

Maps Surfaces and Shapes

Wednesday 8 August 1045 am-1215 pm Simple Formulas For Quasiconformal Plane Deformations Yaron Lipman Vladimir G Kim Thomas Funkhouser

Interactive Systems amp Hardware Wednesday 8 August 2-330 pm Position-Correcting Tools for 2D Digital Fabrication Alec Rivers Ilan E Moyer Freacutedo Durand

48

ISTC-VC SIGGRAPH Papers (cont)

Collisions Wednesday 8 August 345-535 pm Energy-Based Self-Collision Culling for Arbitrary Mesh Deformations Changxi Zheng Doug L James

All About Images

Thursday 9 August 9-1030 am A Framework for Content-Adaptive Photo Manipulation Macros Application to Face Landscape and Global Manipulations Floraine Berthouzoz Wilmot Li Mira Dontcheva Maneesh Agrawala

Sound and Elements

Thursday 9 August 9-1030 am Motion-Driven Concatenative Synthesis of Cloth Sounds Steven S An Doug L James Steve Marschner Precomputed Acceleration Noise for Improved Rigid-Body Sound Jeffrey N Chadwick Changxi Zheng Doug L James Interactive Sound Propagation Using Compact Acoustic Transfer Operators Lakulish Antani Anish Chandak Lauri Savioja Dinesh Manocha Updated Sparse Cholesky Factors for Corotational Elastodynamics Florian Hecht Yeon Jin Lee Jonathan R Shewchuk James F OrsquoBrien

49

ISTC-VC SIGGRAPH Papers (cont)

Geometry amp Viewing Thursday 9 August 2-330 pm Perceptual Models of Viewpoint Preference Adrian Secordm Jingwan Lu Adam Finkelstein Manish Singh Andrew Nealen

Faces and Hair [Closing Session]

Thursday 9 August 345-515 pm Coupled 3D Reconstruction of Sparse Facial Hair and Skin Thabo Beeler Bernd Bickel Gioacchino Noris Paul Beardsley Steve Marschner Robert W Sumner Markus Gross Physical Face Cloning Bernd Bickel Peter Kaufmann Melina Skouras Bernhard Thomaszewski Derek Bradley Thabo Beeler Philip Jackson Steve Marschner Wojciech Matusik Markus Gross

50

ISTC-VC SIGGRAPH Papers (cont)

Siggraph Courses Optimizing Realistic Rendering With Many-Light Methods Sunday 5 August 2-515 pm Jaroslav Krivanek Milos Hasan Adam Arbree Carsten Dachsbacher Alexander Keller Bruce Walter State of the Art in Photon-Density Estimation Thursday 9 August 2-515 pm Toshiya Hachisuka Wojciech Jarosz Guillaume Bouchard Per Christensen Jeppe Revall Frisvad Wenzel Jakob Henrik Wann Jensen Jared M Johnson Michael Kaschalk Claude Knaus Andrew Selle Ben Spencer

Siggraph Talks

Silence Eliminate the Noise Thursday 9 August 9-1030 am Importance Sampling for Hair Scattering Jiawei Ou Feng Xie Parashar Krishnamachari Fabio Pellacini

Siggraph Exhibitor Sessions

Intel Corporation Wednesday 8 August 430-530 pm room 402B The Future of Visual Computing as Viewed by Intel Visual Computing Research Centers

51

Other ISTC-VC SIGGRAPH Participation

Page 8: Future of Visual Computing as viewed by Intel Visual ... · PDF fileFuture of Visual Computing as viewed by Intel Visual Computing Research Centers ... Justin Rattner Intel Science

Control of Virtual Characters Autonomous Behavior

- Goal Automate low-level actions such as walking carrying things dealing with obstacles etc - PIs Vladlen Koltun (Stanford) Zoran Popovic (UW)

Siggraph 2012 Papers - Optimizing Locomotion Controllers Using Biologically-Based Actuators and Objectives Wang et al - Discovery of Complex Behaviors through Contact-Invariant Optimization Mordatch et al

httpvisualstanfordedu

Control of Virtual Characters Autonomous Behavior

- Goal Automate low-level actions such as walking carrying things dealing with obstacles etc - Investigators Vladlen Koltun (Stanford) Zoran Popovic (UW)

Siggraph 2012 Papers - Optimizing Locomotion Controllers Using Biologically-Based Actuators and Objectives Wang et al - Discovery of Complex Behaviors through Contact-Invariant Optimization Mordatch et al - Continuous Character Control With Low-Dimensional Embeddings Levine et al

httpvisualstanfordedu

Physically-Based Sound

Widely reported in popular scientific media (NPR Science Friday BBC hellip)

bull Goal automatically generate sounds due to object interactions in the physical simulation of a virtual environment

bull PI Doug James (Cornell)

Siggraph 2012 Papers - Motion-Driven Concatenative Synthesis of Cloth Sounds An et al - Precomputed Acceleration Noise for Improved Rigid-Body Sound Chadwick et al

Data-Driven Modeling

Siggraph 2012 Papers - A Probabilistic Model for Component-Based Shape Synthesis Kalogerakis et al - An Algebraic Model for Parameterized Shape Editing Bokeloh et al

httpvisualstanfordedu

- Goal Capture the nature of a chair or an animal by analyzing large databases of similar objects to allow working with parts rather than polygons Make tools that enable users of all skill levels to produce custom high-quality content for virtual worlds - PIs Vladlen Koltun (Stanford) Tom Funkhouser (Princeton) Pat Hanrahan (Stanford)

Data-Driven Modeling

Siggraph 2012 Papers - A Probabilistic Model for Component-Based Shape Synthesis Kalogerakis et al - An Algebraic Model for Parameterized Shape Editing Bokeloh et al

httpvisualstanfordedu

- Goal Capture the nature of a chair or an animal by analyzing large databases of similar objects to allow working with parts rather than polygons Make tools that enable users of all skill levels to produce custom high-quality content for virtual worlds - PIs Vladlen Koltun (Stanford) Tom Funkhouser (Princeton) Pat Hanrahan (Stanford)

Intel Visual Computing Institute

httpswwwintel-university-collaborationnetpage_id=998

Saarbruumlcken Germany

An Open Collaborative Research Institute at the Saarland Campus

Multimodal

Computing

and

Interaction

IVCI Mission Facilitate the progress of Visual Computing research and be a driver towards highest

quality image real-time processing and interactive visualization

Virtual Worlds (Model-based)

Multimodal Scene Analysis amp Interaction

Real Worlds (Sample-based)

Intel VCI Vision Scalable Algorithms for

Real Time Realistic

Rendering

Compiler Support for

High Performance

Graphics

Collaborative Distributed Molecular

Modeling and Visualization

Efficient High Quality

Rendering Using Sample-based

Representations

Scalable Hybrid Rendering for

Large Scale Visualization

Marker-free Performance

Capture

Algorithms for Low Cost Depth

Imaging

Visualization and editing of light

transport

Internet Transport and Coding for 3D

HD-TV

Software- innovation for the Digital Enterprise

Kusanagi Coding and

Interaction for Networked Games

Multi Touch Interaction

Techniques for Mixed 2D and 3D Graphics Displays

Advanced Ray Tracing and Data-Flow

Processing for the 3D Internet

Intel VCI Projects-Based Organization

ECOUSS Efficient and open Compiler-

Framework for parallel Simulations

SCENE Novel Scene Representations for Rich

Networked Media

VERVE Vanquishing fear and apathy

through E-inclusion

Large Scale Visualization in the Internet of Displays

User-centric Video

Processing

Local Dimming for Edge-lit LED LCD-Monitors

SCI Institute Utah USA

Stanford University California USA

Research Collaboration

Consortium Members

User-Centric Video Processing Jan Kautz Christian Theobalt

bull Objective ndash Create new user experiences for capturing

editing and browsing

ndash Targets amateur video creators

bull Approach ndash Automatically identify spationdashtemporal and

semantic relationships withinbetween videos

ndash Leverage graph of these to drive UI and video processing

bull Expected results Capturing automatic stabilization and

enhancement

Editing edit semantic objects in videos

Browsing find semantically related videos

Remove the person in white

Video Inpainting in Dynamic Scenes amp Videoscape for moving through Internet Videos

Efficient High-Quality Rendering Using Sample-based Representations Elmar Eisemann

bull Realistic Rendering ndash Lens Flare [Siggraphrsquo11]

ndash Depth-of-field [Eurographics lsquo11]

ndash Global Illumination [PGrsquo11]

bull Perceptual Rendering ndash Stereo

ndash High Dynamic Range

bull Alternative representations ndash Voxel Data

ndash Height Fields

3D Internet Interactive 3D Content on the Web Philipp Slusallek

bull XML3D Scene Description ndash HTML-5 extension for interactive graphics

ndash JS implementation amp built into the browser

ndash Reuses Web Technology (DOM CSS JS)

bull XFLOW Parallel Processing ndash Data-parallel flowgraph for XML3D

ndash Animations image amp geometry processing

ndash Configuration within the DOM

bull Results ndash W3C standardization ldquoDeclarative 3D for the Webrdquo

ndash Rich media apps for BMW SLS-Museum hellip

3D-Internet Apps SLS-Museum 3D-Installation amp Museum with Interactive Virtual Characters

3D-Internet Apps Using OpenStreetMap-3D as Shared Virtual Worlds

Fully automatically generated from OpenStreet Map Taking semantic data into acount

Marker-free Performance Capture Christian Theobalt

bull Reconstruction of detailed human animation models ndash In Multi-view video without markers

ndash Out Detailed motion shape and appearance

ndash General clothing modifiable performances new animations

bull Real-time performance capture ndash Fast full-body motion estimation from depth

cameras

ndash Interaction

ndash Collaboration with Intel Magic Mirror project

[ICCV 2011]

[SIGGRAPH Asia 2010]

Markerless Motion Capture of Interacting Characters Using Multi-view Image Segmentation

Articulated Models Input silhouettes Segmentation Contour labels Estimated surface Estimated 3D models

Handling Intersections

Improved segmentation with 3D shape priors Excellent performance when evaluated against marker-based system

bull Interactive inspection of light transport in virtual scenes ndash You can only manipulate what you see

ndash First prototypal light manipulation tools

bull Efficient global illumination ndash Otherwise no interactive

visualization nor manipulation

ndash Improvements on many-lights methods and progressive photon mapping

bull Results ndash Demonstrator Maya plugin ndash Collaboration with local film academy

Visualization and Editing of Light Transport Carsten Dachsbacher

Advanced Real-Time Ray Tracing Techniques Philipp Slusallek

bull Perfect importance sampling and caching ndash Sparse but perfect importance sampling

ndash Caching and interpolation [Eurographics`12]

bull Unifying Photon-Mapping amp Monte-Carlo ndash Formulating PM as a MC process

ndash Per pixel combination using MIS

bull Data-parallel implementations

ndash Efficiency and performance

bull Integration into XML3D

ndash Provide ldquocorrectrdquo results by default

Vertex Merging with Multiple Importance Sampling Photon-Mapping as a Monte-Carlo Process

BPT

PPM Progressive Photon-Mapping (PPM)

Bidirectional Path Tracing (BPT)

bull Whole-Function Vectorization ndash Restore scalar computations

ndash LLVM platform-independent

ndash RenderMan frontend OpenCL driver

bull Vector Programming ndash Formalized C extension for portable

effective SIMD programming

ndash Type system triggers vectorization

ndash Data layout adaption

bull New Programming Models for High-Performance Graphics

bull Results ndash Demonstrators for shaders and HPC code

ndash CC++-Extensions (with Intel)

ndash OpenCL compiler (CPU)

Compiler Support for High-Performance Graphics Sebastian Hack

bull Hybrid Rendering ndash Client amp Server Model

ndash Smartphone to Mainframe

bull Large Data Processing ndash Scalable Hierarchical

RW Data Structures

bull Results ndash ZAPP displaywall demonstrator

ndash ImageVis3D (Mobile) demonstrator

ndash Practically use in hospitals

Scalable Hybrid Rendering for Large Scale Visualization Jens Kruumlger

Displays as a Service Large Scale Visualization Alexander Loumlffler

bull Virtualization of Displays ndash Virtual Framebuffer and Displays exposed to Internet

ndash Replacing cables by switched IP network

ndash Internet standards for video encoding and streaming

bull Fully Synchronized ndash 120 Hz active stereo sync over IP

ndash Accuracy of ~100us in software

ndash Drives GPU displays output

bull Results ndash 20-screen wall demonstrator

ndash 3-screen wall (thin-bezel)

ndash CE4100 based SW synchronization

SIGGRAPH 2012

Backup

The Intel Science and Technology Center (ISTC) and Intel Collaborative Research Institute (ICRI) Programs

35

The modern economy is an information economy and one that is driven by innovations that enhance productivity as well as create new modes of entertainment We need to invest in the basic research that will inspire future products and services and ensure long term health of our information economy Government and private foundations are helping but corporate America needs to step up and increase commitments to university research - Justin Rattner ndash Intel CTO

$140M investment over 5 years announced by Intel in 2011 and 2012

Centers of Excellence bull Each ISTC and ICRI will focus on one

research area eg visual computing secure computing

bull The ISTCs and ICRIs are meant to bring the best and brightest researchers across the US together

bull Each ISTC and ICRI will be led by a host university and will include thought leaders from other schools

Breaking Barriers to Collaboration

bull Open IP models and open source software to encourage free information exchange (In most of the Centers)

bull Favor projects that span multiple institutions to encourage collaboration among universities

bull Intel researches per center assigned to work on-campus to encourage collaboration between Intel and academia

Greater Impact to Future Tech bull Center research themes to

address essential needs of computing technology

bull Research agendas jointly defined and co-led by an Intel and a University Principal Investigator

bull After completing 3-5 year charters new ISTCs and ICRIs can be formed to respond to changing tech environment

httpfolditportal

Serious Gaming pplied to Content Creation

Highlighted by President Obama Winner of most-significant new visualization tool (NSF)

Goal Create high-quality content by casting creation activities as games in which large numbers of people are incentivized to perform simple tasks which in combination yield sophisticated content PIs Zoran Popovic (UW) Noah Snavely (Cornell) Maneesh Agrawala(Berkeley)

Determining the structure of retroviral protease (HIV)

Video Frank to add Papers Frank to add

Extracting Structure and Semantics

CAD Model Points

Structures

People

Goals Enable context aware computing and automated content creation through the capture analysis and manipulation of real-world visual data PIs Steve Seitz (UW) Noah Snavely (Cornell) Tom Funkhouser (Princeton) Vladlen Koltun (Stanford) Jitendra Malik (Berkeley) Deva Ramanan (UV Irvine)

Video Frank to add Papers Frank to add

httpvisualstanfordedu

Computational Photography (Franken Camera)

Being adopted as a standard API for cellphone camera systems (Apple Android)

bull Goal Develop algorithms languages architectures and prototypes demonstrating the use of computation in the process of image capture and display

bull PIs Marc Levoy (Stanford) Mark Horowitz (Stanford) Pat Hanrahan (Stanford)

Video Frank to add Papers Frank to add

ISTC-VC SIGGRAPH Papers

Character Locomotion Monday 6 August 900 AM - 1030 AM Optimizing Locomotion Controllers Using Biologically Based Actuators and Objectives Jack M Wang Samuel R Hamner Scott L Delp Vladlen Koltun Continuous Character Control With Low-Dimensional Embeddings Sergey Levine Jack M Wang Alexis Haraux Zoran Popović Vladlen Koltun Shape Analysis Monday 6 August 900 AM - 1030 AM Schelling Points on 3D Surface Meshes Xiaobai Chen Abulhair Saparov Bill Pang Thomas Funkhouser Shape Transformation Wednesday 8 August 900 - 1030 AM An Algebraic Model for Parameterized Shape Editing Martin Bokeloh Michael Wand Hans-Peter Seidel Vladlen Koltun

42

ISTC-VC SIGGRAPH Papers

Image Processing Monday 6 August 2- 330 pm Decoupling Algorithms From Schedules for Easy Optimization of Image-Processing Pipelines Jonathan Ragan-Kelley Andrew Adams Sylvain Paris Marc Levoy Saman Amarasinghe Freacutedo Durand

Cloth

Monday 6 August 2-330 pm Specular Reflection From Woven Cloth Piti Irawan Steve Marschner Stitch Meshes for Modeling Knitted Clothing With Yarn-level Detail Cem Yuksel Jonathan M Kaldor Doug L James Steve Marschner

Appearance

Monday 6 August 345-535 pm Printing Spatially Varying Reflectance for Reproducing HDR Images Yue Dong Xin Tong Fabio Pellacini Baining Guo

43

ISTC-VC SIGGRAPH Papers (cont)

Hand Eye and Face Monday 6 August 345-535 pm Session Chair - Vladlen Koltun Discovery of Complex Behaviors through Contact-Invariant Optimization Igor Mordatch Emanuel Todorov Zoran Popovi1049029 Sketching Monday 6 August 345-535 pm HelpingHand Example-Based Stroke Stylization Jingwan Lu Fisher Yu Adam Finkelstein Stephen DiVerdi Fabrication Tuesday 7 August 9-1030 am Fabricating Articulated Characters From Skinned Meshes Moritz Baumlcher Bernd Bickel Doug L James Hanspeter Pfister

44

Sampling Reconstructing and Filtering Light Tuesday 7 August 1045 am-1215 pm A Theory of Monte Carlo Visibility Sampling Ravi Ramamoorthi John Anderson Mark Meyer Derek Nowrouzezahrai Reconstructing the Indirect Light Field for Global Illumination Jaakko Lehtinen Timo Aila Samuli Laine Freacutedo Durand

Geometry Reconstruction amp Tracking

Tuesday 7 August 1045 am-1215 pm Temporally Coherent Completion of Dynamic Shapes Hao Li Linjie Luo Daniel Vlasic Pieter Peers Jovan Popovic Mark Pauly Szymon Rusinkiewicz

Sets of Shapes

Tuesday 7 August 2-330 pm Exploring Collections of 3D Models Using Fuzzy Correspondence Vladimir G Kim Wilmot Li Niloy J Mitra Stephen DiVerdi Thomas Funkhouser A Probabilistic Model for Component-Based Shape Synthesis Evangelos Kalogerakis Siddhartha Chaudhuri Daphne Koller Vladlen Koltun

45

ISTC-VC SIGGRAPH Papers (cont)

Light Rays Tuesday 7 August 2-330 pm Manifold Exploration A Markov Chain Monte Carlo Technique for Rendering Scenes With Difficult Specular Transport Wenzel Jakob Steve Marschner Bidirectional Lightcuts Bruce Walter Pramook Khungurn Kavita Bala

Fun With Video

Tuesday 7 August 345-535 pm Session Chair Noah Snavely Video Deblurring for Hand-Held Cameras Using Patch-Based Synthesis Sunghyun Cho Jue Wang Seungyong Lee Eulerian Video Magnification for Revealing Subtle Changes in the World Hao-Yu Wu Michael Rubinstein Eugene Shih John Guttag Freacutedo Durand William T Freeman Selectively De-Animating Video Jiamin Bai Aseem Agarwala Maneesh Agrawala Ravi Ramamoorthi Tools for Placing Cuts and Transitions in Interview Video Floraine Berthouzoz Wilmot Li Maneesh Agrawala

46

ISTC-VC SIGGRAPH Papers (cont)

Noise and Texture Tuesday 7 August 345-535 pm Structure-Aware Synthesis for Predictive Woven Fabric Appearance Shuang Zhao Kavita Bala Steve Marschner Wenzel Jakob Symmetry-Guided Texture Synthesis and Manipulation Vladimir Kim Yaron Lipman Thomas Funkhouser

Shape Transformation Wednesday 8 August 900 - 1030 AM An Algebraic Model for Parameterized Shape Editing Martin Bokeloh Michael Wand Hans-Peter Seidel Vladlen Koltun

Stitching

Wednesday 8 August 1045 am-1215 pm Exposing Photo Manipulation With Inconsistent Reflections James F OrsquoBrien Hany Farid

47

ISTC-VC SIGGRAPH Papers (cont)

Maps Surfaces and Shapes

Wednesday 8 August 1045 am-1215 pm Simple Formulas For Quasiconformal Plane Deformations Yaron Lipman Vladimir G Kim Thomas Funkhouser

Interactive Systems amp Hardware Wednesday 8 August 2-330 pm Position-Correcting Tools for 2D Digital Fabrication Alec Rivers Ilan E Moyer Freacutedo Durand

48

ISTC-VC SIGGRAPH Papers (cont)

Collisions Wednesday 8 August 345-535 pm Energy-Based Self-Collision Culling for Arbitrary Mesh Deformations Changxi Zheng Doug L James

All About Images

Thursday 9 August 9-1030 am A Framework for Content-Adaptive Photo Manipulation Macros Application to Face Landscape and Global Manipulations Floraine Berthouzoz Wilmot Li Mira Dontcheva Maneesh Agrawala

Sound and Elements

Thursday 9 August 9-1030 am Motion-Driven Concatenative Synthesis of Cloth Sounds Steven S An Doug L James Steve Marschner Precomputed Acceleration Noise for Improved Rigid-Body Sound Jeffrey N Chadwick Changxi Zheng Doug L James Interactive Sound Propagation Using Compact Acoustic Transfer Operators Lakulish Antani Anish Chandak Lauri Savioja Dinesh Manocha Updated Sparse Cholesky Factors for Corotational Elastodynamics Florian Hecht Yeon Jin Lee Jonathan R Shewchuk James F OrsquoBrien

49

ISTC-VC SIGGRAPH Papers (cont)

Geometry amp Viewing Thursday 9 August 2-330 pm Perceptual Models of Viewpoint Preference Adrian Secordm Jingwan Lu Adam Finkelstein Manish Singh Andrew Nealen

Faces and Hair [Closing Session]

Thursday 9 August 345-515 pm Coupled 3D Reconstruction of Sparse Facial Hair and Skin Thabo Beeler Bernd Bickel Gioacchino Noris Paul Beardsley Steve Marschner Robert W Sumner Markus Gross Physical Face Cloning Bernd Bickel Peter Kaufmann Melina Skouras Bernhard Thomaszewski Derek Bradley Thabo Beeler Philip Jackson Steve Marschner Wojciech Matusik Markus Gross

50

ISTC-VC SIGGRAPH Papers (cont)

Siggraph Courses Optimizing Realistic Rendering With Many-Light Methods Sunday 5 August 2-515 pm Jaroslav Krivanek Milos Hasan Adam Arbree Carsten Dachsbacher Alexander Keller Bruce Walter State of the Art in Photon-Density Estimation Thursday 9 August 2-515 pm Toshiya Hachisuka Wojciech Jarosz Guillaume Bouchard Per Christensen Jeppe Revall Frisvad Wenzel Jakob Henrik Wann Jensen Jared M Johnson Michael Kaschalk Claude Knaus Andrew Selle Ben Spencer

Siggraph Talks

Silence Eliminate the Noise Thursday 9 August 9-1030 am Importance Sampling for Hair Scattering Jiawei Ou Feng Xie Parashar Krishnamachari Fabio Pellacini

Siggraph Exhibitor Sessions

Intel Corporation Wednesday 8 August 430-530 pm room 402B The Future of Visual Computing as Viewed by Intel Visual Computing Research Centers

51

Other ISTC-VC SIGGRAPH Participation

Page 9: Future of Visual Computing as viewed by Intel Visual ... · PDF fileFuture of Visual Computing as viewed by Intel Visual Computing Research Centers ... Justin Rattner Intel Science

Control of Virtual Characters Autonomous Behavior

- Goal Automate low-level actions such as walking carrying things dealing with obstacles etc - Investigators Vladlen Koltun (Stanford) Zoran Popovic (UW)

Siggraph 2012 Papers - Optimizing Locomotion Controllers Using Biologically-Based Actuators and Objectives Wang et al - Discovery of Complex Behaviors through Contact-Invariant Optimization Mordatch et al - Continuous Character Control With Low-Dimensional Embeddings Levine et al

httpvisualstanfordedu

Physically-Based Sound

Widely reported in popular scientific media (NPR Science Friday BBC hellip)

bull Goal automatically generate sounds due to object interactions in the physical simulation of a virtual environment

bull PI Doug James (Cornell)

Siggraph 2012 Papers - Motion-Driven Concatenative Synthesis of Cloth Sounds An et al - Precomputed Acceleration Noise for Improved Rigid-Body Sound Chadwick et al

Data-Driven Modeling

Siggraph 2012 Papers - A Probabilistic Model for Component-Based Shape Synthesis Kalogerakis et al - An Algebraic Model for Parameterized Shape Editing Bokeloh et al

httpvisualstanfordedu

- Goal Capture the nature of a chair or an animal by analyzing large databases of similar objects to allow working with parts rather than polygons Make tools that enable users of all skill levels to produce custom high-quality content for virtual worlds - PIs Vladlen Koltun (Stanford) Tom Funkhouser (Princeton) Pat Hanrahan (Stanford)

Data-Driven Modeling

Siggraph 2012 Papers - A Probabilistic Model for Component-Based Shape Synthesis Kalogerakis et al - An Algebraic Model for Parameterized Shape Editing Bokeloh et al

httpvisualstanfordedu

- Goal Capture the nature of a chair or an animal by analyzing large databases of similar objects to allow working with parts rather than polygons Make tools that enable users of all skill levels to produce custom high-quality content for virtual worlds - PIs Vladlen Koltun (Stanford) Tom Funkhouser (Princeton) Pat Hanrahan (Stanford)

Intel Visual Computing Institute

httpswwwintel-university-collaborationnetpage_id=998

Saarbruumlcken Germany

An Open Collaborative Research Institute at the Saarland Campus

Multimodal

Computing

and

Interaction

IVCI Mission Facilitate the progress of Visual Computing research and be a driver towards highest

quality image real-time processing and interactive visualization

Virtual Worlds (Model-based)

Multimodal Scene Analysis amp Interaction

Real Worlds (Sample-based)

Intel VCI Vision Scalable Algorithms for

Real Time Realistic

Rendering

Compiler Support for

High Performance

Graphics

Collaborative Distributed Molecular

Modeling and Visualization

Efficient High Quality

Rendering Using Sample-based

Representations

Scalable Hybrid Rendering for

Large Scale Visualization

Marker-free Performance

Capture

Algorithms for Low Cost Depth

Imaging

Visualization and editing of light

transport

Internet Transport and Coding for 3D

HD-TV

Software- innovation for the Digital Enterprise

Kusanagi Coding and

Interaction for Networked Games

Multi Touch Interaction

Techniques for Mixed 2D and 3D Graphics Displays

Advanced Ray Tracing and Data-Flow

Processing for the 3D Internet

Intel VCI Projects-Based Organization

ECOUSS Efficient and open Compiler-

Framework for parallel Simulations

SCENE Novel Scene Representations for Rich

Networked Media

VERVE Vanquishing fear and apathy

through E-inclusion

Large Scale Visualization in the Internet of Displays

User-centric Video

Processing

Local Dimming for Edge-lit LED LCD-Monitors

SCI Institute Utah USA

Stanford University California USA

Research Collaboration

Consortium Members

User-Centric Video Processing Jan Kautz Christian Theobalt

bull Objective ndash Create new user experiences for capturing

editing and browsing

ndash Targets amateur video creators

bull Approach ndash Automatically identify spationdashtemporal and

semantic relationships withinbetween videos

ndash Leverage graph of these to drive UI and video processing

bull Expected results Capturing automatic stabilization and

enhancement

Editing edit semantic objects in videos

Browsing find semantically related videos

Remove the person in white

Video Inpainting in Dynamic Scenes amp Videoscape for moving through Internet Videos

Efficient High-Quality Rendering Using Sample-based Representations Elmar Eisemann

bull Realistic Rendering ndash Lens Flare [Siggraphrsquo11]

ndash Depth-of-field [Eurographics lsquo11]

ndash Global Illumination [PGrsquo11]

bull Perceptual Rendering ndash Stereo

ndash High Dynamic Range

bull Alternative representations ndash Voxel Data

ndash Height Fields

3D Internet Interactive 3D Content on the Web Philipp Slusallek

bull XML3D Scene Description ndash HTML-5 extension for interactive graphics

ndash JS implementation amp built into the browser

ndash Reuses Web Technology (DOM CSS JS)

bull XFLOW Parallel Processing ndash Data-parallel flowgraph for XML3D

ndash Animations image amp geometry processing

ndash Configuration within the DOM

bull Results ndash W3C standardization ldquoDeclarative 3D for the Webrdquo

ndash Rich media apps for BMW SLS-Museum hellip

3D-Internet Apps SLS-Museum 3D-Installation amp Museum with Interactive Virtual Characters

3D-Internet Apps Using OpenStreetMap-3D as Shared Virtual Worlds

Fully automatically generated from OpenStreet Map Taking semantic data into acount

Marker-free Performance Capture Christian Theobalt

bull Reconstruction of detailed human animation models ndash In Multi-view video without markers

ndash Out Detailed motion shape and appearance

ndash General clothing modifiable performances new animations

bull Real-time performance capture ndash Fast full-body motion estimation from depth

cameras

ndash Interaction

ndash Collaboration with Intel Magic Mirror project

[ICCV 2011]

[SIGGRAPH Asia 2010]

Markerless Motion Capture of Interacting Characters Using Multi-view Image Segmentation

Articulated Models Input silhouettes Segmentation Contour labels Estimated surface Estimated 3D models

Handling Intersections

Improved segmentation with 3D shape priors Excellent performance when evaluated against marker-based system

bull Interactive inspection of light transport in virtual scenes ndash You can only manipulate what you see

ndash First prototypal light manipulation tools

bull Efficient global illumination ndash Otherwise no interactive

visualization nor manipulation

ndash Improvements on many-lights methods and progressive photon mapping

bull Results ndash Demonstrator Maya plugin ndash Collaboration with local film academy

Visualization and Editing of Light Transport Carsten Dachsbacher

Advanced Real-Time Ray Tracing Techniques Philipp Slusallek

bull Perfect importance sampling and caching ndash Sparse but perfect importance sampling

ndash Caching and interpolation [Eurographics`12]

bull Unifying Photon-Mapping amp Monte-Carlo ndash Formulating PM as a MC process

ndash Per pixel combination using MIS

bull Data-parallel implementations

ndash Efficiency and performance

bull Integration into XML3D

ndash Provide ldquocorrectrdquo results by default

Vertex Merging with Multiple Importance Sampling Photon-Mapping as a Monte-Carlo Process

BPT

PPM Progressive Photon-Mapping (PPM)

Bidirectional Path Tracing (BPT)

bull Whole-Function Vectorization ndash Restore scalar computations

ndash LLVM platform-independent

ndash RenderMan frontend OpenCL driver

bull Vector Programming ndash Formalized C extension for portable

effective SIMD programming

ndash Type system triggers vectorization

ndash Data layout adaption

bull New Programming Models for High-Performance Graphics

bull Results ndash Demonstrators for shaders and HPC code

ndash CC++-Extensions (with Intel)

ndash OpenCL compiler (CPU)

Compiler Support for High-Performance Graphics Sebastian Hack

bull Hybrid Rendering ndash Client amp Server Model

ndash Smartphone to Mainframe

bull Large Data Processing ndash Scalable Hierarchical

RW Data Structures

bull Results ndash ZAPP displaywall demonstrator

ndash ImageVis3D (Mobile) demonstrator

ndash Practically use in hospitals

Scalable Hybrid Rendering for Large Scale Visualization Jens Kruumlger

Displays as a Service Large Scale Visualization Alexander Loumlffler

bull Virtualization of Displays ndash Virtual Framebuffer and Displays exposed to Internet

ndash Replacing cables by switched IP network

ndash Internet standards for video encoding and streaming

bull Fully Synchronized ndash 120 Hz active stereo sync over IP

ndash Accuracy of ~100us in software

ndash Drives GPU displays output

bull Results ndash 20-screen wall demonstrator

ndash 3-screen wall (thin-bezel)

ndash CE4100 based SW synchronization

SIGGRAPH 2012

Backup

The Intel Science and Technology Center (ISTC) and Intel Collaborative Research Institute (ICRI) Programs

35

The modern economy is an information economy and one that is driven by innovations that enhance productivity as well as create new modes of entertainment We need to invest in the basic research that will inspire future products and services and ensure long term health of our information economy Government and private foundations are helping but corporate America needs to step up and increase commitments to university research - Justin Rattner ndash Intel CTO

$140M investment over 5 years announced by Intel in 2011 and 2012

Centers of Excellence bull Each ISTC and ICRI will focus on one

research area eg visual computing secure computing

bull The ISTCs and ICRIs are meant to bring the best and brightest researchers across the US together

bull Each ISTC and ICRI will be led by a host university and will include thought leaders from other schools

Breaking Barriers to Collaboration

bull Open IP models and open source software to encourage free information exchange (In most of the Centers)

bull Favor projects that span multiple institutions to encourage collaboration among universities

bull Intel researches per center assigned to work on-campus to encourage collaboration between Intel and academia

Greater Impact to Future Tech bull Center research themes to

address essential needs of computing technology

bull Research agendas jointly defined and co-led by an Intel and a University Principal Investigator

bull After completing 3-5 year charters new ISTCs and ICRIs can be formed to respond to changing tech environment

httpfolditportal

Serious Gaming pplied to Content Creation

Highlighted by President Obama Winner of most-significant new visualization tool (NSF)

Goal Create high-quality content by casting creation activities as games in which large numbers of people are incentivized to perform simple tasks which in combination yield sophisticated content PIs Zoran Popovic (UW) Noah Snavely (Cornell) Maneesh Agrawala(Berkeley)

Determining the structure of retroviral protease (HIV)

Video Frank to add Papers Frank to add

Extracting Structure and Semantics

CAD Model Points

Structures

People

Goals Enable context aware computing and automated content creation through the capture analysis and manipulation of real-world visual data PIs Steve Seitz (UW) Noah Snavely (Cornell) Tom Funkhouser (Princeton) Vladlen Koltun (Stanford) Jitendra Malik (Berkeley) Deva Ramanan (UV Irvine)

Video Frank to add Papers Frank to add

httpvisualstanfordedu

Computational Photography (Franken Camera)

Being adopted as a standard API for cellphone camera systems (Apple Android)

bull Goal Develop algorithms languages architectures and prototypes demonstrating the use of computation in the process of image capture and display

bull PIs Marc Levoy (Stanford) Mark Horowitz (Stanford) Pat Hanrahan (Stanford)

Video Frank to add Papers Frank to add

ISTC-VC SIGGRAPH Papers

Character Locomotion Monday 6 August 900 AM - 1030 AM Optimizing Locomotion Controllers Using Biologically Based Actuators and Objectives Jack M Wang Samuel R Hamner Scott L Delp Vladlen Koltun Continuous Character Control With Low-Dimensional Embeddings Sergey Levine Jack M Wang Alexis Haraux Zoran Popović Vladlen Koltun Shape Analysis Monday 6 August 900 AM - 1030 AM Schelling Points on 3D Surface Meshes Xiaobai Chen Abulhair Saparov Bill Pang Thomas Funkhouser Shape Transformation Wednesday 8 August 900 - 1030 AM An Algebraic Model for Parameterized Shape Editing Martin Bokeloh Michael Wand Hans-Peter Seidel Vladlen Koltun

42

ISTC-VC SIGGRAPH Papers

Image Processing Monday 6 August 2- 330 pm Decoupling Algorithms From Schedules for Easy Optimization of Image-Processing Pipelines Jonathan Ragan-Kelley Andrew Adams Sylvain Paris Marc Levoy Saman Amarasinghe Freacutedo Durand

Cloth

Monday 6 August 2-330 pm Specular Reflection From Woven Cloth Piti Irawan Steve Marschner Stitch Meshes for Modeling Knitted Clothing With Yarn-level Detail Cem Yuksel Jonathan M Kaldor Doug L James Steve Marschner

Appearance

Monday 6 August 345-535 pm Printing Spatially Varying Reflectance for Reproducing HDR Images Yue Dong Xin Tong Fabio Pellacini Baining Guo

43

ISTC-VC SIGGRAPH Papers (cont)

Hand Eye and Face Monday 6 August 345-535 pm Session Chair - Vladlen Koltun Discovery of Complex Behaviors through Contact-Invariant Optimization Igor Mordatch Emanuel Todorov Zoran Popovi1049029 Sketching Monday 6 August 345-535 pm HelpingHand Example-Based Stroke Stylization Jingwan Lu Fisher Yu Adam Finkelstein Stephen DiVerdi Fabrication Tuesday 7 August 9-1030 am Fabricating Articulated Characters From Skinned Meshes Moritz Baumlcher Bernd Bickel Doug L James Hanspeter Pfister

44

Sampling Reconstructing and Filtering Light Tuesday 7 August 1045 am-1215 pm A Theory of Monte Carlo Visibility Sampling Ravi Ramamoorthi John Anderson Mark Meyer Derek Nowrouzezahrai Reconstructing the Indirect Light Field for Global Illumination Jaakko Lehtinen Timo Aila Samuli Laine Freacutedo Durand

Geometry Reconstruction amp Tracking

Tuesday 7 August 1045 am-1215 pm Temporally Coherent Completion of Dynamic Shapes Hao Li Linjie Luo Daniel Vlasic Pieter Peers Jovan Popovic Mark Pauly Szymon Rusinkiewicz

Sets of Shapes

Tuesday 7 August 2-330 pm Exploring Collections of 3D Models Using Fuzzy Correspondence Vladimir G Kim Wilmot Li Niloy J Mitra Stephen DiVerdi Thomas Funkhouser A Probabilistic Model for Component-Based Shape Synthesis Evangelos Kalogerakis Siddhartha Chaudhuri Daphne Koller Vladlen Koltun

45

ISTC-VC SIGGRAPH Papers (cont)

Light Rays Tuesday 7 August 2-330 pm Manifold Exploration A Markov Chain Monte Carlo Technique for Rendering Scenes With Difficult Specular Transport Wenzel Jakob Steve Marschner Bidirectional Lightcuts Bruce Walter Pramook Khungurn Kavita Bala

Fun With Video

Tuesday 7 August 345-535 pm Session Chair Noah Snavely Video Deblurring for Hand-Held Cameras Using Patch-Based Synthesis Sunghyun Cho Jue Wang Seungyong Lee Eulerian Video Magnification for Revealing Subtle Changes in the World Hao-Yu Wu Michael Rubinstein Eugene Shih John Guttag Freacutedo Durand William T Freeman Selectively De-Animating Video Jiamin Bai Aseem Agarwala Maneesh Agrawala Ravi Ramamoorthi Tools for Placing Cuts and Transitions in Interview Video Floraine Berthouzoz Wilmot Li Maneesh Agrawala

46

ISTC-VC SIGGRAPH Papers (cont)

Noise and Texture Tuesday 7 August 345-535 pm Structure-Aware Synthesis for Predictive Woven Fabric Appearance Shuang Zhao Kavita Bala Steve Marschner Wenzel Jakob Symmetry-Guided Texture Synthesis and Manipulation Vladimir Kim Yaron Lipman Thomas Funkhouser

Shape Transformation Wednesday 8 August 900 - 1030 AM An Algebraic Model for Parameterized Shape Editing Martin Bokeloh Michael Wand Hans-Peter Seidel Vladlen Koltun

Stitching

Wednesday 8 August 1045 am-1215 pm Exposing Photo Manipulation With Inconsistent Reflections James F OrsquoBrien Hany Farid

47

ISTC-VC SIGGRAPH Papers (cont)

Maps Surfaces and Shapes

Wednesday 8 August 1045 am-1215 pm Simple Formulas For Quasiconformal Plane Deformations Yaron Lipman Vladimir G Kim Thomas Funkhouser

Interactive Systems amp Hardware Wednesday 8 August 2-330 pm Position-Correcting Tools for 2D Digital Fabrication Alec Rivers Ilan E Moyer Freacutedo Durand

48

ISTC-VC SIGGRAPH Papers (cont)

Collisions Wednesday 8 August 345-535 pm Energy-Based Self-Collision Culling for Arbitrary Mesh Deformations Changxi Zheng Doug L James

All About Images

Thursday 9 August 9-1030 am A Framework for Content-Adaptive Photo Manipulation Macros Application to Face Landscape and Global Manipulations Floraine Berthouzoz Wilmot Li Mira Dontcheva Maneesh Agrawala

Sound and Elements

Thursday 9 August 9-1030 am Motion-Driven Concatenative Synthesis of Cloth Sounds Steven S An Doug L James Steve Marschner Precomputed Acceleration Noise for Improved Rigid-Body Sound Jeffrey N Chadwick Changxi Zheng Doug L James Interactive Sound Propagation Using Compact Acoustic Transfer Operators Lakulish Antani Anish Chandak Lauri Savioja Dinesh Manocha Updated Sparse Cholesky Factors for Corotational Elastodynamics Florian Hecht Yeon Jin Lee Jonathan R Shewchuk James F OrsquoBrien

49

ISTC-VC SIGGRAPH Papers (cont)

Geometry amp Viewing Thursday 9 August 2-330 pm Perceptual Models of Viewpoint Preference Adrian Secordm Jingwan Lu Adam Finkelstein Manish Singh Andrew Nealen

Faces and Hair [Closing Session]

Thursday 9 August 345-515 pm Coupled 3D Reconstruction of Sparse Facial Hair and Skin Thabo Beeler Bernd Bickel Gioacchino Noris Paul Beardsley Steve Marschner Robert W Sumner Markus Gross Physical Face Cloning Bernd Bickel Peter Kaufmann Melina Skouras Bernhard Thomaszewski Derek Bradley Thabo Beeler Philip Jackson Steve Marschner Wojciech Matusik Markus Gross

50

ISTC-VC SIGGRAPH Papers (cont)

Siggraph Courses Optimizing Realistic Rendering With Many-Light Methods Sunday 5 August 2-515 pm Jaroslav Krivanek Milos Hasan Adam Arbree Carsten Dachsbacher Alexander Keller Bruce Walter State of the Art in Photon-Density Estimation Thursday 9 August 2-515 pm Toshiya Hachisuka Wojciech Jarosz Guillaume Bouchard Per Christensen Jeppe Revall Frisvad Wenzel Jakob Henrik Wann Jensen Jared M Johnson Michael Kaschalk Claude Knaus Andrew Selle Ben Spencer

Siggraph Talks

Silence Eliminate the Noise Thursday 9 August 9-1030 am Importance Sampling for Hair Scattering Jiawei Ou Feng Xie Parashar Krishnamachari Fabio Pellacini

Siggraph Exhibitor Sessions

Intel Corporation Wednesday 8 August 430-530 pm room 402B The Future of Visual Computing as Viewed by Intel Visual Computing Research Centers

51

Other ISTC-VC SIGGRAPH Participation

Page 10: Future of Visual Computing as viewed by Intel Visual ... · PDF fileFuture of Visual Computing as viewed by Intel Visual Computing Research Centers ... Justin Rattner Intel Science

Physically-Based Sound

Widely reported in popular scientific media (NPR Science Friday BBC hellip)

bull Goal automatically generate sounds due to object interactions in the physical simulation of a virtual environment

bull PI Doug James (Cornell)

Siggraph 2012 Papers - Motion-Driven Concatenative Synthesis of Cloth Sounds An et al - Precomputed Acceleration Noise for Improved Rigid-Body Sound Chadwick et al

Data-Driven Modeling

Siggraph 2012 Papers - A Probabilistic Model for Component-Based Shape Synthesis Kalogerakis et al - An Algebraic Model for Parameterized Shape Editing Bokeloh et al

httpvisualstanfordedu

- Goal Capture the nature of a chair or an animal by analyzing large databases of similar objects to allow working with parts rather than polygons Make tools that enable users of all skill levels to produce custom high-quality content for virtual worlds - PIs Vladlen Koltun (Stanford) Tom Funkhouser (Princeton) Pat Hanrahan (Stanford)

Data-Driven Modeling

Siggraph 2012 Papers - A Probabilistic Model for Component-Based Shape Synthesis Kalogerakis et al - An Algebraic Model for Parameterized Shape Editing Bokeloh et al

httpvisualstanfordedu

- Goal Capture the nature of a chair or an animal by analyzing large databases of similar objects to allow working with parts rather than polygons Make tools that enable users of all skill levels to produce custom high-quality content for virtual worlds - PIs Vladlen Koltun (Stanford) Tom Funkhouser (Princeton) Pat Hanrahan (Stanford)

Intel Visual Computing Institute

httpswwwintel-university-collaborationnetpage_id=998

Saarbruumlcken Germany

An Open Collaborative Research Institute at the Saarland Campus

Multimodal

Computing

and

Interaction

IVCI Mission Facilitate the progress of Visual Computing research and be a driver towards highest

quality image real-time processing and interactive visualization

Virtual Worlds (Model-based)

Multimodal Scene Analysis amp Interaction

Real Worlds (Sample-based)

Intel VCI Vision Scalable Algorithms for

Real Time Realistic

Rendering

Compiler Support for

High Performance

Graphics

Collaborative Distributed Molecular

Modeling and Visualization

Efficient High Quality

Rendering Using Sample-based

Representations

Scalable Hybrid Rendering for

Large Scale Visualization

Marker-free Performance

Capture

Algorithms for Low Cost Depth

Imaging

Visualization and editing of light

transport

Internet Transport and Coding for 3D

HD-TV

Software- innovation for the Digital Enterprise

Kusanagi Coding and

Interaction for Networked Games

Multi Touch Interaction

Techniques for Mixed 2D and 3D Graphics Displays

Advanced Ray Tracing and Data-Flow

Processing for the 3D Internet

Intel VCI Projects-Based Organization

ECOUSS Efficient and open Compiler-

Framework for parallel Simulations

SCENE Novel Scene Representations for Rich

Networked Media

VERVE Vanquishing fear and apathy

through E-inclusion

Large Scale Visualization in the Internet of Displays

User-centric Video

Processing

Local Dimming for Edge-lit LED LCD-Monitors

SCI Institute Utah USA

Stanford University California USA

Research Collaboration

Consortium Members

User-Centric Video Processing Jan Kautz Christian Theobalt

bull Objective ndash Create new user experiences for capturing

editing and browsing

ndash Targets amateur video creators

bull Approach ndash Automatically identify spationdashtemporal and

semantic relationships withinbetween videos

ndash Leverage graph of these to drive UI and video processing

bull Expected results Capturing automatic stabilization and

enhancement

Editing edit semantic objects in videos

Browsing find semantically related videos

Remove the person in white

Video Inpainting in Dynamic Scenes amp Videoscape for moving through Internet Videos

Efficient High-Quality Rendering Using Sample-based Representations Elmar Eisemann

bull Realistic Rendering ndash Lens Flare [Siggraphrsquo11]

ndash Depth-of-field [Eurographics lsquo11]

ndash Global Illumination [PGrsquo11]

bull Perceptual Rendering ndash Stereo

ndash High Dynamic Range

bull Alternative representations ndash Voxel Data

ndash Height Fields

3D Internet Interactive 3D Content on the Web Philipp Slusallek

bull XML3D Scene Description ndash HTML-5 extension for interactive graphics

ndash JS implementation amp built into the browser

ndash Reuses Web Technology (DOM CSS JS)

bull XFLOW Parallel Processing ndash Data-parallel flowgraph for XML3D

ndash Animations image amp geometry processing

ndash Configuration within the DOM

bull Results ndash W3C standardization ldquoDeclarative 3D for the Webrdquo

ndash Rich media apps for BMW SLS-Museum hellip

3D-Internet Apps SLS-Museum 3D-Installation amp Museum with Interactive Virtual Characters

3D-Internet Apps Using OpenStreetMap-3D as Shared Virtual Worlds

Fully automatically generated from OpenStreet Map Taking semantic data into acount

Marker-free Performance Capture Christian Theobalt

bull Reconstruction of detailed human animation models ndash In Multi-view video without markers

ndash Out Detailed motion shape and appearance

ndash General clothing modifiable performances new animations

bull Real-time performance capture ndash Fast full-body motion estimation from depth

cameras

ndash Interaction

ndash Collaboration with Intel Magic Mirror project

[ICCV 2011]

[SIGGRAPH Asia 2010]

Markerless Motion Capture of Interacting Characters Using Multi-view Image Segmentation

Articulated Models Input silhouettes Segmentation Contour labels Estimated surface Estimated 3D models

Handling Intersections

Improved segmentation with 3D shape priors Excellent performance when evaluated against marker-based system

bull Interactive inspection of light transport in virtual scenes ndash You can only manipulate what you see

ndash First prototypal light manipulation tools

bull Efficient global illumination ndash Otherwise no interactive

visualization nor manipulation

ndash Improvements on many-lights methods and progressive photon mapping

bull Results ndash Demonstrator Maya plugin ndash Collaboration with local film academy

Visualization and Editing of Light Transport Carsten Dachsbacher

Advanced Real-Time Ray Tracing Techniques Philipp Slusallek

bull Perfect importance sampling and caching ndash Sparse but perfect importance sampling

ndash Caching and interpolation [Eurographics`12]

bull Unifying Photon-Mapping amp Monte-Carlo ndash Formulating PM as a MC process

ndash Per pixel combination using MIS

bull Data-parallel implementations

ndash Efficiency and performance

bull Integration into XML3D

ndash Provide ldquocorrectrdquo results by default

Vertex Merging with Multiple Importance Sampling Photon-Mapping as a Monte-Carlo Process

BPT

PPM Progressive Photon-Mapping (PPM)

Bidirectional Path Tracing (BPT)

bull Whole-Function Vectorization ndash Restore scalar computations

ndash LLVM platform-independent

ndash RenderMan frontend OpenCL driver

bull Vector Programming ndash Formalized C extension for portable

effective SIMD programming

ndash Type system triggers vectorization

ndash Data layout adaption

bull New Programming Models for High-Performance Graphics

bull Results ndash Demonstrators for shaders and HPC code

ndash CC++-Extensions (with Intel)

ndash OpenCL compiler (CPU)

Compiler Support for High-Performance Graphics Sebastian Hack

bull Hybrid Rendering ndash Client amp Server Model

ndash Smartphone to Mainframe

bull Large Data Processing ndash Scalable Hierarchical

RW Data Structures

bull Results ndash ZAPP displaywall demonstrator

ndash ImageVis3D (Mobile) demonstrator

ndash Practically use in hospitals

Scalable Hybrid Rendering for Large Scale Visualization Jens Kruumlger

Displays as a Service Large Scale Visualization Alexander Loumlffler

bull Virtualization of Displays ndash Virtual Framebuffer and Displays exposed to Internet

ndash Replacing cables by switched IP network

ndash Internet standards for video encoding and streaming

bull Fully Synchronized ndash 120 Hz active stereo sync over IP

ndash Accuracy of ~100us in software

ndash Drives GPU displays output

bull Results ndash 20-screen wall demonstrator

ndash 3-screen wall (thin-bezel)

ndash CE4100 based SW synchronization

SIGGRAPH 2012

Backup

The Intel Science and Technology Center (ISTC) and Intel Collaborative Research Institute (ICRI) Programs

35

The modern economy is an information economy and one that is driven by innovations that enhance productivity as well as create new modes of entertainment We need to invest in the basic research that will inspire future products and services and ensure long term health of our information economy Government and private foundations are helping but corporate America needs to step up and increase commitments to university research - Justin Rattner ndash Intel CTO

$140M investment over 5 years announced by Intel in 2011 and 2012

Centers of Excellence bull Each ISTC and ICRI will focus on one

research area eg visual computing secure computing

bull The ISTCs and ICRIs are meant to bring the best and brightest researchers across the US together

bull Each ISTC and ICRI will be led by a host university and will include thought leaders from other schools

Breaking Barriers to Collaboration

bull Open IP models and open source software to encourage free information exchange (In most of the Centers)

bull Favor projects that span multiple institutions to encourage collaboration among universities

bull Intel researches per center assigned to work on-campus to encourage collaboration between Intel and academia

Greater Impact to Future Tech bull Center research themes to

address essential needs of computing technology

bull Research agendas jointly defined and co-led by an Intel and a University Principal Investigator

bull After completing 3-5 year charters new ISTCs and ICRIs can be formed to respond to changing tech environment

httpfolditportal

Serious Gaming pplied to Content Creation

Highlighted by President Obama Winner of most-significant new visualization tool (NSF)

Goal Create high-quality content by casting creation activities as games in which large numbers of people are incentivized to perform simple tasks which in combination yield sophisticated content PIs Zoran Popovic (UW) Noah Snavely (Cornell) Maneesh Agrawala(Berkeley)

Determining the structure of retroviral protease (HIV)

Video Frank to add Papers Frank to add

Extracting Structure and Semantics

CAD Model Points

Structures

People

Goals Enable context aware computing and automated content creation through the capture analysis and manipulation of real-world visual data PIs Steve Seitz (UW) Noah Snavely (Cornell) Tom Funkhouser (Princeton) Vladlen Koltun (Stanford) Jitendra Malik (Berkeley) Deva Ramanan (UV Irvine)

Video Frank to add Papers Frank to add

httpvisualstanfordedu

Computational Photography (Franken Camera)

Being adopted as a standard API for cellphone camera systems (Apple Android)

bull Goal Develop algorithms languages architectures and prototypes demonstrating the use of computation in the process of image capture and display

bull PIs Marc Levoy (Stanford) Mark Horowitz (Stanford) Pat Hanrahan (Stanford)

Video Frank to add Papers Frank to add

ISTC-VC SIGGRAPH Papers

Character Locomotion Monday 6 August 900 AM - 1030 AM Optimizing Locomotion Controllers Using Biologically Based Actuators and Objectives Jack M Wang Samuel R Hamner Scott L Delp Vladlen Koltun Continuous Character Control With Low-Dimensional Embeddings Sergey Levine Jack M Wang Alexis Haraux Zoran Popović Vladlen Koltun Shape Analysis Monday 6 August 900 AM - 1030 AM Schelling Points on 3D Surface Meshes Xiaobai Chen Abulhair Saparov Bill Pang Thomas Funkhouser Shape Transformation Wednesday 8 August 900 - 1030 AM An Algebraic Model for Parameterized Shape Editing Martin Bokeloh Michael Wand Hans-Peter Seidel Vladlen Koltun

42

ISTC-VC SIGGRAPH Papers

Image Processing Monday 6 August 2- 330 pm Decoupling Algorithms From Schedules for Easy Optimization of Image-Processing Pipelines Jonathan Ragan-Kelley Andrew Adams Sylvain Paris Marc Levoy Saman Amarasinghe Freacutedo Durand

Cloth

Monday 6 August 2-330 pm Specular Reflection From Woven Cloth Piti Irawan Steve Marschner Stitch Meshes for Modeling Knitted Clothing With Yarn-level Detail Cem Yuksel Jonathan M Kaldor Doug L James Steve Marschner

Appearance

Monday 6 August 345-535 pm Printing Spatially Varying Reflectance for Reproducing HDR Images Yue Dong Xin Tong Fabio Pellacini Baining Guo

43

ISTC-VC SIGGRAPH Papers (cont)

Hand Eye and Face Monday 6 August 345-535 pm Session Chair - Vladlen Koltun Discovery of Complex Behaviors through Contact-Invariant Optimization Igor Mordatch Emanuel Todorov Zoran Popovi1049029 Sketching Monday 6 August 345-535 pm HelpingHand Example-Based Stroke Stylization Jingwan Lu Fisher Yu Adam Finkelstein Stephen DiVerdi Fabrication Tuesday 7 August 9-1030 am Fabricating Articulated Characters From Skinned Meshes Moritz Baumlcher Bernd Bickel Doug L James Hanspeter Pfister

44

Sampling Reconstructing and Filtering Light Tuesday 7 August 1045 am-1215 pm A Theory of Monte Carlo Visibility Sampling Ravi Ramamoorthi John Anderson Mark Meyer Derek Nowrouzezahrai Reconstructing the Indirect Light Field for Global Illumination Jaakko Lehtinen Timo Aila Samuli Laine Freacutedo Durand

Geometry Reconstruction amp Tracking

Tuesday 7 August 1045 am-1215 pm Temporally Coherent Completion of Dynamic Shapes Hao Li Linjie Luo Daniel Vlasic Pieter Peers Jovan Popovic Mark Pauly Szymon Rusinkiewicz

Sets of Shapes

Tuesday 7 August 2-330 pm Exploring Collections of 3D Models Using Fuzzy Correspondence Vladimir G Kim Wilmot Li Niloy J Mitra Stephen DiVerdi Thomas Funkhouser A Probabilistic Model for Component-Based Shape Synthesis Evangelos Kalogerakis Siddhartha Chaudhuri Daphne Koller Vladlen Koltun

45

ISTC-VC SIGGRAPH Papers (cont)

Light Rays Tuesday 7 August 2-330 pm Manifold Exploration A Markov Chain Monte Carlo Technique for Rendering Scenes With Difficult Specular Transport Wenzel Jakob Steve Marschner Bidirectional Lightcuts Bruce Walter Pramook Khungurn Kavita Bala

Fun With Video

Tuesday 7 August 345-535 pm Session Chair Noah Snavely Video Deblurring for Hand-Held Cameras Using Patch-Based Synthesis Sunghyun Cho Jue Wang Seungyong Lee Eulerian Video Magnification for Revealing Subtle Changes in the World Hao-Yu Wu Michael Rubinstein Eugene Shih John Guttag Freacutedo Durand William T Freeman Selectively De-Animating Video Jiamin Bai Aseem Agarwala Maneesh Agrawala Ravi Ramamoorthi Tools for Placing Cuts and Transitions in Interview Video Floraine Berthouzoz Wilmot Li Maneesh Agrawala

46

ISTC-VC SIGGRAPH Papers (cont)

Noise and Texture Tuesday 7 August 345-535 pm Structure-Aware Synthesis for Predictive Woven Fabric Appearance Shuang Zhao Kavita Bala Steve Marschner Wenzel Jakob Symmetry-Guided Texture Synthesis and Manipulation Vladimir Kim Yaron Lipman Thomas Funkhouser

Shape Transformation Wednesday 8 August 900 - 1030 AM An Algebraic Model for Parameterized Shape Editing Martin Bokeloh Michael Wand Hans-Peter Seidel Vladlen Koltun

Stitching

Wednesday 8 August 1045 am-1215 pm Exposing Photo Manipulation With Inconsistent Reflections James F OrsquoBrien Hany Farid

47

ISTC-VC SIGGRAPH Papers (cont)

Maps Surfaces and Shapes

Wednesday 8 August 1045 am-1215 pm Simple Formulas For Quasiconformal Plane Deformations Yaron Lipman Vladimir G Kim Thomas Funkhouser

Interactive Systems amp Hardware Wednesday 8 August 2-330 pm Position-Correcting Tools for 2D Digital Fabrication Alec Rivers Ilan E Moyer Freacutedo Durand

48

ISTC-VC SIGGRAPH Papers (cont)

Collisions Wednesday 8 August 345-535 pm Energy-Based Self-Collision Culling for Arbitrary Mesh Deformations Changxi Zheng Doug L James

All About Images

Thursday 9 August 9-1030 am A Framework for Content-Adaptive Photo Manipulation Macros Application to Face Landscape and Global Manipulations Floraine Berthouzoz Wilmot Li Mira Dontcheva Maneesh Agrawala

Sound and Elements

Thursday 9 August 9-1030 am Motion-Driven Concatenative Synthesis of Cloth Sounds Steven S An Doug L James Steve Marschner Precomputed Acceleration Noise for Improved Rigid-Body Sound Jeffrey N Chadwick Changxi Zheng Doug L James Interactive Sound Propagation Using Compact Acoustic Transfer Operators Lakulish Antani Anish Chandak Lauri Savioja Dinesh Manocha Updated Sparse Cholesky Factors for Corotational Elastodynamics Florian Hecht Yeon Jin Lee Jonathan R Shewchuk James F OrsquoBrien

49

ISTC-VC SIGGRAPH Papers (cont)

Geometry amp Viewing Thursday 9 August 2-330 pm Perceptual Models of Viewpoint Preference Adrian Secordm Jingwan Lu Adam Finkelstein Manish Singh Andrew Nealen

Faces and Hair [Closing Session]

Thursday 9 August 345-515 pm Coupled 3D Reconstruction of Sparse Facial Hair and Skin Thabo Beeler Bernd Bickel Gioacchino Noris Paul Beardsley Steve Marschner Robert W Sumner Markus Gross Physical Face Cloning Bernd Bickel Peter Kaufmann Melina Skouras Bernhard Thomaszewski Derek Bradley Thabo Beeler Philip Jackson Steve Marschner Wojciech Matusik Markus Gross

50

ISTC-VC SIGGRAPH Papers (cont)

Siggraph Courses Optimizing Realistic Rendering With Many-Light Methods Sunday 5 August 2-515 pm Jaroslav Krivanek Milos Hasan Adam Arbree Carsten Dachsbacher Alexander Keller Bruce Walter State of the Art in Photon-Density Estimation Thursday 9 August 2-515 pm Toshiya Hachisuka Wojciech Jarosz Guillaume Bouchard Per Christensen Jeppe Revall Frisvad Wenzel Jakob Henrik Wann Jensen Jared M Johnson Michael Kaschalk Claude Knaus Andrew Selle Ben Spencer

Siggraph Talks

Silence Eliminate the Noise Thursday 9 August 9-1030 am Importance Sampling for Hair Scattering Jiawei Ou Feng Xie Parashar Krishnamachari Fabio Pellacini

Siggraph Exhibitor Sessions

Intel Corporation Wednesday 8 August 430-530 pm room 402B The Future of Visual Computing as Viewed by Intel Visual Computing Research Centers

51

Other ISTC-VC SIGGRAPH Participation

Page 11: Future of Visual Computing as viewed by Intel Visual ... · PDF fileFuture of Visual Computing as viewed by Intel Visual Computing Research Centers ... Justin Rattner Intel Science

Data-Driven Modeling

Siggraph 2012 Papers - A Probabilistic Model for Component-Based Shape Synthesis Kalogerakis et al - An Algebraic Model for Parameterized Shape Editing Bokeloh et al

httpvisualstanfordedu

- Goal Capture the nature of a chair or an animal by analyzing large databases of similar objects to allow working with parts rather than polygons Make tools that enable users of all skill levels to produce custom high-quality content for virtual worlds - PIs Vladlen Koltun (Stanford) Tom Funkhouser (Princeton) Pat Hanrahan (Stanford)

Data-Driven Modeling

Siggraph 2012 Papers - A Probabilistic Model for Component-Based Shape Synthesis Kalogerakis et al - An Algebraic Model for Parameterized Shape Editing Bokeloh et al

httpvisualstanfordedu

- Goal Capture the nature of a chair or an animal by analyzing large databases of similar objects to allow working with parts rather than polygons Make tools that enable users of all skill levels to produce custom high-quality content for virtual worlds - PIs Vladlen Koltun (Stanford) Tom Funkhouser (Princeton) Pat Hanrahan (Stanford)

Intel Visual Computing Institute

httpswwwintel-university-collaborationnetpage_id=998

Saarbruumlcken Germany

An Open Collaborative Research Institute at the Saarland Campus

Multimodal

Computing

and

Interaction

IVCI Mission Facilitate the progress of Visual Computing research and be a driver towards highest

quality image real-time processing and interactive visualization

Virtual Worlds (Model-based)

Multimodal Scene Analysis amp Interaction

Real Worlds (Sample-based)

Intel VCI Vision Scalable Algorithms for

Real Time Realistic

Rendering

Compiler Support for

High Performance

Graphics

Collaborative Distributed Molecular

Modeling and Visualization

Efficient High Quality

Rendering Using Sample-based

Representations

Scalable Hybrid Rendering for

Large Scale Visualization

Marker-free Performance

Capture

Algorithms for Low Cost Depth

Imaging

Visualization and editing of light

transport

Internet Transport and Coding for 3D

HD-TV

Software- innovation for the Digital Enterprise

Kusanagi Coding and

Interaction for Networked Games

Multi Touch Interaction

Techniques for Mixed 2D and 3D Graphics Displays

Advanced Ray Tracing and Data-Flow

Processing for the 3D Internet

Intel VCI Projects-Based Organization

ECOUSS Efficient and open Compiler-

Framework for parallel Simulations

SCENE Novel Scene Representations for Rich

Networked Media

VERVE Vanquishing fear and apathy

through E-inclusion

Large Scale Visualization in the Internet of Displays

User-centric Video

Processing

Local Dimming for Edge-lit LED LCD-Monitors

SCI Institute Utah USA

Stanford University California USA

Research Collaboration

Consortium Members

User-Centric Video Processing Jan Kautz Christian Theobalt

bull Objective ndash Create new user experiences for capturing

editing and browsing

ndash Targets amateur video creators

bull Approach ndash Automatically identify spationdashtemporal and

semantic relationships withinbetween videos

ndash Leverage graph of these to drive UI and video processing

bull Expected results Capturing automatic stabilization and

enhancement

Editing edit semantic objects in videos

Browsing find semantically related videos

Remove the person in white

Video Inpainting in Dynamic Scenes amp Videoscape for moving through Internet Videos

Efficient High-Quality Rendering Using Sample-based Representations Elmar Eisemann

bull Realistic Rendering ndash Lens Flare [Siggraphrsquo11]

ndash Depth-of-field [Eurographics lsquo11]

ndash Global Illumination [PGrsquo11]

bull Perceptual Rendering ndash Stereo

ndash High Dynamic Range

bull Alternative representations ndash Voxel Data

ndash Height Fields

3D Internet Interactive 3D Content on the Web Philipp Slusallek

bull XML3D Scene Description ndash HTML-5 extension for interactive graphics

ndash JS implementation amp built into the browser

ndash Reuses Web Technology (DOM CSS JS)

bull XFLOW Parallel Processing ndash Data-parallel flowgraph for XML3D

ndash Animations image amp geometry processing

ndash Configuration within the DOM

bull Results ndash W3C standardization ldquoDeclarative 3D for the Webrdquo

ndash Rich media apps for BMW SLS-Museum hellip

3D-Internet Apps SLS-Museum 3D-Installation amp Museum with Interactive Virtual Characters

3D-Internet Apps Using OpenStreetMap-3D as Shared Virtual Worlds

Fully automatically generated from OpenStreet Map Taking semantic data into acount

Marker-free Performance Capture Christian Theobalt

bull Reconstruction of detailed human animation models ndash In Multi-view video without markers

ndash Out Detailed motion shape and appearance

ndash General clothing modifiable performances new animations

bull Real-time performance capture ndash Fast full-body motion estimation from depth

cameras

ndash Interaction

ndash Collaboration with Intel Magic Mirror project

[ICCV 2011]

[SIGGRAPH Asia 2010]

Markerless Motion Capture of Interacting Characters Using Multi-view Image Segmentation

Articulated Models Input silhouettes Segmentation Contour labels Estimated surface Estimated 3D models

Handling Intersections

Improved segmentation with 3D shape priors Excellent performance when evaluated against marker-based system

bull Interactive inspection of light transport in virtual scenes ndash You can only manipulate what you see

ndash First prototypal light manipulation tools

bull Efficient global illumination ndash Otherwise no interactive

visualization nor manipulation

ndash Improvements on many-lights methods and progressive photon mapping

bull Results ndash Demonstrator Maya plugin ndash Collaboration with local film academy

Visualization and Editing of Light Transport Carsten Dachsbacher

Advanced Real-Time Ray Tracing Techniques Philipp Slusallek

bull Perfect importance sampling and caching ndash Sparse but perfect importance sampling

ndash Caching and interpolation [Eurographics`12]

bull Unifying Photon-Mapping amp Monte-Carlo ndash Formulating PM as a MC process

ndash Per pixel combination using MIS

bull Data-parallel implementations

ndash Efficiency and performance

bull Integration into XML3D

ndash Provide ldquocorrectrdquo results by default

Vertex Merging with Multiple Importance Sampling Photon-Mapping as a Monte-Carlo Process

BPT

PPM Progressive Photon-Mapping (PPM)

Bidirectional Path Tracing (BPT)

bull Whole-Function Vectorization ndash Restore scalar computations

ndash LLVM platform-independent

ndash RenderMan frontend OpenCL driver

bull Vector Programming ndash Formalized C extension for portable

effective SIMD programming

ndash Type system triggers vectorization

ndash Data layout adaption

bull New Programming Models for High-Performance Graphics

bull Results ndash Demonstrators for shaders and HPC code

ndash CC++-Extensions (with Intel)

ndash OpenCL compiler (CPU)

Compiler Support for High-Performance Graphics Sebastian Hack

bull Hybrid Rendering ndash Client amp Server Model

ndash Smartphone to Mainframe

bull Large Data Processing ndash Scalable Hierarchical

RW Data Structures

bull Results ndash ZAPP displaywall demonstrator

ndash ImageVis3D (Mobile) demonstrator

ndash Practically use in hospitals

Scalable Hybrid Rendering for Large Scale Visualization Jens Kruumlger

Displays as a Service Large Scale Visualization Alexander Loumlffler

bull Virtualization of Displays ndash Virtual Framebuffer and Displays exposed to Internet

ndash Replacing cables by switched IP network

ndash Internet standards for video encoding and streaming

bull Fully Synchronized ndash 120 Hz active stereo sync over IP

ndash Accuracy of ~100us in software

ndash Drives GPU displays output

bull Results ndash 20-screen wall demonstrator

ndash 3-screen wall (thin-bezel)

ndash CE4100 based SW synchronization

SIGGRAPH 2012

Backup

The Intel Science and Technology Center (ISTC) and Intel Collaborative Research Institute (ICRI) Programs

35

The modern economy is an information economy and one that is driven by innovations that enhance productivity as well as create new modes of entertainment We need to invest in the basic research that will inspire future products and services and ensure long term health of our information economy Government and private foundations are helping but corporate America needs to step up and increase commitments to university research - Justin Rattner ndash Intel CTO

$140M investment over 5 years announced by Intel in 2011 and 2012

Centers of Excellence bull Each ISTC and ICRI will focus on one

research area eg visual computing secure computing

bull The ISTCs and ICRIs are meant to bring the best and brightest researchers across the US together

bull Each ISTC and ICRI will be led by a host university and will include thought leaders from other schools

Breaking Barriers to Collaboration

bull Open IP models and open source software to encourage free information exchange (In most of the Centers)

bull Favor projects that span multiple institutions to encourage collaboration among universities

bull Intel researches per center assigned to work on-campus to encourage collaboration between Intel and academia

Greater Impact to Future Tech bull Center research themes to

address essential needs of computing technology

bull Research agendas jointly defined and co-led by an Intel and a University Principal Investigator

bull After completing 3-5 year charters new ISTCs and ICRIs can be formed to respond to changing tech environment

httpfolditportal

Serious Gaming pplied to Content Creation

Highlighted by President Obama Winner of most-significant new visualization tool (NSF)

Goal Create high-quality content by casting creation activities as games in which large numbers of people are incentivized to perform simple tasks which in combination yield sophisticated content PIs Zoran Popovic (UW) Noah Snavely (Cornell) Maneesh Agrawala(Berkeley)

Determining the structure of retroviral protease (HIV)

Video Frank to add Papers Frank to add

Extracting Structure and Semantics

CAD Model Points

Structures

People

Goals Enable context aware computing and automated content creation through the capture analysis and manipulation of real-world visual data PIs Steve Seitz (UW) Noah Snavely (Cornell) Tom Funkhouser (Princeton) Vladlen Koltun (Stanford) Jitendra Malik (Berkeley) Deva Ramanan (UV Irvine)

Video Frank to add Papers Frank to add

httpvisualstanfordedu

Computational Photography (Franken Camera)

Being adopted as a standard API for cellphone camera systems (Apple Android)

bull Goal Develop algorithms languages architectures and prototypes demonstrating the use of computation in the process of image capture and display

bull PIs Marc Levoy (Stanford) Mark Horowitz (Stanford) Pat Hanrahan (Stanford)

Video Frank to add Papers Frank to add

ISTC-VC SIGGRAPH Papers

Character Locomotion Monday 6 August 900 AM - 1030 AM Optimizing Locomotion Controllers Using Biologically Based Actuators and Objectives Jack M Wang Samuel R Hamner Scott L Delp Vladlen Koltun Continuous Character Control With Low-Dimensional Embeddings Sergey Levine Jack M Wang Alexis Haraux Zoran Popović Vladlen Koltun Shape Analysis Monday 6 August 900 AM - 1030 AM Schelling Points on 3D Surface Meshes Xiaobai Chen Abulhair Saparov Bill Pang Thomas Funkhouser Shape Transformation Wednesday 8 August 900 - 1030 AM An Algebraic Model for Parameterized Shape Editing Martin Bokeloh Michael Wand Hans-Peter Seidel Vladlen Koltun

42

ISTC-VC SIGGRAPH Papers

Image Processing Monday 6 August 2- 330 pm Decoupling Algorithms From Schedules for Easy Optimization of Image-Processing Pipelines Jonathan Ragan-Kelley Andrew Adams Sylvain Paris Marc Levoy Saman Amarasinghe Freacutedo Durand

Cloth

Monday 6 August 2-330 pm Specular Reflection From Woven Cloth Piti Irawan Steve Marschner Stitch Meshes for Modeling Knitted Clothing With Yarn-level Detail Cem Yuksel Jonathan M Kaldor Doug L James Steve Marschner

Appearance

Monday 6 August 345-535 pm Printing Spatially Varying Reflectance for Reproducing HDR Images Yue Dong Xin Tong Fabio Pellacini Baining Guo

43

ISTC-VC SIGGRAPH Papers (cont)

Hand Eye and Face Monday 6 August 345-535 pm Session Chair - Vladlen Koltun Discovery of Complex Behaviors through Contact-Invariant Optimization Igor Mordatch Emanuel Todorov Zoran Popovi1049029 Sketching Monday 6 August 345-535 pm HelpingHand Example-Based Stroke Stylization Jingwan Lu Fisher Yu Adam Finkelstein Stephen DiVerdi Fabrication Tuesday 7 August 9-1030 am Fabricating Articulated Characters From Skinned Meshes Moritz Baumlcher Bernd Bickel Doug L James Hanspeter Pfister

44

Sampling Reconstructing and Filtering Light Tuesday 7 August 1045 am-1215 pm A Theory of Monte Carlo Visibility Sampling Ravi Ramamoorthi John Anderson Mark Meyer Derek Nowrouzezahrai Reconstructing the Indirect Light Field for Global Illumination Jaakko Lehtinen Timo Aila Samuli Laine Freacutedo Durand

Geometry Reconstruction amp Tracking

Tuesday 7 August 1045 am-1215 pm Temporally Coherent Completion of Dynamic Shapes Hao Li Linjie Luo Daniel Vlasic Pieter Peers Jovan Popovic Mark Pauly Szymon Rusinkiewicz

Sets of Shapes

Tuesday 7 August 2-330 pm Exploring Collections of 3D Models Using Fuzzy Correspondence Vladimir G Kim Wilmot Li Niloy J Mitra Stephen DiVerdi Thomas Funkhouser A Probabilistic Model for Component-Based Shape Synthesis Evangelos Kalogerakis Siddhartha Chaudhuri Daphne Koller Vladlen Koltun

45

ISTC-VC SIGGRAPH Papers (cont)

Light Rays Tuesday 7 August 2-330 pm Manifold Exploration A Markov Chain Monte Carlo Technique for Rendering Scenes With Difficult Specular Transport Wenzel Jakob Steve Marschner Bidirectional Lightcuts Bruce Walter Pramook Khungurn Kavita Bala

Fun With Video

Tuesday 7 August 345-535 pm Session Chair Noah Snavely Video Deblurring for Hand-Held Cameras Using Patch-Based Synthesis Sunghyun Cho Jue Wang Seungyong Lee Eulerian Video Magnification for Revealing Subtle Changes in the World Hao-Yu Wu Michael Rubinstein Eugene Shih John Guttag Freacutedo Durand William T Freeman Selectively De-Animating Video Jiamin Bai Aseem Agarwala Maneesh Agrawala Ravi Ramamoorthi Tools for Placing Cuts and Transitions in Interview Video Floraine Berthouzoz Wilmot Li Maneesh Agrawala

46

ISTC-VC SIGGRAPH Papers (cont)

Noise and Texture Tuesday 7 August 345-535 pm Structure-Aware Synthesis for Predictive Woven Fabric Appearance Shuang Zhao Kavita Bala Steve Marschner Wenzel Jakob Symmetry-Guided Texture Synthesis and Manipulation Vladimir Kim Yaron Lipman Thomas Funkhouser

Shape Transformation Wednesday 8 August 900 - 1030 AM An Algebraic Model for Parameterized Shape Editing Martin Bokeloh Michael Wand Hans-Peter Seidel Vladlen Koltun

Stitching

Wednesday 8 August 1045 am-1215 pm Exposing Photo Manipulation With Inconsistent Reflections James F OrsquoBrien Hany Farid

47

ISTC-VC SIGGRAPH Papers (cont)

Maps Surfaces and Shapes

Wednesday 8 August 1045 am-1215 pm Simple Formulas For Quasiconformal Plane Deformations Yaron Lipman Vladimir G Kim Thomas Funkhouser

Interactive Systems amp Hardware Wednesday 8 August 2-330 pm Position-Correcting Tools for 2D Digital Fabrication Alec Rivers Ilan E Moyer Freacutedo Durand

48

ISTC-VC SIGGRAPH Papers (cont)

Collisions Wednesday 8 August 345-535 pm Energy-Based Self-Collision Culling for Arbitrary Mesh Deformations Changxi Zheng Doug L James

All About Images

Thursday 9 August 9-1030 am A Framework for Content-Adaptive Photo Manipulation Macros Application to Face Landscape and Global Manipulations Floraine Berthouzoz Wilmot Li Mira Dontcheva Maneesh Agrawala

Sound and Elements

Thursday 9 August 9-1030 am Motion-Driven Concatenative Synthesis of Cloth Sounds Steven S An Doug L James Steve Marschner Precomputed Acceleration Noise for Improved Rigid-Body Sound Jeffrey N Chadwick Changxi Zheng Doug L James Interactive Sound Propagation Using Compact Acoustic Transfer Operators Lakulish Antani Anish Chandak Lauri Savioja Dinesh Manocha Updated Sparse Cholesky Factors for Corotational Elastodynamics Florian Hecht Yeon Jin Lee Jonathan R Shewchuk James F OrsquoBrien

49

ISTC-VC SIGGRAPH Papers (cont)

Geometry amp Viewing Thursday 9 August 2-330 pm Perceptual Models of Viewpoint Preference Adrian Secordm Jingwan Lu Adam Finkelstein Manish Singh Andrew Nealen

Faces and Hair [Closing Session]

Thursday 9 August 345-515 pm Coupled 3D Reconstruction of Sparse Facial Hair and Skin Thabo Beeler Bernd Bickel Gioacchino Noris Paul Beardsley Steve Marschner Robert W Sumner Markus Gross Physical Face Cloning Bernd Bickel Peter Kaufmann Melina Skouras Bernhard Thomaszewski Derek Bradley Thabo Beeler Philip Jackson Steve Marschner Wojciech Matusik Markus Gross

50

ISTC-VC SIGGRAPH Papers (cont)

Siggraph Courses Optimizing Realistic Rendering With Many-Light Methods Sunday 5 August 2-515 pm Jaroslav Krivanek Milos Hasan Adam Arbree Carsten Dachsbacher Alexander Keller Bruce Walter State of the Art in Photon-Density Estimation Thursday 9 August 2-515 pm Toshiya Hachisuka Wojciech Jarosz Guillaume Bouchard Per Christensen Jeppe Revall Frisvad Wenzel Jakob Henrik Wann Jensen Jared M Johnson Michael Kaschalk Claude Knaus Andrew Selle Ben Spencer

Siggraph Talks

Silence Eliminate the Noise Thursday 9 August 9-1030 am Importance Sampling for Hair Scattering Jiawei Ou Feng Xie Parashar Krishnamachari Fabio Pellacini

Siggraph Exhibitor Sessions

Intel Corporation Wednesday 8 August 430-530 pm room 402B The Future of Visual Computing as Viewed by Intel Visual Computing Research Centers

51

Other ISTC-VC SIGGRAPH Participation

Page 12: Future of Visual Computing as viewed by Intel Visual ... · PDF fileFuture of Visual Computing as viewed by Intel Visual Computing Research Centers ... Justin Rattner Intel Science

Data-Driven Modeling

Siggraph 2012 Papers - A Probabilistic Model for Component-Based Shape Synthesis Kalogerakis et al - An Algebraic Model for Parameterized Shape Editing Bokeloh et al

httpvisualstanfordedu

- Goal Capture the nature of a chair or an animal by analyzing large databases of similar objects to allow working with parts rather than polygons Make tools that enable users of all skill levels to produce custom high-quality content for virtual worlds - PIs Vladlen Koltun (Stanford) Tom Funkhouser (Princeton) Pat Hanrahan (Stanford)

Intel Visual Computing Institute

httpswwwintel-university-collaborationnetpage_id=998

Saarbruumlcken Germany

An Open Collaborative Research Institute at the Saarland Campus

Multimodal

Computing

and

Interaction

IVCI Mission Facilitate the progress of Visual Computing research and be a driver towards highest

quality image real-time processing and interactive visualization

Virtual Worlds (Model-based)

Multimodal Scene Analysis amp Interaction

Real Worlds (Sample-based)

Intel VCI Vision Scalable Algorithms for

Real Time Realistic

Rendering

Compiler Support for

High Performance

Graphics

Collaborative Distributed Molecular

Modeling and Visualization

Efficient High Quality

Rendering Using Sample-based

Representations

Scalable Hybrid Rendering for

Large Scale Visualization

Marker-free Performance

Capture

Algorithms for Low Cost Depth

Imaging

Visualization and editing of light

transport

Internet Transport and Coding for 3D

HD-TV

Software- innovation for the Digital Enterprise

Kusanagi Coding and

Interaction for Networked Games

Multi Touch Interaction

Techniques for Mixed 2D and 3D Graphics Displays

Advanced Ray Tracing and Data-Flow

Processing for the 3D Internet

Intel VCI Projects-Based Organization

ECOUSS Efficient and open Compiler-

Framework for parallel Simulations

SCENE Novel Scene Representations for Rich

Networked Media

VERVE Vanquishing fear and apathy

through E-inclusion

Large Scale Visualization in the Internet of Displays

User-centric Video

Processing

Local Dimming for Edge-lit LED LCD-Monitors

SCI Institute Utah USA

Stanford University California USA

Research Collaboration

Consortium Members

User-Centric Video Processing Jan Kautz Christian Theobalt

bull Objective ndash Create new user experiences for capturing

editing and browsing

ndash Targets amateur video creators

bull Approach ndash Automatically identify spationdashtemporal and

semantic relationships withinbetween videos

ndash Leverage graph of these to drive UI and video processing

bull Expected results Capturing automatic stabilization and

enhancement

Editing edit semantic objects in videos

Browsing find semantically related videos

Remove the person in white

Video Inpainting in Dynamic Scenes amp Videoscape for moving through Internet Videos

Efficient High-Quality Rendering Using Sample-based Representations Elmar Eisemann

bull Realistic Rendering ndash Lens Flare [Siggraphrsquo11]

ndash Depth-of-field [Eurographics lsquo11]

ndash Global Illumination [PGrsquo11]

bull Perceptual Rendering ndash Stereo

ndash High Dynamic Range

bull Alternative representations ndash Voxel Data

ndash Height Fields

3D Internet Interactive 3D Content on the Web Philipp Slusallek

bull XML3D Scene Description ndash HTML-5 extension for interactive graphics

ndash JS implementation amp built into the browser

ndash Reuses Web Technology (DOM CSS JS)

bull XFLOW Parallel Processing ndash Data-parallel flowgraph for XML3D

ndash Animations image amp geometry processing

ndash Configuration within the DOM

bull Results ndash W3C standardization ldquoDeclarative 3D for the Webrdquo

ndash Rich media apps for BMW SLS-Museum hellip

3D-Internet Apps SLS-Museum 3D-Installation amp Museum with Interactive Virtual Characters

3D-Internet Apps Using OpenStreetMap-3D as Shared Virtual Worlds

Fully automatically generated from OpenStreet Map Taking semantic data into acount

Marker-free Performance Capture Christian Theobalt

bull Reconstruction of detailed human animation models ndash In Multi-view video without markers

ndash Out Detailed motion shape and appearance

ndash General clothing modifiable performances new animations

bull Real-time performance capture ndash Fast full-body motion estimation from depth

cameras

ndash Interaction

ndash Collaboration with Intel Magic Mirror project

[ICCV 2011]

[SIGGRAPH Asia 2010]

Markerless Motion Capture of Interacting Characters Using Multi-view Image Segmentation

Articulated Models Input silhouettes Segmentation Contour labels Estimated surface Estimated 3D models

Handling Intersections

Improved segmentation with 3D shape priors Excellent performance when evaluated against marker-based system

bull Interactive inspection of light transport in virtual scenes ndash You can only manipulate what you see

ndash First prototypal light manipulation tools

bull Efficient global illumination ndash Otherwise no interactive

visualization nor manipulation

ndash Improvements on many-lights methods and progressive photon mapping

bull Results ndash Demonstrator Maya plugin ndash Collaboration with local film academy

Visualization and Editing of Light Transport Carsten Dachsbacher

Advanced Real-Time Ray Tracing Techniques Philipp Slusallek

bull Perfect importance sampling and caching ndash Sparse but perfect importance sampling

ndash Caching and interpolation [Eurographics`12]

bull Unifying Photon-Mapping amp Monte-Carlo ndash Formulating PM as a MC process

ndash Per pixel combination using MIS

bull Data-parallel implementations

ndash Efficiency and performance

bull Integration into XML3D

ndash Provide ldquocorrectrdquo results by default

Vertex Merging with Multiple Importance Sampling Photon-Mapping as a Monte-Carlo Process

BPT

PPM Progressive Photon-Mapping (PPM)

Bidirectional Path Tracing (BPT)

bull Whole-Function Vectorization ndash Restore scalar computations

ndash LLVM platform-independent

ndash RenderMan frontend OpenCL driver

bull Vector Programming ndash Formalized C extension for portable

effective SIMD programming

ndash Type system triggers vectorization

ndash Data layout adaption

bull New Programming Models for High-Performance Graphics

bull Results ndash Demonstrators for shaders and HPC code

ndash CC++-Extensions (with Intel)

ndash OpenCL compiler (CPU)

Compiler Support for High-Performance Graphics Sebastian Hack

bull Hybrid Rendering ndash Client amp Server Model

ndash Smartphone to Mainframe

bull Large Data Processing ndash Scalable Hierarchical

RW Data Structures

bull Results ndash ZAPP displaywall demonstrator

ndash ImageVis3D (Mobile) demonstrator

ndash Practically use in hospitals

Scalable Hybrid Rendering for Large Scale Visualization Jens Kruumlger

Displays as a Service Large Scale Visualization Alexander Loumlffler

bull Virtualization of Displays ndash Virtual Framebuffer and Displays exposed to Internet

ndash Replacing cables by switched IP network

ndash Internet standards for video encoding and streaming

bull Fully Synchronized ndash 120 Hz active stereo sync over IP

ndash Accuracy of ~100us in software

ndash Drives GPU displays output

bull Results ndash 20-screen wall demonstrator

ndash 3-screen wall (thin-bezel)

ndash CE4100 based SW synchronization

SIGGRAPH 2012

Backup

The Intel Science and Technology Center (ISTC) and Intel Collaborative Research Institute (ICRI) Programs

35

The modern economy is an information economy and one that is driven by innovations that enhance productivity as well as create new modes of entertainment We need to invest in the basic research that will inspire future products and services and ensure long term health of our information economy Government and private foundations are helping but corporate America needs to step up and increase commitments to university research - Justin Rattner ndash Intel CTO

$140M investment over 5 years announced by Intel in 2011 and 2012

Centers of Excellence bull Each ISTC and ICRI will focus on one

research area eg visual computing secure computing

bull The ISTCs and ICRIs are meant to bring the best and brightest researchers across the US together

bull Each ISTC and ICRI will be led by a host university and will include thought leaders from other schools

Breaking Barriers to Collaboration

bull Open IP models and open source software to encourage free information exchange (In most of the Centers)

bull Favor projects that span multiple institutions to encourage collaboration among universities

bull Intel researches per center assigned to work on-campus to encourage collaboration between Intel and academia

Greater Impact to Future Tech bull Center research themes to

address essential needs of computing technology

bull Research agendas jointly defined and co-led by an Intel and a University Principal Investigator

bull After completing 3-5 year charters new ISTCs and ICRIs can be formed to respond to changing tech environment

httpfolditportal

Serious Gaming pplied to Content Creation

Highlighted by President Obama Winner of most-significant new visualization tool (NSF)

Goal Create high-quality content by casting creation activities as games in which large numbers of people are incentivized to perform simple tasks which in combination yield sophisticated content PIs Zoran Popovic (UW) Noah Snavely (Cornell) Maneesh Agrawala(Berkeley)

Determining the structure of retroviral protease (HIV)

Video Frank to add Papers Frank to add

Extracting Structure and Semantics

CAD Model Points

Structures

People

Goals Enable context aware computing and automated content creation through the capture analysis and manipulation of real-world visual data PIs Steve Seitz (UW) Noah Snavely (Cornell) Tom Funkhouser (Princeton) Vladlen Koltun (Stanford) Jitendra Malik (Berkeley) Deva Ramanan (UV Irvine)

Video Frank to add Papers Frank to add

httpvisualstanfordedu

Computational Photography (Franken Camera)

Being adopted as a standard API for cellphone camera systems (Apple Android)

bull Goal Develop algorithms languages architectures and prototypes demonstrating the use of computation in the process of image capture and display

bull PIs Marc Levoy (Stanford) Mark Horowitz (Stanford) Pat Hanrahan (Stanford)

Video Frank to add Papers Frank to add

ISTC-VC SIGGRAPH Papers

Character Locomotion Monday 6 August 900 AM - 1030 AM Optimizing Locomotion Controllers Using Biologically Based Actuators and Objectives Jack M Wang Samuel R Hamner Scott L Delp Vladlen Koltun Continuous Character Control With Low-Dimensional Embeddings Sergey Levine Jack M Wang Alexis Haraux Zoran Popović Vladlen Koltun Shape Analysis Monday 6 August 900 AM - 1030 AM Schelling Points on 3D Surface Meshes Xiaobai Chen Abulhair Saparov Bill Pang Thomas Funkhouser Shape Transformation Wednesday 8 August 900 - 1030 AM An Algebraic Model for Parameterized Shape Editing Martin Bokeloh Michael Wand Hans-Peter Seidel Vladlen Koltun

42

ISTC-VC SIGGRAPH Papers

Image Processing Monday 6 August 2- 330 pm Decoupling Algorithms From Schedules for Easy Optimization of Image-Processing Pipelines Jonathan Ragan-Kelley Andrew Adams Sylvain Paris Marc Levoy Saman Amarasinghe Freacutedo Durand

Cloth

Monday 6 August 2-330 pm Specular Reflection From Woven Cloth Piti Irawan Steve Marschner Stitch Meshes for Modeling Knitted Clothing With Yarn-level Detail Cem Yuksel Jonathan M Kaldor Doug L James Steve Marschner

Appearance

Monday 6 August 345-535 pm Printing Spatially Varying Reflectance for Reproducing HDR Images Yue Dong Xin Tong Fabio Pellacini Baining Guo

43

ISTC-VC SIGGRAPH Papers (cont)

Hand Eye and Face Monday 6 August 345-535 pm Session Chair - Vladlen Koltun Discovery of Complex Behaviors through Contact-Invariant Optimization Igor Mordatch Emanuel Todorov Zoran Popovi1049029 Sketching Monday 6 August 345-535 pm HelpingHand Example-Based Stroke Stylization Jingwan Lu Fisher Yu Adam Finkelstein Stephen DiVerdi Fabrication Tuesday 7 August 9-1030 am Fabricating Articulated Characters From Skinned Meshes Moritz Baumlcher Bernd Bickel Doug L James Hanspeter Pfister

44

Sampling Reconstructing and Filtering Light Tuesday 7 August 1045 am-1215 pm A Theory of Monte Carlo Visibility Sampling Ravi Ramamoorthi John Anderson Mark Meyer Derek Nowrouzezahrai Reconstructing the Indirect Light Field for Global Illumination Jaakko Lehtinen Timo Aila Samuli Laine Freacutedo Durand

Geometry Reconstruction amp Tracking

Tuesday 7 August 1045 am-1215 pm Temporally Coherent Completion of Dynamic Shapes Hao Li Linjie Luo Daniel Vlasic Pieter Peers Jovan Popovic Mark Pauly Szymon Rusinkiewicz

Sets of Shapes

Tuesday 7 August 2-330 pm Exploring Collections of 3D Models Using Fuzzy Correspondence Vladimir G Kim Wilmot Li Niloy J Mitra Stephen DiVerdi Thomas Funkhouser A Probabilistic Model for Component-Based Shape Synthesis Evangelos Kalogerakis Siddhartha Chaudhuri Daphne Koller Vladlen Koltun

45

ISTC-VC SIGGRAPH Papers (cont)

Light Rays Tuesday 7 August 2-330 pm Manifold Exploration A Markov Chain Monte Carlo Technique for Rendering Scenes With Difficult Specular Transport Wenzel Jakob Steve Marschner Bidirectional Lightcuts Bruce Walter Pramook Khungurn Kavita Bala

Fun With Video

Tuesday 7 August 345-535 pm Session Chair Noah Snavely Video Deblurring for Hand-Held Cameras Using Patch-Based Synthesis Sunghyun Cho Jue Wang Seungyong Lee Eulerian Video Magnification for Revealing Subtle Changes in the World Hao-Yu Wu Michael Rubinstein Eugene Shih John Guttag Freacutedo Durand William T Freeman Selectively De-Animating Video Jiamin Bai Aseem Agarwala Maneesh Agrawala Ravi Ramamoorthi Tools for Placing Cuts and Transitions in Interview Video Floraine Berthouzoz Wilmot Li Maneesh Agrawala

46

ISTC-VC SIGGRAPH Papers (cont)

Noise and Texture Tuesday 7 August 345-535 pm Structure-Aware Synthesis for Predictive Woven Fabric Appearance Shuang Zhao Kavita Bala Steve Marschner Wenzel Jakob Symmetry-Guided Texture Synthesis and Manipulation Vladimir Kim Yaron Lipman Thomas Funkhouser

Shape Transformation Wednesday 8 August 900 - 1030 AM An Algebraic Model for Parameterized Shape Editing Martin Bokeloh Michael Wand Hans-Peter Seidel Vladlen Koltun

Stitching

Wednesday 8 August 1045 am-1215 pm Exposing Photo Manipulation With Inconsistent Reflections James F OrsquoBrien Hany Farid

47

ISTC-VC SIGGRAPH Papers (cont)

Maps Surfaces and Shapes

Wednesday 8 August 1045 am-1215 pm Simple Formulas For Quasiconformal Plane Deformations Yaron Lipman Vladimir G Kim Thomas Funkhouser

Interactive Systems amp Hardware Wednesday 8 August 2-330 pm Position-Correcting Tools for 2D Digital Fabrication Alec Rivers Ilan E Moyer Freacutedo Durand

48

ISTC-VC SIGGRAPH Papers (cont)

Collisions Wednesday 8 August 345-535 pm Energy-Based Self-Collision Culling for Arbitrary Mesh Deformations Changxi Zheng Doug L James

All About Images

Thursday 9 August 9-1030 am A Framework for Content-Adaptive Photo Manipulation Macros Application to Face Landscape and Global Manipulations Floraine Berthouzoz Wilmot Li Mira Dontcheva Maneesh Agrawala

Sound and Elements

Thursday 9 August 9-1030 am Motion-Driven Concatenative Synthesis of Cloth Sounds Steven S An Doug L James Steve Marschner Precomputed Acceleration Noise for Improved Rigid-Body Sound Jeffrey N Chadwick Changxi Zheng Doug L James Interactive Sound Propagation Using Compact Acoustic Transfer Operators Lakulish Antani Anish Chandak Lauri Savioja Dinesh Manocha Updated Sparse Cholesky Factors for Corotational Elastodynamics Florian Hecht Yeon Jin Lee Jonathan R Shewchuk James F OrsquoBrien

49

ISTC-VC SIGGRAPH Papers (cont)

Geometry amp Viewing Thursday 9 August 2-330 pm Perceptual Models of Viewpoint Preference Adrian Secordm Jingwan Lu Adam Finkelstein Manish Singh Andrew Nealen

Faces and Hair [Closing Session]

Thursday 9 August 345-515 pm Coupled 3D Reconstruction of Sparse Facial Hair and Skin Thabo Beeler Bernd Bickel Gioacchino Noris Paul Beardsley Steve Marschner Robert W Sumner Markus Gross Physical Face Cloning Bernd Bickel Peter Kaufmann Melina Skouras Bernhard Thomaszewski Derek Bradley Thabo Beeler Philip Jackson Steve Marschner Wojciech Matusik Markus Gross

50

ISTC-VC SIGGRAPH Papers (cont)

Siggraph Courses Optimizing Realistic Rendering With Many-Light Methods Sunday 5 August 2-515 pm Jaroslav Krivanek Milos Hasan Adam Arbree Carsten Dachsbacher Alexander Keller Bruce Walter State of the Art in Photon-Density Estimation Thursday 9 August 2-515 pm Toshiya Hachisuka Wojciech Jarosz Guillaume Bouchard Per Christensen Jeppe Revall Frisvad Wenzel Jakob Henrik Wann Jensen Jared M Johnson Michael Kaschalk Claude Knaus Andrew Selle Ben Spencer

Siggraph Talks

Silence Eliminate the Noise Thursday 9 August 9-1030 am Importance Sampling for Hair Scattering Jiawei Ou Feng Xie Parashar Krishnamachari Fabio Pellacini

Siggraph Exhibitor Sessions

Intel Corporation Wednesday 8 August 430-530 pm room 402B The Future of Visual Computing as Viewed by Intel Visual Computing Research Centers

51

Other ISTC-VC SIGGRAPH Participation

Page 13: Future of Visual Computing as viewed by Intel Visual ... · PDF fileFuture of Visual Computing as viewed by Intel Visual Computing Research Centers ... Justin Rattner Intel Science

Intel Visual Computing Institute

httpswwwintel-university-collaborationnetpage_id=998

Saarbruumlcken Germany

An Open Collaborative Research Institute at the Saarland Campus

Multimodal

Computing

and

Interaction

IVCI Mission Facilitate the progress of Visual Computing research and be a driver towards highest

quality image real-time processing and interactive visualization

Virtual Worlds (Model-based)

Multimodal Scene Analysis amp Interaction

Real Worlds (Sample-based)

Intel VCI Vision Scalable Algorithms for

Real Time Realistic

Rendering

Compiler Support for

High Performance

Graphics

Collaborative Distributed Molecular

Modeling and Visualization

Efficient High Quality

Rendering Using Sample-based

Representations

Scalable Hybrid Rendering for

Large Scale Visualization

Marker-free Performance

Capture

Algorithms for Low Cost Depth

Imaging

Visualization and editing of light

transport

Internet Transport and Coding for 3D

HD-TV

Software- innovation for the Digital Enterprise

Kusanagi Coding and

Interaction for Networked Games

Multi Touch Interaction

Techniques for Mixed 2D and 3D Graphics Displays

Advanced Ray Tracing and Data-Flow

Processing for the 3D Internet

Intel VCI Projects-Based Organization

ECOUSS Efficient and open Compiler-

Framework for parallel Simulations

SCENE Novel Scene Representations for Rich

Networked Media

VERVE Vanquishing fear and apathy

through E-inclusion

Large Scale Visualization in the Internet of Displays

User-centric Video

Processing

Local Dimming for Edge-lit LED LCD-Monitors

SCI Institute Utah USA

Stanford University California USA

Research Collaboration

Consortium Members

User-Centric Video Processing Jan Kautz Christian Theobalt

bull Objective ndash Create new user experiences for capturing

editing and browsing

ndash Targets amateur video creators

bull Approach ndash Automatically identify spationdashtemporal and

semantic relationships withinbetween videos

ndash Leverage graph of these to drive UI and video processing

bull Expected results Capturing automatic stabilization and

enhancement

Editing edit semantic objects in videos

Browsing find semantically related videos

Remove the person in white

Video Inpainting in Dynamic Scenes amp Videoscape for moving through Internet Videos

Efficient High-Quality Rendering Using Sample-based Representations Elmar Eisemann

bull Realistic Rendering ndash Lens Flare [Siggraphrsquo11]

ndash Depth-of-field [Eurographics lsquo11]

ndash Global Illumination [PGrsquo11]

bull Perceptual Rendering ndash Stereo

ndash High Dynamic Range

bull Alternative representations ndash Voxel Data

ndash Height Fields

3D Internet Interactive 3D Content on the Web Philipp Slusallek

bull XML3D Scene Description ndash HTML-5 extension for interactive graphics

ndash JS implementation amp built into the browser

ndash Reuses Web Technology (DOM CSS JS)

bull XFLOW Parallel Processing ndash Data-parallel flowgraph for XML3D

ndash Animations image amp geometry processing

ndash Configuration within the DOM

bull Results ndash W3C standardization ldquoDeclarative 3D for the Webrdquo

ndash Rich media apps for BMW SLS-Museum hellip

3D-Internet Apps SLS-Museum 3D-Installation amp Museum with Interactive Virtual Characters

3D-Internet Apps Using OpenStreetMap-3D as Shared Virtual Worlds

Fully automatically generated from OpenStreet Map Taking semantic data into acount

Marker-free Performance Capture Christian Theobalt

bull Reconstruction of detailed human animation models ndash In Multi-view video without markers

ndash Out Detailed motion shape and appearance

ndash General clothing modifiable performances new animations

bull Real-time performance capture ndash Fast full-body motion estimation from depth

cameras

ndash Interaction

ndash Collaboration with Intel Magic Mirror project

[ICCV 2011]

[SIGGRAPH Asia 2010]

Markerless Motion Capture of Interacting Characters Using Multi-view Image Segmentation

Articulated Models Input silhouettes Segmentation Contour labels Estimated surface Estimated 3D models

Handling Intersections

Improved segmentation with 3D shape priors Excellent performance when evaluated against marker-based system

bull Interactive inspection of light transport in virtual scenes ndash You can only manipulate what you see

ndash First prototypal light manipulation tools

bull Efficient global illumination ndash Otherwise no interactive

visualization nor manipulation

ndash Improvements on many-lights methods and progressive photon mapping

bull Results ndash Demonstrator Maya plugin ndash Collaboration with local film academy

Visualization and Editing of Light Transport Carsten Dachsbacher

Advanced Real-Time Ray Tracing Techniques Philipp Slusallek

bull Perfect importance sampling and caching ndash Sparse but perfect importance sampling

ndash Caching and interpolation [Eurographics`12]

bull Unifying Photon-Mapping amp Monte-Carlo ndash Formulating PM as a MC process

ndash Per pixel combination using MIS

bull Data-parallel implementations

ndash Efficiency and performance

bull Integration into XML3D

ndash Provide ldquocorrectrdquo results by default

Vertex Merging with Multiple Importance Sampling Photon-Mapping as a Monte-Carlo Process

BPT

PPM Progressive Photon-Mapping (PPM)

Bidirectional Path Tracing (BPT)

bull Whole-Function Vectorization ndash Restore scalar computations

ndash LLVM platform-independent

ndash RenderMan frontend OpenCL driver

bull Vector Programming ndash Formalized C extension for portable

effective SIMD programming

ndash Type system triggers vectorization

ndash Data layout adaption

bull New Programming Models for High-Performance Graphics

bull Results ndash Demonstrators for shaders and HPC code

ndash CC++-Extensions (with Intel)

ndash OpenCL compiler (CPU)

Compiler Support for High-Performance Graphics Sebastian Hack

bull Hybrid Rendering ndash Client amp Server Model

ndash Smartphone to Mainframe

bull Large Data Processing ndash Scalable Hierarchical

RW Data Structures

bull Results ndash ZAPP displaywall demonstrator

ndash ImageVis3D (Mobile) demonstrator

ndash Practically use in hospitals

Scalable Hybrid Rendering for Large Scale Visualization Jens Kruumlger

Displays as a Service Large Scale Visualization Alexander Loumlffler

bull Virtualization of Displays ndash Virtual Framebuffer and Displays exposed to Internet

ndash Replacing cables by switched IP network

ndash Internet standards for video encoding and streaming

bull Fully Synchronized ndash 120 Hz active stereo sync over IP

ndash Accuracy of ~100us in software

ndash Drives GPU displays output

bull Results ndash 20-screen wall demonstrator

ndash 3-screen wall (thin-bezel)

ndash CE4100 based SW synchronization

SIGGRAPH 2012

Backup

The Intel Science and Technology Center (ISTC) and Intel Collaborative Research Institute (ICRI) Programs

35

The modern economy is an information economy and one that is driven by innovations that enhance productivity as well as create new modes of entertainment We need to invest in the basic research that will inspire future products and services and ensure long term health of our information economy Government and private foundations are helping but corporate America needs to step up and increase commitments to university research - Justin Rattner ndash Intel CTO

$140M investment over 5 years announced by Intel in 2011 and 2012

Centers of Excellence bull Each ISTC and ICRI will focus on one

research area eg visual computing secure computing

bull The ISTCs and ICRIs are meant to bring the best and brightest researchers across the US together

bull Each ISTC and ICRI will be led by a host university and will include thought leaders from other schools

Breaking Barriers to Collaboration

bull Open IP models and open source software to encourage free information exchange (In most of the Centers)

bull Favor projects that span multiple institutions to encourage collaboration among universities

bull Intel researches per center assigned to work on-campus to encourage collaboration between Intel and academia

Greater Impact to Future Tech bull Center research themes to

address essential needs of computing technology

bull Research agendas jointly defined and co-led by an Intel and a University Principal Investigator

bull After completing 3-5 year charters new ISTCs and ICRIs can be formed to respond to changing tech environment

httpfolditportal

Serious Gaming pplied to Content Creation

Highlighted by President Obama Winner of most-significant new visualization tool (NSF)

Goal Create high-quality content by casting creation activities as games in which large numbers of people are incentivized to perform simple tasks which in combination yield sophisticated content PIs Zoran Popovic (UW) Noah Snavely (Cornell) Maneesh Agrawala(Berkeley)

Determining the structure of retroviral protease (HIV)

Video Frank to add Papers Frank to add

Extracting Structure and Semantics

CAD Model Points

Structures

People

Goals Enable context aware computing and automated content creation through the capture analysis and manipulation of real-world visual data PIs Steve Seitz (UW) Noah Snavely (Cornell) Tom Funkhouser (Princeton) Vladlen Koltun (Stanford) Jitendra Malik (Berkeley) Deva Ramanan (UV Irvine)

Video Frank to add Papers Frank to add

httpvisualstanfordedu

Computational Photography (Franken Camera)

Being adopted as a standard API for cellphone camera systems (Apple Android)

bull Goal Develop algorithms languages architectures and prototypes demonstrating the use of computation in the process of image capture and display

bull PIs Marc Levoy (Stanford) Mark Horowitz (Stanford) Pat Hanrahan (Stanford)

Video Frank to add Papers Frank to add

ISTC-VC SIGGRAPH Papers

Character Locomotion Monday 6 August 900 AM - 1030 AM Optimizing Locomotion Controllers Using Biologically Based Actuators and Objectives Jack M Wang Samuel R Hamner Scott L Delp Vladlen Koltun Continuous Character Control With Low-Dimensional Embeddings Sergey Levine Jack M Wang Alexis Haraux Zoran Popović Vladlen Koltun Shape Analysis Monday 6 August 900 AM - 1030 AM Schelling Points on 3D Surface Meshes Xiaobai Chen Abulhair Saparov Bill Pang Thomas Funkhouser Shape Transformation Wednesday 8 August 900 - 1030 AM An Algebraic Model for Parameterized Shape Editing Martin Bokeloh Michael Wand Hans-Peter Seidel Vladlen Koltun

42

ISTC-VC SIGGRAPH Papers

Image Processing Monday 6 August 2- 330 pm Decoupling Algorithms From Schedules for Easy Optimization of Image-Processing Pipelines Jonathan Ragan-Kelley Andrew Adams Sylvain Paris Marc Levoy Saman Amarasinghe Freacutedo Durand

Cloth

Monday 6 August 2-330 pm Specular Reflection From Woven Cloth Piti Irawan Steve Marschner Stitch Meshes for Modeling Knitted Clothing With Yarn-level Detail Cem Yuksel Jonathan M Kaldor Doug L James Steve Marschner

Appearance

Monday 6 August 345-535 pm Printing Spatially Varying Reflectance for Reproducing HDR Images Yue Dong Xin Tong Fabio Pellacini Baining Guo

43

ISTC-VC SIGGRAPH Papers (cont)

Hand Eye and Face Monday 6 August 345-535 pm Session Chair - Vladlen Koltun Discovery of Complex Behaviors through Contact-Invariant Optimization Igor Mordatch Emanuel Todorov Zoran Popovi1049029 Sketching Monday 6 August 345-535 pm HelpingHand Example-Based Stroke Stylization Jingwan Lu Fisher Yu Adam Finkelstein Stephen DiVerdi Fabrication Tuesday 7 August 9-1030 am Fabricating Articulated Characters From Skinned Meshes Moritz Baumlcher Bernd Bickel Doug L James Hanspeter Pfister

44

Sampling Reconstructing and Filtering Light Tuesday 7 August 1045 am-1215 pm A Theory of Monte Carlo Visibility Sampling Ravi Ramamoorthi John Anderson Mark Meyer Derek Nowrouzezahrai Reconstructing the Indirect Light Field for Global Illumination Jaakko Lehtinen Timo Aila Samuli Laine Freacutedo Durand

Geometry Reconstruction amp Tracking

Tuesday 7 August 1045 am-1215 pm Temporally Coherent Completion of Dynamic Shapes Hao Li Linjie Luo Daniel Vlasic Pieter Peers Jovan Popovic Mark Pauly Szymon Rusinkiewicz

Sets of Shapes

Tuesday 7 August 2-330 pm Exploring Collections of 3D Models Using Fuzzy Correspondence Vladimir G Kim Wilmot Li Niloy J Mitra Stephen DiVerdi Thomas Funkhouser A Probabilistic Model for Component-Based Shape Synthesis Evangelos Kalogerakis Siddhartha Chaudhuri Daphne Koller Vladlen Koltun

45

ISTC-VC SIGGRAPH Papers (cont)

Light Rays Tuesday 7 August 2-330 pm Manifold Exploration A Markov Chain Monte Carlo Technique for Rendering Scenes With Difficult Specular Transport Wenzel Jakob Steve Marschner Bidirectional Lightcuts Bruce Walter Pramook Khungurn Kavita Bala

Fun With Video

Tuesday 7 August 345-535 pm Session Chair Noah Snavely Video Deblurring for Hand-Held Cameras Using Patch-Based Synthesis Sunghyun Cho Jue Wang Seungyong Lee Eulerian Video Magnification for Revealing Subtle Changes in the World Hao-Yu Wu Michael Rubinstein Eugene Shih John Guttag Freacutedo Durand William T Freeman Selectively De-Animating Video Jiamin Bai Aseem Agarwala Maneesh Agrawala Ravi Ramamoorthi Tools for Placing Cuts and Transitions in Interview Video Floraine Berthouzoz Wilmot Li Maneesh Agrawala

46

ISTC-VC SIGGRAPH Papers (cont)

Noise and Texture Tuesday 7 August 345-535 pm Structure-Aware Synthesis for Predictive Woven Fabric Appearance Shuang Zhao Kavita Bala Steve Marschner Wenzel Jakob Symmetry-Guided Texture Synthesis and Manipulation Vladimir Kim Yaron Lipman Thomas Funkhouser

Shape Transformation Wednesday 8 August 900 - 1030 AM An Algebraic Model for Parameterized Shape Editing Martin Bokeloh Michael Wand Hans-Peter Seidel Vladlen Koltun

Stitching

Wednesday 8 August 1045 am-1215 pm Exposing Photo Manipulation With Inconsistent Reflections James F OrsquoBrien Hany Farid

47

ISTC-VC SIGGRAPH Papers (cont)

Maps Surfaces and Shapes

Wednesday 8 August 1045 am-1215 pm Simple Formulas For Quasiconformal Plane Deformations Yaron Lipman Vladimir G Kim Thomas Funkhouser

Interactive Systems amp Hardware Wednesday 8 August 2-330 pm Position-Correcting Tools for 2D Digital Fabrication Alec Rivers Ilan E Moyer Freacutedo Durand

48

ISTC-VC SIGGRAPH Papers (cont)

Collisions Wednesday 8 August 345-535 pm Energy-Based Self-Collision Culling for Arbitrary Mesh Deformations Changxi Zheng Doug L James

All About Images

Thursday 9 August 9-1030 am A Framework for Content-Adaptive Photo Manipulation Macros Application to Face Landscape and Global Manipulations Floraine Berthouzoz Wilmot Li Mira Dontcheva Maneesh Agrawala

Sound and Elements

Thursday 9 August 9-1030 am Motion-Driven Concatenative Synthesis of Cloth Sounds Steven S An Doug L James Steve Marschner Precomputed Acceleration Noise for Improved Rigid-Body Sound Jeffrey N Chadwick Changxi Zheng Doug L James Interactive Sound Propagation Using Compact Acoustic Transfer Operators Lakulish Antani Anish Chandak Lauri Savioja Dinesh Manocha Updated Sparse Cholesky Factors for Corotational Elastodynamics Florian Hecht Yeon Jin Lee Jonathan R Shewchuk James F OrsquoBrien

49

ISTC-VC SIGGRAPH Papers (cont)

Geometry amp Viewing Thursday 9 August 2-330 pm Perceptual Models of Viewpoint Preference Adrian Secordm Jingwan Lu Adam Finkelstein Manish Singh Andrew Nealen

Faces and Hair [Closing Session]

Thursday 9 August 345-515 pm Coupled 3D Reconstruction of Sparse Facial Hair and Skin Thabo Beeler Bernd Bickel Gioacchino Noris Paul Beardsley Steve Marschner Robert W Sumner Markus Gross Physical Face Cloning Bernd Bickel Peter Kaufmann Melina Skouras Bernhard Thomaszewski Derek Bradley Thabo Beeler Philip Jackson Steve Marschner Wojciech Matusik Markus Gross

50

ISTC-VC SIGGRAPH Papers (cont)

Siggraph Courses Optimizing Realistic Rendering With Many-Light Methods Sunday 5 August 2-515 pm Jaroslav Krivanek Milos Hasan Adam Arbree Carsten Dachsbacher Alexander Keller Bruce Walter State of the Art in Photon-Density Estimation Thursday 9 August 2-515 pm Toshiya Hachisuka Wojciech Jarosz Guillaume Bouchard Per Christensen Jeppe Revall Frisvad Wenzel Jakob Henrik Wann Jensen Jared M Johnson Michael Kaschalk Claude Knaus Andrew Selle Ben Spencer

Siggraph Talks

Silence Eliminate the Noise Thursday 9 August 9-1030 am Importance Sampling for Hair Scattering Jiawei Ou Feng Xie Parashar Krishnamachari Fabio Pellacini

Siggraph Exhibitor Sessions

Intel Corporation Wednesday 8 August 430-530 pm room 402B The Future of Visual Computing as Viewed by Intel Visual Computing Research Centers

51

Other ISTC-VC SIGGRAPH Participation

Page 14: Future of Visual Computing as viewed by Intel Visual ... · PDF fileFuture of Visual Computing as viewed by Intel Visual Computing Research Centers ... Justin Rattner Intel Science

Saarbruumlcken Germany

An Open Collaborative Research Institute at the Saarland Campus

Multimodal

Computing

and

Interaction

IVCI Mission Facilitate the progress of Visual Computing research and be a driver towards highest

quality image real-time processing and interactive visualization

Virtual Worlds (Model-based)

Multimodal Scene Analysis amp Interaction

Real Worlds (Sample-based)

Intel VCI Vision Scalable Algorithms for

Real Time Realistic

Rendering

Compiler Support for

High Performance

Graphics

Collaborative Distributed Molecular

Modeling and Visualization

Efficient High Quality

Rendering Using Sample-based

Representations

Scalable Hybrid Rendering for

Large Scale Visualization

Marker-free Performance

Capture

Algorithms for Low Cost Depth

Imaging

Visualization and editing of light

transport

Internet Transport and Coding for 3D

HD-TV

Software- innovation for the Digital Enterprise

Kusanagi Coding and

Interaction for Networked Games

Multi Touch Interaction

Techniques for Mixed 2D and 3D Graphics Displays

Advanced Ray Tracing and Data-Flow

Processing for the 3D Internet

Intel VCI Projects-Based Organization

ECOUSS Efficient and open Compiler-

Framework for parallel Simulations

SCENE Novel Scene Representations for Rich

Networked Media

VERVE Vanquishing fear and apathy

through E-inclusion

Large Scale Visualization in the Internet of Displays

User-centric Video

Processing

Local Dimming for Edge-lit LED LCD-Monitors

SCI Institute Utah USA

Stanford University California USA

Research Collaboration

Consortium Members

User-Centric Video Processing Jan Kautz Christian Theobalt

bull Objective ndash Create new user experiences for capturing

editing and browsing

ndash Targets amateur video creators

bull Approach ndash Automatically identify spationdashtemporal and

semantic relationships withinbetween videos

ndash Leverage graph of these to drive UI and video processing

bull Expected results Capturing automatic stabilization and

enhancement

Editing edit semantic objects in videos

Browsing find semantically related videos

Remove the person in white

Video Inpainting in Dynamic Scenes amp Videoscape for moving through Internet Videos

Efficient High-Quality Rendering Using Sample-based Representations Elmar Eisemann

bull Realistic Rendering ndash Lens Flare [Siggraphrsquo11]

ndash Depth-of-field [Eurographics lsquo11]

ndash Global Illumination [PGrsquo11]

bull Perceptual Rendering ndash Stereo

ndash High Dynamic Range

bull Alternative representations ndash Voxel Data

ndash Height Fields

3D Internet Interactive 3D Content on the Web Philipp Slusallek

bull XML3D Scene Description ndash HTML-5 extension for interactive graphics

ndash JS implementation amp built into the browser

ndash Reuses Web Technology (DOM CSS JS)

bull XFLOW Parallel Processing ndash Data-parallel flowgraph for XML3D

ndash Animations image amp geometry processing

ndash Configuration within the DOM

bull Results ndash W3C standardization ldquoDeclarative 3D for the Webrdquo

ndash Rich media apps for BMW SLS-Museum hellip

3D-Internet Apps SLS-Museum 3D-Installation amp Museum with Interactive Virtual Characters

3D-Internet Apps Using OpenStreetMap-3D as Shared Virtual Worlds

Fully automatically generated from OpenStreet Map Taking semantic data into acount

Marker-free Performance Capture Christian Theobalt

bull Reconstruction of detailed human animation models ndash In Multi-view video without markers

ndash Out Detailed motion shape and appearance

ndash General clothing modifiable performances new animations

bull Real-time performance capture ndash Fast full-body motion estimation from depth

cameras

ndash Interaction

ndash Collaboration with Intel Magic Mirror project

[ICCV 2011]

[SIGGRAPH Asia 2010]

Markerless Motion Capture of Interacting Characters Using Multi-view Image Segmentation

Articulated Models Input silhouettes Segmentation Contour labels Estimated surface Estimated 3D models

Handling Intersections

Improved segmentation with 3D shape priors Excellent performance when evaluated against marker-based system

bull Interactive inspection of light transport in virtual scenes ndash You can only manipulate what you see

ndash First prototypal light manipulation tools

bull Efficient global illumination ndash Otherwise no interactive

visualization nor manipulation

ndash Improvements on many-lights methods and progressive photon mapping

bull Results ndash Demonstrator Maya plugin ndash Collaboration with local film academy

Visualization and Editing of Light Transport Carsten Dachsbacher

Advanced Real-Time Ray Tracing Techniques Philipp Slusallek

bull Perfect importance sampling and caching ndash Sparse but perfect importance sampling

ndash Caching and interpolation [Eurographics`12]

bull Unifying Photon-Mapping amp Monte-Carlo ndash Formulating PM as a MC process

ndash Per pixel combination using MIS

bull Data-parallel implementations

ndash Efficiency and performance

bull Integration into XML3D

ndash Provide ldquocorrectrdquo results by default

Vertex Merging with Multiple Importance Sampling Photon-Mapping as a Monte-Carlo Process

BPT

PPM Progressive Photon-Mapping (PPM)

Bidirectional Path Tracing (BPT)

bull Whole-Function Vectorization ndash Restore scalar computations

ndash LLVM platform-independent

ndash RenderMan frontend OpenCL driver

bull Vector Programming ndash Formalized C extension for portable

effective SIMD programming

ndash Type system triggers vectorization

ndash Data layout adaption

bull New Programming Models for High-Performance Graphics

bull Results ndash Demonstrators for shaders and HPC code

ndash CC++-Extensions (with Intel)

ndash OpenCL compiler (CPU)

Compiler Support for High-Performance Graphics Sebastian Hack

bull Hybrid Rendering ndash Client amp Server Model

ndash Smartphone to Mainframe

bull Large Data Processing ndash Scalable Hierarchical

RW Data Structures

bull Results ndash ZAPP displaywall demonstrator

ndash ImageVis3D (Mobile) demonstrator

ndash Practically use in hospitals

Scalable Hybrid Rendering for Large Scale Visualization Jens Kruumlger

Displays as a Service Large Scale Visualization Alexander Loumlffler

bull Virtualization of Displays ndash Virtual Framebuffer and Displays exposed to Internet

ndash Replacing cables by switched IP network

ndash Internet standards for video encoding and streaming

bull Fully Synchronized ndash 120 Hz active stereo sync over IP

ndash Accuracy of ~100us in software

ndash Drives GPU displays output

bull Results ndash 20-screen wall demonstrator

ndash 3-screen wall (thin-bezel)

ndash CE4100 based SW synchronization

SIGGRAPH 2012

Backup

The Intel Science and Technology Center (ISTC) and Intel Collaborative Research Institute (ICRI) Programs

35

The modern economy is an information economy and one that is driven by innovations that enhance productivity as well as create new modes of entertainment We need to invest in the basic research that will inspire future products and services and ensure long term health of our information economy Government and private foundations are helping but corporate America needs to step up and increase commitments to university research - Justin Rattner ndash Intel CTO

$140M investment over 5 years announced by Intel in 2011 and 2012

Centers of Excellence bull Each ISTC and ICRI will focus on one

research area eg visual computing secure computing

bull The ISTCs and ICRIs are meant to bring the best and brightest researchers across the US together

bull Each ISTC and ICRI will be led by a host university and will include thought leaders from other schools

Breaking Barriers to Collaboration

bull Open IP models and open source software to encourage free information exchange (In most of the Centers)

bull Favor projects that span multiple institutions to encourage collaboration among universities

bull Intel researches per center assigned to work on-campus to encourage collaboration between Intel and academia

Greater Impact to Future Tech bull Center research themes to

address essential needs of computing technology

bull Research agendas jointly defined and co-led by an Intel and a University Principal Investigator

bull After completing 3-5 year charters new ISTCs and ICRIs can be formed to respond to changing tech environment

httpfolditportal

Serious Gaming pplied to Content Creation

Highlighted by President Obama Winner of most-significant new visualization tool (NSF)

Goal Create high-quality content by casting creation activities as games in which large numbers of people are incentivized to perform simple tasks which in combination yield sophisticated content PIs Zoran Popovic (UW) Noah Snavely (Cornell) Maneesh Agrawala(Berkeley)

Determining the structure of retroviral protease (HIV)

Video Frank to add Papers Frank to add

Extracting Structure and Semantics

CAD Model Points

Structures

People

Goals Enable context aware computing and automated content creation through the capture analysis and manipulation of real-world visual data PIs Steve Seitz (UW) Noah Snavely (Cornell) Tom Funkhouser (Princeton) Vladlen Koltun (Stanford) Jitendra Malik (Berkeley) Deva Ramanan (UV Irvine)

Video Frank to add Papers Frank to add

httpvisualstanfordedu

Computational Photography (Franken Camera)

Being adopted as a standard API for cellphone camera systems (Apple Android)

bull Goal Develop algorithms languages architectures and prototypes demonstrating the use of computation in the process of image capture and display

bull PIs Marc Levoy (Stanford) Mark Horowitz (Stanford) Pat Hanrahan (Stanford)

Video Frank to add Papers Frank to add

ISTC-VC SIGGRAPH Papers

Character Locomotion Monday 6 August 900 AM - 1030 AM Optimizing Locomotion Controllers Using Biologically Based Actuators and Objectives Jack M Wang Samuel R Hamner Scott L Delp Vladlen Koltun Continuous Character Control With Low-Dimensional Embeddings Sergey Levine Jack M Wang Alexis Haraux Zoran Popović Vladlen Koltun Shape Analysis Monday 6 August 900 AM - 1030 AM Schelling Points on 3D Surface Meshes Xiaobai Chen Abulhair Saparov Bill Pang Thomas Funkhouser Shape Transformation Wednesday 8 August 900 - 1030 AM An Algebraic Model for Parameterized Shape Editing Martin Bokeloh Michael Wand Hans-Peter Seidel Vladlen Koltun

42

ISTC-VC SIGGRAPH Papers

Image Processing Monday 6 August 2- 330 pm Decoupling Algorithms From Schedules for Easy Optimization of Image-Processing Pipelines Jonathan Ragan-Kelley Andrew Adams Sylvain Paris Marc Levoy Saman Amarasinghe Freacutedo Durand

Cloth

Monday 6 August 2-330 pm Specular Reflection From Woven Cloth Piti Irawan Steve Marschner Stitch Meshes for Modeling Knitted Clothing With Yarn-level Detail Cem Yuksel Jonathan M Kaldor Doug L James Steve Marschner

Appearance

Monday 6 August 345-535 pm Printing Spatially Varying Reflectance for Reproducing HDR Images Yue Dong Xin Tong Fabio Pellacini Baining Guo

43

ISTC-VC SIGGRAPH Papers (cont)

Hand Eye and Face Monday 6 August 345-535 pm Session Chair - Vladlen Koltun Discovery of Complex Behaviors through Contact-Invariant Optimization Igor Mordatch Emanuel Todorov Zoran Popovi1049029 Sketching Monday 6 August 345-535 pm HelpingHand Example-Based Stroke Stylization Jingwan Lu Fisher Yu Adam Finkelstein Stephen DiVerdi Fabrication Tuesday 7 August 9-1030 am Fabricating Articulated Characters From Skinned Meshes Moritz Baumlcher Bernd Bickel Doug L James Hanspeter Pfister

44

Sampling Reconstructing and Filtering Light Tuesday 7 August 1045 am-1215 pm A Theory of Monte Carlo Visibility Sampling Ravi Ramamoorthi John Anderson Mark Meyer Derek Nowrouzezahrai Reconstructing the Indirect Light Field for Global Illumination Jaakko Lehtinen Timo Aila Samuli Laine Freacutedo Durand

Geometry Reconstruction amp Tracking

Tuesday 7 August 1045 am-1215 pm Temporally Coherent Completion of Dynamic Shapes Hao Li Linjie Luo Daniel Vlasic Pieter Peers Jovan Popovic Mark Pauly Szymon Rusinkiewicz

Sets of Shapes

Tuesday 7 August 2-330 pm Exploring Collections of 3D Models Using Fuzzy Correspondence Vladimir G Kim Wilmot Li Niloy J Mitra Stephen DiVerdi Thomas Funkhouser A Probabilistic Model for Component-Based Shape Synthesis Evangelos Kalogerakis Siddhartha Chaudhuri Daphne Koller Vladlen Koltun

45

ISTC-VC SIGGRAPH Papers (cont)

Light Rays Tuesday 7 August 2-330 pm Manifold Exploration A Markov Chain Monte Carlo Technique for Rendering Scenes With Difficult Specular Transport Wenzel Jakob Steve Marschner Bidirectional Lightcuts Bruce Walter Pramook Khungurn Kavita Bala

Fun With Video

Tuesday 7 August 345-535 pm Session Chair Noah Snavely Video Deblurring for Hand-Held Cameras Using Patch-Based Synthesis Sunghyun Cho Jue Wang Seungyong Lee Eulerian Video Magnification for Revealing Subtle Changes in the World Hao-Yu Wu Michael Rubinstein Eugene Shih John Guttag Freacutedo Durand William T Freeman Selectively De-Animating Video Jiamin Bai Aseem Agarwala Maneesh Agrawala Ravi Ramamoorthi Tools for Placing Cuts and Transitions in Interview Video Floraine Berthouzoz Wilmot Li Maneesh Agrawala

46

ISTC-VC SIGGRAPH Papers (cont)

Noise and Texture Tuesday 7 August 345-535 pm Structure-Aware Synthesis for Predictive Woven Fabric Appearance Shuang Zhao Kavita Bala Steve Marschner Wenzel Jakob Symmetry-Guided Texture Synthesis and Manipulation Vladimir Kim Yaron Lipman Thomas Funkhouser

Shape Transformation Wednesday 8 August 900 - 1030 AM An Algebraic Model for Parameterized Shape Editing Martin Bokeloh Michael Wand Hans-Peter Seidel Vladlen Koltun

Stitching

Wednesday 8 August 1045 am-1215 pm Exposing Photo Manipulation With Inconsistent Reflections James F OrsquoBrien Hany Farid

47

ISTC-VC SIGGRAPH Papers (cont)

Maps Surfaces and Shapes

Wednesday 8 August 1045 am-1215 pm Simple Formulas For Quasiconformal Plane Deformations Yaron Lipman Vladimir G Kim Thomas Funkhouser

Interactive Systems amp Hardware Wednesday 8 August 2-330 pm Position-Correcting Tools for 2D Digital Fabrication Alec Rivers Ilan E Moyer Freacutedo Durand

48

ISTC-VC SIGGRAPH Papers (cont)

Collisions Wednesday 8 August 345-535 pm Energy-Based Self-Collision Culling for Arbitrary Mesh Deformations Changxi Zheng Doug L James

All About Images

Thursday 9 August 9-1030 am A Framework for Content-Adaptive Photo Manipulation Macros Application to Face Landscape and Global Manipulations Floraine Berthouzoz Wilmot Li Mira Dontcheva Maneesh Agrawala

Sound and Elements

Thursday 9 August 9-1030 am Motion-Driven Concatenative Synthesis of Cloth Sounds Steven S An Doug L James Steve Marschner Precomputed Acceleration Noise for Improved Rigid-Body Sound Jeffrey N Chadwick Changxi Zheng Doug L James Interactive Sound Propagation Using Compact Acoustic Transfer Operators Lakulish Antani Anish Chandak Lauri Savioja Dinesh Manocha Updated Sparse Cholesky Factors for Corotational Elastodynamics Florian Hecht Yeon Jin Lee Jonathan R Shewchuk James F OrsquoBrien

49

ISTC-VC SIGGRAPH Papers (cont)

Geometry amp Viewing Thursday 9 August 2-330 pm Perceptual Models of Viewpoint Preference Adrian Secordm Jingwan Lu Adam Finkelstein Manish Singh Andrew Nealen

Faces and Hair [Closing Session]

Thursday 9 August 345-515 pm Coupled 3D Reconstruction of Sparse Facial Hair and Skin Thabo Beeler Bernd Bickel Gioacchino Noris Paul Beardsley Steve Marschner Robert W Sumner Markus Gross Physical Face Cloning Bernd Bickel Peter Kaufmann Melina Skouras Bernhard Thomaszewski Derek Bradley Thabo Beeler Philip Jackson Steve Marschner Wojciech Matusik Markus Gross

50

ISTC-VC SIGGRAPH Papers (cont)

Siggraph Courses Optimizing Realistic Rendering With Many-Light Methods Sunday 5 August 2-515 pm Jaroslav Krivanek Milos Hasan Adam Arbree Carsten Dachsbacher Alexander Keller Bruce Walter State of the Art in Photon-Density Estimation Thursday 9 August 2-515 pm Toshiya Hachisuka Wojciech Jarosz Guillaume Bouchard Per Christensen Jeppe Revall Frisvad Wenzel Jakob Henrik Wann Jensen Jared M Johnson Michael Kaschalk Claude Knaus Andrew Selle Ben Spencer

Siggraph Talks

Silence Eliminate the Noise Thursday 9 August 9-1030 am Importance Sampling for Hair Scattering Jiawei Ou Feng Xie Parashar Krishnamachari Fabio Pellacini

Siggraph Exhibitor Sessions

Intel Corporation Wednesday 8 August 430-530 pm room 402B The Future of Visual Computing as Viewed by Intel Visual Computing Research Centers

51

Other ISTC-VC SIGGRAPH Participation

Page 15: Future of Visual Computing as viewed by Intel Visual ... · PDF fileFuture of Visual Computing as viewed by Intel Visual Computing Research Centers ... Justin Rattner Intel Science

An Open Collaborative Research Institute at the Saarland Campus

Multimodal

Computing

and

Interaction

IVCI Mission Facilitate the progress of Visual Computing research and be a driver towards highest

quality image real-time processing and interactive visualization

Virtual Worlds (Model-based)

Multimodal Scene Analysis amp Interaction

Real Worlds (Sample-based)

Intel VCI Vision Scalable Algorithms for

Real Time Realistic

Rendering

Compiler Support for

High Performance

Graphics

Collaborative Distributed Molecular

Modeling and Visualization

Efficient High Quality

Rendering Using Sample-based

Representations

Scalable Hybrid Rendering for

Large Scale Visualization

Marker-free Performance

Capture

Algorithms for Low Cost Depth

Imaging

Visualization and editing of light

transport

Internet Transport and Coding for 3D

HD-TV

Software- innovation for the Digital Enterprise

Kusanagi Coding and

Interaction for Networked Games

Multi Touch Interaction

Techniques for Mixed 2D and 3D Graphics Displays

Advanced Ray Tracing and Data-Flow

Processing for the 3D Internet

Intel VCI Projects-Based Organization

ECOUSS Efficient and open Compiler-

Framework for parallel Simulations

SCENE Novel Scene Representations for Rich

Networked Media

VERVE Vanquishing fear and apathy

through E-inclusion

Large Scale Visualization in the Internet of Displays

User-centric Video

Processing

Local Dimming for Edge-lit LED LCD-Monitors

SCI Institute Utah USA

Stanford University California USA

Research Collaboration

Consortium Members

User-Centric Video Processing Jan Kautz Christian Theobalt

bull Objective ndash Create new user experiences for capturing

editing and browsing

ndash Targets amateur video creators

bull Approach ndash Automatically identify spationdashtemporal and

semantic relationships withinbetween videos

ndash Leverage graph of these to drive UI and video processing

bull Expected results Capturing automatic stabilization and

enhancement

Editing edit semantic objects in videos

Browsing find semantically related videos

Remove the person in white

Video Inpainting in Dynamic Scenes amp Videoscape for moving through Internet Videos

Efficient High-Quality Rendering Using Sample-based Representations Elmar Eisemann

bull Realistic Rendering ndash Lens Flare [Siggraphrsquo11]

ndash Depth-of-field [Eurographics lsquo11]

ndash Global Illumination [PGrsquo11]

bull Perceptual Rendering ndash Stereo

ndash High Dynamic Range

bull Alternative representations ndash Voxel Data

ndash Height Fields

3D Internet Interactive 3D Content on the Web Philipp Slusallek

bull XML3D Scene Description ndash HTML-5 extension for interactive graphics

ndash JS implementation amp built into the browser

ndash Reuses Web Technology (DOM CSS JS)

bull XFLOW Parallel Processing ndash Data-parallel flowgraph for XML3D

ndash Animations image amp geometry processing

ndash Configuration within the DOM

bull Results ndash W3C standardization ldquoDeclarative 3D for the Webrdquo

ndash Rich media apps for BMW SLS-Museum hellip

3D-Internet Apps SLS-Museum 3D-Installation amp Museum with Interactive Virtual Characters

3D-Internet Apps Using OpenStreetMap-3D as Shared Virtual Worlds

Fully automatically generated from OpenStreet Map Taking semantic data into acount

Marker-free Performance Capture Christian Theobalt

bull Reconstruction of detailed human animation models ndash In Multi-view video without markers

ndash Out Detailed motion shape and appearance

ndash General clothing modifiable performances new animations

bull Real-time performance capture ndash Fast full-body motion estimation from depth

cameras

ndash Interaction

ndash Collaboration with Intel Magic Mirror project

[ICCV 2011]

[SIGGRAPH Asia 2010]

Markerless Motion Capture of Interacting Characters Using Multi-view Image Segmentation

Articulated Models Input silhouettes Segmentation Contour labels Estimated surface Estimated 3D models

Handling Intersections

Improved segmentation with 3D shape priors Excellent performance when evaluated against marker-based system

bull Interactive inspection of light transport in virtual scenes ndash You can only manipulate what you see

ndash First prototypal light manipulation tools

bull Efficient global illumination ndash Otherwise no interactive

visualization nor manipulation

ndash Improvements on many-lights methods and progressive photon mapping

bull Results ndash Demonstrator Maya plugin ndash Collaboration with local film academy

Visualization and Editing of Light Transport Carsten Dachsbacher

Advanced Real-Time Ray Tracing Techniques Philipp Slusallek

bull Perfect importance sampling and caching ndash Sparse but perfect importance sampling

ndash Caching and interpolation [Eurographics`12]

bull Unifying Photon-Mapping amp Monte-Carlo ndash Formulating PM as a MC process

ndash Per pixel combination using MIS

bull Data-parallel implementations

ndash Efficiency and performance

bull Integration into XML3D

ndash Provide ldquocorrectrdquo results by default

Vertex Merging with Multiple Importance Sampling Photon-Mapping as a Monte-Carlo Process

BPT

PPM Progressive Photon-Mapping (PPM)

Bidirectional Path Tracing (BPT)

bull Whole-Function Vectorization ndash Restore scalar computations

ndash LLVM platform-independent

ndash RenderMan frontend OpenCL driver

bull Vector Programming ndash Formalized C extension for portable

effective SIMD programming

ndash Type system triggers vectorization

ndash Data layout adaption

bull New Programming Models for High-Performance Graphics

bull Results ndash Demonstrators for shaders and HPC code

ndash CC++-Extensions (with Intel)

ndash OpenCL compiler (CPU)

Compiler Support for High-Performance Graphics Sebastian Hack

bull Hybrid Rendering ndash Client amp Server Model

ndash Smartphone to Mainframe

bull Large Data Processing ndash Scalable Hierarchical

RW Data Structures

bull Results ndash ZAPP displaywall demonstrator

ndash ImageVis3D (Mobile) demonstrator

ndash Practically use in hospitals

Scalable Hybrid Rendering for Large Scale Visualization Jens Kruumlger

Displays as a Service Large Scale Visualization Alexander Loumlffler

bull Virtualization of Displays ndash Virtual Framebuffer and Displays exposed to Internet

ndash Replacing cables by switched IP network

ndash Internet standards for video encoding and streaming

bull Fully Synchronized ndash 120 Hz active stereo sync over IP

ndash Accuracy of ~100us in software

ndash Drives GPU displays output

bull Results ndash 20-screen wall demonstrator

ndash 3-screen wall (thin-bezel)

ndash CE4100 based SW synchronization

SIGGRAPH 2012

Backup

The Intel Science and Technology Center (ISTC) and Intel Collaborative Research Institute (ICRI) Programs

35

The modern economy is an information economy and one that is driven by innovations that enhance productivity as well as create new modes of entertainment We need to invest in the basic research that will inspire future products and services and ensure long term health of our information economy Government and private foundations are helping but corporate America needs to step up and increase commitments to university research - Justin Rattner ndash Intel CTO

$140M investment over 5 years announced by Intel in 2011 and 2012

Centers of Excellence bull Each ISTC and ICRI will focus on one

research area eg visual computing secure computing

bull The ISTCs and ICRIs are meant to bring the best and brightest researchers across the US together

bull Each ISTC and ICRI will be led by a host university and will include thought leaders from other schools

Breaking Barriers to Collaboration

bull Open IP models and open source software to encourage free information exchange (In most of the Centers)

bull Favor projects that span multiple institutions to encourage collaboration among universities

bull Intel researches per center assigned to work on-campus to encourage collaboration between Intel and academia

Greater Impact to Future Tech bull Center research themes to

address essential needs of computing technology

bull Research agendas jointly defined and co-led by an Intel and a University Principal Investigator

bull After completing 3-5 year charters new ISTCs and ICRIs can be formed to respond to changing tech environment

httpfolditportal

Serious Gaming pplied to Content Creation

Highlighted by President Obama Winner of most-significant new visualization tool (NSF)

Goal Create high-quality content by casting creation activities as games in which large numbers of people are incentivized to perform simple tasks which in combination yield sophisticated content PIs Zoran Popovic (UW) Noah Snavely (Cornell) Maneesh Agrawala(Berkeley)

Determining the structure of retroviral protease (HIV)

Video Frank to add Papers Frank to add

Extracting Structure and Semantics

CAD Model Points

Structures

People

Goals Enable context aware computing and automated content creation through the capture analysis and manipulation of real-world visual data PIs Steve Seitz (UW) Noah Snavely (Cornell) Tom Funkhouser (Princeton) Vladlen Koltun (Stanford) Jitendra Malik (Berkeley) Deva Ramanan (UV Irvine)

Video Frank to add Papers Frank to add

httpvisualstanfordedu

Computational Photography (Franken Camera)

Being adopted as a standard API for cellphone camera systems (Apple Android)

bull Goal Develop algorithms languages architectures and prototypes demonstrating the use of computation in the process of image capture and display

bull PIs Marc Levoy (Stanford) Mark Horowitz (Stanford) Pat Hanrahan (Stanford)

Video Frank to add Papers Frank to add

ISTC-VC SIGGRAPH Papers

Character Locomotion Monday 6 August 900 AM - 1030 AM Optimizing Locomotion Controllers Using Biologically Based Actuators and Objectives Jack M Wang Samuel R Hamner Scott L Delp Vladlen Koltun Continuous Character Control With Low-Dimensional Embeddings Sergey Levine Jack M Wang Alexis Haraux Zoran Popović Vladlen Koltun Shape Analysis Monday 6 August 900 AM - 1030 AM Schelling Points on 3D Surface Meshes Xiaobai Chen Abulhair Saparov Bill Pang Thomas Funkhouser Shape Transformation Wednesday 8 August 900 - 1030 AM An Algebraic Model for Parameterized Shape Editing Martin Bokeloh Michael Wand Hans-Peter Seidel Vladlen Koltun

42

ISTC-VC SIGGRAPH Papers

Image Processing Monday 6 August 2- 330 pm Decoupling Algorithms From Schedules for Easy Optimization of Image-Processing Pipelines Jonathan Ragan-Kelley Andrew Adams Sylvain Paris Marc Levoy Saman Amarasinghe Freacutedo Durand

Cloth

Monday 6 August 2-330 pm Specular Reflection From Woven Cloth Piti Irawan Steve Marschner Stitch Meshes for Modeling Knitted Clothing With Yarn-level Detail Cem Yuksel Jonathan M Kaldor Doug L James Steve Marschner

Appearance

Monday 6 August 345-535 pm Printing Spatially Varying Reflectance for Reproducing HDR Images Yue Dong Xin Tong Fabio Pellacini Baining Guo

43

ISTC-VC SIGGRAPH Papers (cont)

Hand Eye and Face Monday 6 August 345-535 pm Session Chair - Vladlen Koltun Discovery of Complex Behaviors through Contact-Invariant Optimization Igor Mordatch Emanuel Todorov Zoran Popovi1049029 Sketching Monday 6 August 345-535 pm HelpingHand Example-Based Stroke Stylization Jingwan Lu Fisher Yu Adam Finkelstein Stephen DiVerdi Fabrication Tuesday 7 August 9-1030 am Fabricating Articulated Characters From Skinned Meshes Moritz Baumlcher Bernd Bickel Doug L James Hanspeter Pfister

44

Sampling Reconstructing and Filtering Light Tuesday 7 August 1045 am-1215 pm A Theory of Monte Carlo Visibility Sampling Ravi Ramamoorthi John Anderson Mark Meyer Derek Nowrouzezahrai Reconstructing the Indirect Light Field for Global Illumination Jaakko Lehtinen Timo Aila Samuli Laine Freacutedo Durand

Geometry Reconstruction amp Tracking

Tuesday 7 August 1045 am-1215 pm Temporally Coherent Completion of Dynamic Shapes Hao Li Linjie Luo Daniel Vlasic Pieter Peers Jovan Popovic Mark Pauly Szymon Rusinkiewicz

Sets of Shapes

Tuesday 7 August 2-330 pm Exploring Collections of 3D Models Using Fuzzy Correspondence Vladimir G Kim Wilmot Li Niloy J Mitra Stephen DiVerdi Thomas Funkhouser A Probabilistic Model for Component-Based Shape Synthesis Evangelos Kalogerakis Siddhartha Chaudhuri Daphne Koller Vladlen Koltun

45

ISTC-VC SIGGRAPH Papers (cont)

Light Rays Tuesday 7 August 2-330 pm Manifold Exploration A Markov Chain Monte Carlo Technique for Rendering Scenes With Difficult Specular Transport Wenzel Jakob Steve Marschner Bidirectional Lightcuts Bruce Walter Pramook Khungurn Kavita Bala

Fun With Video

Tuesday 7 August 345-535 pm Session Chair Noah Snavely Video Deblurring for Hand-Held Cameras Using Patch-Based Synthesis Sunghyun Cho Jue Wang Seungyong Lee Eulerian Video Magnification for Revealing Subtle Changes in the World Hao-Yu Wu Michael Rubinstein Eugene Shih John Guttag Freacutedo Durand William T Freeman Selectively De-Animating Video Jiamin Bai Aseem Agarwala Maneesh Agrawala Ravi Ramamoorthi Tools for Placing Cuts and Transitions in Interview Video Floraine Berthouzoz Wilmot Li Maneesh Agrawala

46

ISTC-VC SIGGRAPH Papers (cont)

Noise and Texture Tuesday 7 August 345-535 pm Structure-Aware Synthesis for Predictive Woven Fabric Appearance Shuang Zhao Kavita Bala Steve Marschner Wenzel Jakob Symmetry-Guided Texture Synthesis and Manipulation Vladimir Kim Yaron Lipman Thomas Funkhouser

Shape Transformation Wednesday 8 August 900 - 1030 AM An Algebraic Model for Parameterized Shape Editing Martin Bokeloh Michael Wand Hans-Peter Seidel Vladlen Koltun

Stitching

Wednesday 8 August 1045 am-1215 pm Exposing Photo Manipulation With Inconsistent Reflections James F OrsquoBrien Hany Farid

47

ISTC-VC SIGGRAPH Papers (cont)

Maps Surfaces and Shapes

Wednesday 8 August 1045 am-1215 pm Simple Formulas For Quasiconformal Plane Deformations Yaron Lipman Vladimir G Kim Thomas Funkhouser

Interactive Systems amp Hardware Wednesday 8 August 2-330 pm Position-Correcting Tools for 2D Digital Fabrication Alec Rivers Ilan E Moyer Freacutedo Durand

48

ISTC-VC SIGGRAPH Papers (cont)

Collisions Wednesday 8 August 345-535 pm Energy-Based Self-Collision Culling for Arbitrary Mesh Deformations Changxi Zheng Doug L James

All About Images

Thursday 9 August 9-1030 am A Framework for Content-Adaptive Photo Manipulation Macros Application to Face Landscape and Global Manipulations Floraine Berthouzoz Wilmot Li Mira Dontcheva Maneesh Agrawala

Sound and Elements

Thursday 9 August 9-1030 am Motion-Driven Concatenative Synthesis of Cloth Sounds Steven S An Doug L James Steve Marschner Precomputed Acceleration Noise for Improved Rigid-Body Sound Jeffrey N Chadwick Changxi Zheng Doug L James Interactive Sound Propagation Using Compact Acoustic Transfer Operators Lakulish Antani Anish Chandak Lauri Savioja Dinesh Manocha Updated Sparse Cholesky Factors for Corotational Elastodynamics Florian Hecht Yeon Jin Lee Jonathan R Shewchuk James F OrsquoBrien

49

ISTC-VC SIGGRAPH Papers (cont)

Geometry amp Viewing Thursday 9 August 2-330 pm Perceptual Models of Viewpoint Preference Adrian Secordm Jingwan Lu Adam Finkelstein Manish Singh Andrew Nealen

Faces and Hair [Closing Session]

Thursday 9 August 345-515 pm Coupled 3D Reconstruction of Sparse Facial Hair and Skin Thabo Beeler Bernd Bickel Gioacchino Noris Paul Beardsley Steve Marschner Robert W Sumner Markus Gross Physical Face Cloning Bernd Bickel Peter Kaufmann Melina Skouras Bernhard Thomaszewski Derek Bradley Thabo Beeler Philip Jackson Steve Marschner Wojciech Matusik Markus Gross

50

ISTC-VC SIGGRAPH Papers (cont)

Siggraph Courses Optimizing Realistic Rendering With Many-Light Methods Sunday 5 August 2-515 pm Jaroslav Krivanek Milos Hasan Adam Arbree Carsten Dachsbacher Alexander Keller Bruce Walter State of the Art in Photon-Density Estimation Thursday 9 August 2-515 pm Toshiya Hachisuka Wojciech Jarosz Guillaume Bouchard Per Christensen Jeppe Revall Frisvad Wenzel Jakob Henrik Wann Jensen Jared M Johnson Michael Kaschalk Claude Knaus Andrew Selle Ben Spencer

Siggraph Talks

Silence Eliminate the Noise Thursday 9 August 9-1030 am Importance Sampling for Hair Scattering Jiawei Ou Feng Xie Parashar Krishnamachari Fabio Pellacini

Siggraph Exhibitor Sessions

Intel Corporation Wednesday 8 August 430-530 pm room 402B The Future of Visual Computing as Viewed by Intel Visual Computing Research Centers

51

Other ISTC-VC SIGGRAPH Participation

Page 16: Future of Visual Computing as viewed by Intel Visual ... · PDF fileFuture of Visual Computing as viewed by Intel Visual Computing Research Centers ... Justin Rattner Intel Science

IVCI Mission Facilitate the progress of Visual Computing research and be a driver towards highest

quality image real-time processing and interactive visualization

Virtual Worlds (Model-based)

Multimodal Scene Analysis amp Interaction

Real Worlds (Sample-based)

Intel VCI Vision Scalable Algorithms for

Real Time Realistic

Rendering

Compiler Support for

High Performance

Graphics

Collaborative Distributed Molecular

Modeling and Visualization

Efficient High Quality

Rendering Using Sample-based

Representations

Scalable Hybrid Rendering for

Large Scale Visualization

Marker-free Performance

Capture

Algorithms for Low Cost Depth

Imaging

Visualization and editing of light

transport

Internet Transport and Coding for 3D

HD-TV

Software- innovation for the Digital Enterprise

Kusanagi Coding and

Interaction for Networked Games

Multi Touch Interaction

Techniques for Mixed 2D and 3D Graphics Displays

Advanced Ray Tracing and Data-Flow

Processing for the 3D Internet

Intel VCI Projects-Based Organization

ECOUSS Efficient and open Compiler-

Framework for parallel Simulations

SCENE Novel Scene Representations for Rich

Networked Media

VERVE Vanquishing fear and apathy

through E-inclusion

Large Scale Visualization in the Internet of Displays

User-centric Video

Processing

Local Dimming for Edge-lit LED LCD-Monitors

SCI Institute Utah USA

Stanford University California USA

Research Collaboration

Consortium Members

User-Centric Video Processing Jan Kautz Christian Theobalt

bull Objective ndash Create new user experiences for capturing

editing and browsing

ndash Targets amateur video creators

bull Approach ndash Automatically identify spationdashtemporal and

semantic relationships withinbetween videos

ndash Leverage graph of these to drive UI and video processing

bull Expected results Capturing automatic stabilization and

enhancement

Editing edit semantic objects in videos

Browsing find semantically related videos

Remove the person in white

Video Inpainting in Dynamic Scenes amp Videoscape for moving through Internet Videos

Efficient High-Quality Rendering Using Sample-based Representations Elmar Eisemann

bull Realistic Rendering ndash Lens Flare [Siggraphrsquo11]

ndash Depth-of-field [Eurographics lsquo11]

ndash Global Illumination [PGrsquo11]

bull Perceptual Rendering ndash Stereo

ndash High Dynamic Range

bull Alternative representations ndash Voxel Data

ndash Height Fields

3D Internet Interactive 3D Content on the Web Philipp Slusallek

bull XML3D Scene Description ndash HTML-5 extension for interactive graphics

ndash JS implementation amp built into the browser

ndash Reuses Web Technology (DOM CSS JS)

bull XFLOW Parallel Processing ndash Data-parallel flowgraph for XML3D

ndash Animations image amp geometry processing

ndash Configuration within the DOM

bull Results ndash W3C standardization ldquoDeclarative 3D for the Webrdquo

ndash Rich media apps for BMW SLS-Museum hellip

3D-Internet Apps SLS-Museum 3D-Installation amp Museum with Interactive Virtual Characters

3D-Internet Apps Using OpenStreetMap-3D as Shared Virtual Worlds

Fully automatically generated from OpenStreet Map Taking semantic data into acount

Marker-free Performance Capture Christian Theobalt

bull Reconstruction of detailed human animation models ndash In Multi-view video without markers

ndash Out Detailed motion shape and appearance

ndash General clothing modifiable performances new animations

bull Real-time performance capture ndash Fast full-body motion estimation from depth

cameras

ndash Interaction

ndash Collaboration with Intel Magic Mirror project

[ICCV 2011]

[SIGGRAPH Asia 2010]

Markerless Motion Capture of Interacting Characters Using Multi-view Image Segmentation

Articulated Models Input silhouettes Segmentation Contour labels Estimated surface Estimated 3D models

Handling Intersections

Improved segmentation with 3D shape priors Excellent performance when evaluated against marker-based system

bull Interactive inspection of light transport in virtual scenes ndash You can only manipulate what you see

ndash First prototypal light manipulation tools

bull Efficient global illumination ndash Otherwise no interactive

visualization nor manipulation

ndash Improvements on many-lights methods and progressive photon mapping

bull Results ndash Demonstrator Maya plugin ndash Collaboration with local film academy

Visualization and Editing of Light Transport Carsten Dachsbacher

Advanced Real-Time Ray Tracing Techniques Philipp Slusallek

bull Perfect importance sampling and caching ndash Sparse but perfect importance sampling

ndash Caching and interpolation [Eurographics`12]

bull Unifying Photon-Mapping amp Monte-Carlo ndash Formulating PM as a MC process

ndash Per pixel combination using MIS

bull Data-parallel implementations

ndash Efficiency and performance

bull Integration into XML3D

ndash Provide ldquocorrectrdquo results by default

Vertex Merging with Multiple Importance Sampling Photon-Mapping as a Monte-Carlo Process

BPT

PPM Progressive Photon-Mapping (PPM)

Bidirectional Path Tracing (BPT)

bull Whole-Function Vectorization ndash Restore scalar computations

ndash LLVM platform-independent

ndash RenderMan frontend OpenCL driver

bull Vector Programming ndash Formalized C extension for portable

effective SIMD programming

ndash Type system triggers vectorization

ndash Data layout adaption

bull New Programming Models for High-Performance Graphics

bull Results ndash Demonstrators for shaders and HPC code

ndash CC++-Extensions (with Intel)

ndash OpenCL compiler (CPU)

Compiler Support for High-Performance Graphics Sebastian Hack

bull Hybrid Rendering ndash Client amp Server Model

ndash Smartphone to Mainframe

bull Large Data Processing ndash Scalable Hierarchical

RW Data Structures

bull Results ndash ZAPP displaywall demonstrator

ndash ImageVis3D (Mobile) demonstrator

ndash Practically use in hospitals

Scalable Hybrid Rendering for Large Scale Visualization Jens Kruumlger

Displays as a Service Large Scale Visualization Alexander Loumlffler

bull Virtualization of Displays ndash Virtual Framebuffer and Displays exposed to Internet

ndash Replacing cables by switched IP network

ndash Internet standards for video encoding and streaming

bull Fully Synchronized ndash 120 Hz active stereo sync over IP

ndash Accuracy of ~100us in software

ndash Drives GPU displays output

bull Results ndash 20-screen wall demonstrator

ndash 3-screen wall (thin-bezel)

ndash CE4100 based SW synchronization

SIGGRAPH 2012

Backup

The Intel Science and Technology Center (ISTC) and Intel Collaborative Research Institute (ICRI) Programs

35

The modern economy is an information economy and one that is driven by innovations that enhance productivity as well as create new modes of entertainment We need to invest in the basic research that will inspire future products and services and ensure long term health of our information economy Government and private foundations are helping but corporate America needs to step up and increase commitments to university research - Justin Rattner ndash Intel CTO

$140M investment over 5 years announced by Intel in 2011 and 2012

Centers of Excellence bull Each ISTC and ICRI will focus on one

research area eg visual computing secure computing

bull The ISTCs and ICRIs are meant to bring the best and brightest researchers across the US together

bull Each ISTC and ICRI will be led by a host university and will include thought leaders from other schools

Breaking Barriers to Collaboration

bull Open IP models and open source software to encourage free information exchange (In most of the Centers)

bull Favor projects that span multiple institutions to encourage collaboration among universities

bull Intel researches per center assigned to work on-campus to encourage collaboration between Intel and academia

Greater Impact to Future Tech bull Center research themes to

address essential needs of computing technology

bull Research agendas jointly defined and co-led by an Intel and a University Principal Investigator

bull After completing 3-5 year charters new ISTCs and ICRIs can be formed to respond to changing tech environment

httpfolditportal

Serious Gaming pplied to Content Creation

Highlighted by President Obama Winner of most-significant new visualization tool (NSF)

Goal Create high-quality content by casting creation activities as games in which large numbers of people are incentivized to perform simple tasks which in combination yield sophisticated content PIs Zoran Popovic (UW) Noah Snavely (Cornell) Maneesh Agrawala(Berkeley)

Determining the structure of retroviral protease (HIV)

Video Frank to add Papers Frank to add

Extracting Structure and Semantics

CAD Model Points

Structures

People

Goals Enable context aware computing and automated content creation through the capture analysis and manipulation of real-world visual data PIs Steve Seitz (UW) Noah Snavely (Cornell) Tom Funkhouser (Princeton) Vladlen Koltun (Stanford) Jitendra Malik (Berkeley) Deva Ramanan (UV Irvine)

Video Frank to add Papers Frank to add

httpvisualstanfordedu

Computational Photography (Franken Camera)

Being adopted as a standard API for cellphone camera systems (Apple Android)

bull Goal Develop algorithms languages architectures and prototypes demonstrating the use of computation in the process of image capture and display

bull PIs Marc Levoy (Stanford) Mark Horowitz (Stanford) Pat Hanrahan (Stanford)

Video Frank to add Papers Frank to add

ISTC-VC SIGGRAPH Papers

Character Locomotion Monday 6 August 900 AM - 1030 AM Optimizing Locomotion Controllers Using Biologically Based Actuators and Objectives Jack M Wang Samuel R Hamner Scott L Delp Vladlen Koltun Continuous Character Control With Low-Dimensional Embeddings Sergey Levine Jack M Wang Alexis Haraux Zoran Popović Vladlen Koltun Shape Analysis Monday 6 August 900 AM - 1030 AM Schelling Points on 3D Surface Meshes Xiaobai Chen Abulhair Saparov Bill Pang Thomas Funkhouser Shape Transformation Wednesday 8 August 900 - 1030 AM An Algebraic Model for Parameterized Shape Editing Martin Bokeloh Michael Wand Hans-Peter Seidel Vladlen Koltun

42

ISTC-VC SIGGRAPH Papers

Image Processing Monday 6 August 2- 330 pm Decoupling Algorithms From Schedules for Easy Optimization of Image-Processing Pipelines Jonathan Ragan-Kelley Andrew Adams Sylvain Paris Marc Levoy Saman Amarasinghe Freacutedo Durand

Cloth

Monday 6 August 2-330 pm Specular Reflection From Woven Cloth Piti Irawan Steve Marschner Stitch Meshes for Modeling Knitted Clothing With Yarn-level Detail Cem Yuksel Jonathan M Kaldor Doug L James Steve Marschner

Appearance

Monday 6 August 345-535 pm Printing Spatially Varying Reflectance for Reproducing HDR Images Yue Dong Xin Tong Fabio Pellacini Baining Guo

43

ISTC-VC SIGGRAPH Papers (cont)

Hand Eye and Face Monday 6 August 345-535 pm Session Chair - Vladlen Koltun Discovery of Complex Behaviors through Contact-Invariant Optimization Igor Mordatch Emanuel Todorov Zoran Popovi1049029 Sketching Monday 6 August 345-535 pm HelpingHand Example-Based Stroke Stylization Jingwan Lu Fisher Yu Adam Finkelstein Stephen DiVerdi Fabrication Tuesday 7 August 9-1030 am Fabricating Articulated Characters From Skinned Meshes Moritz Baumlcher Bernd Bickel Doug L James Hanspeter Pfister

44

Sampling Reconstructing and Filtering Light Tuesday 7 August 1045 am-1215 pm A Theory of Monte Carlo Visibility Sampling Ravi Ramamoorthi John Anderson Mark Meyer Derek Nowrouzezahrai Reconstructing the Indirect Light Field for Global Illumination Jaakko Lehtinen Timo Aila Samuli Laine Freacutedo Durand

Geometry Reconstruction amp Tracking

Tuesday 7 August 1045 am-1215 pm Temporally Coherent Completion of Dynamic Shapes Hao Li Linjie Luo Daniel Vlasic Pieter Peers Jovan Popovic Mark Pauly Szymon Rusinkiewicz

Sets of Shapes

Tuesday 7 August 2-330 pm Exploring Collections of 3D Models Using Fuzzy Correspondence Vladimir G Kim Wilmot Li Niloy J Mitra Stephen DiVerdi Thomas Funkhouser A Probabilistic Model for Component-Based Shape Synthesis Evangelos Kalogerakis Siddhartha Chaudhuri Daphne Koller Vladlen Koltun

45

ISTC-VC SIGGRAPH Papers (cont)

Light Rays Tuesday 7 August 2-330 pm Manifold Exploration A Markov Chain Monte Carlo Technique for Rendering Scenes With Difficult Specular Transport Wenzel Jakob Steve Marschner Bidirectional Lightcuts Bruce Walter Pramook Khungurn Kavita Bala

Fun With Video

Tuesday 7 August 345-535 pm Session Chair Noah Snavely Video Deblurring for Hand-Held Cameras Using Patch-Based Synthesis Sunghyun Cho Jue Wang Seungyong Lee Eulerian Video Magnification for Revealing Subtle Changes in the World Hao-Yu Wu Michael Rubinstein Eugene Shih John Guttag Freacutedo Durand William T Freeman Selectively De-Animating Video Jiamin Bai Aseem Agarwala Maneesh Agrawala Ravi Ramamoorthi Tools for Placing Cuts and Transitions in Interview Video Floraine Berthouzoz Wilmot Li Maneesh Agrawala

46

ISTC-VC SIGGRAPH Papers (cont)

Noise and Texture Tuesday 7 August 345-535 pm Structure-Aware Synthesis for Predictive Woven Fabric Appearance Shuang Zhao Kavita Bala Steve Marschner Wenzel Jakob Symmetry-Guided Texture Synthesis and Manipulation Vladimir Kim Yaron Lipman Thomas Funkhouser

Shape Transformation Wednesday 8 August 900 - 1030 AM An Algebraic Model for Parameterized Shape Editing Martin Bokeloh Michael Wand Hans-Peter Seidel Vladlen Koltun

Stitching

Wednesday 8 August 1045 am-1215 pm Exposing Photo Manipulation With Inconsistent Reflections James F OrsquoBrien Hany Farid

47

ISTC-VC SIGGRAPH Papers (cont)

Maps Surfaces and Shapes

Wednesday 8 August 1045 am-1215 pm Simple Formulas For Quasiconformal Plane Deformations Yaron Lipman Vladimir G Kim Thomas Funkhouser

Interactive Systems amp Hardware Wednesday 8 August 2-330 pm Position-Correcting Tools for 2D Digital Fabrication Alec Rivers Ilan E Moyer Freacutedo Durand

48

ISTC-VC SIGGRAPH Papers (cont)

Collisions Wednesday 8 August 345-535 pm Energy-Based Self-Collision Culling for Arbitrary Mesh Deformations Changxi Zheng Doug L James

All About Images

Thursday 9 August 9-1030 am A Framework for Content-Adaptive Photo Manipulation Macros Application to Face Landscape and Global Manipulations Floraine Berthouzoz Wilmot Li Mira Dontcheva Maneesh Agrawala

Sound and Elements

Thursday 9 August 9-1030 am Motion-Driven Concatenative Synthesis of Cloth Sounds Steven S An Doug L James Steve Marschner Precomputed Acceleration Noise for Improved Rigid-Body Sound Jeffrey N Chadwick Changxi Zheng Doug L James Interactive Sound Propagation Using Compact Acoustic Transfer Operators Lakulish Antani Anish Chandak Lauri Savioja Dinesh Manocha Updated Sparse Cholesky Factors for Corotational Elastodynamics Florian Hecht Yeon Jin Lee Jonathan R Shewchuk James F OrsquoBrien

49

ISTC-VC SIGGRAPH Papers (cont)

Geometry amp Viewing Thursday 9 August 2-330 pm Perceptual Models of Viewpoint Preference Adrian Secordm Jingwan Lu Adam Finkelstein Manish Singh Andrew Nealen

Faces and Hair [Closing Session]

Thursday 9 August 345-515 pm Coupled 3D Reconstruction of Sparse Facial Hair and Skin Thabo Beeler Bernd Bickel Gioacchino Noris Paul Beardsley Steve Marschner Robert W Sumner Markus Gross Physical Face Cloning Bernd Bickel Peter Kaufmann Melina Skouras Bernhard Thomaszewski Derek Bradley Thabo Beeler Philip Jackson Steve Marschner Wojciech Matusik Markus Gross

50

ISTC-VC SIGGRAPH Papers (cont)

Siggraph Courses Optimizing Realistic Rendering With Many-Light Methods Sunday 5 August 2-515 pm Jaroslav Krivanek Milos Hasan Adam Arbree Carsten Dachsbacher Alexander Keller Bruce Walter State of the Art in Photon-Density Estimation Thursday 9 August 2-515 pm Toshiya Hachisuka Wojciech Jarosz Guillaume Bouchard Per Christensen Jeppe Revall Frisvad Wenzel Jakob Henrik Wann Jensen Jared M Johnson Michael Kaschalk Claude Knaus Andrew Selle Ben Spencer

Siggraph Talks

Silence Eliminate the Noise Thursday 9 August 9-1030 am Importance Sampling for Hair Scattering Jiawei Ou Feng Xie Parashar Krishnamachari Fabio Pellacini

Siggraph Exhibitor Sessions

Intel Corporation Wednesday 8 August 430-530 pm room 402B The Future of Visual Computing as Viewed by Intel Visual Computing Research Centers

51

Other ISTC-VC SIGGRAPH Participation

Page 17: Future of Visual Computing as viewed by Intel Visual ... · PDF fileFuture of Visual Computing as viewed by Intel Visual Computing Research Centers ... Justin Rattner Intel Science

Virtual Worlds (Model-based)

Multimodal Scene Analysis amp Interaction

Real Worlds (Sample-based)

Intel VCI Vision Scalable Algorithms for

Real Time Realistic

Rendering

Compiler Support for

High Performance

Graphics

Collaborative Distributed Molecular

Modeling and Visualization

Efficient High Quality

Rendering Using Sample-based

Representations

Scalable Hybrid Rendering for

Large Scale Visualization

Marker-free Performance

Capture

Algorithms for Low Cost Depth

Imaging

Visualization and editing of light

transport

Internet Transport and Coding for 3D

HD-TV

Software- innovation for the Digital Enterprise

Kusanagi Coding and

Interaction for Networked Games

Multi Touch Interaction

Techniques for Mixed 2D and 3D Graphics Displays

Advanced Ray Tracing and Data-Flow

Processing for the 3D Internet

Intel VCI Projects-Based Organization

ECOUSS Efficient and open Compiler-

Framework for parallel Simulations

SCENE Novel Scene Representations for Rich

Networked Media

VERVE Vanquishing fear and apathy

through E-inclusion

Large Scale Visualization in the Internet of Displays

User-centric Video

Processing

Local Dimming for Edge-lit LED LCD-Monitors

SCI Institute Utah USA

Stanford University California USA

Research Collaboration

Consortium Members

User-Centric Video Processing Jan Kautz Christian Theobalt

bull Objective ndash Create new user experiences for capturing

editing and browsing

ndash Targets amateur video creators

bull Approach ndash Automatically identify spationdashtemporal and

semantic relationships withinbetween videos

ndash Leverage graph of these to drive UI and video processing

bull Expected results Capturing automatic stabilization and

enhancement

Editing edit semantic objects in videos

Browsing find semantically related videos

Remove the person in white

Video Inpainting in Dynamic Scenes amp Videoscape for moving through Internet Videos

Efficient High-Quality Rendering Using Sample-based Representations Elmar Eisemann

bull Realistic Rendering ndash Lens Flare [Siggraphrsquo11]

ndash Depth-of-field [Eurographics lsquo11]

ndash Global Illumination [PGrsquo11]

bull Perceptual Rendering ndash Stereo

ndash High Dynamic Range

bull Alternative representations ndash Voxel Data

ndash Height Fields

3D Internet Interactive 3D Content on the Web Philipp Slusallek

bull XML3D Scene Description ndash HTML-5 extension for interactive graphics

ndash JS implementation amp built into the browser

ndash Reuses Web Technology (DOM CSS JS)

bull XFLOW Parallel Processing ndash Data-parallel flowgraph for XML3D

ndash Animations image amp geometry processing

ndash Configuration within the DOM

bull Results ndash W3C standardization ldquoDeclarative 3D for the Webrdquo

ndash Rich media apps for BMW SLS-Museum hellip

3D-Internet Apps SLS-Museum 3D-Installation amp Museum with Interactive Virtual Characters

3D-Internet Apps Using OpenStreetMap-3D as Shared Virtual Worlds

Fully automatically generated from OpenStreet Map Taking semantic data into acount

Marker-free Performance Capture Christian Theobalt

bull Reconstruction of detailed human animation models ndash In Multi-view video without markers

ndash Out Detailed motion shape and appearance

ndash General clothing modifiable performances new animations

bull Real-time performance capture ndash Fast full-body motion estimation from depth

cameras

ndash Interaction

ndash Collaboration with Intel Magic Mirror project

[ICCV 2011]

[SIGGRAPH Asia 2010]

Markerless Motion Capture of Interacting Characters Using Multi-view Image Segmentation

Articulated Models Input silhouettes Segmentation Contour labels Estimated surface Estimated 3D models

Handling Intersections

Improved segmentation with 3D shape priors Excellent performance when evaluated against marker-based system

bull Interactive inspection of light transport in virtual scenes ndash You can only manipulate what you see

ndash First prototypal light manipulation tools

bull Efficient global illumination ndash Otherwise no interactive

visualization nor manipulation

ndash Improvements on many-lights methods and progressive photon mapping

bull Results ndash Demonstrator Maya plugin ndash Collaboration with local film academy

Visualization and Editing of Light Transport Carsten Dachsbacher

Advanced Real-Time Ray Tracing Techniques Philipp Slusallek

bull Perfect importance sampling and caching ndash Sparse but perfect importance sampling

ndash Caching and interpolation [Eurographics`12]

bull Unifying Photon-Mapping amp Monte-Carlo ndash Formulating PM as a MC process

ndash Per pixel combination using MIS

bull Data-parallel implementations

ndash Efficiency and performance

bull Integration into XML3D

ndash Provide ldquocorrectrdquo results by default

Vertex Merging with Multiple Importance Sampling Photon-Mapping as a Monte-Carlo Process

BPT

PPM Progressive Photon-Mapping (PPM)

Bidirectional Path Tracing (BPT)

bull Whole-Function Vectorization ndash Restore scalar computations

ndash LLVM platform-independent

ndash RenderMan frontend OpenCL driver

bull Vector Programming ndash Formalized C extension for portable

effective SIMD programming

ndash Type system triggers vectorization

ndash Data layout adaption

bull New Programming Models for High-Performance Graphics

bull Results ndash Demonstrators for shaders and HPC code

ndash CC++-Extensions (with Intel)

ndash OpenCL compiler (CPU)

Compiler Support for High-Performance Graphics Sebastian Hack

bull Hybrid Rendering ndash Client amp Server Model

ndash Smartphone to Mainframe

bull Large Data Processing ndash Scalable Hierarchical

RW Data Structures

bull Results ndash ZAPP displaywall demonstrator

ndash ImageVis3D (Mobile) demonstrator

ndash Practically use in hospitals

Scalable Hybrid Rendering for Large Scale Visualization Jens Kruumlger

Displays as a Service Large Scale Visualization Alexander Loumlffler

bull Virtualization of Displays ndash Virtual Framebuffer and Displays exposed to Internet

ndash Replacing cables by switched IP network

ndash Internet standards for video encoding and streaming

bull Fully Synchronized ndash 120 Hz active stereo sync over IP

ndash Accuracy of ~100us in software

ndash Drives GPU displays output

bull Results ndash 20-screen wall demonstrator

ndash 3-screen wall (thin-bezel)

ndash CE4100 based SW synchronization

SIGGRAPH 2012

Backup

The Intel Science and Technology Center (ISTC) and Intel Collaborative Research Institute (ICRI) Programs

35

The modern economy is an information economy and one that is driven by innovations that enhance productivity as well as create new modes of entertainment We need to invest in the basic research that will inspire future products and services and ensure long term health of our information economy Government and private foundations are helping but corporate America needs to step up and increase commitments to university research - Justin Rattner ndash Intel CTO

$140M investment over 5 years announced by Intel in 2011 and 2012

Centers of Excellence bull Each ISTC and ICRI will focus on one

research area eg visual computing secure computing

bull The ISTCs and ICRIs are meant to bring the best and brightest researchers across the US together

bull Each ISTC and ICRI will be led by a host university and will include thought leaders from other schools

Breaking Barriers to Collaboration

bull Open IP models and open source software to encourage free information exchange (In most of the Centers)

bull Favor projects that span multiple institutions to encourage collaboration among universities

bull Intel researches per center assigned to work on-campus to encourage collaboration between Intel and academia

Greater Impact to Future Tech bull Center research themes to

address essential needs of computing technology

bull Research agendas jointly defined and co-led by an Intel and a University Principal Investigator

bull After completing 3-5 year charters new ISTCs and ICRIs can be formed to respond to changing tech environment

httpfolditportal

Serious Gaming pplied to Content Creation

Highlighted by President Obama Winner of most-significant new visualization tool (NSF)

Goal Create high-quality content by casting creation activities as games in which large numbers of people are incentivized to perform simple tasks which in combination yield sophisticated content PIs Zoran Popovic (UW) Noah Snavely (Cornell) Maneesh Agrawala(Berkeley)

Determining the structure of retroviral protease (HIV)

Video Frank to add Papers Frank to add

Extracting Structure and Semantics

CAD Model Points

Structures

People

Goals Enable context aware computing and automated content creation through the capture analysis and manipulation of real-world visual data PIs Steve Seitz (UW) Noah Snavely (Cornell) Tom Funkhouser (Princeton) Vladlen Koltun (Stanford) Jitendra Malik (Berkeley) Deva Ramanan (UV Irvine)

Video Frank to add Papers Frank to add

httpvisualstanfordedu

Computational Photography (Franken Camera)

Being adopted as a standard API for cellphone camera systems (Apple Android)

bull Goal Develop algorithms languages architectures and prototypes demonstrating the use of computation in the process of image capture and display

bull PIs Marc Levoy (Stanford) Mark Horowitz (Stanford) Pat Hanrahan (Stanford)

Video Frank to add Papers Frank to add

ISTC-VC SIGGRAPH Papers

Character Locomotion Monday 6 August 900 AM - 1030 AM Optimizing Locomotion Controllers Using Biologically Based Actuators and Objectives Jack M Wang Samuel R Hamner Scott L Delp Vladlen Koltun Continuous Character Control With Low-Dimensional Embeddings Sergey Levine Jack M Wang Alexis Haraux Zoran Popović Vladlen Koltun Shape Analysis Monday 6 August 900 AM - 1030 AM Schelling Points on 3D Surface Meshes Xiaobai Chen Abulhair Saparov Bill Pang Thomas Funkhouser Shape Transformation Wednesday 8 August 900 - 1030 AM An Algebraic Model for Parameterized Shape Editing Martin Bokeloh Michael Wand Hans-Peter Seidel Vladlen Koltun

42

ISTC-VC SIGGRAPH Papers

Image Processing Monday 6 August 2- 330 pm Decoupling Algorithms From Schedules for Easy Optimization of Image-Processing Pipelines Jonathan Ragan-Kelley Andrew Adams Sylvain Paris Marc Levoy Saman Amarasinghe Freacutedo Durand

Cloth

Monday 6 August 2-330 pm Specular Reflection From Woven Cloth Piti Irawan Steve Marschner Stitch Meshes for Modeling Knitted Clothing With Yarn-level Detail Cem Yuksel Jonathan M Kaldor Doug L James Steve Marschner

Appearance

Monday 6 August 345-535 pm Printing Spatially Varying Reflectance for Reproducing HDR Images Yue Dong Xin Tong Fabio Pellacini Baining Guo

43

ISTC-VC SIGGRAPH Papers (cont)

Hand Eye and Face Monday 6 August 345-535 pm Session Chair - Vladlen Koltun Discovery of Complex Behaviors through Contact-Invariant Optimization Igor Mordatch Emanuel Todorov Zoran Popovi1049029 Sketching Monday 6 August 345-535 pm HelpingHand Example-Based Stroke Stylization Jingwan Lu Fisher Yu Adam Finkelstein Stephen DiVerdi Fabrication Tuesday 7 August 9-1030 am Fabricating Articulated Characters From Skinned Meshes Moritz Baumlcher Bernd Bickel Doug L James Hanspeter Pfister

44

Sampling Reconstructing and Filtering Light Tuesday 7 August 1045 am-1215 pm A Theory of Monte Carlo Visibility Sampling Ravi Ramamoorthi John Anderson Mark Meyer Derek Nowrouzezahrai Reconstructing the Indirect Light Field for Global Illumination Jaakko Lehtinen Timo Aila Samuli Laine Freacutedo Durand

Geometry Reconstruction amp Tracking

Tuesday 7 August 1045 am-1215 pm Temporally Coherent Completion of Dynamic Shapes Hao Li Linjie Luo Daniel Vlasic Pieter Peers Jovan Popovic Mark Pauly Szymon Rusinkiewicz

Sets of Shapes

Tuesday 7 August 2-330 pm Exploring Collections of 3D Models Using Fuzzy Correspondence Vladimir G Kim Wilmot Li Niloy J Mitra Stephen DiVerdi Thomas Funkhouser A Probabilistic Model for Component-Based Shape Synthesis Evangelos Kalogerakis Siddhartha Chaudhuri Daphne Koller Vladlen Koltun

45

ISTC-VC SIGGRAPH Papers (cont)

Light Rays Tuesday 7 August 2-330 pm Manifold Exploration A Markov Chain Monte Carlo Technique for Rendering Scenes With Difficult Specular Transport Wenzel Jakob Steve Marschner Bidirectional Lightcuts Bruce Walter Pramook Khungurn Kavita Bala

Fun With Video

Tuesday 7 August 345-535 pm Session Chair Noah Snavely Video Deblurring for Hand-Held Cameras Using Patch-Based Synthesis Sunghyun Cho Jue Wang Seungyong Lee Eulerian Video Magnification for Revealing Subtle Changes in the World Hao-Yu Wu Michael Rubinstein Eugene Shih John Guttag Freacutedo Durand William T Freeman Selectively De-Animating Video Jiamin Bai Aseem Agarwala Maneesh Agrawala Ravi Ramamoorthi Tools for Placing Cuts and Transitions in Interview Video Floraine Berthouzoz Wilmot Li Maneesh Agrawala

46

ISTC-VC SIGGRAPH Papers (cont)

Noise and Texture Tuesday 7 August 345-535 pm Structure-Aware Synthesis for Predictive Woven Fabric Appearance Shuang Zhao Kavita Bala Steve Marschner Wenzel Jakob Symmetry-Guided Texture Synthesis and Manipulation Vladimir Kim Yaron Lipman Thomas Funkhouser

Shape Transformation Wednesday 8 August 900 - 1030 AM An Algebraic Model for Parameterized Shape Editing Martin Bokeloh Michael Wand Hans-Peter Seidel Vladlen Koltun

Stitching

Wednesday 8 August 1045 am-1215 pm Exposing Photo Manipulation With Inconsistent Reflections James F OrsquoBrien Hany Farid

47

ISTC-VC SIGGRAPH Papers (cont)

Maps Surfaces and Shapes

Wednesday 8 August 1045 am-1215 pm Simple Formulas For Quasiconformal Plane Deformations Yaron Lipman Vladimir G Kim Thomas Funkhouser

Interactive Systems amp Hardware Wednesday 8 August 2-330 pm Position-Correcting Tools for 2D Digital Fabrication Alec Rivers Ilan E Moyer Freacutedo Durand

48

ISTC-VC SIGGRAPH Papers (cont)

Collisions Wednesday 8 August 345-535 pm Energy-Based Self-Collision Culling for Arbitrary Mesh Deformations Changxi Zheng Doug L James

All About Images

Thursday 9 August 9-1030 am A Framework for Content-Adaptive Photo Manipulation Macros Application to Face Landscape and Global Manipulations Floraine Berthouzoz Wilmot Li Mira Dontcheva Maneesh Agrawala

Sound and Elements

Thursday 9 August 9-1030 am Motion-Driven Concatenative Synthesis of Cloth Sounds Steven S An Doug L James Steve Marschner Precomputed Acceleration Noise for Improved Rigid-Body Sound Jeffrey N Chadwick Changxi Zheng Doug L James Interactive Sound Propagation Using Compact Acoustic Transfer Operators Lakulish Antani Anish Chandak Lauri Savioja Dinesh Manocha Updated Sparse Cholesky Factors for Corotational Elastodynamics Florian Hecht Yeon Jin Lee Jonathan R Shewchuk James F OrsquoBrien

49

ISTC-VC SIGGRAPH Papers (cont)

Geometry amp Viewing Thursday 9 August 2-330 pm Perceptual Models of Viewpoint Preference Adrian Secordm Jingwan Lu Adam Finkelstein Manish Singh Andrew Nealen

Faces and Hair [Closing Session]

Thursday 9 August 345-515 pm Coupled 3D Reconstruction of Sparse Facial Hair and Skin Thabo Beeler Bernd Bickel Gioacchino Noris Paul Beardsley Steve Marschner Robert W Sumner Markus Gross Physical Face Cloning Bernd Bickel Peter Kaufmann Melina Skouras Bernhard Thomaszewski Derek Bradley Thabo Beeler Philip Jackson Steve Marschner Wojciech Matusik Markus Gross

50

ISTC-VC SIGGRAPH Papers (cont)

Siggraph Courses Optimizing Realistic Rendering With Many-Light Methods Sunday 5 August 2-515 pm Jaroslav Krivanek Milos Hasan Adam Arbree Carsten Dachsbacher Alexander Keller Bruce Walter State of the Art in Photon-Density Estimation Thursday 9 August 2-515 pm Toshiya Hachisuka Wojciech Jarosz Guillaume Bouchard Per Christensen Jeppe Revall Frisvad Wenzel Jakob Henrik Wann Jensen Jared M Johnson Michael Kaschalk Claude Knaus Andrew Selle Ben Spencer

Siggraph Talks

Silence Eliminate the Noise Thursday 9 August 9-1030 am Importance Sampling for Hair Scattering Jiawei Ou Feng Xie Parashar Krishnamachari Fabio Pellacini

Siggraph Exhibitor Sessions

Intel Corporation Wednesday 8 August 430-530 pm room 402B The Future of Visual Computing as Viewed by Intel Visual Computing Research Centers

51

Other ISTC-VC SIGGRAPH Participation

Page 18: Future of Visual Computing as viewed by Intel Visual ... · PDF fileFuture of Visual Computing as viewed by Intel Visual Computing Research Centers ... Justin Rattner Intel Science

SCI Institute Utah USA

Stanford University California USA

Research Collaboration

Consortium Members

User-Centric Video Processing Jan Kautz Christian Theobalt

bull Objective ndash Create new user experiences for capturing

editing and browsing

ndash Targets amateur video creators

bull Approach ndash Automatically identify spationdashtemporal and

semantic relationships withinbetween videos

ndash Leverage graph of these to drive UI and video processing

bull Expected results Capturing automatic stabilization and

enhancement

Editing edit semantic objects in videos

Browsing find semantically related videos

Remove the person in white

Video Inpainting in Dynamic Scenes amp Videoscape for moving through Internet Videos

Efficient High-Quality Rendering Using Sample-based Representations Elmar Eisemann

bull Realistic Rendering ndash Lens Flare [Siggraphrsquo11]

ndash Depth-of-field [Eurographics lsquo11]

ndash Global Illumination [PGrsquo11]

bull Perceptual Rendering ndash Stereo

ndash High Dynamic Range

bull Alternative representations ndash Voxel Data

ndash Height Fields

3D Internet Interactive 3D Content on the Web Philipp Slusallek

bull XML3D Scene Description ndash HTML-5 extension for interactive graphics

ndash JS implementation amp built into the browser

ndash Reuses Web Technology (DOM CSS JS)

bull XFLOW Parallel Processing ndash Data-parallel flowgraph for XML3D

ndash Animations image amp geometry processing

ndash Configuration within the DOM

bull Results ndash W3C standardization ldquoDeclarative 3D for the Webrdquo

ndash Rich media apps for BMW SLS-Museum hellip

3D-Internet Apps SLS-Museum 3D-Installation amp Museum with Interactive Virtual Characters

3D-Internet Apps Using OpenStreetMap-3D as Shared Virtual Worlds

Fully automatically generated from OpenStreet Map Taking semantic data into acount

Marker-free Performance Capture Christian Theobalt

bull Reconstruction of detailed human animation models ndash In Multi-view video without markers

ndash Out Detailed motion shape and appearance

ndash General clothing modifiable performances new animations

bull Real-time performance capture ndash Fast full-body motion estimation from depth

cameras

ndash Interaction

ndash Collaboration with Intel Magic Mirror project

[ICCV 2011]

[SIGGRAPH Asia 2010]

Markerless Motion Capture of Interacting Characters Using Multi-view Image Segmentation

Articulated Models Input silhouettes Segmentation Contour labels Estimated surface Estimated 3D models

Handling Intersections

Improved segmentation with 3D shape priors Excellent performance when evaluated against marker-based system

bull Interactive inspection of light transport in virtual scenes ndash You can only manipulate what you see

ndash First prototypal light manipulation tools

bull Efficient global illumination ndash Otherwise no interactive

visualization nor manipulation

ndash Improvements on many-lights methods and progressive photon mapping

bull Results ndash Demonstrator Maya plugin ndash Collaboration with local film academy

Visualization and Editing of Light Transport Carsten Dachsbacher

Advanced Real-Time Ray Tracing Techniques Philipp Slusallek

bull Perfect importance sampling and caching ndash Sparse but perfect importance sampling

ndash Caching and interpolation [Eurographics`12]

bull Unifying Photon-Mapping amp Monte-Carlo ndash Formulating PM as a MC process

ndash Per pixel combination using MIS

bull Data-parallel implementations

ndash Efficiency and performance

bull Integration into XML3D

ndash Provide ldquocorrectrdquo results by default

Vertex Merging with Multiple Importance Sampling Photon-Mapping as a Monte-Carlo Process

BPT

PPM Progressive Photon-Mapping (PPM)

Bidirectional Path Tracing (BPT)

bull Whole-Function Vectorization ndash Restore scalar computations

ndash LLVM platform-independent

ndash RenderMan frontend OpenCL driver

bull Vector Programming ndash Formalized C extension for portable

effective SIMD programming

ndash Type system triggers vectorization

ndash Data layout adaption

bull New Programming Models for High-Performance Graphics

bull Results ndash Demonstrators for shaders and HPC code

ndash CC++-Extensions (with Intel)

ndash OpenCL compiler (CPU)

Compiler Support for High-Performance Graphics Sebastian Hack

bull Hybrid Rendering ndash Client amp Server Model

ndash Smartphone to Mainframe

bull Large Data Processing ndash Scalable Hierarchical

RW Data Structures

bull Results ndash ZAPP displaywall demonstrator

ndash ImageVis3D (Mobile) demonstrator

ndash Practically use in hospitals

Scalable Hybrid Rendering for Large Scale Visualization Jens Kruumlger

Displays as a Service Large Scale Visualization Alexander Loumlffler

bull Virtualization of Displays ndash Virtual Framebuffer and Displays exposed to Internet

ndash Replacing cables by switched IP network

ndash Internet standards for video encoding and streaming

bull Fully Synchronized ndash 120 Hz active stereo sync over IP

ndash Accuracy of ~100us in software

ndash Drives GPU displays output

bull Results ndash 20-screen wall demonstrator

ndash 3-screen wall (thin-bezel)

ndash CE4100 based SW synchronization

SIGGRAPH 2012

Backup

The Intel Science and Technology Center (ISTC) and Intel Collaborative Research Institute (ICRI) Programs

35

The modern economy is an information economy and one that is driven by innovations that enhance productivity as well as create new modes of entertainment We need to invest in the basic research that will inspire future products and services and ensure long term health of our information economy Government and private foundations are helping but corporate America needs to step up and increase commitments to university research - Justin Rattner ndash Intel CTO

$140M investment over 5 years announced by Intel in 2011 and 2012

Centers of Excellence bull Each ISTC and ICRI will focus on one

research area eg visual computing secure computing

bull The ISTCs and ICRIs are meant to bring the best and brightest researchers across the US together

bull Each ISTC and ICRI will be led by a host university and will include thought leaders from other schools

Breaking Barriers to Collaboration

bull Open IP models and open source software to encourage free information exchange (In most of the Centers)

bull Favor projects that span multiple institutions to encourage collaboration among universities

bull Intel researches per center assigned to work on-campus to encourage collaboration between Intel and academia

Greater Impact to Future Tech bull Center research themes to

address essential needs of computing technology

bull Research agendas jointly defined and co-led by an Intel and a University Principal Investigator

bull After completing 3-5 year charters new ISTCs and ICRIs can be formed to respond to changing tech environment

httpfolditportal

Serious Gaming pplied to Content Creation

Highlighted by President Obama Winner of most-significant new visualization tool (NSF)

Goal Create high-quality content by casting creation activities as games in which large numbers of people are incentivized to perform simple tasks which in combination yield sophisticated content PIs Zoran Popovic (UW) Noah Snavely (Cornell) Maneesh Agrawala(Berkeley)

Determining the structure of retroviral protease (HIV)

Video Frank to add Papers Frank to add

Extracting Structure and Semantics

CAD Model Points

Structures

People

Goals Enable context aware computing and automated content creation through the capture analysis and manipulation of real-world visual data PIs Steve Seitz (UW) Noah Snavely (Cornell) Tom Funkhouser (Princeton) Vladlen Koltun (Stanford) Jitendra Malik (Berkeley) Deva Ramanan (UV Irvine)

Video Frank to add Papers Frank to add

httpvisualstanfordedu

Computational Photography (Franken Camera)

Being adopted as a standard API for cellphone camera systems (Apple Android)

bull Goal Develop algorithms languages architectures and prototypes demonstrating the use of computation in the process of image capture and display

bull PIs Marc Levoy (Stanford) Mark Horowitz (Stanford) Pat Hanrahan (Stanford)

Video Frank to add Papers Frank to add

ISTC-VC SIGGRAPH Papers

Character Locomotion Monday 6 August 900 AM - 1030 AM Optimizing Locomotion Controllers Using Biologically Based Actuators and Objectives Jack M Wang Samuel R Hamner Scott L Delp Vladlen Koltun Continuous Character Control With Low-Dimensional Embeddings Sergey Levine Jack M Wang Alexis Haraux Zoran Popović Vladlen Koltun Shape Analysis Monday 6 August 900 AM - 1030 AM Schelling Points on 3D Surface Meshes Xiaobai Chen Abulhair Saparov Bill Pang Thomas Funkhouser Shape Transformation Wednesday 8 August 900 - 1030 AM An Algebraic Model for Parameterized Shape Editing Martin Bokeloh Michael Wand Hans-Peter Seidel Vladlen Koltun

42

ISTC-VC SIGGRAPH Papers

Image Processing Monday 6 August 2- 330 pm Decoupling Algorithms From Schedules for Easy Optimization of Image-Processing Pipelines Jonathan Ragan-Kelley Andrew Adams Sylvain Paris Marc Levoy Saman Amarasinghe Freacutedo Durand

Cloth

Monday 6 August 2-330 pm Specular Reflection From Woven Cloth Piti Irawan Steve Marschner Stitch Meshes for Modeling Knitted Clothing With Yarn-level Detail Cem Yuksel Jonathan M Kaldor Doug L James Steve Marschner

Appearance

Monday 6 August 345-535 pm Printing Spatially Varying Reflectance for Reproducing HDR Images Yue Dong Xin Tong Fabio Pellacini Baining Guo

43

ISTC-VC SIGGRAPH Papers (cont)

Hand Eye and Face Monday 6 August 345-535 pm Session Chair - Vladlen Koltun Discovery of Complex Behaviors through Contact-Invariant Optimization Igor Mordatch Emanuel Todorov Zoran Popovi1049029 Sketching Monday 6 August 345-535 pm HelpingHand Example-Based Stroke Stylization Jingwan Lu Fisher Yu Adam Finkelstein Stephen DiVerdi Fabrication Tuesday 7 August 9-1030 am Fabricating Articulated Characters From Skinned Meshes Moritz Baumlcher Bernd Bickel Doug L James Hanspeter Pfister

44

Sampling Reconstructing and Filtering Light Tuesday 7 August 1045 am-1215 pm A Theory of Monte Carlo Visibility Sampling Ravi Ramamoorthi John Anderson Mark Meyer Derek Nowrouzezahrai Reconstructing the Indirect Light Field for Global Illumination Jaakko Lehtinen Timo Aila Samuli Laine Freacutedo Durand

Geometry Reconstruction amp Tracking

Tuesday 7 August 1045 am-1215 pm Temporally Coherent Completion of Dynamic Shapes Hao Li Linjie Luo Daniel Vlasic Pieter Peers Jovan Popovic Mark Pauly Szymon Rusinkiewicz

Sets of Shapes

Tuesday 7 August 2-330 pm Exploring Collections of 3D Models Using Fuzzy Correspondence Vladimir G Kim Wilmot Li Niloy J Mitra Stephen DiVerdi Thomas Funkhouser A Probabilistic Model for Component-Based Shape Synthesis Evangelos Kalogerakis Siddhartha Chaudhuri Daphne Koller Vladlen Koltun

45

ISTC-VC SIGGRAPH Papers (cont)

Light Rays Tuesday 7 August 2-330 pm Manifold Exploration A Markov Chain Monte Carlo Technique for Rendering Scenes With Difficult Specular Transport Wenzel Jakob Steve Marschner Bidirectional Lightcuts Bruce Walter Pramook Khungurn Kavita Bala

Fun With Video

Tuesday 7 August 345-535 pm Session Chair Noah Snavely Video Deblurring for Hand-Held Cameras Using Patch-Based Synthesis Sunghyun Cho Jue Wang Seungyong Lee Eulerian Video Magnification for Revealing Subtle Changes in the World Hao-Yu Wu Michael Rubinstein Eugene Shih John Guttag Freacutedo Durand William T Freeman Selectively De-Animating Video Jiamin Bai Aseem Agarwala Maneesh Agrawala Ravi Ramamoorthi Tools for Placing Cuts and Transitions in Interview Video Floraine Berthouzoz Wilmot Li Maneesh Agrawala

46

ISTC-VC SIGGRAPH Papers (cont)

Noise and Texture Tuesday 7 August 345-535 pm Structure-Aware Synthesis for Predictive Woven Fabric Appearance Shuang Zhao Kavita Bala Steve Marschner Wenzel Jakob Symmetry-Guided Texture Synthesis and Manipulation Vladimir Kim Yaron Lipman Thomas Funkhouser

Shape Transformation Wednesday 8 August 900 - 1030 AM An Algebraic Model for Parameterized Shape Editing Martin Bokeloh Michael Wand Hans-Peter Seidel Vladlen Koltun

Stitching

Wednesday 8 August 1045 am-1215 pm Exposing Photo Manipulation With Inconsistent Reflections James F OrsquoBrien Hany Farid

47

ISTC-VC SIGGRAPH Papers (cont)

Maps Surfaces and Shapes

Wednesday 8 August 1045 am-1215 pm Simple Formulas For Quasiconformal Plane Deformations Yaron Lipman Vladimir G Kim Thomas Funkhouser

Interactive Systems amp Hardware Wednesday 8 August 2-330 pm Position-Correcting Tools for 2D Digital Fabrication Alec Rivers Ilan E Moyer Freacutedo Durand

48

ISTC-VC SIGGRAPH Papers (cont)

Collisions Wednesday 8 August 345-535 pm Energy-Based Self-Collision Culling for Arbitrary Mesh Deformations Changxi Zheng Doug L James

All About Images

Thursday 9 August 9-1030 am A Framework for Content-Adaptive Photo Manipulation Macros Application to Face Landscape and Global Manipulations Floraine Berthouzoz Wilmot Li Mira Dontcheva Maneesh Agrawala

Sound and Elements

Thursday 9 August 9-1030 am Motion-Driven Concatenative Synthesis of Cloth Sounds Steven S An Doug L James Steve Marschner Precomputed Acceleration Noise for Improved Rigid-Body Sound Jeffrey N Chadwick Changxi Zheng Doug L James Interactive Sound Propagation Using Compact Acoustic Transfer Operators Lakulish Antani Anish Chandak Lauri Savioja Dinesh Manocha Updated Sparse Cholesky Factors for Corotational Elastodynamics Florian Hecht Yeon Jin Lee Jonathan R Shewchuk James F OrsquoBrien

49

ISTC-VC SIGGRAPH Papers (cont)

Geometry amp Viewing Thursday 9 August 2-330 pm Perceptual Models of Viewpoint Preference Adrian Secordm Jingwan Lu Adam Finkelstein Manish Singh Andrew Nealen

Faces and Hair [Closing Session]

Thursday 9 August 345-515 pm Coupled 3D Reconstruction of Sparse Facial Hair and Skin Thabo Beeler Bernd Bickel Gioacchino Noris Paul Beardsley Steve Marschner Robert W Sumner Markus Gross Physical Face Cloning Bernd Bickel Peter Kaufmann Melina Skouras Bernhard Thomaszewski Derek Bradley Thabo Beeler Philip Jackson Steve Marschner Wojciech Matusik Markus Gross

50

ISTC-VC SIGGRAPH Papers (cont)

Siggraph Courses Optimizing Realistic Rendering With Many-Light Methods Sunday 5 August 2-515 pm Jaroslav Krivanek Milos Hasan Adam Arbree Carsten Dachsbacher Alexander Keller Bruce Walter State of the Art in Photon-Density Estimation Thursday 9 August 2-515 pm Toshiya Hachisuka Wojciech Jarosz Guillaume Bouchard Per Christensen Jeppe Revall Frisvad Wenzel Jakob Henrik Wann Jensen Jared M Johnson Michael Kaschalk Claude Knaus Andrew Selle Ben Spencer

Siggraph Talks

Silence Eliminate the Noise Thursday 9 August 9-1030 am Importance Sampling for Hair Scattering Jiawei Ou Feng Xie Parashar Krishnamachari Fabio Pellacini

Siggraph Exhibitor Sessions

Intel Corporation Wednesday 8 August 430-530 pm room 402B The Future of Visual Computing as Viewed by Intel Visual Computing Research Centers

51

Other ISTC-VC SIGGRAPH Participation

Page 19: Future of Visual Computing as viewed by Intel Visual ... · PDF fileFuture of Visual Computing as viewed by Intel Visual Computing Research Centers ... Justin Rattner Intel Science

Consortium Members

User-Centric Video Processing Jan Kautz Christian Theobalt

bull Objective ndash Create new user experiences for capturing

editing and browsing

ndash Targets amateur video creators

bull Approach ndash Automatically identify spationdashtemporal and

semantic relationships withinbetween videos

ndash Leverage graph of these to drive UI and video processing

bull Expected results Capturing automatic stabilization and

enhancement

Editing edit semantic objects in videos

Browsing find semantically related videos

Remove the person in white

Video Inpainting in Dynamic Scenes amp Videoscape for moving through Internet Videos

Efficient High-Quality Rendering Using Sample-based Representations Elmar Eisemann

bull Realistic Rendering ndash Lens Flare [Siggraphrsquo11]

ndash Depth-of-field [Eurographics lsquo11]

ndash Global Illumination [PGrsquo11]

bull Perceptual Rendering ndash Stereo

ndash High Dynamic Range

bull Alternative representations ndash Voxel Data

ndash Height Fields

3D Internet Interactive 3D Content on the Web Philipp Slusallek

bull XML3D Scene Description ndash HTML-5 extension for interactive graphics

ndash JS implementation amp built into the browser

ndash Reuses Web Technology (DOM CSS JS)

bull XFLOW Parallel Processing ndash Data-parallel flowgraph for XML3D

ndash Animations image amp geometry processing

ndash Configuration within the DOM

bull Results ndash W3C standardization ldquoDeclarative 3D for the Webrdquo

ndash Rich media apps for BMW SLS-Museum hellip

3D-Internet Apps SLS-Museum 3D-Installation amp Museum with Interactive Virtual Characters

3D-Internet Apps Using OpenStreetMap-3D as Shared Virtual Worlds

Fully automatically generated from OpenStreet Map Taking semantic data into acount

Marker-free Performance Capture Christian Theobalt

bull Reconstruction of detailed human animation models ndash In Multi-view video without markers

ndash Out Detailed motion shape and appearance

ndash General clothing modifiable performances new animations

bull Real-time performance capture ndash Fast full-body motion estimation from depth

cameras

ndash Interaction

ndash Collaboration with Intel Magic Mirror project

[ICCV 2011]

[SIGGRAPH Asia 2010]

Markerless Motion Capture of Interacting Characters Using Multi-view Image Segmentation

Articulated Models Input silhouettes Segmentation Contour labels Estimated surface Estimated 3D models

Handling Intersections

Improved segmentation with 3D shape priors Excellent performance when evaluated against marker-based system

bull Interactive inspection of light transport in virtual scenes ndash You can only manipulate what you see

ndash First prototypal light manipulation tools

bull Efficient global illumination ndash Otherwise no interactive

visualization nor manipulation

ndash Improvements on many-lights methods and progressive photon mapping

bull Results ndash Demonstrator Maya plugin ndash Collaboration with local film academy

Visualization and Editing of Light Transport Carsten Dachsbacher

Advanced Real-Time Ray Tracing Techniques Philipp Slusallek

bull Perfect importance sampling and caching ndash Sparse but perfect importance sampling

ndash Caching and interpolation [Eurographics`12]

bull Unifying Photon-Mapping amp Monte-Carlo ndash Formulating PM as a MC process

ndash Per pixel combination using MIS

bull Data-parallel implementations

ndash Efficiency and performance

bull Integration into XML3D

ndash Provide ldquocorrectrdquo results by default

Vertex Merging with Multiple Importance Sampling Photon-Mapping as a Monte-Carlo Process

BPT

PPM Progressive Photon-Mapping (PPM)

Bidirectional Path Tracing (BPT)

bull Whole-Function Vectorization ndash Restore scalar computations

ndash LLVM platform-independent

ndash RenderMan frontend OpenCL driver

bull Vector Programming ndash Formalized C extension for portable

effective SIMD programming

ndash Type system triggers vectorization

ndash Data layout adaption

bull New Programming Models for High-Performance Graphics

bull Results ndash Demonstrators for shaders and HPC code

ndash CC++-Extensions (with Intel)

ndash OpenCL compiler (CPU)

Compiler Support for High-Performance Graphics Sebastian Hack

bull Hybrid Rendering ndash Client amp Server Model

ndash Smartphone to Mainframe

bull Large Data Processing ndash Scalable Hierarchical

RW Data Structures

bull Results ndash ZAPP displaywall demonstrator

ndash ImageVis3D (Mobile) demonstrator

ndash Practically use in hospitals

Scalable Hybrid Rendering for Large Scale Visualization Jens Kruumlger

Displays as a Service Large Scale Visualization Alexander Loumlffler

bull Virtualization of Displays ndash Virtual Framebuffer and Displays exposed to Internet

ndash Replacing cables by switched IP network

ndash Internet standards for video encoding and streaming

bull Fully Synchronized ndash 120 Hz active stereo sync over IP

ndash Accuracy of ~100us in software

ndash Drives GPU displays output

bull Results ndash 20-screen wall demonstrator

ndash 3-screen wall (thin-bezel)

ndash CE4100 based SW synchronization

SIGGRAPH 2012

Backup

The Intel Science and Technology Center (ISTC) and Intel Collaborative Research Institute (ICRI) Programs

35

The modern economy is an information economy and one that is driven by innovations that enhance productivity as well as create new modes of entertainment We need to invest in the basic research that will inspire future products and services and ensure long term health of our information economy Government and private foundations are helping but corporate America needs to step up and increase commitments to university research - Justin Rattner ndash Intel CTO

$140M investment over 5 years announced by Intel in 2011 and 2012

Centers of Excellence bull Each ISTC and ICRI will focus on one

research area eg visual computing secure computing

bull The ISTCs and ICRIs are meant to bring the best and brightest researchers across the US together

bull Each ISTC and ICRI will be led by a host university and will include thought leaders from other schools

Breaking Barriers to Collaboration

bull Open IP models and open source software to encourage free information exchange (In most of the Centers)

bull Favor projects that span multiple institutions to encourage collaboration among universities

bull Intel researches per center assigned to work on-campus to encourage collaboration between Intel and academia

Greater Impact to Future Tech bull Center research themes to

address essential needs of computing technology

bull Research agendas jointly defined and co-led by an Intel and a University Principal Investigator

bull After completing 3-5 year charters new ISTCs and ICRIs can be formed to respond to changing tech environment

httpfolditportal

Serious Gaming pplied to Content Creation

Highlighted by President Obama Winner of most-significant new visualization tool (NSF)

Goal Create high-quality content by casting creation activities as games in which large numbers of people are incentivized to perform simple tasks which in combination yield sophisticated content PIs Zoran Popovic (UW) Noah Snavely (Cornell) Maneesh Agrawala(Berkeley)

Determining the structure of retroviral protease (HIV)

Video Frank to add Papers Frank to add

Extracting Structure and Semantics

CAD Model Points

Structures

People

Goals Enable context aware computing and automated content creation through the capture analysis and manipulation of real-world visual data PIs Steve Seitz (UW) Noah Snavely (Cornell) Tom Funkhouser (Princeton) Vladlen Koltun (Stanford) Jitendra Malik (Berkeley) Deva Ramanan (UV Irvine)

Video Frank to add Papers Frank to add

httpvisualstanfordedu

Computational Photography (Franken Camera)

Being adopted as a standard API for cellphone camera systems (Apple Android)

bull Goal Develop algorithms languages architectures and prototypes demonstrating the use of computation in the process of image capture and display

bull PIs Marc Levoy (Stanford) Mark Horowitz (Stanford) Pat Hanrahan (Stanford)

Video Frank to add Papers Frank to add

ISTC-VC SIGGRAPH Papers

Character Locomotion Monday 6 August 900 AM - 1030 AM Optimizing Locomotion Controllers Using Biologically Based Actuators and Objectives Jack M Wang Samuel R Hamner Scott L Delp Vladlen Koltun Continuous Character Control With Low-Dimensional Embeddings Sergey Levine Jack M Wang Alexis Haraux Zoran Popović Vladlen Koltun Shape Analysis Monday 6 August 900 AM - 1030 AM Schelling Points on 3D Surface Meshes Xiaobai Chen Abulhair Saparov Bill Pang Thomas Funkhouser Shape Transformation Wednesday 8 August 900 - 1030 AM An Algebraic Model for Parameterized Shape Editing Martin Bokeloh Michael Wand Hans-Peter Seidel Vladlen Koltun

42

ISTC-VC SIGGRAPH Papers

Image Processing Monday 6 August 2- 330 pm Decoupling Algorithms From Schedules for Easy Optimization of Image-Processing Pipelines Jonathan Ragan-Kelley Andrew Adams Sylvain Paris Marc Levoy Saman Amarasinghe Freacutedo Durand

Cloth

Monday 6 August 2-330 pm Specular Reflection From Woven Cloth Piti Irawan Steve Marschner Stitch Meshes for Modeling Knitted Clothing With Yarn-level Detail Cem Yuksel Jonathan M Kaldor Doug L James Steve Marschner

Appearance

Monday 6 August 345-535 pm Printing Spatially Varying Reflectance for Reproducing HDR Images Yue Dong Xin Tong Fabio Pellacini Baining Guo

43

ISTC-VC SIGGRAPH Papers (cont)

Hand Eye and Face Monday 6 August 345-535 pm Session Chair - Vladlen Koltun Discovery of Complex Behaviors through Contact-Invariant Optimization Igor Mordatch Emanuel Todorov Zoran Popovi1049029 Sketching Monday 6 August 345-535 pm HelpingHand Example-Based Stroke Stylization Jingwan Lu Fisher Yu Adam Finkelstein Stephen DiVerdi Fabrication Tuesday 7 August 9-1030 am Fabricating Articulated Characters From Skinned Meshes Moritz Baumlcher Bernd Bickel Doug L James Hanspeter Pfister

44

Sampling Reconstructing and Filtering Light Tuesday 7 August 1045 am-1215 pm A Theory of Monte Carlo Visibility Sampling Ravi Ramamoorthi John Anderson Mark Meyer Derek Nowrouzezahrai Reconstructing the Indirect Light Field for Global Illumination Jaakko Lehtinen Timo Aila Samuli Laine Freacutedo Durand

Geometry Reconstruction amp Tracking

Tuesday 7 August 1045 am-1215 pm Temporally Coherent Completion of Dynamic Shapes Hao Li Linjie Luo Daniel Vlasic Pieter Peers Jovan Popovic Mark Pauly Szymon Rusinkiewicz

Sets of Shapes

Tuesday 7 August 2-330 pm Exploring Collections of 3D Models Using Fuzzy Correspondence Vladimir G Kim Wilmot Li Niloy J Mitra Stephen DiVerdi Thomas Funkhouser A Probabilistic Model for Component-Based Shape Synthesis Evangelos Kalogerakis Siddhartha Chaudhuri Daphne Koller Vladlen Koltun

45

ISTC-VC SIGGRAPH Papers (cont)

Light Rays Tuesday 7 August 2-330 pm Manifold Exploration A Markov Chain Monte Carlo Technique for Rendering Scenes With Difficult Specular Transport Wenzel Jakob Steve Marschner Bidirectional Lightcuts Bruce Walter Pramook Khungurn Kavita Bala

Fun With Video

Tuesday 7 August 345-535 pm Session Chair Noah Snavely Video Deblurring for Hand-Held Cameras Using Patch-Based Synthesis Sunghyun Cho Jue Wang Seungyong Lee Eulerian Video Magnification for Revealing Subtle Changes in the World Hao-Yu Wu Michael Rubinstein Eugene Shih John Guttag Freacutedo Durand William T Freeman Selectively De-Animating Video Jiamin Bai Aseem Agarwala Maneesh Agrawala Ravi Ramamoorthi Tools for Placing Cuts and Transitions in Interview Video Floraine Berthouzoz Wilmot Li Maneesh Agrawala

46

ISTC-VC SIGGRAPH Papers (cont)

Noise and Texture Tuesday 7 August 345-535 pm Structure-Aware Synthesis for Predictive Woven Fabric Appearance Shuang Zhao Kavita Bala Steve Marschner Wenzel Jakob Symmetry-Guided Texture Synthesis and Manipulation Vladimir Kim Yaron Lipman Thomas Funkhouser

Shape Transformation Wednesday 8 August 900 - 1030 AM An Algebraic Model for Parameterized Shape Editing Martin Bokeloh Michael Wand Hans-Peter Seidel Vladlen Koltun

Stitching

Wednesday 8 August 1045 am-1215 pm Exposing Photo Manipulation With Inconsistent Reflections James F OrsquoBrien Hany Farid

47

ISTC-VC SIGGRAPH Papers (cont)

Maps Surfaces and Shapes

Wednesday 8 August 1045 am-1215 pm Simple Formulas For Quasiconformal Plane Deformations Yaron Lipman Vladimir G Kim Thomas Funkhouser

Interactive Systems amp Hardware Wednesday 8 August 2-330 pm Position-Correcting Tools for 2D Digital Fabrication Alec Rivers Ilan E Moyer Freacutedo Durand

48

ISTC-VC SIGGRAPH Papers (cont)

Collisions Wednesday 8 August 345-535 pm Energy-Based Self-Collision Culling for Arbitrary Mesh Deformations Changxi Zheng Doug L James

All About Images

Thursday 9 August 9-1030 am A Framework for Content-Adaptive Photo Manipulation Macros Application to Face Landscape and Global Manipulations Floraine Berthouzoz Wilmot Li Mira Dontcheva Maneesh Agrawala

Sound and Elements

Thursday 9 August 9-1030 am Motion-Driven Concatenative Synthesis of Cloth Sounds Steven S An Doug L James Steve Marschner Precomputed Acceleration Noise for Improved Rigid-Body Sound Jeffrey N Chadwick Changxi Zheng Doug L James Interactive Sound Propagation Using Compact Acoustic Transfer Operators Lakulish Antani Anish Chandak Lauri Savioja Dinesh Manocha Updated Sparse Cholesky Factors for Corotational Elastodynamics Florian Hecht Yeon Jin Lee Jonathan R Shewchuk James F OrsquoBrien

49

ISTC-VC SIGGRAPH Papers (cont)

Geometry amp Viewing Thursday 9 August 2-330 pm Perceptual Models of Viewpoint Preference Adrian Secordm Jingwan Lu Adam Finkelstein Manish Singh Andrew Nealen

Faces and Hair [Closing Session]

Thursday 9 August 345-515 pm Coupled 3D Reconstruction of Sparse Facial Hair and Skin Thabo Beeler Bernd Bickel Gioacchino Noris Paul Beardsley Steve Marschner Robert W Sumner Markus Gross Physical Face Cloning Bernd Bickel Peter Kaufmann Melina Skouras Bernhard Thomaszewski Derek Bradley Thabo Beeler Philip Jackson Steve Marschner Wojciech Matusik Markus Gross

50

ISTC-VC SIGGRAPH Papers (cont)

Siggraph Courses Optimizing Realistic Rendering With Many-Light Methods Sunday 5 August 2-515 pm Jaroslav Krivanek Milos Hasan Adam Arbree Carsten Dachsbacher Alexander Keller Bruce Walter State of the Art in Photon-Density Estimation Thursday 9 August 2-515 pm Toshiya Hachisuka Wojciech Jarosz Guillaume Bouchard Per Christensen Jeppe Revall Frisvad Wenzel Jakob Henrik Wann Jensen Jared M Johnson Michael Kaschalk Claude Knaus Andrew Selle Ben Spencer

Siggraph Talks

Silence Eliminate the Noise Thursday 9 August 9-1030 am Importance Sampling for Hair Scattering Jiawei Ou Feng Xie Parashar Krishnamachari Fabio Pellacini

Siggraph Exhibitor Sessions

Intel Corporation Wednesday 8 August 430-530 pm room 402B The Future of Visual Computing as Viewed by Intel Visual Computing Research Centers

51

Other ISTC-VC SIGGRAPH Participation

Page 20: Future of Visual Computing as viewed by Intel Visual ... · PDF fileFuture of Visual Computing as viewed by Intel Visual Computing Research Centers ... Justin Rattner Intel Science

User-Centric Video Processing Jan Kautz Christian Theobalt

bull Objective ndash Create new user experiences for capturing

editing and browsing

ndash Targets amateur video creators

bull Approach ndash Automatically identify spationdashtemporal and

semantic relationships withinbetween videos

ndash Leverage graph of these to drive UI and video processing

bull Expected results Capturing automatic stabilization and

enhancement

Editing edit semantic objects in videos

Browsing find semantically related videos

Remove the person in white

Video Inpainting in Dynamic Scenes amp Videoscape for moving through Internet Videos

Efficient High-Quality Rendering Using Sample-based Representations Elmar Eisemann

bull Realistic Rendering ndash Lens Flare [Siggraphrsquo11]

ndash Depth-of-field [Eurographics lsquo11]

ndash Global Illumination [PGrsquo11]

bull Perceptual Rendering ndash Stereo

ndash High Dynamic Range

bull Alternative representations ndash Voxel Data

ndash Height Fields

3D Internet Interactive 3D Content on the Web Philipp Slusallek

bull XML3D Scene Description ndash HTML-5 extension for interactive graphics

ndash JS implementation amp built into the browser

ndash Reuses Web Technology (DOM CSS JS)

bull XFLOW Parallel Processing ndash Data-parallel flowgraph for XML3D

ndash Animations image amp geometry processing

ndash Configuration within the DOM

bull Results ndash W3C standardization ldquoDeclarative 3D for the Webrdquo

ndash Rich media apps for BMW SLS-Museum hellip

3D-Internet Apps SLS-Museum 3D-Installation amp Museum with Interactive Virtual Characters

3D-Internet Apps Using OpenStreetMap-3D as Shared Virtual Worlds

Fully automatically generated from OpenStreet Map Taking semantic data into acount

Marker-free Performance Capture Christian Theobalt

bull Reconstruction of detailed human animation models ndash In Multi-view video without markers

ndash Out Detailed motion shape and appearance

ndash General clothing modifiable performances new animations

bull Real-time performance capture ndash Fast full-body motion estimation from depth

cameras

ndash Interaction

ndash Collaboration with Intel Magic Mirror project

[ICCV 2011]

[SIGGRAPH Asia 2010]

Markerless Motion Capture of Interacting Characters Using Multi-view Image Segmentation

Articulated Models Input silhouettes Segmentation Contour labels Estimated surface Estimated 3D models

Handling Intersections

Improved segmentation with 3D shape priors Excellent performance when evaluated against marker-based system

bull Interactive inspection of light transport in virtual scenes ndash You can only manipulate what you see

ndash First prototypal light manipulation tools

bull Efficient global illumination ndash Otherwise no interactive

visualization nor manipulation

ndash Improvements on many-lights methods and progressive photon mapping

bull Results ndash Demonstrator Maya plugin ndash Collaboration with local film academy

Visualization and Editing of Light Transport Carsten Dachsbacher

Advanced Real-Time Ray Tracing Techniques Philipp Slusallek

bull Perfect importance sampling and caching ndash Sparse but perfect importance sampling

ndash Caching and interpolation [Eurographics`12]

bull Unifying Photon-Mapping amp Monte-Carlo ndash Formulating PM as a MC process

ndash Per pixel combination using MIS

bull Data-parallel implementations

ndash Efficiency and performance

bull Integration into XML3D

ndash Provide ldquocorrectrdquo results by default

Vertex Merging with Multiple Importance Sampling Photon-Mapping as a Monte-Carlo Process

BPT

PPM Progressive Photon-Mapping (PPM)

Bidirectional Path Tracing (BPT)

bull Whole-Function Vectorization ndash Restore scalar computations

ndash LLVM platform-independent

ndash RenderMan frontend OpenCL driver

bull Vector Programming ndash Formalized C extension for portable

effective SIMD programming

ndash Type system triggers vectorization

ndash Data layout adaption

bull New Programming Models for High-Performance Graphics

bull Results ndash Demonstrators for shaders and HPC code

ndash CC++-Extensions (with Intel)

ndash OpenCL compiler (CPU)

Compiler Support for High-Performance Graphics Sebastian Hack

bull Hybrid Rendering ndash Client amp Server Model

ndash Smartphone to Mainframe

bull Large Data Processing ndash Scalable Hierarchical

RW Data Structures

bull Results ndash ZAPP displaywall demonstrator

ndash ImageVis3D (Mobile) demonstrator

ndash Practically use in hospitals

Scalable Hybrid Rendering for Large Scale Visualization Jens Kruumlger

Displays as a Service Large Scale Visualization Alexander Loumlffler

bull Virtualization of Displays ndash Virtual Framebuffer and Displays exposed to Internet

ndash Replacing cables by switched IP network

ndash Internet standards for video encoding and streaming

bull Fully Synchronized ndash 120 Hz active stereo sync over IP

ndash Accuracy of ~100us in software

ndash Drives GPU displays output

bull Results ndash 20-screen wall demonstrator

ndash 3-screen wall (thin-bezel)

ndash CE4100 based SW synchronization

SIGGRAPH 2012

Backup

The Intel Science and Technology Center (ISTC) and Intel Collaborative Research Institute (ICRI) Programs

35

The modern economy is an information economy and one that is driven by innovations that enhance productivity as well as create new modes of entertainment We need to invest in the basic research that will inspire future products and services and ensure long term health of our information economy Government and private foundations are helping but corporate America needs to step up and increase commitments to university research - Justin Rattner ndash Intel CTO

$140M investment over 5 years announced by Intel in 2011 and 2012

Centers of Excellence bull Each ISTC and ICRI will focus on one

research area eg visual computing secure computing

bull The ISTCs and ICRIs are meant to bring the best and brightest researchers across the US together

bull Each ISTC and ICRI will be led by a host university and will include thought leaders from other schools

Breaking Barriers to Collaboration

bull Open IP models and open source software to encourage free information exchange (In most of the Centers)

bull Favor projects that span multiple institutions to encourage collaboration among universities

bull Intel researches per center assigned to work on-campus to encourage collaboration between Intel and academia

Greater Impact to Future Tech bull Center research themes to

address essential needs of computing technology

bull Research agendas jointly defined and co-led by an Intel and a University Principal Investigator

bull After completing 3-5 year charters new ISTCs and ICRIs can be formed to respond to changing tech environment

httpfolditportal

Serious Gaming pplied to Content Creation

Highlighted by President Obama Winner of most-significant new visualization tool (NSF)

Goal Create high-quality content by casting creation activities as games in which large numbers of people are incentivized to perform simple tasks which in combination yield sophisticated content PIs Zoran Popovic (UW) Noah Snavely (Cornell) Maneesh Agrawala(Berkeley)

Determining the structure of retroviral protease (HIV)

Video Frank to add Papers Frank to add

Extracting Structure and Semantics

CAD Model Points

Structures

People

Goals Enable context aware computing and automated content creation through the capture analysis and manipulation of real-world visual data PIs Steve Seitz (UW) Noah Snavely (Cornell) Tom Funkhouser (Princeton) Vladlen Koltun (Stanford) Jitendra Malik (Berkeley) Deva Ramanan (UV Irvine)

Video Frank to add Papers Frank to add

httpvisualstanfordedu

Computational Photography (Franken Camera)

Being adopted as a standard API for cellphone camera systems (Apple Android)

bull Goal Develop algorithms languages architectures and prototypes demonstrating the use of computation in the process of image capture and display

bull PIs Marc Levoy (Stanford) Mark Horowitz (Stanford) Pat Hanrahan (Stanford)

Video Frank to add Papers Frank to add

ISTC-VC SIGGRAPH Papers

Character Locomotion Monday 6 August 900 AM - 1030 AM Optimizing Locomotion Controllers Using Biologically Based Actuators and Objectives Jack M Wang Samuel R Hamner Scott L Delp Vladlen Koltun Continuous Character Control With Low-Dimensional Embeddings Sergey Levine Jack M Wang Alexis Haraux Zoran Popović Vladlen Koltun Shape Analysis Monday 6 August 900 AM - 1030 AM Schelling Points on 3D Surface Meshes Xiaobai Chen Abulhair Saparov Bill Pang Thomas Funkhouser Shape Transformation Wednesday 8 August 900 - 1030 AM An Algebraic Model for Parameterized Shape Editing Martin Bokeloh Michael Wand Hans-Peter Seidel Vladlen Koltun

42

ISTC-VC SIGGRAPH Papers

Image Processing Monday 6 August 2- 330 pm Decoupling Algorithms From Schedules for Easy Optimization of Image-Processing Pipelines Jonathan Ragan-Kelley Andrew Adams Sylvain Paris Marc Levoy Saman Amarasinghe Freacutedo Durand

Cloth

Monday 6 August 2-330 pm Specular Reflection From Woven Cloth Piti Irawan Steve Marschner Stitch Meshes for Modeling Knitted Clothing With Yarn-level Detail Cem Yuksel Jonathan M Kaldor Doug L James Steve Marschner

Appearance

Monday 6 August 345-535 pm Printing Spatially Varying Reflectance for Reproducing HDR Images Yue Dong Xin Tong Fabio Pellacini Baining Guo

43

ISTC-VC SIGGRAPH Papers (cont)

Hand Eye and Face Monday 6 August 345-535 pm Session Chair - Vladlen Koltun Discovery of Complex Behaviors through Contact-Invariant Optimization Igor Mordatch Emanuel Todorov Zoran Popovi1049029 Sketching Monday 6 August 345-535 pm HelpingHand Example-Based Stroke Stylization Jingwan Lu Fisher Yu Adam Finkelstein Stephen DiVerdi Fabrication Tuesday 7 August 9-1030 am Fabricating Articulated Characters From Skinned Meshes Moritz Baumlcher Bernd Bickel Doug L James Hanspeter Pfister

44

Sampling Reconstructing and Filtering Light Tuesday 7 August 1045 am-1215 pm A Theory of Monte Carlo Visibility Sampling Ravi Ramamoorthi John Anderson Mark Meyer Derek Nowrouzezahrai Reconstructing the Indirect Light Field for Global Illumination Jaakko Lehtinen Timo Aila Samuli Laine Freacutedo Durand

Geometry Reconstruction amp Tracking

Tuesday 7 August 1045 am-1215 pm Temporally Coherent Completion of Dynamic Shapes Hao Li Linjie Luo Daniel Vlasic Pieter Peers Jovan Popovic Mark Pauly Szymon Rusinkiewicz

Sets of Shapes

Tuesday 7 August 2-330 pm Exploring Collections of 3D Models Using Fuzzy Correspondence Vladimir G Kim Wilmot Li Niloy J Mitra Stephen DiVerdi Thomas Funkhouser A Probabilistic Model for Component-Based Shape Synthesis Evangelos Kalogerakis Siddhartha Chaudhuri Daphne Koller Vladlen Koltun

45

ISTC-VC SIGGRAPH Papers (cont)

Light Rays Tuesday 7 August 2-330 pm Manifold Exploration A Markov Chain Monte Carlo Technique for Rendering Scenes With Difficult Specular Transport Wenzel Jakob Steve Marschner Bidirectional Lightcuts Bruce Walter Pramook Khungurn Kavita Bala

Fun With Video

Tuesday 7 August 345-535 pm Session Chair Noah Snavely Video Deblurring for Hand-Held Cameras Using Patch-Based Synthesis Sunghyun Cho Jue Wang Seungyong Lee Eulerian Video Magnification for Revealing Subtle Changes in the World Hao-Yu Wu Michael Rubinstein Eugene Shih John Guttag Freacutedo Durand William T Freeman Selectively De-Animating Video Jiamin Bai Aseem Agarwala Maneesh Agrawala Ravi Ramamoorthi Tools for Placing Cuts and Transitions in Interview Video Floraine Berthouzoz Wilmot Li Maneesh Agrawala

46

ISTC-VC SIGGRAPH Papers (cont)

Noise and Texture Tuesday 7 August 345-535 pm Structure-Aware Synthesis for Predictive Woven Fabric Appearance Shuang Zhao Kavita Bala Steve Marschner Wenzel Jakob Symmetry-Guided Texture Synthesis and Manipulation Vladimir Kim Yaron Lipman Thomas Funkhouser

Shape Transformation Wednesday 8 August 900 - 1030 AM An Algebraic Model for Parameterized Shape Editing Martin Bokeloh Michael Wand Hans-Peter Seidel Vladlen Koltun

Stitching

Wednesday 8 August 1045 am-1215 pm Exposing Photo Manipulation With Inconsistent Reflections James F OrsquoBrien Hany Farid

47

ISTC-VC SIGGRAPH Papers (cont)

Maps Surfaces and Shapes

Wednesday 8 August 1045 am-1215 pm Simple Formulas For Quasiconformal Plane Deformations Yaron Lipman Vladimir G Kim Thomas Funkhouser

Interactive Systems amp Hardware Wednesday 8 August 2-330 pm Position-Correcting Tools for 2D Digital Fabrication Alec Rivers Ilan E Moyer Freacutedo Durand

48

ISTC-VC SIGGRAPH Papers (cont)

Collisions Wednesday 8 August 345-535 pm Energy-Based Self-Collision Culling for Arbitrary Mesh Deformations Changxi Zheng Doug L James

All About Images

Thursday 9 August 9-1030 am A Framework for Content-Adaptive Photo Manipulation Macros Application to Face Landscape and Global Manipulations Floraine Berthouzoz Wilmot Li Mira Dontcheva Maneesh Agrawala

Sound and Elements

Thursday 9 August 9-1030 am Motion-Driven Concatenative Synthesis of Cloth Sounds Steven S An Doug L James Steve Marschner Precomputed Acceleration Noise for Improved Rigid-Body Sound Jeffrey N Chadwick Changxi Zheng Doug L James Interactive Sound Propagation Using Compact Acoustic Transfer Operators Lakulish Antani Anish Chandak Lauri Savioja Dinesh Manocha Updated Sparse Cholesky Factors for Corotational Elastodynamics Florian Hecht Yeon Jin Lee Jonathan R Shewchuk James F OrsquoBrien

49

ISTC-VC SIGGRAPH Papers (cont)

Geometry amp Viewing Thursday 9 August 2-330 pm Perceptual Models of Viewpoint Preference Adrian Secordm Jingwan Lu Adam Finkelstein Manish Singh Andrew Nealen

Faces and Hair [Closing Session]

Thursday 9 August 345-515 pm Coupled 3D Reconstruction of Sparse Facial Hair and Skin Thabo Beeler Bernd Bickel Gioacchino Noris Paul Beardsley Steve Marschner Robert W Sumner Markus Gross Physical Face Cloning Bernd Bickel Peter Kaufmann Melina Skouras Bernhard Thomaszewski Derek Bradley Thabo Beeler Philip Jackson Steve Marschner Wojciech Matusik Markus Gross

50

ISTC-VC SIGGRAPH Papers (cont)

Siggraph Courses Optimizing Realistic Rendering With Many-Light Methods Sunday 5 August 2-515 pm Jaroslav Krivanek Milos Hasan Adam Arbree Carsten Dachsbacher Alexander Keller Bruce Walter State of the Art in Photon-Density Estimation Thursday 9 August 2-515 pm Toshiya Hachisuka Wojciech Jarosz Guillaume Bouchard Per Christensen Jeppe Revall Frisvad Wenzel Jakob Henrik Wann Jensen Jared M Johnson Michael Kaschalk Claude Knaus Andrew Selle Ben Spencer

Siggraph Talks

Silence Eliminate the Noise Thursday 9 August 9-1030 am Importance Sampling for Hair Scattering Jiawei Ou Feng Xie Parashar Krishnamachari Fabio Pellacini

Siggraph Exhibitor Sessions

Intel Corporation Wednesday 8 August 430-530 pm room 402B The Future of Visual Computing as Viewed by Intel Visual Computing Research Centers

51

Other ISTC-VC SIGGRAPH Participation

Page 21: Future of Visual Computing as viewed by Intel Visual ... · PDF fileFuture of Visual Computing as viewed by Intel Visual Computing Research Centers ... Justin Rattner Intel Science

Video Inpainting in Dynamic Scenes amp Videoscape for moving through Internet Videos

Efficient High-Quality Rendering Using Sample-based Representations Elmar Eisemann

bull Realistic Rendering ndash Lens Flare [Siggraphrsquo11]

ndash Depth-of-field [Eurographics lsquo11]

ndash Global Illumination [PGrsquo11]

bull Perceptual Rendering ndash Stereo

ndash High Dynamic Range

bull Alternative representations ndash Voxel Data

ndash Height Fields

3D Internet Interactive 3D Content on the Web Philipp Slusallek

bull XML3D Scene Description ndash HTML-5 extension for interactive graphics

ndash JS implementation amp built into the browser

ndash Reuses Web Technology (DOM CSS JS)

bull XFLOW Parallel Processing ndash Data-parallel flowgraph for XML3D

ndash Animations image amp geometry processing

ndash Configuration within the DOM

bull Results ndash W3C standardization ldquoDeclarative 3D for the Webrdquo

ndash Rich media apps for BMW SLS-Museum hellip

3D-Internet Apps SLS-Museum 3D-Installation amp Museum with Interactive Virtual Characters

3D-Internet Apps Using OpenStreetMap-3D as Shared Virtual Worlds

Fully automatically generated from OpenStreet Map Taking semantic data into acount

Marker-free Performance Capture Christian Theobalt

bull Reconstruction of detailed human animation models ndash In Multi-view video without markers

ndash Out Detailed motion shape and appearance

ndash General clothing modifiable performances new animations

bull Real-time performance capture ndash Fast full-body motion estimation from depth

cameras

ndash Interaction

ndash Collaboration with Intel Magic Mirror project

[ICCV 2011]

[SIGGRAPH Asia 2010]

Markerless Motion Capture of Interacting Characters Using Multi-view Image Segmentation

Articulated Models Input silhouettes Segmentation Contour labels Estimated surface Estimated 3D models

Handling Intersections

Improved segmentation with 3D shape priors Excellent performance when evaluated against marker-based system

bull Interactive inspection of light transport in virtual scenes ndash You can only manipulate what you see

ndash First prototypal light manipulation tools

bull Efficient global illumination ndash Otherwise no interactive

visualization nor manipulation

ndash Improvements on many-lights methods and progressive photon mapping

bull Results ndash Demonstrator Maya plugin ndash Collaboration with local film academy

Visualization and Editing of Light Transport Carsten Dachsbacher

Advanced Real-Time Ray Tracing Techniques Philipp Slusallek

bull Perfect importance sampling and caching ndash Sparse but perfect importance sampling

ndash Caching and interpolation [Eurographics`12]

bull Unifying Photon-Mapping amp Monte-Carlo ndash Formulating PM as a MC process

ndash Per pixel combination using MIS

bull Data-parallel implementations

ndash Efficiency and performance

bull Integration into XML3D

ndash Provide ldquocorrectrdquo results by default

Vertex Merging with Multiple Importance Sampling Photon-Mapping as a Monte-Carlo Process

BPT

PPM Progressive Photon-Mapping (PPM)

Bidirectional Path Tracing (BPT)

bull Whole-Function Vectorization ndash Restore scalar computations

ndash LLVM platform-independent

ndash RenderMan frontend OpenCL driver

bull Vector Programming ndash Formalized C extension for portable

effective SIMD programming

ndash Type system triggers vectorization

ndash Data layout adaption

bull New Programming Models for High-Performance Graphics

bull Results ndash Demonstrators for shaders and HPC code

ndash CC++-Extensions (with Intel)

ndash OpenCL compiler (CPU)

Compiler Support for High-Performance Graphics Sebastian Hack

bull Hybrid Rendering ndash Client amp Server Model

ndash Smartphone to Mainframe

bull Large Data Processing ndash Scalable Hierarchical

RW Data Structures

bull Results ndash ZAPP displaywall demonstrator

ndash ImageVis3D (Mobile) demonstrator

ndash Practically use in hospitals

Scalable Hybrid Rendering for Large Scale Visualization Jens Kruumlger

Displays as a Service Large Scale Visualization Alexander Loumlffler

bull Virtualization of Displays ndash Virtual Framebuffer and Displays exposed to Internet

ndash Replacing cables by switched IP network

ndash Internet standards for video encoding and streaming

bull Fully Synchronized ndash 120 Hz active stereo sync over IP

ndash Accuracy of ~100us in software

ndash Drives GPU displays output

bull Results ndash 20-screen wall demonstrator

ndash 3-screen wall (thin-bezel)

ndash CE4100 based SW synchronization

SIGGRAPH 2012

Backup

The Intel Science and Technology Center (ISTC) and Intel Collaborative Research Institute (ICRI) Programs

35

The modern economy is an information economy and one that is driven by innovations that enhance productivity as well as create new modes of entertainment We need to invest in the basic research that will inspire future products and services and ensure long term health of our information economy Government and private foundations are helping but corporate America needs to step up and increase commitments to university research - Justin Rattner ndash Intel CTO

$140M investment over 5 years announced by Intel in 2011 and 2012

Centers of Excellence bull Each ISTC and ICRI will focus on one

research area eg visual computing secure computing

bull The ISTCs and ICRIs are meant to bring the best and brightest researchers across the US together

bull Each ISTC and ICRI will be led by a host university and will include thought leaders from other schools

Breaking Barriers to Collaboration

bull Open IP models and open source software to encourage free information exchange (In most of the Centers)

bull Favor projects that span multiple institutions to encourage collaboration among universities

bull Intel researches per center assigned to work on-campus to encourage collaboration between Intel and academia

Greater Impact to Future Tech bull Center research themes to

address essential needs of computing technology

bull Research agendas jointly defined and co-led by an Intel and a University Principal Investigator

bull After completing 3-5 year charters new ISTCs and ICRIs can be formed to respond to changing tech environment

httpfolditportal

Serious Gaming pplied to Content Creation

Highlighted by President Obama Winner of most-significant new visualization tool (NSF)

Goal Create high-quality content by casting creation activities as games in which large numbers of people are incentivized to perform simple tasks which in combination yield sophisticated content PIs Zoran Popovic (UW) Noah Snavely (Cornell) Maneesh Agrawala(Berkeley)

Determining the structure of retroviral protease (HIV)

Video Frank to add Papers Frank to add

Extracting Structure and Semantics

CAD Model Points

Structures

People

Goals Enable context aware computing and automated content creation through the capture analysis and manipulation of real-world visual data PIs Steve Seitz (UW) Noah Snavely (Cornell) Tom Funkhouser (Princeton) Vladlen Koltun (Stanford) Jitendra Malik (Berkeley) Deva Ramanan (UV Irvine)

Video Frank to add Papers Frank to add

httpvisualstanfordedu

Computational Photography (Franken Camera)

Being adopted as a standard API for cellphone camera systems (Apple Android)

bull Goal Develop algorithms languages architectures and prototypes demonstrating the use of computation in the process of image capture and display

bull PIs Marc Levoy (Stanford) Mark Horowitz (Stanford) Pat Hanrahan (Stanford)

Video Frank to add Papers Frank to add

ISTC-VC SIGGRAPH Papers

Character Locomotion Monday 6 August 900 AM - 1030 AM Optimizing Locomotion Controllers Using Biologically Based Actuators and Objectives Jack M Wang Samuel R Hamner Scott L Delp Vladlen Koltun Continuous Character Control With Low-Dimensional Embeddings Sergey Levine Jack M Wang Alexis Haraux Zoran Popović Vladlen Koltun Shape Analysis Monday 6 August 900 AM - 1030 AM Schelling Points on 3D Surface Meshes Xiaobai Chen Abulhair Saparov Bill Pang Thomas Funkhouser Shape Transformation Wednesday 8 August 900 - 1030 AM An Algebraic Model for Parameterized Shape Editing Martin Bokeloh Michael Wand Hans-Peter Seidel Vladlen Koltun

42

ISTC-VC SIGGRAPH Papers

Image Processing Monday 6 August 2- 330 pm Decoupling Algorithms From Schedules for Easy Optimization of Image-Processing Pipelines Jonathan Ragan-Kelley Andrew Adams Sylvain Paris Marc Levoy Saman Amarasinghe Freacutedo Durand

Cloth

Monday 6 August 2-330 pm Specular Reflection From Woven Cloth Piti Irawan Steve Marschner Stitch Meshes for Modeling Knitted Clothing With Yarn-level Detail Cem Yuksel Jonathan M Kaldor Doug L James Steve Marschner

Appearance

Monday 6 August 345-535 pm Printing Spatially Varying Reflectance for Reproducing HDR Images Yue Dong Xin Tong Fabio Pellacini Baining Guo

43

ISTC-VC SIGGRAPH Papers (cont)

Hand Eye and Face Monday 6 August 345-535 pm Session Chair - Vladlen Koltun Discovery of Complex Behaviors through Contact-Invariant Optimization Igor Mordatch Emanuel Todorov Zoran Popovi1049029 Sketching Monday 6 August 345-535 pm HelpingHand Example-Based Stroke Stylization Jingwan Lu Fisher Yu Adam Finkelstein Stephen DiVerdi Fabrication Tuesday 7 August 9-1030 am Fabricating Articulated Characters From Skinned Meshes Moritz Baumlcher Bernd Bickel Doug L James Hanspeter Pfister

44

Sampling Reconstructing and Filtering Light Tuesday 7 August 1045 am-1215 pm A Theory of Monte Carlo Visibility Sampling Ravi Ramamoorthi John Anderson Mark Meyer Derek Nowrouzezahrai Reconstructing the Indirect Light Field for Global Illumination Jaakko Lehtinen Timo Aila Samuli Laine Freacutedo Durand

Geometry Reconstruction amp Tracking

Tuesday 7 August 1045 am-1215 pm Temporally Coherent Completion of Dynamic Shapes Hao Li Linjie Luo Daniel Vlasic Pieter Peers Jovan Popovic Mark Pauly Szymon Rusinkiewicz

Sets of Shapes

Tuesday 7 August 2-330 pm Exploring Collections of 3D Models Using Fuzzy Correspondence Vladimir G Kim Wilmot Li Niloy J Mitra Stephen DiVerdi Thomas Funkhouser A Probabilistic Model for Component-Based Shape Synthesis Evangelos Kalogerakis Siddhartha Chaudhuri Daphne Koller Vladlen Koltun

45

ISTC-VC SIGGRAPH Papers (cont)

Light Rays Tuesday 7 August 2-330 pm Manifold Exploration A Markov Chain Monte Carlo Technique for Rendering Scenes With Difficult Specular Transport Wenzel Jakob Steve Marschner Bidirectional Lightcuts Bruce Walter Pramook Khungurn Kavita Bala

Fun With Video

Tuesday 7 August 345-535 pm Session Chair Noah Snavely Video Deblurring for Hand-Held Cameras Using Patch-Based Synthesis Sunghyun Cho Jue Wang Seungyong Lee Eulerian Video Magnification for Revealing Subtle Changes in the World Hao-Yu Wu Michael Rubinstein Eugene Shih John Guttag Freacutedo Durand William T Freeman Selectively De-Animating Video Jiamin Bai Aseem Agarwala Maneesh Agrawala Ravi Ramamoorthi Tools for Placing Cuts and Transitions in Interview Video Floraine Berthouzoz Wilmot Li Maneesh Agrawala

46

ISTC-VC SIGGRAPH Papers (cont)

Noise and Texture Tuesday 7 August 345-535 pm Structure-Aware Synthesis for Predictive Woven Fabric Appearance Shuang Zhao Kavita Bala Steve Marschner Wenzel Jakob Symmetry-Guided Texture Synthesis and Manipulation Vladimir Kim Yaron Lipman Thomas Funkhouser

Shape Transformation Wednesday 8 August 900 - 1030 AM An Algebraic Model for Parameterized Shape Editing Martin Bokeloh Michael Wand Hans-Peter Seidel Vladlen Koltun

Stitching

Wednesday 8 August 1045 am-1215 pm Exposing Photo Manipulation With Inconsistent Reflections James F OrsquoBrien Hany Farid

47

ISTC-VC SIGGRAPH Papers (cont)

Maps Surfaces and Shapes

Wednesday 8 August 1045 am-1215 pm Simple Formulas For Quasiconformal Plane Deformations Yaron Lipman Vladimir G Kim Thomas Funkhouser

Interactive Systems amp Hardware Wednesday 8 August 2-330 pm Position-Correcting Tools for 2D Digital Fabrication Alec Rivers Ilan E Moyer Freacutedo Durand

48

ISTC-VC SIGGRAPH Papers (cont)

Collisions Wednesday 8 August 345-535 pm Energy-Based Self-Collision Culling for Arbitrary Mesh Deformations Changxi Zheng Doug L James

All About Images

Thursday 9 August 9-1030 am A Framework for Content-Adaptive Photo Manipulation Macros Application to Face Landscape and Global Manipulations Floraine Berthouzoz Wilmot Li Mira Dontcheva Maneesh Agrawala

Sound and Elements

Thursday 9 August 9-1030 am Motion-Driven Concatenative Synthesis of Cloth Sounds Steven S An Doug L James Steve Marschner Precomputed Acceleration Noise for Improved Rigid-Body Sound Jeffrey N Chadwick Changxi Zheng Doug L James Interactive Sound Propagation Using Compact Acoustic Transfer Operators Lakulish Antani Anish Chandak Lauri Savioja Dinesh Manocha Updated Sparse Cholesky Factors for Corotational Elastodynamics Florian Hecht Yeon Jin Lee Jonathan R Shewchuk James F OrsquoBrien

49

ISTC-VC SIGGRAPH Papers (cont)

Geometry amp Viewing Thursday 9 August 2-330 pm Perceptual Models of Viewpoint Preference Adrian Secordm Jingwan Lu Adam Finkelstein Manish Singh Andrew Nealen

Faces and Hair [Closing Session]

Thursday 9 August 345-515 pm Coupled 3D Reconstruction of Sparse Facial Hair and Skin Thabo Beeler Bernd Bickel Gioacchino Noris Paul Beardsley Steve Marschner Robert W Sumner Markus Gross Physical Face Cloning Bernd Bickel Peter Kaufmann Melina Skouras Bernhard Thomaszewski Derek Bradley Thabo Beeler Philip Jackson Steve Marschner Wojciech Matusik Markus Gross

50

ISTC-VC SIGGRAPH Papers (cont)

Siggraph Courses Optimizing Realistic Rendering With Many-Light Methods Sunday 5 August 2-515 pm Jaroslav Krivanek Milos Hasan Adam Arbree Carsten Dachsbacher Alexander Keller Bruce Walter State of the Art in Photon-Density Estimation Thursday 9 August 2-515 pm Toshiya Hachisuka Wojciech Jarosz Guillaume Bouchard Per Christensen Jeppe Revall Frisvad Wenzel Jakob Henrik Wann Jensen Jared M Johnson Michael Kaschalk Claude Knaus Andrew Selle Ben Spencer

Siggraph Talks

Silence Eliminate the Noise Thursday 9 August 9-1030 am Importance Sampling for Hair Scattering Jiawei Ou Feng Xie Parashar Krishnamachari Fabio Pellacini

Siggraph Exhibitor Sessions

Intel Corporation Wednesday 8 August 430-530 pm room 402B The Future of Visual Computing as Viewed by Intel Visual Computing Research Centers

51

Other ISTC-VC SIGGRAPH Participation

Page 22: Future of Visual Computing as viewed by Intel Visual ... · PDF fileFuture of Visual Computing as viewed by Intel Visual Computing Research Centers ... Justin Rattner Intel Science

Efficient High-Quality Rendering Using Sample-based Representations Elmar Eisemann

bull Realistic Rendering ndash Lens Flare [Siggraphrsquo11]

ndash Depth-of-field [Eurographics lsquo11]

ndash Global Illumination [PGrsquo11]

bull Perceptual Rendering ndash Stereo

ndash High Dynamic Range

bull Alternative representations ndash Voxel Data

ndash Height Fields

3D Internet Interactive 3D Content on the Web Philipp Slusallek

bull XML3D Scene Description ndash HTML-5 extension for interactive graphics

ndash JS implementation amp built into the browser

ndash Reuses Web Technology (DOM CSS JS)

bull XFLOW Parallel Processing ndash Data-parallel flowgraph for XML3D

ndash Animations image amp geometry processing

ndash Configuration within the DOM

bull Results ndash W3C standardization ldquoDeclarative 3D for the Webrdquo

ndash Rich media apps for BMW SLS-Museum hellip

3D-Internet Apps SLS-Museum 3D-Installation amp Museum with Interactive Virtual Characters

3D-Internet Apps Using OpenStreetMap-3D as Shared Virtual Worlds

Fully automatically generated from OpenStreet Map Taking semantic data into acount

Marker-free Performance Capture Christian Theobalt

bull Reconstruction of detailed human animation models ndash In Multi-view video without markers

ndash Out Detailed motion shape and appearance

ndash General clothing modifiable performances new animations

bull Real-time performance capture ndash Fast full-body motion estimation from depth

cameras

ndash Interaction

ndash Collaboration with Intel Magic Mirror project

[ICCV 2011]

[SIGGRAPH Asia 2010]

Markerless Motion Capture of Interacting Characters Using Multi-view Image Segmentation

Articulated Models Input silhouettes Segmentation Contour labels Estimated surface Estimated 3D models

Handling Intersections

Improved segmentation with 3D shape priors Excellent performance when evaluated against marker-based system

bull Interactive inspection of light transport in virtual scenes ndash You can only manipulate what you see

ndash First prototypal light manipulation tools

bull Efficient global illumination ndash Otherwise no interactive

visualization nor manipulation

ndash Improvements on many-lights methods and progressive photon mapping

bull Results ndash Demonstrator Maya plugin ndash Collaboration with local film academy

Visualization and Editing of Light Transport Carsten Dachsbacher

Advanced Real-Time Ray Tracing Techniques Philipp Slusallek

bull Perfect importance sampling and caching ndash Sparse but perfect importance sampling

ndash Caching and interpolation [Eurographics`12]

bull Unifying Photon-Mapping amp Monte-Carlo ndash Formulating PM as a MC process

ndash Per pixel combination using MIS

bull Data-parallel implementations

ndash Efficiency and performance

bull Integration into XML3D

ndash Provide ldquocorrectrdquo results by default

Vertex Merging with Multiple Importance Sampling Photon-Mapping as a Monte-Carlo Process

BPT

PPM Progressive Photon-Mapping (PPM)

Bidirectional Path Tracing (BPT)

bull Whole-Function Vectorization ndash Restore scalar computations

ndash LLVM platform-independent

ndash RenderMan frontend OpenCL driver

bull Vector Programming ndash Formalized C extension for portable

effective SIMD programming

ndash Type system triggers vectorization

ndash Data layout adaption

bull New Programming Models for High-Performance Graphics

bull Results ndash Demonstrators for shaders and HPC code

ndash CC++-Extensions (with Intel)

ndash OpenCL compiler (CPU)

Compiler Support for High-Performance Graphics Sebastian Hack

bull Hybrid Rendering ndash Client amp Server Model

ndash Smartphone to Mainframe

bull Large Data Processing ndash Scalable Hierarchical

RW Data Structures

bull Results ndash ZAPP displaywall demonstrator

ndash ImageVis3D (Mobile) demonstrator

ndash Practically use in hospitals

Scalable Hybrid Rendering for Large Scale Visualization Jens Kruumlger

Displays as a Service Large Scale Visualization Alexander Loumlffler

bull Virtualization of Displays ndash Virtual Framebuffer and Displays exposed to Internet

ndash Replacing cables by switched IP network

ndash Internet standards for video encoding and streaming

bull Fully Synchronized ndash 120 Hz active stereo sync over IP

ndash Accuracy of ~100us in software

ndash Drives GPU displays output

bull Results ndash 20-screen wall demonstrator

ndash 3-screen wall (thin-bezel)

ndash CE4100 based SW synchronization

SIGGRAPH 2012

Backup

The Intel Science and Technology Center (ISTC) and Intel Collaborative Research Institute (ICRI) Programs

35

The modern economy is an information economy and one that is driven by innovations that enhance productivity as well as create new modes of entertainment We need to invest in the basic research that will inspire future products and services and ensure long term health of our information economy Government and private foundations are helping but corporate America needs to step up and increase commitments to university research - Justin Rattner ndash Intel CTO

$140M investment over 5 years announced by Intel in 2011 and 2012

Centers of Excellence bull Each ISTC and ICRI will focus on one

research area eg visual computing secure computing

bull The ISTCs and ICRIs are meant to bring the best and brightest researchers across the US together

bull Each ISTC and ICRI will be led by a host university and will include thought leaders from other schools

Breaking Barriers to Collaboration

bull Open IP models and open source software to encourage free information exchange (In most of the Centers)

bull Favor projects that span multiple institutions to encourage collaboration among universities

bull Intel researches per center assigned to work on-campus to encourage collaboration between Intel and academia

Greater Impact to Future Tech bull Center research themes to

address essential needs of computing technology

bull Research agendas jointly defined and co-led by an Intel and a University Principal Investigator

bull After completing 3-5 year charters new ISTCs and ICRIs can be formed to respond to changing tech environment

httpfolditportal

Serious Gaming pplied to Content Creation

Highlighted by President Obama Winner of most-significant new visualization tool (NSF)

Goal Create high-quality content by casting creation activities as games in which large numbers of people are incentivized to perform simple tasks which in combination yield sophisticated content PIs Zoran Popovic (UW) Noah Snavely (Cornell) Maneesh Agrawala(Berkeley)

Determining the structure of retroviral protease (HIV)

Video Frank to add Papers Frank to add

Extracting Structure and Semantics

CAD Model Points

Structures

People

Goals Enable context aware computing and automated content creation through the capture analysis and manipulation of real-world visual data PIs Steve Seitz (UW) Noah Snavely (Cornell) Tom Funkhouser (Princeton) Vladlen Koltun (Stanford) Jitendra Malik (Berkeley) Deva Ramanan (UV Irvine)

Video Frank to add Papers Frank to add

httpvisualstanfordedu

Computational Photography (Franken Camera)

Being adopted as a standard API for cellphone camera systems (Apple Android)

bull Goal Develop algorithms languages architectures and prototypes demonstrating the use of computation in the process of image capture and display

bull PIs Marc Levoy (Stanford) Mark Horowitz (Stanford) Pat Hanrahan (Stanford)

Video Frank to add Papers Frank to add

ISTC-VC SIGGRAPH Papers

Character Locomotion Monday 6 August 900 AM - 1030 AM Optimizing Locomotion Controllers Using Biologically Based Actuators and Objectives Jack M Wang Samuel R Hamner Scott L Delp Vladlen Koltun Continuous Character Control With Low-Dimensional Embeddings Sergey Levine Jack M Wang Alexis Haraux Zoran Popović Vladlen Koltun Shape Analysis Monday 6 August 900 AM - 1030 AM Schelling Points on 3D Surface Meshes Xiaobai Chen Abulhair Saparov Bill Pang Thomas Funkhouser Shape Transformation Wednesday 8 August 900 - 1030 AM An Algebraic Model for Parameterized Shape Editing Martin Bokeloh Michael Wand Hans-Peter Seidel Vladlen Koltun

42

ISTC-VC SIGGRAPH Papers

Image Processing Monday 6 August 2- 330 pm Decoupling Algorithms From Schedules for Easy Optimization of Image-Processing Pipelines Jonathan Ragan-Kelley Andrew Adams Sylvain Paris Marc Levoy Saman Amarasinghe Freacutedo Durand

Cloth

Monday 6 August 2-330 pm Specular Reflection From Woven Cloth Piti Irawan Steve Marschner Stitch Meshes for Modeling Knitted Clothing With Yarn-level Detail Cem Yuksel Jonathan M Kaldor Doug L James Steve Marschner

Appearance

Monday 6 August 345-535 pm Printing Spatially Varying Reflectance for Reproducing HDR Images Yue Dong Xin Tong Fabio Pellacini Baining Guo

43

ISTC-VC SIGGRAPH Papers (cont)

Hand Eye and Face Monday 6 August 345-535 pm Session Chair - Vladlen Koltun Discovery of Complex Behaviors through Contact-Invariant Optimization Igor Mordatch Emanuel Todorov Zoran Popovi1049029 Sketching Monday 6 August 345-535 pm HelpingHand Example-Based Stroke Stylization Jingwan Lu Fisher Yu Adam Finkelstein Stephen DiVerdi Fabrication Tuesday 7 August 9-1030 am Fabricating Articulated Characters From Skinned Meshes Moritz Baumlcher Bernd Bickel Doug L James Hanspeter Pfister

44

Sampling Reconstructing and Filtering Light Tuesday 7 August 1045 am-1215 pm A Theory of Monte Carlo Visibility Sampling Ravi Ramamoorthi John Anderson Mark Meyer Derek Nowrouzezahrai Reconstructing the Indirect Light Field for Global Illumination Jaakko Lehtinen Timo Aila Samuli Laine Freacutedo Durand

Geometry Reconstruction amp Tracking

Tuesday 7 August 1045 am-1215 pm Temporally Coherent Completion of Dynamic Shapes Hao Li Linjie Luo Daniel Vlasic Pieter Peers Jovan Popovic Mark Pauly Szymon Rusinkiewicz

Sets of Shapes

Tuesday 7 August 2-330 pm Exploring Collections of 3D Models Using Fuzzy Correspondence Vladimir G Kim Wilmot Li Niloy J Mitra Stephen DiVerdi Thomas Funkhouser A Probabilistic Model for Component-Based Shape Synthesis Evangelos Kalogerakis Siddhartha Chaudhuri Daphne Koller Vladlen Koltun

45

ISTC-VC SIGGRAPH Papers (cont)

Light Rays Tuesday 7 August 2-330 pm Manifold Exploration A Markov Chain Monte Carlo Technique for Rendering Scenes With Difficult Specular Transport Wenzel Jakob Steve Marschner Bidirectional Lightcuts Bruce Walter Pramook Khungurn Kavita Bala

Fun With Video

Tuesday 7 August 345-535 pm Session Chair Noah Snavely Video Deblurring for Hand-Held Cameras Using Patch-Based Synthesis Sunghyun Cho Jue Wang Seungyong Lee Eulerian Video Magnification for Revealing Subtle Changes in the World Hao-Yu Wu Michael Rubinstein Eugene Shih John Guttag Freacutedo Durand William T Freeman Selectively De-Animating Video Jiamin Bai Aseem Agarwala Maneesh Agrawala Ravi Ramamoorthi Tools for Placing Cuts and Transitions in Interview Video Floraine Berthouzoz Wilmot Li Maneesh Agrawala

46

ISTC-VC SIGGRAPH Papers (cont)

Noise and Texture Tuesday 7 August 345-535 pm Structure-Aware Synthesis for Predictive Woven Fabric Appearance Shuang Zhao Kavita Bala Steve Marschner Wenzel Jakob Symmetry-Guided Texture Synthesis and Manipulation Vladimir Kim Yaron Lipman Thomas Funkhouser

Shape Transformation Wednesday 8 August 900 - 1030 AM An Algebraic Model for Parameterized Shape Editing Martin Bokeloh Michael Wand Hans-Peter Seidel Vladlen Koltun

Stitching

Wednesday 8 August 1045 am-1215 pm Exposing Photo Manipulation With Inconsistent Reflections James F OrsquoBrien Hany Farid

47

ISTC-VC SIGGRAPH Papers (cont)

Maps Surfaces and Shapes

Wednesday 8 August 1045 am-1215 pm Simple Formulas For Quasiconformal Plane Deformations Yaron Lipman Vladimir G Kim Thomas Funkhouser

Interactive Systems amp Hardware Wednesday 8 August 2-330 pm Position-Correcting Tools for 2D Digital Fabrication Alec Rivers Ilan E Moyer Freacutedo Durand

48

ISTC-VC SIGGRAPH Papers (cont)

Collisions Wednesday 8 August 345-535 pm Energy-Based Self-Collision Culling for Arbitrary Mesh Deformations Changxi Zheng Doug L James

All About Images

Thursday 9 August 9-1030 am A Framework for Content-Adaptive Photo Manipulation Macros Application to Face Landscape and Global Manipulations Floraine Berthouzoz Wilmot Li Mira Dontcheva Maneesh Agrawala

Sound and Elements

Thursday 9 August 9-1030 am Motion-Driven Concatenative Synthesis of Cloth Sounds Steven S An Doug L James Steve Marschner Precomputed Acceleration Noise for Improved Rigid-Body Sound Jeffrey N Chadwick Changxi Zheng Doug L James Interactive Sound Propagation Using Compact Acoustic Transfer Operators Lakulish Antani Anish Chandak Lauri Savioja Dinesh Manocha Updated Sparse Cholesky Factors for Corotational Elastodynamics Florian Hecht Yeon Jin Lee Jonathan R Shewchuk James F OrsquoBrien

49

ISTC-VC SIGGRAPH Papers (cont)

Geometry amp Viewing Thursday 9 August 2-330 pm Perceptual Models of Viewpoint Preference Adrian Secordm Jingwan Lu Adam Finkelstein Manish Singh Andrew Nealen

Faces and Hair [Closing Session]

Thursday 9 August 345-515 pm Coupled 3D Reconstruction of Sparse Facial Hair and Skin Thabo Beeler Bernd Bickel Gioacchino Noris Paul Beardsley Steve Marschner Robert W Sumner Markus Gross Physical Face Cloning Bernd Bickel Peter Kaufmann Melina Skouras Bernhard Thomaszewski Derek Bradley Thabo Beeler Philip Jackson Steve Marschner Wojciech Matusik Markus Gross

50

ISTC-VC SIGGRAPH Papers (cont)

Siggraph Courses Optimizing Realistic Rendering With Many-Light Methods Sunday 5 August 2-515 pm Jaroslav Krivanek Milos Hasan Adam Arbree Carsten Dachsbacher Alexander Keller Bruce Walter State of the Art in Photon-Density Estimation Thursday 9 August 2-515 pm Toshiya Hachisuka Wojciech Jarosz Guillaume Bouchard Per Christensen Jeppe Revall Frisvad Wenzel Jakob Henrik Wann Jensen Jared M Johnson Michael Kaschalk Claude Knaus Andrew Selle Ben Spencer

Siggraph Talks

Silence Eliminate the Noise Thursday 9 August 9-1030 am Importance Sampling for Hair Scattering Jiawei Ou Feng Xie Parashar Krishnamachari Fabio Pellacini

Siggraph Exhibitor Sessions

Intel Corporation Wednesday 8 August 430-530 pm room 402B The Future of Visual Computing as Viewed by Intel Visual Computing Research Centers

51

Other ISTC-VC SIGGRAPH Participation

Page 23: Future of Visual Computing as viewed by Intel Visual ... · PDF fileFuture of Visual Computing as viewed by Intel Visual Computing Research Centers ... Justin Rattner Intel Science

3D Internet Interactive 3D Content on the Web Philipp Slusallek

bull XML3D Scene Description ndash HTML-5 extension for interactive graphics

ndash JS implementation amp built into the browser

ndash Reuses Web Technology (DOM CSS JS)

bull XFLOW Parallel Processing ndash Data-parallel flowgraph for XML3D

ndash Animations image amp geometry processing

ndash Configuration within the DOM

bull Results ndash W3C standardization ldquoDeclarative 3D for the Webrdquo

ndash Rich media apps for BMW SLS-Museum hellip

3D-Internet Apps SLS-Museum 3D-Installation amp Museum with Interactive Virtual Characters

3D-Internet Apps Using OpenStreetMap-3D as Shared Virtual Worlds

Fully automatically generated from OpenStreet Map Taking semantic data into acount

Marker-free Performance Capture Christian Theobalt

bull Reconstruction of detailed human animation models ndash In Multi-view video without markers

ndash Out Detailed motion shape and appearance

ndash General clothing modifiable performances new animations

bull Real-time performance capture ndash Fast full-body motion estimation from depth

cameras

ndash Interaction

ndash Collaboration with Intel Magic Mirror project

[ICCV 2011]

[SIGGRAPH Asia 2010]

Markerless Motion Capture of Interacting Characters Using Multi-view Image Segmentation

Articulated Models Input silhouettes Segmentation Contour labels Estimated surface Estimated 3D models

Handling Intersections

Improved segmentation with 3D shape priors Excellent performance when evaluated against marker-based system

bull Interactive inspection of light transport in virtual scenes ndash You can only manipulate what you see

ndash First prototypal light manipulation tools

bull Efficient global illumination ndash Otherwise no interactive

visualization nor manipulation

ndash Improvements on many-lights methods and progressive photon mapping

bull Results ndash Demonstrator Maya plugin ndash Collaboration with local film academy

Visualization and Editing of Light Transport Carsten Dachsbacher

Advanced Real-Time Ray Tracing Techniques Philipp Slusallek

bull Perfect importance sampling and caching ndash Sparse but perfect importance sampling

ndash Caching and interpolation [Eurographics`12]

bull Unifying Photon-Mapping amp Monte-Carlo ndash Formulating PM as a MC process

ndash Per pixel combination using MIS

bull Data-parallel implementations

ndash Efficiency and performance

bull Integration into XML3D

ndash Provide ldquocorrectrdquo results by default

Vertex Merging with Multiple Importance Sampling Photon-Mapping as a Monte-Carlo Process

BPT

PPM Progressive Photon-Mapping (PPM)

Bidirectional Path Tracing (BPT)

bull Whole-Function Vectorization ndash Restore scalar computations

ndash LLVM platform-independent

ndash RenderMan frontend OpenCL driver

bull Vector Programming ndash Formalized C extension for portable

effective SIMD programming

ndash Type system triggers vectorization

ndash Data layout adaption

bull New Programming Models for High-Performance Graphics

bull Results ndash Demonstrators for shaders and HPC code

ndash CC++-Extensions (with Intel)

ndash OpenCL compiler (CPU)

Compiler Support for High-Performance Graphics Sebastian Hack

bull Hybrid Rendering ndash Client amp Server Model

ndash Smartphone to Mainframe

bull Large Data Processing ndash Scalable Hierarchical

RW Data Structures

bull Results ndash ZAPP displaywall demonstrator

ndash ImageVis3D (Mobile) demonstrator

ndash Practically use in hospitals

Scalable Hybrid Rendering for Large Scale Visualization Jens Kruumlger

Displays as a Service Large Scale Visualization Alexander Loumlffler

bull Virtualization of Displays ndash Virtual Framebuffer and Displays exposed to Internet

ndash Replacing cables by switched IP network

ndash Internet standards for video encoding and streaming

bull Fully Synchronized ndash 120 Hz active stereo sync over IP

ndash Accuracy of ~100us in software

ndash Drives GPU displays output

bull Results ndash 20-screen wall demonstrator

ndash 3-screen wall (thin-bezel)

ndash CE4100 based SW synchronization

SIGGRAPH 2012

Backup

The Intel Science and Technology Center (ISTC) and Intel Collaborative Research Institute (ICRI) Programs

35

The modern economy is an information economy and one that is driven by innovations that enhance productivity as well as create new modes of entertainment We need to invest in the basic research that will inspire future products and services and ensure long term health of our information economy Government and private foundations are helping but corporate America needs to step up and increase commitments to university research - Justin Rattner ndash Intel CTO

$140M investment over 5 years announced by Intel in 2011 and 2012

Centers of Excellence bull Each ISTC and ICRI will focus on one

research area eg visual computing secure computing

bull The ISTCs and ICRIs are meant to bring the best and brightest researchers across the US together

bull Each ISTC and ICRI will be led by a host university and will include thought leaders from other schools

Breaking Barriers to Collaboration

bull Open IP models and open source software to encourage free information exchange (In most of the Centers)

bull Favor projects that span multiple institutions to encourage collaboration among universities

bull Intel researches per center assigned to work on-campus to encourage collaboration between Intel and academia

Greater Impact to Future Tech bull Center research themes to

address essential needs of computing technology

bull Research agendas jointly defined and co-led by an Intel and a University Principal Investigator

bull After completing 3-5 year charters new ISTCs and ICRIs can be formed to respond to changing tech environment

httpfolditportal

Serious Gaming pplied to Content Creation

Highlighted by President Obama Winner of most-significant new visualization tool (NSF)

Goal Create high-quality content by casting creation activities as games in which large numbers of people are incentivized to perform simple tasks which in combination yield sophisticated content PIs Zoran Popovic (UW) Noah Snavely (Cornell) Maneesh Agrawala(Berkeley)

Determining the structure of retroviral protease (HIV)

Video Frank to add Papers Frank to add

Extracting Structure and Semantics

CAD Model Points

Structures

People

Goals Enable context aware computing and automated content creation through the capture analysis and manipulation of real-world visual data PIs Steve Seitz (UW) Noah Snavely (Cornell) Tom Funkhouser (Princeton) Vladlen Koltun (Stanford) Jitendra Malik (Berkeley) Deva Ramanan (UV Irvine)

Video Frank to add Papers Frank to add

httpvisualstanfordedu

Computational Photography (Franken Camera)

Being adopted as a standard API for cellphone camera systems (Apple Android)

bull Goal Develop algorithms languages architectures and prototypes demonstrating the use of computation in the process of image capture and display

bull PIs Marc Levoy (Stanford) Mark Horowitz (Stanford) Pat Hanrahan (Stanford)

Video Frank to add Papers Frank to add

ISTC-VC SIGGRAPH Papers

Character Locomotion Monday 6 August 900 AM - 1030 AM Optimizing Locomotion Controllers Using Biologically Based Actuators and Objectives Jack M Wang Samuel R Hamner Scott L Delp Vladlen Koltun Continuous Character Control With Low-Dimensional Embeddings Sergey Levine Jack M Wang Alexis Haraux Zoran Popović Vladlen Koltun Shape Analysis Monday 6 August 900 AM - 1030 AM Schelling Points on 3D Surface Meshes Xiaobai Chen Abulhair Saparov Bill Pang Thomas Funkhouser Shape Transformation Wednesday 8 August 900 - 1030 AM An Algebraic Model for Parameterized Shape Editing Martin Bokeloh Michael Wand Hans-Peter Seidel Vladlen Koltun

42

ISTC-VC SIGGRAPH Papers

Image Processing Monday 6 August 2- 330 pm Decoupling Algorithms From Schedules for Easy Optimization of Image-Processing Pipelines Jonathan Ragan-Kelley Andrew Adams Sylvain Paris Marc Levoy Saman Amarasinghe Freacutedo Durand

Cloth

Monday 6 August 2-330 pm Specular Reflection From Woven Cloth Piti Irawan Steve Marschner Stitch Meshes for Modeling Knitted Clothing With Yarn-level Detail Cem Yuksel Jonathan M Kaldor Doug L James Steve Marschner

Appearance

Monday 6 August 345-535 pm Printing Spatially Varying Reflectance for Reproducing HDR Images Yue Dong Xin Tong Fabio Pellacini Baining Guo

43

ISTC-VC SIGGRAPH Papers (cont)

Hand Eye and Face Monday 6 August 345-535 pm Session Chair - Vladlen Koltun Discovery of Complex Behaviors through Contact-Invariant Optimization Igor Mordatch Emanuel Todorov Zoran Popovi1049029 Sketching Monday 6 August 345-535 pm HelpingHand Example-Based Stroke Stylization Jingwan Lu Fisher Yu Adam Finkelstein Stephen DiVerdi Fabrication Tuesday 7 August 9-1030 am Fabricating Articulated Characters From Skinned Meshes Moritz Baumlcher Bernd Bickel Doug L James Hanspeter Pfister

44

Sampling Reconstructing and Filtering Light Tuesday 7 August 1045 am-1215 pm A Theory of Monte Carlo Visibility Sampling Ravi Ramamoorthi John Anderson Mark Meyer Derek Nowrouzezahrai Reconstructing the Indirect Light Field for Global Illumination Jaakko Lehtinen Timo Aila Samuli Laine Freacutedo Durand

Geometry Reconstruction amp Tracking

Tuesday 7 August 1045 am-1215 pm Temporally Coherent Completion of Dynamic Shapes Hao Li Linjie Luo Daniel Vlasic Pieter Peers Jovan Popovic Mark Pauly Szymon Rusinkiewicz

Sets of Shapes

Tuesday 7 August 2-330 pm Exploring Collections of 3D Models Using Fuzzy Correspondence Vladimir G Kim Wilmot Li Niloy J Mitra Stephen DiVerdi Thomas Funkhouser A Probabilistic Model for Component-Based Shape Synthesis Evangelos Kalogerakis Siddhartha Chaudhuri Daphne Koller Vladlen Koltun

45

ISTC-VC SIGGRAPH Papers (cont)

Light Rays Tuesday 7 August 2-330 pm Manifold Exploration A Markov Chain Monte Carlo Technique for Rendering Scenes With Difficult Specular Transport Wenzel Jakob Steve Marschner Bidirectional Lightcuts Bruce Walter Pramook Khungurn Kavita Bala

Fun With Video

Tuesday 7 August 345-535 pm Session Chair Noah Snavely Video Deblurring for Hand-Held Cameras Using Patch-Based Synthesis Sunghyun Cho Jue Wang Seungyong Lee Eulerian Video Magnification for Revealing Subtle Changes in the World Hao-Yu Wu Michael Rubinstein Eugene Shih John Guttag Freacutedo Durand William T Freeman Selectively De-Animating Video Jiamin Bai Aseem Agarwala Maneesh Agrawala Ravi Ramamoorthi Tools for Placing Cuts and Transitions in Interview Video Floraine Berthouzoz Wilmot Li Maneesh Agrawala

46

ISTC-VC SIGGRAPH Papers (cont)

Noise and Texture Tuesday 7 August 345-535 pm Structure-Aware Synthesis for Predictive Woven Fabric Appearance Shuang Zhao Kavita Bala Steve Marschner Wenzel Jakob Symmetry-Guided Texture Synthesis and Manipulation Vladimir Kim Yaron Lipman Thomas Funkhouser

Shape Transformation Wednesday 8 August 900 - 1030 AM An Algebraic Model for Parameterized Shape Editing Martin Bokeloh Michael Wand Hans-Peter Seidel Vladlen Koltun

Stitching

Wednesday 8 August 1045 am-1215 pm Exposing Photo Manipulation With Inconsistent Reflections James F OrsquoBrien Hany Farid

47

ISTC-VC SIGGRAPH Papers (cont)

Maps Surfaces and Shapes

Wednesday 8 August 1045 am-1215 pm Simple Formulas For Quasiconformal Plane Deformations Yaron Lipman Vladimir G Kim Thomas Funkhouser

Interactive Systems amp Hardware Wednesday 8 August 2-330 pm Position-Correcting Tools for 2D Digital Fabrication Alec Rivers Ilan E Moyer Freacutedo Durand

48

ISTC-VC SIGGRAPH Papers (cont)

Collisions Wednesday 8 August 345-535 pm Energy-Based Self-Collision Culling for Arbitrary Mesh Deformations Changxi Zheng Doug L James

All About Images

Thursday 9 August 9-1030 am A Framework for Content-Adaptive Photo Manipulation Macros Application to Face Landscape and Global Manipulations Floraine Berthouzoz Wilmot Li Mira Dontcheva Maneesh Agrawala

Sound and Elements

Thursday 9 August 9-1030 am Motion-Driven Concatenative Synthesis of Cloth Sounds Steven S An Doug L James Steve Marschner Precomputed Acceleration Noise for Improved Rigid-Body Sound Jeffrey N Chadwick Changxi Zheng Doug L James Interactive Sound Propagation Using Compact Acoustic Transfer Operators Lakulish Antani Anish Chandak Lauri Savioja Dinesh Manocha Updated Sparse Cholesky Factors for Corotational Elastodynamics Florian Hecht Yeon Jin Lee Jonathan R Shewchuk James F OrsquoBrien

49

ISTC-VC SIGGRAPH Papers (cont)

Geometry amp Viewing Thursday 9 August 2-330 pm Perceptual Models of Viewpoint Preference Adrian Secordm Jingwan Lu Adam Finkelstein Manish Singh Andrew Nealen

Faces and Hair [Closing Session]

Thursday 9 August 345-515 pm Coupled 3D Reconstruction of Sparse Facial Hair and Skin Thabo Beeler Bernd Bickel Gioacchino Noris Paul Beardsley Steve Marschner Robert W Sumner Markus Gross Physical Face Cloning Bernd Bickel Peter Kaufmann Melina Skouras Bernhard Thomaszewski Derek Bradley Thabo Beeler Philip Jackson Steve Marschner Wojciech Matusik Markus Gross

50

ISTC-VC SIGGRAPH Papers (cont)

Siggraph Courses Optimizing Realistic Rendering With Many-Light Methods Sunday 5 August 2-515 pm Jaroslav Krivanek Milos Hasan Adam Arbree Carsten Dachsbacher Alexander Keller Bruce Walter State of the Art in Photon-Density Estimation Thursday 9 August 2-515 pm Toshiya Hachisuka Wojciech Jarosz Guillaume Bouchard Per Christensen Jeppe Revall Frisvad Wenzel Jakob Henrik Wann Jensen Jared M Johnson Michael Kaschalk Claude Knaus Andrew Selle Ben Spencer

Siggraph Talks

Silence Eliminate the Noise Thursday 9 August 9-1030 am Importance Sampling for Hair Scattering Jiawei Ou Feng Xie Parashar Krishnamachari Fabio Pellacini

Siggraph Exhibitor Sessions

Intel Corporation Wednesday 8 August 430-530 pm room 402B The Future of Visual Computing as Viewed by Intel Visual Computing Research Centers

51

Other ISTC-VC SIGGRAPH Participation

Page 24: Future of Visual Computing as viewed by Intel Visual ... · PDF fileFuture of Visual Computing as viewed by Intel Visual Computing Research Centers ... Justin Rattner Intel Science

3D-Internet Apps SLS-Museum 3D-Installation amp Museum with Interactive Virtual Characters

3D-Internet Apps Using OpenStreetMap-3D as Shared Virtual Worlds

Fully automatically generated from OpenStreet Map Taking semantic data into acount

Marker-free Performance Capture Christian Theobalt

bull Reconstruction of detailed human animation models ndash In Multi-view video without markers

ndash Out Detailed motion shape and appearance

ndash General clothing modifiable performances new animations

bull Real-time performance capture ndash Fast full-body motion estimation from depth

cameras

ndash Interaction

ndash Collaboration with Intel Magic Mirror project

[ICCV 2011]

[SIGGRAPH Asia 2010]

Markerless Motion Capture of Interacting Characters Using Multi-view Image Segmentation

Articulated Models Input silhouettes Segmentation Contour labels Estimated surface Estimated 3D models

Handling Intersections

Improved segmentation with 3D shape priors Excellent performance when evaluated against marker-based system

bull Interactive inspection of light transport in virtual scenes ndash You can only manipulate what you see

ndash First prototypal light manipulation tools

bull Efficient global illumination ndash Otherwise no interactive

visualization nor manipulation

ndash Improvements on many-lights methods and progressive photon mapping

bull Results ndash Demonstrator Maya plugin ndash Collaboration with local film academy

Visualization and Editing of Light Transport Carsten Dachsbacher

Advanced Real-Time Ray Tracing Techniques Philipp Slusallek

bull Perfect importance sampling and caching ndash Sparse but perfect importance sampling

ndash Caching and interpolation [Eurographics`12]

bull Unifying Photon-Mapping amp Monte-Carlo ndash Formulating PM as a MC process

ndash Per pixel combination using MIS

bull Data-parallel implementations

ndash Efficiency and performance

bull Integration into XML3D

ndash Provide ldquocorrectrdquo results by default

Vertex Merging with Multiple Importance Sampling Photon-Mapping as a Monte-Carlo Process

BPT

PPM Progressive Photon-Mapping (PPM)

Bidirectional Path Tracing (BPT)

bull Whole-Function Vectorization ndash Restore scalar computations

ndash LLVM platform-independent

ndash RenderMan frontend OpenCL driver

bull Vector Programming ndash Formalized C extension for portable

effective SIMD programming

ndash Type system triggers vectorization

ndash Data layout adaption

bull New Programming Models for High-Performance Graphics

bull Results ndash Demonstrators for shaders and HPC code

ndash CC++-Extensions (with Intel)

ndash OpenCL compiler (CPU)

Compiler Support for High-Performance Graphics Sebastian Hack

bull Hybrid Rendering ndash Client amp Server Model

ndash Smartphone to Mainframe

bull Large Data Processing ndash Scalable Hierarchical

RW Data Structures

bull Results ndash ZAPP displaywall demonstrator

ndash ImageVis3D (Mobile) demonstrator

ndash Practically use in hospitals

Scalable Hybrid Rendering for Large Scale Visualization Jens Kruumlger

Displays as a Service Large Scale Visualization Alexander Loumlffler

bull Virtualization of Displays ndash Virtual Framebuffer and Displays exposed to Internet

ndash Replacing cables by switched IP network

ndash Internet standards for video encoding and streaming

bull Fully Synchronized ndash 120 Hz active stereo sync over IP

ndash Accuracy of ~100us in software

ndash Drives GPU displays output

bull Results ndash 20-screen wall demonstrator

ndash 3-screen wall (thin-bezel)

ndash CE4100 based SW synchronization

SIGGRAPH 2012

Backup

The Intel Science and Technology Center (ISTC) and Intel Collaborative Research Institute (ICRI) Programs

35

The modern economy is an information economy and one that is driven by innovations that enhance productivity as well as create new modes of entertainment We need to invest in the basic research that will inspire future products and services and ensure long term health of our information economy Government and private foundations are helping but corporate America needs to step up and increase commitments to university research - Justin Rattner ndash Intel CTO

$140M investment over 5 years announced by Intel in 2011 and 2012

Centers of Excellence bull Each ISTC and ICRI will focus on one

research area eg visual computing secure computing

bull The ISTCs and ICRIs are meant to bring the best and brightest researchers across the US together

bull Each ISTC and ICRI will be led by a host university and will include thought leaders from other schools

Breaking Barriers to Collaboration

bull Open IP models and open source software to encourage free information exchange (In most of the Centers)

bull Favor projects that span multiple institutions to encourage collaboration among universities

bull Intel researches per center assigned to work on-campus to encourage collaboration between Intel and academia

Greater Impact to Future Tech bull Center research themes to

address essential needs of computing technology

bull Research agendas jointly defined and co-led by an Intel and a University Principal Investigator

bull After completing 3-5 year charters new ISTCs and ICRIs can be formed to respond to changing tech environment

httpfolditportal

Serious Gaming pplied to Content Creation

Highlighted by President Obama Winner of most-significant new visualization tool (NSF)

Goal Create high-quality content by casting creation activities as games in which large numbers of people are incentivized to perform simple tasks which in combination yield sophisticated content PIs Zoran Popovic (UW) Noah Snavely (Cornell) Maneesh Agrawala(Berkeley)

Determining the structure of retroviral protease (HIV)

Video Frank to add Papers Frank to add

Extracting Structure and Semantics

CAD Model Points

Structures

People

Goals Enable context aware computing and automated content creation through the capture analysis and manipulation of real-world visual data PIs Steve Seitz (UW) Noah Snavely (Cornell) Tom Funkhouser (Princeton) Vladlen Koltun (Stanford) Jitendra Malik (Berkeley) Deva Ramanan (UV Irvine)

Video Frank to add Papers Frank to add

httpvisualstanfordedu

Computational Photography (Franken Camera)

Being adopted as a standard API for cellphone camera systems (Apple Android)

bull Goal Develop algorithms languages architectures and prototypes demonstrating the use of computation in the process of image capture and display

bull PIs Marc Levoy (Stanford) Mark Horowitz (Stanford) Pat Hanrahan (Stanford)

Video Frank to add Papers Frank to add

ISTC-VC SIGGRAPH Papers

Character Locomotion Monday 6 August 900 AM - 1030 AM Optimizing Locomotion Controllers Using Biologically Based Actuators and Objectives Jack M Wang Samuel R Hamner Scott L Delp Vladlen Koltun Continuous Character Control With Low-Dimensional Embeddings Sergey Levine Jack M Wang Alexis Haraux Zoran Popović Vladlen Koltun Shape Analysis Monday 6 August 900 AM - 1030 AM Schelling Points on 3D Surface Meshes Xiaobai Chen Abulhair Saparov Bill Pang Thomas Funkhouser Shape Transformation Wednesday 8 August 900 - 1030 AM An Algebraic Model for Parameterized Shape Editing Martin Bokeloh Michael Wand Hans-Peter Seidel Vladlen Koltun

42

ISTC-VC SIGGRAPH Papers

Image Processing Monday 6 August 2- 330 pm Decoupling Algorithms From Schedules for Easy Optimization of Image-Processing Pipelines Jonathan Ragan-Kelley Andrew Adams Sylvain Paris Marc Levoy Saman Amarasinghe Freacutedo Durand

Cloth

Monday 6 August 2-330 pm Specular Reflection From Woven Cloth Piti Irawan Steve Marschner Stitch Meshes for Modeling Knitted Clothing With Yarn-level Detail Cem Yuksel Jonathan M Kaldor Doug L James Steve Marschner

Appearance

Monday 6 August 345-535 pm Printing Spatially Varying Reflectance for Reproducing HDR Images Yue Dong Xin Tong Fabio Pellacini Baining Guo

43

ISTC-VC SIGGRAPH Papers (cont)

Hand Eye and Face Monday 6 August 345-535 pm Session Chair - Vladlen Koltun Discovery of Complex Behaviors through Contact-Invariant Optimization Igor Mordatch Emanuel Todorov Zoran Popovi1049029 Sketching Monday 6 August 345-535 pm HelpingHand Example-Based Stroke Stylization Jingwan Lu Fisher Yu Adam Finkelstein Stephen DiVerdi Fabrication Tuesday 7 August 9-1030 am Fabricating Articulated Characters From Skinned Meshes Moritz Baumlcher Bernd Bickel Doug L James Hanspeter Pfister

44

Sampling Reconstructing and Filtering Light Tuesday 7 August 1045 am-1215 pm A Theory of Monte Carlo Visibility Sampling Ravi Ramamoorthi John Anderson Mark Meyer Derek Nowrouzezahrai Reconstructing the Indirect Light Field for Global Illumination Jaakko Lehtinen Timo Aila Samuli Laine Freacutedo Durand

Geometry Reconstruction amp Tracking

Tuesday 7 August 1045 am-1215 pm Temporally Coherent Completion of Dynamic Shapes Hao Li Linjie Luo Daniel Vlasic Pieter Peers Jovan Popovic Mark Pauly Szymon Rusinkiewicz

Sets of Shapes

Tuesday 7 August 2-330 pm Exploring Collections of 3D Models Using Fuzzy Correspondence Vladimir G Kim Wilmot Li Niloy J Mitra Stephen DiVerdi Thomas Funkhouser A Probabilistic Model for Component-Based Shape Synthesis Evangelos Kalogerakis Siddhartha Chaudhuri Daphne Koller Vladlen Koltun

45

ISTC-VC SIGGRAPH Papers (cont)

Light Rays Tuesday 7 August 2-330 pm Manifold Exploration A Markov Chain Monte Carlo Technique for Rendering Scenes With Difficult Specular Transport Wenzel Jakob Steve Marschner Bidirectional Lightcuts Bruce Walter Pramook Khungurn Kavita Bala

Fun With Video

Tuesday 7 August 345-535 pm Session Chair Noah Snavely Video Deblurring for Hand-Held Cameras Using Patch-Based Synthesis Sunghyun Cho Jue Wang Seungyong Lee Eulerian Video Magnification for Revealing Subtle Changes in the World Hao-Yu Wu Michael Rubinstein Eugene Shih John Guttag Freacutedo Durand William T Freeman Selectively De-Animating Video Jiamin Bai Aseem Agarwala Maneesh Agrawala Ravi Ramamoorthi Tools for Placing Cuts and Transitions in Interview Video Floraine Berthouzoz Wilmot Li Maneesh Agrawala

46

ISTC-VC SIGGRAPH Papers (cont)

Noise and Texture Tuesday 7 August 345-535 pm Structure-Aware Synthesis for Predictive Woven Fabric Appearance Shuang Zhao Kavita Bala Steve Marschner Wenzel Jakob Symmetry-Guided Texture Synthesis and Manipulation Vladimir Kim Yaron Lipman Thomas Funkhouser

Shape Transformation Wednesday 8 August 900 - 1030 AM An Algebraic Model for Parameterized Shape Editing Martin Bokeloh Michael Wand Hans-Peter Seidel Vladlen Koltun

Stitching

Wednesday 8 August 1045 am-1215 pm Exposing Photo Manipulation With Inconsistent Reflections James F OrsquoBrien Hany Farid

47

ISTC-VC SIGGRAPH Papers (cont)

Maps Surfaces and Shapes

Wednesday 8 August 1045 am-1215 pm Simple Formulas For Quasiconformal Plane Deformations Yaron Lipman Vladimir G Kim Thomas Funkhouser

Interactive Systems amp Hardware Wednesday 8 August 2-330 pm Position-Correcting Tools for 2D Digital Fabrication Alec Rivers Ilan E Moyer Freacutedo Durand

48

ISTC-VC SIGGRAPH Papers (cont)

Collisions Wednesday 8 August 345-535 pm Energy-Based Self-Collision Culling for Arbitrary Mesh Deformations Changxi Zheng Doug L James

All About Images

Thursday 9 August 9-1030 am A Framework for Content-Adaptive Photo Manipulation Macros Application to Face Landscape and Global Manipulations Floraine Berthouzoz Wilmot Li Mira Dontcheva Maneesh Agrawala

Sound and Elements

Thursday 9 August 9-1030 am Motion-Driven Concatenative Synthesis of Cloth Sounds Steven S An Doug L James Steve Marschner Precomputed Acceleration Noise for Improved Rigid-Body Sound Jeffrey N Chadwick Changxi Zheng Doug L James Interactive Sound Propagation Using Compact Acoustic Transfer Operators Lakulish Antani Anish Chandak Lauri Savioja Dinesh Manocha Updated Sparse Cholesky Factors for Corotational Elastodynamics Florian Hecht Yeon Jin Lee Jonathan R Shewchuk James F OrsquoBrien

49

ISTC-VC SIGGRAPH Papers (cont)

Geometry amp Viewing Thursday 9 August 2-330 pm Perceptual Models of Viewpoint Preference Adrian Secordm Jingwan Lu Adam Finkelstein Manish Singh Andrew Nealen

Faces and Hair [Closing Session]

Thursday 9 August 345-515 pm Coupled 3D Reconstruction of Sparse Facial Hair and Skin Thabo Beeler Bernd Bickel Gioacchino Noris Paul Beardsley Steve Marschner Robert W Sumner Markus Gross Physical Face Cloning Bernd Bickel Peter Kaufmann Melina Skouras Bernhard Thomaszewski Derek Bradley Thabo Beeler Philip Jackson Steve Marschner Wojciech Matusik Markus Gross

50

ISTC-VC SIGGRAPH Papers (cont)

Siggraph Courses Optimizing Realistic Rendering With Many-Light Methods Sunday 5 August 2-515 pm Jaroslav Krivanek Milos Hasan Adam Arbree Carsten Dachsbacher Alexander Keller Bruce Walter State of the Art in Photon-Density Estimation Thursday 9 August 2-515 pm Toshiya Hachisuka Wojciech Jarosz Guillaume Bouchard Per Christensen Jeppe Revall Frisvad Wenzel Jakob Henrik Wann Jensen Jared M Johnson Michael Kaschalk Claude Knaus Andrew Selle Ben Spencer

Siggraph Talks

Silence Eliminate the Noise Thursday 9 August 9-1030 am Importance Sampling for Hair Scattering Jiawei Ou Feng Xie Parashar Krishnamachari Fabio Pellacini

Siggraph Exhibitor Sessions

Intel Corporation Wednesday 8 August 430-530 pm room 402B The Future of Visual Computing as Viewed by Intel Visual Computing Research Centers

51

Other ISTC-VC SIGGRAPH Participation

Page 25: Future of Visual Computing as viewed by Intel Visual ... · PDF fileFuture of Visual Computing as viewed by Intel Visual Computing Research Centers ... Justin Rattner Intel Science

3D-Internet Apps Using OpenStreetMap-3D as Shared Virtual Worlds

Fully automatically generated from OpenStreet Map Taking semantic data into acount

Marker-free Performance Capture Christian Theobalt

bull Reconstruction of detailed human animation models ndash In Multi-view video without markers

ndash Out Detailed motion shape and appearance

ndash General clothing modifiable performances new animations

bull Real-time performance capture ndash Fast full-body motion estimation from depth

cameras

ndash Interaction

ndash Collaboration with Intel Magic Mirror project

[ICCV 2011]

[SIGGRAPH Asia 2010]

Markerless Motion Capture of Interacting Characters Using Multi-view Image Segmentation

Articulated Models Input silhouettes Segmentation Contour labels Estimated surface Estimated 3D models

Handling Intersections

Improved segmentation with 3D shape priors Excellent performance when evaluated against marker-based system

bull Interactive inspection of light transport in virtual scenes ndash You can only manipulate what you see

ndash First prototypal light manipulation tools

bull Efficient global illumination ndash Otherwise no interactive

visualization nor manipulation

ndash Improvements on many-lights methods and progressive photon mapping

bull Results ndash Demonstrator Maya plugin ndash Collaboration with local film academy

Visualization and Editing of Light Transport Carsten Dachsbacher

Advanced Real-Time Ray Tracing Techniques Philipp Slusallek

bull Perfect importance sampling and caching ndash Sparse but perfect importance sampling

ndash Caching and interpolation [Eurographics`12]

bull Unifying Photon-Mapping amp Monte-Carlo ndash Formulating PM as a MC process

ndash Per pixel combination using MIS

bull Data-parallel implementations

ndash Efficiency and performance

bull Integration into XML3D

ndash Provide ldquocorrectrdquo results by default

Vertex Merging with Multiple Importance Sampling Photon-Mapping as a Monte-Carlo Process

BPT

PPM Progressive Photon-Mapping (PPM)

Bidirectional Path Tracing (BPT)

bull Whole-Function Vectorization ndash Restore scalar computations

ndash LLVM platform-independent

ndash RenderMan frontend OpenCL driver

bull Vector Programming ndash Formalized C extension for portable

effective SIMD programming

ndash Type system triggers vectorization

ndash Data layout adaption

bull New Programming Models for High-Performance Graphics

bull Results ndash Demonstrators for shaders and HPC code

ndash CC++-Extensions (with Intel)

ndash OpenCL compiler (CPU)

Compiler Support for High-Performance Graphics Sebastian Hack

bull Hybrid Rendering ndash Client amp Server Model

ndash Smartphone to Mainframe

bull Large Data Processing ndash Scalable Hierarchical

RW Data Structures

bull Results ndash ZAPP displaywall demonstrator

ndash ImageVis3D (Mobile) demonstrator

ndash Practically use in hospitals

Scalable Hybrid Rendering for Large Scale Visualization Jens Kruumlger

Displays as a Service Large Scale Visualization Alexander Loumlffler

bull Virtualization of Displays ndash Virtual Framebuffer and Displays exposed to Internet

ndash Replacing cables by switched IP network

ndash Internet standards for video encoding and streaming

bull Fully Synchronized ndash 120 Hz active stereo sync over IP

ndash Accuracy of ~100us in software

ndash Drives GPU displays output

bull Results ndash 20-screen wall demonstrator

ndash 3-screen wall (thin-bezel)

ndash CE4100 based SW synchronization

SIGGRAPH 2012

Backup

The Intel Science and Technology Center (ISTC) and Intel Collaborative Research Institute (ICRI) Programs

35

The modern economy is an information economy and one that is driven by innovations that enhance productivity as well as create new modes of entertainment We need to invest in the basic research that will inspire future products and services and ensure long term health of our information economy Government and private foundations are helping but corporate America needs to step up and increase commitments to university research - Justin Rattner ndash Intel CTO

$140M investment over 5 years announced by Intel in 2011 and 2012

Centers of Excellence bull Each ISTC and ICRI will focus on one

research area eg visual computing secure computing

bull The ISTCs and ICRIs are meant to bring the best and brightest researchers across the US together

bull Each ISTC and ICRI will be led by a host university and will include thought leaders from other schools

Breaking Barriers to Collaboration

bull Open IP models and open source software to encourage free information exchange (In most of the Centers)

bull Favor projects that span multiple institutions to encourage collaboration among universities

bull Intel researches per center assigned to work on-campus to encourage collaboration between Intel and academia

Greater Impact to Future Tech bull Center research themes to

address essential needs of computing technology

bull Research agendas jointly defined and co-led by an Intel and a University Principal Investigator

bull After completing 3-5 year charters new ISTCs and ICRIs can be formed to respond to changing tech environment

httpfolditportal

Serious Gaming pplied to Content Creation

Highlighted by President Obama Winner of most-significant new visualization tool (NSF)

Goal Create high-quality content by casting creation activities as games in which large numbers of people are incentivized to perform simple tasks which in combination yield sophisticated content PIs Zoran Popovic (UW) Noah Snavely (Cornell) Maneesh Agrawala(Berkeley)

Determining the structure of retroviral protease (HIV)

Video Frank to add Papers Frank to add

Extracting Structure and Semantics

CAD Model Points

Structures

People

Goals Enable context aware computing and automated content creation through the capture analysis and manipulation of real-world visual data PIs Steve Seitz (UW) Noah Snavely (Cornell) Tom Funkhouser (Princeton) Vladlen Koltun (Stanford) Jitendra Malik (Berkeley) Deva Ramanan (UV Irvine)

Video Frank to add Papers Frank to add

httpvisualstanfordedu

Computational Photography (Franken Camera)

Being adopted as a standard API for cellphone camera systems (Apple Android)

bull Goal Develop algorithms languages architectures and prototypes demonstrating the use of computation in the process of image capture and display

bull PIs Marc Levoy (Stanford) Mark Horowitz (Stanford) Pat Hanrahan (Stanford)

Video Frank to add Papers Frank to add

ISTC-VC SIGGRAPH Papers

Character Locomotion Monday 6 August 900 AM - 1030 AM Optimizing Locomotion Controllers Using Biologically Based Actuators and Objectives Jack M Wang Samuel R Hamner Scott L Delp Vladlen Koltun Continuous Character Control With Low-Dimensional Embeddings Sergey Levine Jack M Wang Alexis Haraux Zoran Popović Vladlen Koltun Shape Analysis Monday 6 August 900 AM - 1030 AM Schelling Points on 3D Surface Meshes Xiaobai Chen Abulhair Saparov Bill Pang Thomas Funkhouser Shape Transformation Wednesday 8 August 900 - 1030 AM An Algebraic Model for Parameterized Shape Editing Martin Bokeloh Michael Wand Hans-Peter Seidel Vladlen Koltun

42

ISTC-VC SIGGRAPH Papers

Image Processing Monday 6 August 2- 330 pm Decoupling Algorithms From Schedules for Easy Optimization of Image-Processing Pipelines Jonathan Ragan-Kelley Andrew Adams Sylvain Paris Marc Levoy Saman Amarasinghe Freacutedo Durand

Cloth

Monday 6 August 2-330 pm Specular Reflection From Woven Cloth Piti Irawan Steve Marschner Stitch Meshes for Modeling Knitted Clothing With Yarn-level Detail Cem Yuksel Jonathan M Kaldor Doug L James Steve Marschner

Appearance

Monday 6 August 345-535 pm Printing Spatially Varying Reflectance for Reproducing HDR Images Yue Dong Xin Tong Fabio Pellacini Baining Guo

43

ISTC-VC SIGGRAPH Papers (cont)

Hand Eye and Face Monday 6 August 345-535 pm Session Chair - Vladlen Koltun Discovery of Complex Behaviors through Contact-Invariant Optimization Igor Mordatch Emanuel Todorov Zoran Popovi1049029 Sketching Monday 6 August 345-535 pm HelpingHand Example-Based Stroke Stylization Jingwan Lu Fisher Yu Adam Finkelstein Stephen DiVerdi Fabrication Tuesday 7 August 9-1030 am Fabricating Articulated Characters From Skinned Meshes Moritz Baumlcher Bernd Bickel Doug L James Hanspeter Pfister

44

Sampling Reconstructing and Filtering Light Tuesday 7 August 1045 am-1215 pm A Theory of Monte Carlo Visibility Sampling Ravi Ramamoorthi John Anderson Mark Meyer Derek Nowrouzezahrai Reconstructing the Indirect Light Field for Global Illumination Jaakko Lehtinen Timo Aila Samuli Laine Freacutedo Durand

Geometry Reconstruction amp Tracking

Tuesday 7 August 1045 am-1215 pm Temporally Coherent Completion of Dynamic Shapes Hao Li Linjie Luo Daniel Vlasic Pieter Peers Jovan Popovic Mark Pauly Szymon Rusinkiewicz

Sets of Shapes

Tuesday 7 August 2-330 pm Exploring Collections of 3D Models Using Fuzzy Correspondence Vladimir G Kim Wilmot Li Niloy J Mitra Stephen DiVerdi Thomas Funkhouser A Probabilistic Model for Component-Based Shape Synthesis Evangelos Kalogerakis Siddhartha Chaudhuri Daphne Koller Vladlen Koltun

45

ISTC-VC SIGGRAPH Papers (cont)

Light Rays Tuesday 7 August 2-330 pm Manifold Exploration A Markov Chain Monte Carlo Technique for Rendering Scenes With Difficult Specular Transport Wenzel Jakob Steve Marschner Bidirectional Lightcuts Bruce Walter Pramook Khungurn Kavita Bala

Fun With Video

Tuesday 7 August 345-535 pm Session Chair Noah Snavely Video Deblurring for Hand-Held Cameras Using Patch-Based Synthesis Sunghyun Cho Jue Wang Seungyong Lee Eulerian Video Magnification for Revealing Subtle Changes in the World Hao-Yu Wu Michael Rubinstein Eugene Shih John Guttag Freacutedo Durand William T Freeman Selectively De-Animating Video Jiamin Bai Aseem Agarwala Maneesh Agrawala Ravi Ramamoorthi Tools for Placing Cuts and Transitions in Interview Video Floraine Berthouzoz Wilmot Li Maneesh Agrawala

46

ISTC-VC SIGGRAPH Papers (cont)

Noise and Texture Tuesday 7 August 345-535 pm Structure-Aware Synthesis for Predictive Woven Fabric Appearance Shuang Zhao Kavita Bala Steve Marschner Wenzel Jakob Symmetry-Guided Texture Synthesis and Manipulation Vladimir Kim Yaron Lipman Thomas Funkhouser

Shape Transformation Wednesday 8 August 900 - 1030 AM An Algebraic Model for Parameterized Shape Editing Martin Bokeloh Michael Wand Hans-Peter Seidel Vladlen Koltun

Stitching

Wednesday 8 August 1045 am-1215 pm Exposing Photo Manipulation With Inconsistent Reflections James F OrsquoBrien Hany Farid

47

ISTC-VC SIGGRAPH Papers (cont)

Maps Surfaces and Shapes

Wednesday 8 August 1045 am-1215 pm Simple Formulas For Quasiconformal Plane Deformations Yaron Lipman Vladimir G Kim Thomas Funkhouser

Interactive Systems amp Hardware Wednesday 8 August 2-330 pm Position-Correcting Tools for 2D Digital Fabrication Alec Rivers Ilan E Moyer Freacutedo Durand

48

ISTC-VC SIGGRAPH Papers (cont)

Collisions Wednesday 8 August 345-535 pm Energy-Based Self-Collision Culling for Arbitrary Mesh Deformations Changxi Zheng Doug L James

All About Images

Thursday 9 August 9-1030 am A Framework for Content-Adaptive Photo Manipulation Macros Application to Face Landscape and Global Manipulations Floraine Berthouzoz Wilmot Li Mira Dontcheva Maneesh Agrawala

Sound and Elements

Thursday 9 August 9-1030 am Motion-Driven Concatenative Synthesis of Cloth Sounds Steven S An Doug L James Steve Marschner Precomputed Acceleration Noise for Improved Rigid-Body Sound Jeffrey N Chadwick Changxi Zheng Doug L James Interactive Sound Propagation Using Compact Acoustic Transfer Operators Lakulish Antani Anish Chandak Lauri Savioja Dinesh Manocha Updated Sparse Cholesky Factors for Corotational Elastodynamics Florian Hecht Yeon Jin Lee Jonathan R Shewchuk James F OrsquoBrien

49

ISTC-VC SIGGRAPH Papers (cont)

Geometry amp Viewing Thursday 9 August 2-330 pm Perceptual Models of Viewpoint Preference Adrian Secordm Jingwan Lu Adam Finkelstein Manish Singh Andrew Nealen

Faces and Hair [Closing Session]

Thursday 9 August 345-515 pm Coupled 3D Reconstruction of Sparse Facial Hair and Skin Thabo Beeler Bernd Bickel Gioacchino Noris Paul Beardsley Steve Marschner Robert W Sumner Markus Gross Physical Face Cloning Bernd Bickel Peter Kaufmann Melina Skouras Bernhard Thomaszewski Derek Bradley Thabo Beeler Philip Jackson Steve Marschner Wojciech Matusik Markus Gross

50

ISTC-VC SIGGRAPH Papers (cont)

Siggraph Courses Optimizing Realistic Rendering With Many-Light Methods Sunday 5 August 2-515 pm Jaroslav Krivanek Milos Hasan Adam Arbree Carsten Dachsbacher Alexander Keller Bruce Walter State of the Art in Photon-Density Estimation Thursday 9 August 2-515 pm Toshiya Hachisuka Wojciech Jarosz Guillaume Bouchard Per Christensen Jeppe Revall Frisvad Wenzel Jakob Henrik Wann Jensen Jared M Johnson Michael Kaschalk Claude Knaus Andrew Selle Ben Spencer

Siggraph Talks

Silence Eliminate the Noise Thursday 9 August 9-1030 am Importance Sampling for Hair Scattering Jiawei Ou Feng Xie Parashar Krishnamachari Fabio Pellacini

Siggraph Exhibitor Sessions

Intel Corporation Wednesday 8 August 430-530 pm room 402B The Future of Visual Computing as Viewed by Intel Visual Computing Research Centers

51

Other ISTC-VC SIGGRAPH Participation

Page 26: Future of Visual Computing as viewed by Intel Visual ... · PDF fileFuture of Visual Computing as viewed by Intel Visual Computing Research Centers ... Justin Rattner Intel Science

Marker-free Performance Capture Christian Theobalt

bull Reconstruction of detailed human animation models ndash In Multi-view video without markers

ndash Out Detailed motion shape and appearance

ndash General clothing modifiable performances new animations

bull Real-time performance capture ndash Fast full-body motion estimation from depth

cameras

ndash Interaction

ndash Collaboration with Intel Magic Mirror project

[ICCV 2011]

[SIGGRAPH Asia 2010]

Markerless Motion Capture of Interacting Characters Using Multi-view Image Segmentation

Articulated Models Input silhouettes Segmentation Contour labels Estimated surface Estimated 3D models

Handling Intersections

Improved segmentation with 3D shape priors Excellent performance when evaluated against marker-based system

bull Interactive inspection of light transport in virtual scenes ndash You can only manipulate what you see

ndash First prototypal light manipulation tools

bull Efficient global illumination ndash Otherwise no interactive

visualization nor manipulation

ndash Improvements on many-lights methods and progressive photon mapping

bull Results ndash Demonstrator Maya plugin ndash Collaboration with local film academy

Visualization and Editing of Light Transport Carsten Dachsbacher

Advanced Real-Time Ray Tracing Techniques Philipp Slusallek

bull Perfect importance sampling and caching ndash Sparse but perfect importance sampling

ndash Caching and interpolation [Eurographics`12]

bull Unifying Photon-Mapping amp Monte-Carlo ndash Formulating PM as a MC process

ndash Per pixel combination using MIS

bull Data-parallel implementations

ndash Efficiency and performance

bull Integration into XML3D

ndash Provide ldquocorrectrdquo results by default

Vertex Merging with Multiple Importance Sampling Photon-Mapping as a Monte-Carlo Process

BPT

PPM Progressive Photon-Mapping (PPM)

Bidirectional Path Tracing (BPT)

bull Whole-Function Vectorization ndash Restore scalar computations

ndash LLVM platform-independent

ndash RenderMan frontend OpenCL driver

bull Vector Programming ndash Formalized C extension for portable

effective SIMD programming

ndash Type system triggers vectorization

ndash Data layout adaption

bull New Programming Models for High-Performance Graphics

bull Results ndash Demonstrators for shaders and HPC code

ndash CC++-Extensions (with Intel)

ndash OpenCL compiler (CPU)

Compiler Support for High-Performance Graphics Sebastian Hack

bull Hybrid Rendering ndash Client amp Server Model

ndash Smartphone to Mainframe

bull Large Data Processing ndash Scalable Hierarchical

RW Data Structures

bull Results ndash ZAPP displaywall demonstrator

ndash ImageVis3D (Mobile) demonstrator

ndash Practically use in hospitals

Scalable Hybrid Rendering for Large Scale Visualization Jens Kruumlger

Displays as a Service Large Scale Visualization Alexander Loumlffler

bull Virtualization of Displays ndash Virtual Framebuffer and Displays exposed to Internet

ndash Replacing cables by switched IP network

ndash Internet standards for video encoding and streaming

bull Fully Synchronized ndash 120 Hz active stereo sync over IP

ndash Accuracy of ~100us in software

ndash Drives GPU displays output

bull Results ndash 20-screen wall demonstrator

ndash 3-screen wall (thin-bezel)

ndash CE4100 based SW synchronization

SIGGRAPH 2012

Backup

The Intel Science and Technology Center (ISTC) and Intel Collaborative Research Institute (ICRI) Programs

35

The modern economy is an information economy and one that is driven by innovations that enhance productivity as well as create new modes of entertainment We need to invest in the basic research that will inspire future products and services and ensure long term health of our information economy Government and private foundations are helping but corporate America needs to step up and increase commitments to university research - Justin Rattner ndash Intel CTO

$140M investment over 5 years announced by Intel in 2011 and 2012

Centers of Excellence bull Each ISTC and ICRI will focus on one

research area eg visual computing secure computing

bull The ISTCs and ICRIs are meant to bring the best and brightest researchers across the US together

bull Each ISTC and ICRI will be led by a host university and will include thought leaders from other schools

Breaking Barriers to Collaboration

bull Open IP models and open source software to encourage free information exchange (In most of the Centers)

bull Favor projects that span multiple institutions to encourage collaboration among universities

bull Intel researches per center assigned to work on-campus to encourage collaboration between Intel and academia

Greater Impact to Future Tech bull Center research themes to

address essential needs of computing technology

bull Research agendas jointly defined and co-led by an Intel and a University Principal Investigator

bull After completing 3-5 year charters new ISTCs and ICRIs can be formed to respond to changing tech environment

httpfolditportal

Serious Gaming pplied to Content Creation

Highlighted by President Obama Winner of most-significant new visualization tool (NSF)

Goal Create high-quality content by casting creation activities as games in which large numbers of people are incentivized to perform simple tasks which in combination yield sophisticated content PIs Zoran Popovic (UW) Noah Snavely (Cornell) Maneesh Agrawala(Berkeley)

Determining the structure of retroviral protease (HIV)

Video Frank to add Papers Frank to add

Extracting Structure and Semantics

CAD Model Points

Structures

People

Goals Enable context aware computing and automated content creation through the capture analysis and manipulation of real-world visual data PIs Steve Seitz (UW) Noah Snavely (Cornell) Tom Funkhouser (Princeton) Vladlen Koltun (Stanford) Jitendra Malik (Berkeley) Deva Ramanan (UV Irvine)

Video Frank to add Papers Frank to add

httpvisualstanfordedu

Computational Photography (Franken Camera)

Being adopted as a standard API for cellphone camera systems (Apple Android)

bull Goal Develop algorithms languages architectures and prototypes demonstrating the use of computation in the process of image capture and display

bull PIs Marc Levoy (Stanford) Mark Horowitz (Stanford) Pat Hanrahan (Stanford)

Video Frank to add Papers Frank to add

ISTC-VC SIGGRAPH Papers

Character Locomotion Monday 6 August 900 AM - 1030 AM Optimizing Locomotion Controllers Using Biologically Based Actuators and Objectives Jack M Wang Samuel R Hamner Scott L Delp Vladlen Koltun Continuous Character Control With Low-Dimensional Embeddings Sergey Levine Jack M Wang Alexis Haraux Zoran Popović Vladlen Koltun Shape Analysis Monday 6 August 900 AM - 1030 AM Schelling Points on 3D Surface Meshes Xiaobai Chen Abulhair Saparov Bill Pang Thomas Funkhouser Shape Transformation Wednesday 8 August 900 - 1030 AM An Algebraic Model for Parameterized Shape Editing Martin Bokeloh Michael Wand Hans-Peter Seidel Vladlen Koltun

42

ISTC-VC SIGGRAPH Papers

Image Processing Monday 6 August 2- 330 pm Decoupling Algorithms From Schedules for Easy Optimization of Image-Processing Pipelines Jonathan Ragan-Kelley Andrew Adams Sylvain Paris Marc Levoy Saman Amarasinghe Freacutedo Durand

Cloth

Monday 6 August 2-330 pm Specular Reflection From Woven Cloth Piti Irawan Steve Marschner Stitch Meshes for Modeling Knitted Clothing With Yarn-level Detail Cem Yuksel Jonathan M Kaldor Doug L James Steve Marschner

Appearance

Monday 6 August 345-535 pm Printing Spatially Varying Reflectance for Reproducing HDR Images Yue Dong Xin Tong Fabio Pellacini Baining Guo

43

ISTC-VC SIGGRAPH Papers (cont)

Hand Eye and Face Monday 6 August 345-535 pm Session Chair - Vladlen Koltun Discovery of Complex Behaviors through Contact-Invariant Optimization Igor Mordatch Emanuel Todorov Zoran Popovi1049029 Sketching Monday 6 August 345-535 pm HelpingHand Example-Based Stroke Stylization Jingwan Lu Fisher Yu Adam Finkelstein Stephen DiVerdi Fabrication Tuesday 7 August 9-1030 am Fabricating Articulated Characters From Skinned Meshes Moritz Baumlcher Bernd Bickel Doug L James Hanspeter Pfister

44

Sampling Reconstructing and Filtering Light Tuesday 7 August 1045 am-1215 pm A Theory of Monte Carlo Visibility Sampling Ravi Ramamoorthi John Anderson Mark Meyer Derek Nowrouzezahrai Reconstructing the Indirect Light Field for Global Illumination Jaakko Lehtinen Timo Aila Samuli Laine Freacutedo Durand

Geometry Reconstruction amp Tracking

Tuesday 7 August 1045 am-1215 pm Temporally Coherent Completion of Dynamic Shapes Hao Li Linjie Luo Daniel Vlasic Pieter Peers Jovan Popovic Mark Pauly Szymon Rusinkiewicz

Sets of Shapes

Tuesday 7 August 2-330 pm Exploring Collections of 3D Models Using Fuzzy Correspondence Vladimir G Kim Wilmot Li Niloy J Mitra Stephen DiVerdi Thomas Funkhouser A Probabilistic Model for Component-Based Shape Synthesis Evangelos Kalogerakis Siddhartha Chaudhuri Daphne Koller Vladlen Koltun

45

ISTC-VC SIGGRAPH Papers (cont)

Light Rays Tuesday 7 August 2-330 pm Manifold Exploration A Markov Chain Monte Carlo Technique for Rendering Scenes With Difficult Specular Transport Wenzel Jakob Steve Marschner Bidirectional Lightcuts Bruce Walter Pramook Khungurn Kavita Bala

Fun With Video

Tuesday 7 August 345-535 pm Session Chair Noah Snavely Video Deblurring for Hand-Held Cameras Using Patch-Based Synthesis Sunghyun Cho Jue Wang Seungyong Lee Eulerian Video Magnification for Revealing Subtle Changes in the World Hao-Yu Wu Michael Rubinstein Eugene Shih John Guttag Freacutedo Durand William T Freeman Selectively De-Animating Video Jiamin Bai Aseem Agarwala Maneesh Agrawala Ravi Ramamoorthi Tools for Placing Cuts and Transitions in Interview Video Floraine Berthouzoz Wilmot Li Maneesh Agrawala

46

ISTC-VC SIGGRAPH Papers (cont)

Noise and Texture Tuesday 7 August 345-535 pm Structure-Aware Synthesis for Predictive Woven Fabric Appearance Shuang Zhao Kavita Bala Steve Marschner Wenzel Jakob Symmetry-Guided Texture Synthesis and Manipulation Vladimir Kim Yaron Lipman Thomas Funkhouser

Shape Transformation Wednesday 8 August 900 - 1030 AM An Algebraic Model for Parameterized Shape Editing Martin Bokeloh Michael Wand Hans-Peter Seidel Vladlen Koltun

Stitching

Wednesday 8 August 1045 am-1215 pm Exposing Photo Manipulation With Inconsistent Reflections James F OrsquoBrien Hany Farid

47

ISTC-VC SIGGRAPH Papers (cont)

Maps Surfaces and Shapes

Wednesday 8 August 1045 am-1215 pm Simple Formulas For Quasiconformal Plane Deformations Yaron Lipman Vladimir G Kim Thomas Funkhouser

Interactive Systems amp Hardware Wednesday 8 August 2-330 pm Position-Correcting Tools for 2D Digital Fabrication Alec Rivers Ilan E Moyer Freacutedo Durand

48

ISTC-VC SIGGRAPH Papers (cont)

Collisions Wednesday 8 August 345-535 pm Energy-Based Self-Collision Culling for Arbitrary Mesh Deformations Changxi Zheng Doug L James

All About Images

Thursday 9 August 9-1030 am A Framework for Content-Adaptive Photo Manipulation Macros Application to Face Landscape and Global Manipulations Floraine Berthouzoz Wilmot Li Mira Dontcheva Maneesh Agrawala

Sound and Elements

Thursday 9 August 9-1030 am Motion-Driven Concatenative Synthesis of Cloth Sounds Steven S An Doug L James Steve Marschner Precomputed Acceleration Noise for Improved Rigid-Body Sound Jeffrey N Chadwick Changxi Zheng Doug L James Interactive Sound Propagation Using Compact Acoustic Transfer Operators Lakulish Antani Anish Chandak Lauri Savioja Dinesh Manocha Updated Sparse Cholesky Factors for Corotational Elastodynamics Florian Hecht Yeon Jin Lee Jonathan R Shewchuk James F OrsquoBrien

49

ISTC-VC SIGGRAPH Papers (cont)

Geometry amp Viewing Thursday 9 August 2-330 pm Perceptual Models of Viewpoint Preference Adrian Secordm Jingwan Lu Adam Finkelstein Manish Singh Andrew Nealen

Faces and Hair [Closing Session]

Thursday 9 August 345-515 pm Coupled 3D Reconstruction of Sparse Facial Hair and Skin Thabo Beeler Bernd Bickel Gioacchino Noris Paul Beardsley Steve Marschner Robert W Sumner Markus Gross Physical Face Cloning Bernd Bickel Peter Kaufmann Melina Skouras Bernhard Thomaszewski Derek Bradley Thabo Beeler Philip Jackson Steve Marschner Wojciech Matusik Markus Gross

50

ISTC-VC SIGGRAPH Papers (cont)

Siggraph Courses Optimizing Realistic Rendering With Many-Light Methods Sunday 5 August 2-515 pm Jaroslav Krivanek Milos Hasan Adam Arbree Carsten Dachsbacher Alexander Keller Bruce Walter State of the Art in Photon-Density Estimation Thursday 9 August 2-515 pm Toshiya Hachisuka Wojciech Jarosz Guillaume Bouchard Per Christensen Jeppe Revall Frisvad Wenzel Jakob Henrik Wann Jensen Jared M Johnson Michael Kaschalk Claude Knaus Andrew Selle Ben Spencer

Siggraph Talks

Silence Eliminate the Noise Thursday 9 August 9-1030 am Importance Sampling for Hair Scattering Jiawei Ou Feng Xie Parashar Krishnamachari Fabio Pellacini

Siggraph Exhibitor Sessions

Intel Corporation Wednesday 8 August 430-530 pm room 402B The Future of Visual Computing as Viewed by Intel Visual Computing Research Centers

51

Other ISTC-VC SIGGRAPH Participation

Page 27: Future of Visual Computing as viewed by Intel Visual ... · PDF fileFuture of Visual Computing as viewed by Intel Visual Computing Research Centers ... Justin Rattner Intel Science

Markerless Motion Capture of Interacting Characters Using Multi-view Image Segmentation

Articulated Models Input silhouettes Segmentation Contour labels Estimated surface Estimated 3D models

Handling Intersections

Improved segmentation with 3D shape priors Excellent performance when evaluated against marker-based system

bull Interactive inspection of light transport in virtual scenes ndash You can only manipulate what you see

ndash First prototypal light manipulation tools

bull Efficient global illumination ndash Otherwise no interactive

visualization nor manipulation

ndash Improvements on many-lights methods and progressive photon mapping

bull Results ndash Demonstrator Maya plugin ndash Collaboration with local film academy

Visualization and Editing of Light Transport Carsten Dachsbacher

Advanced Real-Time Ray Tracing Techniques Philipp Slusallek

bull Perfect importance sampling and caching ndash Sparse but perfect importance sampling

ndash Caching and interpolation [Eurographics`12]

bull Unifying Photon-Mapping amp Monte-Carlo ndash Formulating PM as a MC process

ndash Per pixel combination using MIS

bull Data-parallel implementations

ndash Efficiency and performance

bull Integration into XML3D

ndash Provide ldquocorrectrdquo results by default

Vertex Merging with Multiple Importance Sampling Photon-Mapping as a Monte-Carlo Process

BPT

PPM Progressive Photon-Mapping (PPM)

Bidirectional Path Tracing (BPT)

bull Whole-Function Vectorization ndash Restore scalar computations

ndash LLVM platform-independent

ndash RenderMan frontend OpenCL driver

bull Vector Programming ndash Formalized C extension for portable

effective SIMD programming

ndash Type system triggers vectorization

ndash Data layout adaption

bull New Programming Models for High-Performance Graphics

bull Results ndash Demonstrators for shaders and HPC code

ndash CC++-Extensions (with Intel)

ndash OpenCL compiler (CPU)

Compiler Support for High-Performance Graphics Sebastian Hack

bull Hybrid Rendering ndash Client amp Server Model

ndash Smartphone to Mainframe

bull Large Data Processing ndash Scalable Hierarchical

RW Data Structures

bull Results ndash ZAPP displaywall demonstrator

ndash ImageVis3D (Mobile) demonstrator

ndash Practically use in hospitals

Scalable Hybrid Rendering for Large Scale Visualization Jens Kruumlger

Displays as a Service Large Scale Visualization Alexander Loumlffler

bull Virtualization of Displays ndash Virtual Framebuffer and Displays exposed to Internet

ndash Replacing cables by switched IP network

ndash Internet standards for video encoding and streaming

bull Fully Synchronized ndash 120 Hz active stereo sync over IP

ndash Accuracy of ~100us in software

ndash Drives GPU displays output

bull Results ndash 20-screen wall demonstrator

ndash 3-screen wall (thin-bezel)

ndash CE4100 based SW synchronization

SIGGRAPH 2012

Backup

The Intel Science and Technology Center (ISTC) and Intel Collaborative Research Institute (ICRI) Programs

35

The modern economy is an information economy and one that is driven by innovations that enhance productivity as well as create new modes of entertainment We need to invest in the basic research that will inspire future products and services and ensure long term health of our information economy Government and private foundations are helping but corporate America needs to step up and increase commitments to university research - Justin Rattner ndash Intel CTO

$140M investment over 5 years announced by Intel in 2011 and 2012

Centers of Excellence bull Each ISTC and ICRI will focus on one

research area eg visual computing secure computing

bull The ISTCs and ICRIs are meant to bring the best and brightest researchers across the US together

bull Each ISTC and ICRI will be led by a host university and will include thought leaders from other schools

Breaking Barriers to Collaboration

bull Open IP models and open source software to encourage free information exchange (In most of the Centers)

bull Favor projects that span multiple institutions to encourage collaboration among universities

bull Intel researches per center assigned to work on-campus to encourage collaboration between Intel and academia

Greater Impact to Future Tech bull Center research themes to

address essential needs of computing technology

bull Research agendas jointly defined and co-led by an Intel and a University Principal Investigator

bull After completing 3-5 year charters new ISTCs and ICRIs can be formed to respond to changing tech environment

httpfolditportal

Serious Gaming pplied to Content Creation

Highlighted by President Obama Winner of most-significant new visualization tool (NSF)

Goal Create high-quality content by casting creation activities as games in which large numbers of people are incentivized to perform simple tasks which in combination yield sophisticated content PIs Zoran Popovic (UW) Noah Snavely (Cornell) Maneesh Agrawala(Berkeley)

Determining the structure of retroviral protease (HIV)

Video Frank to add Papers Frank to add

Extracting Structure and Semantics

CAD Model Points

Structures

People

Goals Enable context aware computing and automated content creation through the capture analysis and manipulation of real-world visual data PIs Steve Seitz (UW) Noah Snavely (Cornell) Tom Funkhouser (Princeton) Vladlen Koltun (Stanford) Jitendra Malik (Berkeley) Deva Ramanan (UV Irvine)

Video Frank to add Papers Frank to add

httpvisualstanfordedu

Computational Photography (Franken Camera)

Being adopted as a standard API for cellphone camera systems (Apple Android)

bull Goal Develop algorithms languages architectures and prototypes demonstrating the use of computation in the process of image capture and display

bull PIs Marc Levoy (Stanford) Mark Horowitz (Stanford) Pat Hanrahan (Stanford)

Video Frank to add Papers Frank to add

ISTC-VC SIGGRAPH Papers

Character Locomotion Monday 6 August 900 AM - 1030 AM Optimizing Locomotion Controllers Using Biologically Based Actuators and Objectives Jack M Wang Samuel R Hamner Scott L Delp Vladlen Koltun Continuous Character Control With Low-Dimensional Embeddings Sergey Levine Jack M Wang Alexis Haraux Zoran Popović Vladlen Koltun Shape Analysis Monday 6 August 900 AM - 1030 AM Schelling Points on 3D Surface Meshes Xiaobai Chen Abulhair Saparov Bill Pang Thomas Funkhouser Shape Transformation Wednesday 8 August 900 - 1030 AM An Algebraic Model for Parameterized Shape Editing Martin Bokeloh Michael Wand Hans-Peter Seidel Vladlen Koltun

42

ISTC-VC SIGGRAPH Papers

Image Processing Monday 6 August 2- 330 pm Decoupling Algorithms From Schedules for Easy Optimization of Image-Processing Pipelines Jonathan Ragan-Kelley Andrew Adams Sylvain Paris Marc Levoy Saman Amarasinghe Freacutedo Durand

Cloth

Monday 6 August 2-330 pm Specular Reflection From Woven Cloth Piti Irawan Steve Marschner Stitch Meshes for Modeling Knitted Clothing With Yarn-level Detail Cem Yuksel Jonathan M Kaldor Doug L James Steve Marschner

Appearance

Monday 6 August 345-535 pm Printing Spatially Varying Reflectance for Reproducing HDR Images Yue Dong Xin Tong Fabio Pellacini Baining Guo

43

ISTC-VC SIGGRAPH Papers (cont)

Hand Eye and Face Monday 6 August 345-535 pm Session Chair - Vladlen Koltun Discovery of Complex Behaviors through Contact-Invariant Optimization Igor Mordatch Emanuel Todorov Zoran Popovi1049029 Sketching Monday 6 August 345-535 pm HelpingHand Example-Based Stroke Stylization Jingwan Lu Fisher Yu Adam Finkelstein Stephen DiVerdi Fabrication Tuesday 7 August 9-1030 am Fabricating Articulated Characters From Skinned Meshes Moritz Baumlcher Bernd Bickel Doug L James Hanspeter Pfister

44

Sampling Reconstructing and Filtering Light Tuesday 7 August 1045 am-1215 pm A Theory of Monte Carlo Visibility Sampling Ravi Ramamoorthi John Anderson Mark Meyer Derek Nowrouzezahrai Reconstructing the Indirect Light Field for Global Illumination Jaakko Lehtinen Timo Aila Samuli Laine Freacutedo Durand

Geometry Reconstruction amp Tracking

Tuesday 7 August 1045 am-1215 pm Temporally Coherent Completion of Dynamic Shapes Hao Li Linjie Luo Daniel Vlasic Pieter Peers Jovan Popovic Mark Pauly Szymon Rusinkiewicz

Sets of Shapes

Tuesday 7 August 2-330 pm Exploring Collections of 3D Models Using Fuzzy Correspondence Vladimir G Kim Wilmot Li Niloy J Mitra Stephen DiVerdi Thomas Funkhouser A Probabilistic Model for Component-Based Shape Synthesis Evangelos Kalogerakis Siddhartha Chaudhuri Daphne Koller Vladlen Koltun

45

ISTC-VC SIGGRAPH Papers (cont)

Light Rays Tuesday 7 August 2-330 pm Manifold Exploration A Markov Chain Monte Carlo Technique for Rendering Scenes With Difficult Specular Transport Wenzel Jakob Steve Marschner Bidirectional Lightcuts Bruce Walter Pramook Khungurn Kavita Bala

Fun With Video

Tuesday 7 August 345-535 pm Session Chair Noah Snavely Video Deblurring for Hand-Held Cameras Using Patch-Based Synthesis Sunghyun Cho Jue Wang Seungyong Lee Eulerian Video Magnification for Revealing Subtle Changes in the World Hao-Yu Wu Michael Rubinstein Eugene Shih John Guttag Freacutedo Durand William T Freeman Selectively De-Animating Video Jiamin Bai Aseem Agarwala Maneesh Agrawala Ravi Ramamoorthi Tools for Placing Cuts and Transitions in Interview Video Floraine Berthouzoz Wilmot Li Maneesh Agrawala

46

ISTC-VC SIGGRAPH Papers (cont)

Noise and Texture Tuesday 7 August 345-535 pm Structure-Aware Synthesis for Predictive Woven Fabric Appearance Shuang Zhao Kavita Bala Steve Marschner Wenzel Jakob Symmetry-Guided Texture Synthesis and Manipulation Vladimir Kim Yaron Lipman Thomas Funkhouser

Shape Transformation Wednesday 8 August 900 - 1030 AM An Algebraic Model for Parameterized Shape Editing Martin Bokeloh Michael Wand Hans-Peter Seidel Vladlen Koltun

Stitching

Wednesday 8 August 1045 am-1215 pm Exposing Photo Manipulation With Inconsistent Reflections James F OrsquoBrien Hany Farid

47

ISTC-VC SIGGRAPH Papers (cont)

Maps Surfaces and Shapes

Wednesday 8 August 1045 am-1215 pm Simple Formulas For Quasiconformal Plane Deformations Yaron Lipman Vladimir G Kim Thomas Funkhouser

Interactive Systems amp Hardware Wednesday 8 August 2-330 pm Position-Correcting Tools for 2D Digital Fabrication Alec Rivers Ilan E Moyer Freacutedo Durand

48

ISTC-VC SIGGRAPH Papers (cont)

Collisions Wednesday 8 August 345-535 pm Energy-Based Self-Collision Culling for Arbitrary Mesh Deformations Changxi Zheng Doug L James

All About Images

Thursday 9 August 9-1030 am A Framework for Content-Adaptive Photo Manipulation Macros Application to Face Landscape and Global Manipulations Floraine Berthouzoz Wilmot Li Mira Dontcheva Maneesh Agrawala

Sound and Elements

Thursday 9 August 9-1030 am Motion-Driven Concatenative Synthesis of Cloth Sounds Steven S An Doug L James Steve Marschner Precomputed Acceleration Noise for Improved Rigid-Body Sound Jeffrey N Chadwick Changxi Zheng Doug L James Interactive Sound Propagation Using Compact Acoustic Transfer Operators Lakulish Antani Anish Chandak Lauri Savioja Dinesh Manocha Updated Sparse Cholesky Factors for Corotational Elastodynamics Florian Hecht Yeon Jin Lee Jonathan R Shewchuk James F OrsquoBrien

49

ISTC-VC SIGGRAPH Papers (cont)

Geometry amp Viewing Thursday 9 August 2-330 pm Perceptual Models of Viewpoint Preference Adrian Secordm Jingwan Lu Adam Finkelstein Manish Singh Andrew Nealen

Faces and Hair [Closing Session]

Thursday 9 August 345-515 pm Coupled 3D Reconstruction of Sparse Facial Hair and Skin Thabo Beeler Bernd Bickel Gioacchino Noris Paul Beardsley Steve Marschner Robert W Sumner Markus Gross Physical Face Cloning Bernd Bickel Peter Kaufmann Melina Skouras Bernhard Thomaszewski Derek Bradley Thabo Beeler Philip Jackson Steve Marschner Wojciech Matusik Markus Gross

50

ISTC-VC SIGGRAPH Papers (cont)

Siggraph Courses Optimizing Realistic Rendering With Many-Light Methods Sunday 5 August 2-515 pm Jaroslav Krivanek Milos Hasan Adam Arbree Carsten Dachsbacher Alexander Keller Bruce Walter State of the Art in Photon-Density Estimation Thursday 9 August 2-515 pm Toshiya Hachisuka Wojciech Jarosz Guillaume Bouchard Per Christensen Jeppe Revall Frisvad Wenzel Jakob Henrik Wann Jensen Jared M Johnson Michael Kaschalk Claude Knaus Andrew Selle Ben Spencer

Siggraph Talks

Silence Eliminate the Noise Thursday 9 August 9-1030 am Importance Sampling for Hair Scattering Jiawei Ou Feng Xie Parashar Krishnamachari Fabio Pellacini

Siggraph Exhibitor Sessions

Intel Corporation Wednesday 8 August 430-530 pm room 402B The Future of Visual Computing as Viewed by Intel Visual Computing Research Centers

51

Other ISTC-VC SIGGRAPH Participation

Page 28: Future of Visual Computing as viewed by Intel Visual ... · PDF fileFuture of Visual Computing as viewed by Intel Visual Computing Research Centers ... Justin Rattner Intel Science

bull Interactive inspection of light transport in virtual scenes ndash You can only manipulate what you see

ndash First prototypal light manipulation tools

bull Efficient global illumination ndash Otherwise no interactive

visualization nor manipulation

ndash Improvements on many-lights methods and progressive photon mapping

bull Results ndash Demonstrator Maya plugin ndash Collaboration with local film academy

Visualization and Editing of Light Transport Carsten Dachsbacher

Advanced Real-Time Ray Tracing Techniques Philipp Slusallek

bull Perfect importance sampling and caching ndash Sparse but perfect importance sampling

ndash Caching and interpolation [Eurographics`12]

bull Unifying Photon-Mapping amp Monte-Carlo ndash Formulating PM as a MC process

ndash Per pixel combination using MIS

bull Data-parallel implementations

ndash Efficiency and performance

bull Integration into XML3D

ndash Provide ldquocorrectrdquo results by default

Vertex Merging with Multiple Importance Sampling Photon-Mapping as a Monte-Carlo Process

BPT

PPM Progressive Photon-Mapping (PPM)

Bidirectional Path Tracing (BPT)

bull Whole-Function Vectorization ndash Restore scalar computations

ndash LLVM platform-independent

ndash RenderMan frontend OpenCL driver

bull Vector Programming ndash Formalized C extension for portable

effective SIMD programming

ndash Type system triggers vectorization

ndash Data layout adaption

bull New Programming Models for High-Performance Graphics

bull Results ndash Demonstrators for shaders and HPC code

ndash CC++-Extensions (with Intel)

ndash OpenCL compiler (CPU)

Compiler Support for High-Performance Graphics Sebastian Hack

bull Hybrid Rendering ndash Client amp Server Model

ndash Smartphone to Mainframe

bull Large Data Processing ndash Scalable Hierarchical

RW Data Structures

bull Results ndash ZAPP displaywall demonstrator

ndash ImageVis3D (Mobile) demonstrator

ndash Practically use in hospitals

Scalable Hybrid Rendering for Large Scale Visualization Jens Kruumlger

Displays as a Service Large Scale Visualization Alexander Loumlffler

bull Virtualization of Displays ndash Virtual Framebuffer and Displays exposed to Internet

ndash Replacing cables by switched IP network

ndash Internet standards for video encoding and streaming

bull Fully Synchronized ndash 120 Hz active stereo sync over IP

ndash Accuracy of ~100us in software

ndash Drives GPU displays output

bull Results ndash 20-screen wall demonstrator

ndash 3-screen wall (thin-bezel)

ndash CE4100 based SW synchronization

SIGGRAPH 2012

Backup

The Intel Science and Technology Center (ISTC) and Intel Collaborative Research Institute (ICRI) Programs

35

The modern economy is an information economy and one that is driven by innovations that enhance productivity as well as create new modes of entertainment We need to invest in the basic research that will inspire future products and services and ensure long term health of our information economy Government and private foundations are helping but corporate America needs to step up and increase commitments to university research - Justin Rattner ndash Intel CTO

$140M investment over 5 years announced by Intel in 2011 and 2012

Centers of Excellence bull Each ISTC and ICRI will focus on one

research area eg visual computing secure computing

bull The ISTCs and ICRIs are meant to bring the best and brightest researchers across the US together

bull Each ISTC and ICRI will be led by a host university and will include thought leaders from other schools

Breaking Barriers to Collaboration

bull Open IP models and open source software to encourage free information exchange (In most of the Centers)

bull Favor projects that span multiple institutions to encourage collaboration among universities

bull Intel researches per center assigned to work on-campus to encourage collaboration between Intel and academia

Greater Impact to Future Tech bull Center research themes to

address essential needs of computing technology

bull Research agendas jointly defined and co-led by an Intel and a University Principal Investigator

bull After completing 3-5 year charters new ISTCs and ICRIs can be formed to respond to changing tech environment

httpfolditportal

Serious Gaming pplied to Content Creation

Highlighted by President Obama Winner of most-significant new visualization tool (NSF)

Goal Create high-quality content by casting creation activities as games in which large numbers of people are incentivized to perform simple tasks which in combination yield sophisticated content PIs Zoran Popovic (UW) Noah Snavely (Cornell) Maneesh Agrawala(Berkeley)

Determining the structure of retroviral protease (HIV)

Video Frank to add Papers Frank to add

Extracting Structure and Semantics

CAD Model Points

Structures

People

Goals Enable context aware computing and automated content creation through the capture analysis and manipulation of real-world visual data PIs Steve Seitz (UW) Noah Snavely (Cornell) Tom Funkhouser (Princeton) Vladlen Koltun (Stanford) Jitendra Malik (Berkeley) Deva Ramanan (UV Irvine)

Video Frank to add Papers Frank to add

httpvisualstanfordedu

Computational Photography (Franken Camera)

Being adopted as a standard API for cellphone camera systems (Apple Android)

bull Goal Develop algorithms languages architectures and prototypes demonstrating the use of computation in the process of image capture and display

bull PIs Marc Levoy (Stanford) Mark Horowitz (Stanford) Pat Hanrahan (Stanford)

Video Frank to add Papers Frank to add

ISTC-VC SIGGRAPH Papers

Character Locomotion Monday 6 August 900 AM - 1030 AM Optimizing Locomotion Controllers Using Biologically Based Actuators and Objectives Jack M Wang Samuel R Hamner Scott L Delp Vladlen Koltun Continuous Character Control With Low-Dimensional Embeddings Sergey Levine Jack M Wang Alexis Haraux Zoran Popović Vladlen Koltun Shape Analysis Monday 6 August 900 AM - 1030 AM Schelling Points on 3D Surface Meshes Xiaobai Chen Abulhair Saparov Bill Pang Thomas Funkhouser Shape Transformation Wednesday 8 August 900 - 1030 AM An Algebraic Model for Parameterized Shape Editing Martin Bokeloh Michael Wand Hans-Peter Seidel Vladlen Koltun

42

ISTC-VC SIGGRAPH Papers

Image Processing Monday 6 August 2- 330 pm Decoupling Algorithms From Schedules for Easy Optimization of Image-Processing Pipelines Jonathan Ragan-Kelley Andrew Adams Sylvain Paris Marc Levoy Saman Amarasinghe Freacutedo Durand

Cloth

Monday 6 August 2-330 pm Specular Reflection From Woven Cloth Piti Irawan Steve Marschner Stitch Meshes for Modeling Knitted Clothing With Yarn-level Detail Cem Yuksel Jonathan M Kaldor Doug L James Steve Marschner

Appearance

Monday 6 August 345-535 pm Printing Spatially Varying Reflectance for Reproducing HDR Images Yue Dong Xin Tong Fabio Pellacini Baining Guo

43

ISTC-VC SIGGRAPH Papers (cont)

Hand Eye and Face Monday 6 August 345-535 pm Session Chair - Vladlen Koltun Discovery of Complex Behaviors through Contact-Invariant Optimization Igor Mordatch Emanuel Todorov Zoran Popovi1049029 Sketching Monday 6 August 345-535 pm HelpingHand Example-Based Stroke Stylization Jingwan Lu Fisher Yu Adam Finkelstein Stephen DiVerdi Fabrication Tuesday 7 August 9-1030 am Fabricating Articulated Characters From Skinned Meshes Moritz Baumlcher Bernd Bickel Doug L James Hanspeter Pfister

44

Sampling Reconstructing and Filtering Light Tuesday 7 August 1045 am-1215 pm A Theory of Monte Carlo Visibility Sampling Ravi Ramamoorthi John Anderson Mark Meyer Derek Nowrouzezahrai Reconstructing the Indirect Light Field for Global Illumination Jaakko Lehtinen Timo Aila Samuli Laine Freacutedo Durand

Geometry Reconstruction amp Tracking

Tuesday 7 August 1045 am-1215 pm Temporally Coherent Completion of Dynamic Shapes Hao Li Linjie Luo Daniel Vlasic Pieter Peers Jovan Popovic Mark Pauly Szymon Rusinkiewicz

Sets of Shapes

Tuesday 7 August 2-330 pm Exploring Collections of 3D Models Using Fuzzy Correspondence Vladimir G Kim Wilmot Li Niloy J Mitra Stephen DiVerdi Thomas Funkhouser A Probabilistic Model for Component-Based Shape Synthesis Evangelos Kalogerakis Siddhartha Chaudhuri Daphne Koller Vladlen Koltun

45

ISTC-VC SIGGRAPH Papers (cont)

Light Rays Tuesday 7 August 2-330 pm Manifold Exploration A Markov Chain Monte Carlo Technique for Rendering Scenes With Difficult Specular Transport Wenzel Jakob Steve Marschner Bidirectional Lightcuts Bruce Walter Pramook Khungurn Kavita Bala

Fun With Video

Tuesday 7 August 345-535 pm Session Chair Noah Snavely Video Deblurring for Hand-Held Cameras Using Patch-Based Synthesis Sunghyun Cho Jue Wang Seungyong Lee Eulerian Video Magnification for Revealing Subtle Changes in the World Hao-Yu Wu Michael Rubinstein Eugene Shih John Guttag Freacutedo Durand William T Freeman Selectively De-Animating Video Jiamin Bai Aseem Agarwala Maneesh Agrawala Ravi Ramamoorthi Tools for Placing Cuts and Transitions in Interview Video Floraine Berthouzoz Wilmot Li Maneesh Agrawala

46

ISTC-VC SIGGRAPH Papers (cont)

Noise and Texture Tuesday 7 August 345-535 pm Structure-Aware Synthesis for Predictive Woven Fabric Appearance Shuang Zhao Kavita Bala Steve Marschner Wenzel Jakob Symmetry-Guided Texture Synthesis and Manipulation Vladimir Kim Yaron Lipman Thomas Funkhouser

Shape Transformation Wednesday 8 August 900 - 1030 AM An Algebraic Model for Parameterized Shape Editing Martin Bokeloh Michael Wand Hans-Peter Seidel Vladlen Koltun

Stitching

Wednesday 8 August 1045 am-1215 pm Exposing Photo Manipulation With Inconsistent Reflections James F OrsquoBrien Hany Farid

47

ISTC-VC SIGGRAPH Papers (cont)

Maps Surfaces and Shapes

Wednesday 8 August 1045 am-1215 pm Simple Formulas For Quasiconformal Plane Deformations Yaron Lipman Vladimir G Kim Thomas Funkhouser

Interactive Systems amp Hardware Wednesday 8 August 2-330 pm Position-Correcting Tools for 2D Digital Fabrication Alec Rivers Ilan E Moyer Freacutedo Durand

48

ISTC-VC SIGGRAPH Papers (cont)

Collisions Wednesday 8 August 345-535 pm Energy-Based Self-Collision Culling for Arbitrary Mesh Deformations Changxi Zheng Doug L James

All About Images

Thursday 9 August 9-1030 am A Framework for Content-Adaptive Photo Manipulation Macros Application to Face Landscape and Global Manipulations Floraine Berthouzoz Wilmot Li Mira Dontcheva Maneesh Agrawala

Sound and Elements

Thursday 9 August 9-1030 am Motion-Driven Concatenative Synthesis of Cloth Sounds Steven S An Doug L James Steve Marschner Precomputed Acceleration Noise for Improved Rigid-Body Sound Jeffrey N Chadwick Changxi Zheng Doug L James Interactive Sound Propagation Using Compact Acoustic Transfer Operators Lakulish Antani Anish Chandak Lauri Savioja Dinesh Manocha Updated Sparse Cholesky Factors for Corotational Elastodynamics Florian Hecht Yeon Jin Lee Jonathan R Shewchuk James F OrsquoBrien

49

ISTC-VC SIGGRAPH Papers (cont)

Geometry amp Viewing Thursday 9 August 2-330 pm Perceptual Models of Viewpoint Preference Adrian Secordm Jingwan Lu Adam Finkelstein Manish Singh Andrew Nealen

Faces and Hair [Closing Session]

Thursday 9 August 345-515 pm Coupled 3D Reconstruction of Sparse Facial Hair and Skin Thabo Beeler Bernd Bickel Gioacchino Noris Paul Beardsley Steve Marschner Robert W Sumner Markus Gross Physical Face Cloning Bernd Bickel Peter Kaufmann Melina Skouras Bernhard Thomaszewski Derek Bradley Thabo Beeler Philip Jackson Steve Marschner Wojciech Matusik Markus Gross

50

ISTC-VC SIGGRAPH Papers (cont)

Siggraph Courses Optimizing Realistic Rendering With Many-Light Methods Sunday 5 August 2-515 pm Jaroslav Krivanek Milos Hasan Adam Arbree Carsten Dachsbacher Alexander Keller Bruce Walter State of the Art in Photon-Density Estimation Thursday 9 August 2-515 pm Toshiya Hachisuka Wojciech Jarosz Guillaume Bouchard Per Christensen Jeppe Revall Frisvad Wenzel Jakob Henrik Wann Jensen Jared M Johnson Michael Kaschalk Claude Knaus Andrew Selle Ben Spencer

Siggraph Talks

Silence Eliminate the Noise Thursday 9 August 9-1030 am Importance Sampling for Hair Scattering Jiawei Ou Feng Xie Parashar Krishnamachari Fabio Pellacini

Siggraph Exhibitor Sessions

Intel Corporation Wednesday 8 August 430-530 pm room 402B The Future of Visual Computing as Viewed by Intel Visual Computing Research Centers

51

Other ISTC-VC SIGGRAPH Participation

Page 29: Future of Visual Computing as viewed by Intel Visual ... · PDF fileFuture of Visual Computing as viewed by Intel Visual Computing Research Centers ... Justin Rattner Intel Science

Advanced Real-Time Ray Tracing Techniques Philipp Slusallek

bull Perfect importance sampling and caching ndash Sparse but perfect importance sampling

ndash Caching and interpolation [Eurographics`12]

bull Unifying Photon-Mapping amp Monte-Carlo ndash Formulating PM as a MC process

ndash Per pixel combination using MIS

bull Data-parallel implementations

ndash Efficiency and performance

bull Integration into XML3D

ndash Provide ldquocorrectrdquo results by default

Vertex Merging with Multiple Importance Sampling Photon-Mapping as a Monte-Carlo Process

BPT

PPM Progressive Photon-Mapping (PPM)

Bidirectional Path Tracing (BPT)

bull Whole-Function Vectorization ndash Restore scalar computations

ndash LLVM platform-independent

ndash RenderMan frontend OpenCL driver

bull Vector Programming ndash Formalized C extension for portable

effective SIMD programming

ndash Type system triggers vectorization

ndash Data layout adaption

bull New Programming Models for High-Performance Graphics

bull Results ndash Demonstrators for shaders and HPC code

ndash CC++-Extensions (with Intel)

ndash OpenCL compiler (CPU)

Compiler Support for High-Performance Graphics Sebastian Hack

bull Hybrid Rendering ndash Client amp Server Model

ndash Smartphone to Mainframe

bull Large Data Processing ndash Scalable Hierarchical

RW Data Structures

bull Results ndash ZAPP displaywall demonstrator

ndash ImageVis3D (Mobile) demonstrator

ndash Practically use in hospitals

Scalable Hybrid Rendering for Large Scale Visualization Jens Kruumlger

Displays as a Service Large Scale Visualization Alexander Loumlffler

bull Virtualization of Displays ndash Virtual Framebuffer and Displays exposed to Internet

ndash Replacing cables by switched IP network

ndash Internet standards for video encoding and streaming

bull Fully Synchronized ndash 120 Hz active stereo sync over IP

ndash Accuracy of ~100us in software

ndash Drives GPU displays output

bull Results ndash 20-screen wall demonstrator

ndash 3-screen wall (thin-bezel)

ndash CE4100 based SW synchronization

SIGGRAPH 2012

Backup

The Intel Science and Technology Center (ISTC) and Intel Collaborative Research Institute (ICRI) Programs

35

The modern economy is an information economy and one that is driven by innovations that enhance productivity as well as create new modes of entertainment We need to invest in the basic research that will inspire future products and services and ensure long term health of our information economy Government and private foundations are helping but corporate America needs to step up and increase commitments to university research - Justin Rattner ndash Intel CTO

$140M investment over 5 years announced by Intel in 2011 and 2012

Centers of Excellence bull Each ISTC and ICRI will focus on one

research area eg visual computing secure computing

bull The ISTCs and ICRIs are meant to bring the best and brightest researchers across the US together

bull Each ISTC and ICRI will be led by a host university and will include thought leaders from other schools

Breaking Barriers to Collaboration

bull Open IP models and open source software to encourage free information exchange (In most of the Centers)

bull Favor projects that span multiple institutions to encourage collaboration among universities

bull Intel researches per center assigned to work on-campus to encourage collaboration between Intel and academia

Greater Impact to Future Tech bull Center research themes to

address essential needs of computing technology

bull Research agendas jointly defined and co-led by an Intel and a University Principal Investigator

bull After completing 3-5 year charters new ISTCs and ICRIs can be formed to respond to changing tech environment

httpfolditportal

Serious Gaming pplied to Content Creation

Highlighted by President Obama Winner of most-significant new visualization tool (NSF)

Goal Create high-quality content by casting creation activities as games in which large numbers of people are incentivized to perform simple tasks which in combination yield sophisticated content PIs Zoran Popovic (UW) Noah Snavely (Cornell) Maneesh Agrawala(Berkeley)

Determining the structure of retroviral protease (HIV)

Video Frank to add Papers Frank to add

Extracting Structure and Semantics

CAD Model Points

Structures

People

Goals Enable context aware computing and automated content creation through the capture analysis and manipulation of real-world visual data PIs Steve Seitz (UW) Noah Snavely (Cornell) Tom Funkhouser (Princeton) Vladlen Koltun (Stanford) Jitendra Malik (Berkeley) Deva Ramanan (UV Irvine)

Video Frank to add Papers Frank to add

httpvisualstanfordedu

Computational Photography (Franken Camera)

Being adopted as a standard API for cellphone camera systems (Apple Android)

bull Goal Develop algorithms languages architectures and prototypes demonstrating the use of computation in the process of image capture and display

bull PIs Marc Levoy (Stanford) Mark Horowitz (Stanford) Pat Hanrahan (Stanford)

Video Frank to add Papers Frank to add

ISTC-VC SIGGRAPH Papers

Character Locomotion Monday 6 August 900 AM - 1030 AM Optimizing Locomotion Controllers Using Biologically Based Actuators and Objectives Jack M Wang Samuel R Hamner Scott L Delp Vladlen Koltun Continuous Character Control With Low-Dimensional Embeddings Sergey Levine Jack M Wang Alexis Haraux Zoran Popović Vladlen Koltun Shape Analysis Monday 6 August 900 AM - 1030 AM Schelling Points on 3D Surface Meshes Xiaobai Chen Abulhair Saparov Bill Pang Thomas Funkhouser Shape Transformation Wednesday 8 August 900 - 1030 AM An Algebraic Model for Parameterized Shape Editing Martin Bokeloh Michael Wand Hans-Peter Seidel Vladlen Koltun

42

ISTC-VC SIGGRAPH Papers

Image Processing Monday 6 August 2- 330 pm Decoupling Algorithms From Schedules for Easy Optimization of Image-Processing Pipelines Jonathan Ragan-Kelley Andrew Adams Sylvain Paris Marc Levoy Saman Amarasinghe Freacutedo Durand

Cloth

Monday 6 August 2-330 pm Specular Reflection From Woven Cloth Piti Irawan Steve Marschner Stitch Meshes for Modeling Knitted Clothing With Yarn-level Detail Cem Yuksel Jonathan M Kaldor Doug L James Steve Marschner

Appearance

Monday 6 August 345-535 pm Printing Spatially Varying Reflectance for Reproducing HDR Images Yue Dong Xin Tong Fabio Pellacini Baining Guo

43

ISTC-VC SIGGRAPH Papers (cont)

Hand Eye and Face Monday 6 August 345-535 pm Session Chair - Vladlen Koltun Discovery of Complex Behaviors through Contact-Invariant Optimization Igor Mordatch Emanuel Todorov Zoran Popovi1049029 Sketching Monday 6 August 345-535 pm HelpingHand Example-Based Stroke Stylization Jingwan Lu Fisher Yu Adam Finkelstein Stephen DiVerdi Fabrication Tuesday 7 August 9-1030 am Fabricating Articulated Characters From Skinned Meshes Moritz Baumlcher Bernd Bickel Doug L James Hanspeter Pfister

44

Sampling Reconstructing and Filtering Light Tuesday 7 August 1045 am-1215 pm A Theory of Monte Carlo Visibility Sampling Ravi Ramamoorthi John Anderson Mark Meyer Derek Nowrouzezahrai Reconstructing the Indirect Light Field for Global Illumination Jaakko Lehtinen Timo Aila Samuli Laine Freacutedo Durand

Geometry Reconstruction amp Tracking

Tuesday 7 August 1045 am-1215 pm Temporally Coherent Completion of Dynamic Shapes Hao Li Linjie Luo Daniel Vlasic Pieter Peers Jovan Popovic Mark Pauly Szymon Rusinkiewicz

Sets of Shapes

Tuesday 7 August 2-330 pm Exploring Collections of 3D Models Using Fuzzy Correspondence Vladimir G Kim Wilmot Li Niloy J Mitra Stephen DiVerdi Thomas Funkhouser A Probabilistic Model for Component-Based Shape Synthesis Evangelos Kalogerakis Siddhartha Chaudhuri Daphne Koller Vladlen Koltun

45

ISTC-VC SIGGRAPH Papers (cont)

Light Rays Tuesday 7 August 2-330 pm Manifold Exploration A Markov Chain Monte Carlo Technique for Rendering Scenes With Difficult Specular Transport Wenzel Jakob Steve Marschner Bidirectional Lightcuts Bruce Walter Pramook Khungurn Kavita Bala

Fun With Video

Tuesday 7 August 345-535 pm Session Chair Noah Snavely Video Deblurring for Hand-Held Cameras Using Patch-Based Synthesis Sunghyun Cho Jue Wang Seungyong Lee Eulerian Video Magnification for Revealing Subtle Changes in the World Hao-Yu Wu Michael Rubinstein Eugene Shih John Guttag Freacutedo Durand William T Freeman Selectively De-Animating Video Jiamin Bai Aseem Agarwala Maneesh Agrawala Ravi Ramamoorthi Tools for Placing Cuts and Transitions in Interview Video Floraine Berthouzoz Wilmot Li Maneesh Agrawala

46

ISTC-VC SIGGRAPH Papers (cont)

Noise and Texture Tuesday 7 August 345-535 pm Structure-Aware Synthesis for Predictive Woven Fabric Appearance Shuang Zhao Kavita Bala Steve Marschner Wenzel Jakob Symmetry-Guided Texture Synthesis and Manipulation Vladimir Kim Yaron Lipman Thomas Funkhouser

Shape Transformation Wednesday 8 August 900 - 1030 AM An Algebraic Model for Parameterized Shape Editing Martin Bokeloh Michael Wand Hans-Peter Seidel Vladlen Koltun

Stitching

Wednesday 8 August 1045 am-1215 pm Exposing Photo Manipulation With Inconsistent Reflections James F OrsquoBrien Hany Farid

47

ISTC-VC SIGGRAPH Papers (cont)

Maps Surfaces and Shapes

Wednesday 8 August 1045 am-1215 pm Simple Formulas For Quasiconformal Plane Deformations Yaron Lipman Vladimir G Kim Thomas Funkhouser

Interactive Systems amp Hardware Wednesday 8 August 2-330 pm Position-Correcting Tools for 2D Digital Fabrication Alec Rivers Ilan E Moyer Freacutedo Durand

48

ISTC-VC SIGGRAPH Papers (cont)

Collisions Wednesday 8 August 345-535 pm Energy-Based Self-Collision Culling for Arbitrary Mesh Deformations Changxi Zheng Doug L James

All About Images

Thursday 9 August 9-1030 am A Framework for Content-Adaptive Photo Manipulation Macros Application to Face Landscape and Global Manipulations Floraine Berthouzoz Wilmot Li Mira Dontcheva Maneesh Agrawala

Sound and Elements

Thursday 9 August 9-1030 am Motion-Driven Concatenative Synthesis of Cloth Sounds Steven S An Doug L James Steve Marschner Precomputed Acceleration Noise for Improved Rigid-Body Sound Jeffrey N Chadwick Changxi Zheng Doug L James Interactive Sound Propagation Using Compact Acoustic Transfer Operators Lakulish Antani Anish Chandak Lauri Savioja Dinesh Manocha Updated Sparse Cholesky Factors for Corotational Elastodynamics Florian Hecht Yeon Jin Lee Jonathan R Shewchuk James F OrsquoBrien

49

ISTC-VC SIGGRAPH Papers (cont)

Geometry amp Viewing Thursday 9 August 2-330 pm Perceptual Models of Viewpoint Preference Adrian Secordm Jingwan Lu Adam Finkelstein Manish Singh Andrew Nealen

Faces and Hair [Closing Session]

Thursday 9 August 345-515 pm Coupled 3D Reconstruction of Sparse Facial Hair and Skin Thabo Beeler Bernd Bickel Gioacchino Noris Paul Beardsley Steve Marschner Robert W Sumner Markus Gross Physical Face Cloning Bernd Bickel Peter Kaufmann Melina Skouras Bernhard Thomaszewski Derek Bradley Thabo Beeler Philip Jackson Steve Marschner Wojciech Matusik Markus Gross

50

ISTC-VC SIGGRAPH Papers (cont)

Siggraph Courses Optimizing Realistic Rendering With Many-Light Methods Sunday 5 August 2-515 pm Jaroslav Krivanek Milos Hasan Adam Arbree Carsten Dachsbacher Alexander Keller Bruce Walter State of the Art in Photon-Density Estimation Thursday 9 August 2-515 pm Toshiya Hachisuka Wojciech Jarosz Guillaume Bouchard Per Christensen Jeppe Revall Frisvad Wenzel Jakob Henrik Wann Jensen Jared M Johnson Michael Kaschalk Claude Knaus Andrew Selle Ben Spencer

Siggraph Talks

Silence Eliminate the Noise Thursday 9 August 9-1030 am Importance Sampling for Hair Scattering Jiawei Ou Feng Xie Parashar Krishnamachari Fabio Pellacini

Siggraph Exhibitor Sessions

Intel Corporation Wednesday 8 August 430-530 pm room 402B The Future of Visual Computing as Viewed by Intel Visual Computing Research Centers

51

Other ISTC-VC SIGGRAPH Participation

Page 30: Future of Visual Computing as viewed by Intel Visual ... · PDF fileFuture of Visual Computing as viewed by Intel Visual Computing Research Centers ... Justin Rattner Intel Science

Vertex Merging with Multiple Importance Sampling Photon-Mapping as a Monte-Carlo Process

BPT

PPM Progressive Photon-Mapping (PPM)

Bidirectional Path Tracing (BPT)

bull Whole-Function Vectorization ndash Restore scalar computations

ndash LLVM platform-independent

ndash RenderMan frontend OpenCL driver

bull Vector Programming ndash Formalized C extension for portable

effective SIMD programming

ndash Type system triggers vectorization

ndash Data layout adaption

bull New Programming Models for High-Performance Graphics

bull Results ndash Demonstrators for shaders and HPC code

ndash CC++-Extensions (with Intel)

ndash OpenCL compiler (CPU)

Compiler Support for High-Performance Graphics Sebastian Hack

bull Hybrid Rendering ndash Client amp Server Model

ndash Smartphone to Mainframe

bull Large Data Processing ndash Scalable Hierarchical

RW Data Structures

bull Results ndash ZAPP displaywall demonstrator

ndash ImageVis3D (Mobile) demonstrator

ndash Practically use in hospitals

Scalable Hybrid Rendering for Large Scale Visualization Jens Kruumlger

Displays as a Service Large Scale Visualization Alexander Loumlffler

bull Virtualization of Displays ndash Virtual Framebuffer and Displays exposed to Internet

ndash Replacing cables by switched IP network

ndash Internet standards for video encoding and streaming

bull Fully Synchronized ndash 120 Hz active stereo sync over IP

ndash Accuracy of ~100us in software

ndash Drives GPU displays output

bull Results ndash 20-screen wall demonstrator

ndash 3-screen wall (thin-bezel)

ndash CE4100 based SW synchronization

SIGGRAPH 2012

Backup

The Intel Science and Technology Center (ISTC) and Intel Collaborative Research Institute (ICRI) Programs

35

The modern economy is an information economy and one that is driven by innovations that enhance productivity as well as create new modes of entertainment We need to invest in the basic research that will inspire future products and services and ensure long term health of our information economy Government and private foundations are helping but corporate America needs to step up and increase commitments to university research - Justin Rattner ndash Intel CTO

$140M investment over 5 years announced by Intel in 2011 and 2012

Centers of Excellence bull Each ISTC and ICRI will focus on one

research area eg visual computing secure computing

bull The ISTCs and ICRIs are meant to bring the best and brightest researchers across the US together

bull Each ISTC and ICRI will be led by a host university and will include thought leaders from other schools

Breaking Barriers to Collaboration

bull Open IP models and open source software to encourage free information exchange (In most of the Centers)

bull Favor projects that span multiple institutions to encourage collaboration among universities

bull Intel researches per center assigned to work on-campus to encourage collaboration between Intel and academia

Greater Impact to Future Tech bull Center research themes to

address essential needs of computing technology

bull Research agendas jointly defined and co-led by an Intel and a University Principal Investigator

bull After completing 3-5 year charters new ISTCs and ICRIs can be formed to respond to changing tech environment

httpfolditportal

Serious Gaming pplied to Content Creation

Highlighted by President Obama Winner of most-significant new visualization tool (NSF)

Goal Create high-quality content by casting creation activities as games in which large numbers of people are incentivized to perform simple tasks which in combination yield sophisticated content PIs Zoran Popovic (UW) Noah Snavely (Cornell) Maneesh Agrawala(Berkeley)

Determining the structure of retroviral protease (HIV)

Video Frank to add Papers Frank to add

Extracting Structure and Semantics

CAD Model Points

Structures

People

Goals Enable context aware computing and automated content creation through the capture analysis and manipulation of real-world visual data PIs Steve Seitz (UW) Noah Snavely (Cornell) Tom Funkhouser (Princeton) Vladlen Koltun (Stanford) Jitendra Malik (Berkeley) Deva Ramanan (UV Irvine)

Video Frank to add Papers Frank to add

httpvisualstanfordedu

Computational Photography (Franken Camera)

Being adopted as a standard API for cellphone camera systems (Apple Android)

bull Goal Develop algorithms languages architectures and prototypes demonstrating the use of computation in the process of image capture and display

bull PIs Marc Levoy (Stanford) Mark Horowitz (Stanford) Pat Hanrahan (Stanford)

Video Frank to add Papers Frank to add

ISTC-VC SIGGRAPH Papers

Character Locomotion Monday 6 August 900 AM - 1030 AM Optimizing Locomotion Controllers Using Biologically Based Actuators and Objectives Jack M Wang Samuel R Hamner Scott L Delp Vladlen Koltun Continuous Character Control With Low-Dimensional Embeddings Sergey Levine Jack M Wang Alexis Haraux Zoran Popović Vladlen Koltun Shape Analysis Monday 6 August 900 AM - 1030 AM Schelling Points on 3D Surface Meshes Xiaobai Chen Abulhair Saparov Bill Pang Thomas Funkhouser Shape Transformation Wednesday 8 August 900 - 1030 AM An Algebraic Model for Parameterized Shape Editing Martin Bokeloh Michael Wand Hans-Peter Seidel Vladlen Koltun

42

ISTC-VC SIGGRAPH Papers

Image Processing Monday 6 August 2- 330 pm Decoupling Algorithms From Schedules for Easy Optimization of Image-Processing Pipelines Jonathan Ragan-Kelley Andrew Adams Sylvain Paris Marc Levoy Saman Amarasinghe Freacutedo Durand

Cloth

Monday 6 August 2-330 pm Specular Reflection From Woven Cloth Piti Irawan Steve Marschner Stitch Meshes for Modeling Knitted Clothing With Yarn-level Detail Cem Yuksel Jonathan M Kaldor Doug L James Steve Marschner

Appearance

Monday 6 August 345-535 pm Printing Spatially Varying Reflectance for Reproducing HDR Images Yue Dong Xin Tong Fabio Pellacini Baining Guo

43

ISTC-VC SIGGRAPH Papers (cont)

Hand Eye and Face Monday 6 August 345-535 pm Session Chair - Vladlen Koltun Discovery of Complex Behaviors through Contact-Invariant Optimization Igor Mordatch Emanuel Todorov Zoran Popovi1049029 Sketching Monday 6 August 345-535 pm HelpingHand Example-Based Stroke Stylization Jingwan Lu Fisher Yu Adam Finkelstein Stephen DiVerdi Fabrication Tuesday 7 August 9-1030 am Fabricating Articulated Characters From Skinned Meshes Moritz Baumlcher Bernd Bickel Doug L James Hanspeter Pfister

44

Sampling Reconstructing and Filtering Light Tuesday 7 August 1045 am-1215 pm A Theory of Monte Carlo Visibility Sampling Ravi Ramamoorthi John Anderson Mark Meyer Derek Nowrouzezahrai Reconstructing the Indirect Light Field for Global Illumination Jaakko Lehtinen Timo Aila Samuli Laine Freacutedo Durand

Geometry Reconstruction amp Tracking

Tuesday 7 August 1045 am-1215 pm Temporally Coherent Completion of Dynamic Shapes Hao Li Linjie Luo Daniel Vlasic Pieter Peers Jovan Popovic Mark Pauly Szymon Rusinkiewicz

Sets of Shapes

Tuesday 7 August 2-330 pm Exploring Collections of 3D Models Using Fuzzy Correspondence Vladimir G Kim Wilmot Li Niloy J Mitra Stephen DiVerdi Thomas Funkhouser A Probabilistic Model for Component-Based Shape Synthesis Evangelos Kalogerakis Siddhartha Chaudhuri Daphne Koller Vladlen Koltun

45

ISTC-VC SIGGRAPH Papers (cont)

Light Rays Tuesday 7 August 2-330 pm Manifold Exploration A Markov Chain Monte Carlo Technique for Rendering Scenes With Difficult Specular Transport Wenzel Jakob Steve Marschner Bidirectional Lightcuts Bruce Walter Pramook Khungurn Kavita Bala

Fun With Video

Tuesday 7 August 345-535 pm Session Chair Noah Snavely Video Deblurring for Hand-Held Cameras Using Patch-Based Synthesis Sunghyun Cho Jue Wang Seungyong Lee Eulerian Video Magnification for Revealing Subtle Changes in the World Hao-Yu Wu Michael Rubinstein Eugene Shih John Guttag Freacutedo Durand William T Freeman Selectively De-Animating Video Jiamin Bai Aseem Agarwala Maneesh Agrawala Ravi Ramamoorthi Tools for Placing Cuts and Transitions in Interview Video Floraine Berthouzoz Wilmot Li Maneesh Agrawala

46

ISTC-VC SIGGRAPH Papers (cont)

Noise and Texture Tuesday 7 August 345-535 pm Structure-Aware Synthesis for Predictive Woven Fabric Appearance Shuang Zhao Kavita Bala Steve Marschner Wenzel Jakob Symmetry-Guided Texture Synthesis and Manipulation Vladimir Kim Yaron Lipman Thomas Funkhouser

Shape Transformation Wednesday 8 August 900 - 1030 AM An Algebraic Model for Parameterized Shape Editing Martin Bokeloh Michael Wand Hans-Peter Seidel Vladlen Koltun

Stitching

Wednesday 8 August 1045 am-1215 pm Exposing Photo Manipulation With Inconsistent Reflections James F OrsquoBrien Hany Farid

47

ISTC-VC SIGGRAPH Papers (cont)

Maps Surfaces and Shapes

Wednesday 8 August 1045 am-1215 pm Simple Formulas For Quasiconformal Plane Deformations Yaron Lipman Vladimir G Kim Thomas Funkhouser

Interactive Systems amp Hardware Wednesday 8 August 2-330 pm Position-Correcting Tools for 2D Digital Fabrication Alec Rivers Ilan E Moyer Freacutedo Durand

48

ISTC-VC SIGGRAPH Papers (cont)

Collisions Wednesday 8 August 345-535 pm Energy-Based Self-Collision Culling for Arbitrary Mesh Deformations Changxi Zheng Doug L James

All About Images

Thursday 9 August 9-1030 am A Framework for Content-Adaptive Photo Manipulation Macros Application to Face Landscape and Global Manipulations Floraine Berthouzoz Wilmot Li Mira Dontcheva Maneesh Agrawala

Sound and Elements

Thursday 9 August 9-1030 am Motion-Driven Concatenative Synthesis of Cloth Sounds Steven S An Doug L James Steve Marschner Precomputed Acceleration Noise for Improved Rigid-Body Sound Jeffrey N Chadwick Changxi Zheng Doug L James Interactive Sound Propagation Using Compact Acoustic Transfer Operators Lakulish Antani Anish Chandak Lauri Savioja Dinesh Manocha Updated Sparse Cholesky Factors for Corotational Elastodynamics Florian Hecht Yeon Jin Lee Jonathan R Shewchuk James F OrsquoBrien

49

ISTC-VC SIGGRAPH Papers (cont)

Geometry amp Viewing Thursday 9 August 2-330 pm Perceptual Models of Viewpoint Preference Adrian Secordm Jingwan Lu Adam Finkelstein Manish Singh Andrew Nealen

Faces and Hair [Closing Session]

Thursday 9 August 345-515 pm Coupled 3D Reconstruction of Sparse Facial Hair and Skin Thabo Beeler Bernd Bickel Gioacchino Noris Paul Beardsley Steve Marschner Robert W Sumner Markus Gross Physical Face Cloning Bernd Bickel Peter Kaufmann Melina Skouras Bernhard Thomaszewski Derek Bradley Thabo Beeler Philip Jackson Steve Marschner Wojciech Matusik Markus Gross

50

ISTC-VC SIGGRAPH Papers (cont)

Siggraph Courses Optimizing Realistic Rendering With Many-Light Methods Sunday 5 August 2-515 pm Jaroslav Krivanek Milos Hasan Adam Arbree Carsten Dachsbacher Alexander Keller Bruce Walter State of the Art in Photon-Density Estimation Thursday 9 August 2-515 pm Toshiya Hachisuka Wojciech Jarosz Guillaume Bouchard Per Christensen Jeppe Revall Frisvad Wenzel Jakob Henrik Wann Jensen Jared M Johnson Michael Kaschalk Claude Knaus Andrew Selle Ben Spencer

Siggraph Talks

Silence Eliminate the Noise Thursday 9 August 9-1030 am Importance Sampling for Hair Scattering Jiawei Ou Feng Xie Parashar Krishnamachari Fabio Pellacini

Siggraph Exhibitor Sessions

Intel Corporation Wednesday 8 August 430-530 pm room 402B The Future of Visual Computing as Viewed by Intel Visual Computing Research Centers

51

Other ISTC-VC SIGGRAPH Participation

Page 31: Future of Visual Computing as viewed by Intel Visual ... · PDF fileFuture of Visual Computing as viewed by Intel Visual Computing Research Centers ... Justin Rattner Intel Science

bull Whole-Function Vectorization ndash Restore scalar computations

ndash LLVM platform-independent

ndash RenderMan frontend OpenCL driver

bull Vector Programming ndash Formalized C extension for portable

effective SIMD programming

ndash Type system triggers vectorization

ndash Data layout adaption

bull New Programming Models for High-Performance Graphics

bull Results ndash Demonstrators for shaders and HPC code

ndash CC++-Extensions (with Intel)

ndash OpenCL compiler (CPU)

Compiler Support for High-Performance Graphics Sebastian Hack

bull Hybrid Rendering ndash Client amp Server Model

ndash Smartphone to Mainframe

bull Large Data Processing ndash Scalable Hierarchical

RW Data Structures

bull Results ndash ZAPP displaywall demonstrator

ndash ImageVis3D (Mobile) demonstrator

ndash Practically use in hospitals

Scalable Hybrid Rendering for Large Scale Visualization Jens Kruumlger

Displays as a Service Large Scale Visualization Alexander Loumlffler

bull Virtualization of Displays ndash Virtual Framebuffer and Displays exposed to Internet

ndash Replacing cables by switched IP network

ndash Internet standards for video encoding and streaming

bull Fully Synchronized ndash 120 Hz active stereo sync over IP

ndash Accuracy of ~100us in software

ndash Drives GPU displays output

bull Results ndash 20-screen wall demonstrator

ndash 3-screen wall (thin-bezel)

ndash CE4100 based SW synchronization

SIGGRAPH 2012

Backup

The Intel Science and Technology Center (ISTC) and Intel Collaborative Research Institute (ICRI) Programs

35

The modern economy is an information economy and one that is driven by innovations that enhance productivity as well as create new modes of entertainment We need to invest in the basic research that will inspire future products and services and ensure long term health of our information economy Government and private foundations are helping but corporate America needs to step up and increase commitments to university research - Justin Rattner ndash Intel CTO

$140M investment over 5 years announced by Intel in 2011 and 2012

Centers of Excellence bull Each ISTC and ICRI will focus on one

research area eg visual computing secure computing

bull The ISTCs and ICRIs are meant to bring the best and brightest researchers across the US together

bull Each ISTC and ICRI will be led by a host university and will include thought leaders from other schools

Breaking Barriers to Collaboration

bull Open IP models and open source software to encourage free information exchange (In most of the Centers)

bull Favor projects that span multiple institutions to encourage collaboration among universities

bull Intel researches per center assigned to work on-campus to encourage collaboration between Intel and academia

Greater Impact to Future Tech bull Center research themes to

address essential needs of computing technology

bull Research agendas jointly defined and co-led by an Intel and a University Principal Investigator

bull After completing 3-5 year charters new ISTCs and ICRIs can be formed to respond to changing tech environment

httpfolditportal

Serious Gaming pplied to Content Creation

Highlighted by President Obama Winner of most-significant new visualization tool (NSF)

Goal Create high-quality content by casting creation activities as games in which large numbers of people are incentivized to perform simple tasks which in combination yield sophisticated content PIs Zoran Popovic (UW) Noah Snavely (Cornell) Maneesh Agrawala(Berkeley)

Determining the structure of retroviral protease (HIV)

Video Frank to add Papers Frank to add

Extracting Structure and Semantics

CAD Model Points

Structures

People

Goals Enable context aware computing and automated content creation through the capture analysis and manipulation of real-world visual data PIs Steve Seitz (UW) Noah Snavely (Cornell) Tom Funkhouser (Princeton) Vladlen Koltun (Stanford) Jitendra Malik (Berkeley) Deva Ramanan (UV Irvine)

Video Frank to add Papers Frank to add

httpvisualstanfordedu

Computational Photography (Franken Camera)

Being adopted as a standard API for cellphone camera systems (Apple Android)

bull Goal Develop algorithms languages architectures and prototypes demonstrating the use of computation in the process of image capture and display

bull PIs Marc Levoy (Stanford) Mark Horowitz (Stanford) Pat Hanrahan (Stanford)

Video Frank to add Papers Frank to add

ISTC-VC SIGGRAPH Papers

Character Locomotion Monday 6 August 900 AM - 1030 AM Optimizing Locomotion Controllers Using Biologically Based Actuators and Objectives Jack M Wang Samuel R Hamner Scott L Delp Vladlen Koltun Continuous Character Control With Low-Dimensional Embeddings Sergey Levine Jack M Wang Alexis Haraux Zoran Popović Vladlen Koltun Shape Analysis Monday 6 August 900 AM - 1030 AM Schelling Points on 3D Surface Meshes Xiaobai Chen Abulhair Saparov Bill Pang Thomas Funkhouser Shape Transformation Wednesday 8 August 900 - 1030 AM An Algebraic Model for Parameterized Shape Editing Martin Bokeloh Michael Wand Hans-Peter Seidel Vladlen Koltun

42

ISTC-VC SIGGRAPH Papers

Image Processing Monday 6 August 2- 330 pm Decoupling Algorithms From Schedules for Easy Optimization of Image-Processing Pipelines Jonathan Ragan-Kelley Andrew Adams Sylvain Paris Marc Levoy Saman Amarasinghe Freacutedo Durand

Cloth

Monday 6 August 2-330 pm Specular Reflection From Woven Cloth Piti Irawan Steve Marschner Stitch Meshes for Modeling Knitted Clothing With Yarn-level Detail Cem Yuksel Jonathan M Kaldor Doug L James Steve Marschner

Appearance

Monday 6 August 345-535 pm Printing Spatially Varying Reflectance for Reproducing HDR Images Yue Dong Xin Tong Fabio Pellacini Baining Guo

43

ISTC-VC SIGGRAPH Papers (cont)

Hand Eye and Face Monday 6 August 345-535 pm Session Chair - Vladlen Koltun Discovery of Complex Behaviors through Contact-Invariant Optimization Igor Mordatch Emanuel Todorov Zoran Popovi1049029 Sketching Monday 6 August 345-535 pm HelpingHand Example-Based Stroke Stylization Jingwan Lu Fisher Yu Adam Finkelstein Stephen DiVerdi Fabrication Tuesday 7 August 9-1030 am Fabricating Articulated Characters From Skinned Meshes Moritz Baumlcher Bernd Bickel Doug L James Hanspeter Pfister

44

Sampling Reconstructing and Filtering Light Tuesday 7 August 1045 am-1215 pm A Theory of Monte Carlo Visibility Sampling Ravi Ramamoorthi John Anderson Mark Meyer Derek Nowrouzezahrai Reconstructing the Indirect Light Field for Global Illumination Jaakko Lehtinen Timo Aila Samuli Laine Freacutedo Durand

Geometry Reconstruction amp Tracking

Tuesday 7 August 1045 am-1215 pm Temporally Coherent Completion of Dynamic Shapes Hao Li Linjie Luo Daniel Vlasic Pieter Peers Jovan Popovic Mark Pauly Szymon Rusinkiewicz

Sets of Shapes

Tuesday 7 August 2-330 pm Exploring Collections of 3D Models Using Fuzzy Correspondence Vladimir G Kim Wilmot Li Niloy J Mitra Stephen DiVerdi Thomas Funkhouser A Probabilistic Model for Component-Based Shape Synthesis Evangelos Kalogerakis Siddhartha Chaudhuri Daphne Koller Vladlen Koltun

45

ISTC-VC SIGGRAPH Papers (cont)

Light Rays Tuesday 7 August 2-330 pm Manifold Exploration A Markov Chain Monte Carlo Technique for Rendering Scenes With Difficult Specular Transport Wenzel Jakob Steve Marschner Bidirectional Lightcuts Bruce Walter Pramook Khungurn Kavita Bala

Fun With Video

Tuesday 7 August 345-535 pm Session Chair Noah Snavely Video Deblurring for Hand-Held Cameras Using Patch-Based Synthesis Sunghyun Cho Jue Wang Seungyong Lee Eulerian Video Magnification for Revealing Subtle Changes in the World Hao-Yu Wu Michael Rubinstein Eugene Shih John Guttag Freacutedo Durand William T Freeman Selectively De-Animating Video Jiamin Bai Aseem Agarwala Maneesh Agrawala Ravi Ramamoorthi Tools for Placing Cuts and Transitions in Interview Video Floraine Berthouzoz Wilmot Li Maneesh Agrawala

46

ISTC-VC SIGGRAPH Papers (cont)

Noise and Texture Tuesday 7 August 345-535 pm Structure-Aware Synthesis for Predictive Woven Fabric Appearance Shuang Zhao Kavita Bala Steve Marschner Wenzel Jakob Symmetry-Guided Texture Synthesis and Manipulation Vladimir Kim Yaron Lipman Thomas Funkhouser

Shape Transformation Wednesday 8 August 900 - 1030 AM An Algebraic Model for Parameterized Shape Editing Martin Bokeloh Michael Wand Hans-Peter Seidel Vladlen Koltun

Stitching

Wednesday 8 August 1045 am-1215 pm Exposing Photo Manipulation With Inconsistent Reflections James F OrsquoBrien Hany Farid

47

ISTC-VC SIGGRAPH Papers (cont)

Maps Surfaces and Shapes

Wednesday 8 August 1045 am-1215 pm Simple Formulas For Quasiconformal Plane Deformations Yaron Lipman Vladimir G Kim Thomas Funkhouser

Interactive Systems amp Hardware Wednesday 8 August 2-330 pm Position-Correcting Tools for 2D Digital Fabrication Alec Rivers Ilan E Moyer Freacutedo Durand

48

ISTC-VC SIGGRAPH Papers (cont)

Collisions Wednesday 8 August 345-535 pm Energy-Based Self-Collision Culling for Arbitrary Mesh Deformations Changxi Zheng Doug L James

All About Images

Thursday 9 August 9-1030 am A Framework for Content-Adaptive Photo Manipulation Macros Application to Face Landscape and Global Manipulations Floraine Berthouzoz Wilmot Li Mira Dontcheva Maneesh Agrawala

Sound and Elements

Thursday 9 August 9-1030 am Motion-Driven Concatenative Synthesis of Cloth Sounds Steven S An Doug L James Steve Marschner Precomputed Acceleration Noise for Improved Rigid-Body Sound Jeffrey N Chadwick Changxi Zheng Doug L James Interactive Sound Propagation Using Compact Acoustic Transfer Operators Lakulish Antani Anish Chandak Lauri Savioja Dinesh Manocha Updated Sparse Cholesky Factors for Corotational Elastodynamics Florian Hecht Yeon Jin Lee Jonathan R Shewchuk James F OrsquoBrien

49

ISTC-VC SIGGRAPH Papers (cont)

Geometry amp Viewing Thursday 9 August 2-330 pm Perceptual Models of Viewpoint Preference Adrian Secordm Jingwan Lu Adam Finkelstein Manish Singh Andrew Nealen

Faces and Hair [Closing Session]

Thursday 9 August 345-515 pm Coupled 3D Reconstruction of Sparse Facial Hair and Skin Thabo Beeler Bernd Bickel Gioacchino Noris Paul Beardsley Steve Marschner Robert W Sumner Markus Gross Physical Face Cloning Bernd Bickel Peter Kaufmann Melina Skouras Bernhard Thomaszewski Derek Bradley Thabo Beeler Philip Jackson Steve Marschner Wojciech Matusik Markus Gross

50

ISTC-VC SIGGRAPH Papers (cont)

Siggraph Courses Optimizing Realistic Rendering With Many-Light Methods Sunday 5 August 2-515 pm Jaroslav Krivanek Milos Hasan Adam Arbree Carsten Dachsbacher Alexander Keller Bruce Walter State of the Art in Photon-Density Estimation Thursday 9 August 2-515 pm Toshiya Hachisuka Wojciech Jarosz Guillaume Bouchard Per Christensen Jeppe Revall Frisvad Wenzel Jakob Henrik Wann Jensen Jared M Johnson Michael Kaschalk Claude Knaus Andrew Selle Ben Spencer

Siggraph Talks

Silence Eliminate the Noise Thursday 9 August 9-1030 am Importance Sampling for Hair Scattering Jiawei Ou Feng Xie Parashar Krishnamachari Fabio Pellacini

Siggraph Exhibitor Sessions

Intel Corporation Wednesday 8 August 430-530 pm room 402B The Future of Visual Computing as Viewed by Intel Visual Computing Research Centers

51

Other ISTC-VC SIGGRAPH Participation

Page 32: Future of Visual Computing as viewed by Intel Visual ... · PDF fileFuture of Visual Computing as viewed by Intel Visual Computing Research Centers ... Justin Rattner Intel Science

bull Hybrid Rendering ndash Client amp Server Model

ndash Smartphone to Mainframe

bull Large Data Processing ndash Scalable Hierarchical

RW Data Structures

bull Results ndash ZAPP displaywall demonstrator

ndash ImageVis3D (Mobile) demonstrator

ndash Practically use in hospitals

Scalable Hybrid Rendering for Large Scale Visualization Jens Kruumlger

Displays as a Service Large Scale Visualization Alexander Loumlffler

bull Virtualization of Displays ndash Virtual Framebuffer and Displays exposed to Internet

ndash Replacing cables by switched IP network

ndash Internet standards for video encoding and streaming

bull Fully Synchronized ndash 120 Hz active stereo sync over IP

ndash Accuracy of ~100us in software

ndash Drives GPU displays output

bull Results ndash 20-screen wall demonstrator

ndash 3-screen wall (thin-bezel)

ndash CE4100 based SW synchronization

SIGGRAPH 2012

Backup

The Intel Science and Technology Center (ISTC) and Intel Collaborative Research Institute (ICRI) Programs

35

The modern economy is an information economy and one that is driven by innovations that enhance productivity as well as create new modes of entertainment We need to invest in the basic research that will inspire future products and services and ensure long term health of our information economy Government and private foundations are helping but corporate America needs to step up and increase commitments to university research - Justin Rattner ndash Intel CTO

$140M investment over 5 years announced by Intel in 2011 and 2012

Centers of Excellence bull Each ISTC and ICRI will focus on one

research area eg visual computing secure computing

bull The ISTCs and ICRIs are meant to bring the best and brightest researchers across the US together

bull Each ISTC and ICRI will be led by a host university and will include thought leaders from other schools

Breaking Barriers to Collaboration

bull Open IP models and open source software to encourage free information exchange (In most of the Centers)

bull Favor projects that span multiple institutions to encourage collaboration among universities

bull Intel researches per center assigned to work on-campus to encourage collaboration between Intel and academia

Greater Impact to Future Tech bull Center research themes to

address essential needs of computing technology

bull Research agendas jointly defined and co-led by an Intel and a University Principal Investigator

bull After completing 3-5 year charters new ISTCs and ICRIs can be formed to respond to changing tech environment

httpfolditportal

Serious Gaming pplied to Content Creation

Highlighted by President Obama Winner of most-significant new visualization tool (NSF)

Goal Create high-quality content by casting creation activities as games in which large numbers of people are incentivized to perform simple tasks which in combination yield sophisticated content PIs Zoran Popovic (UW) Noah Snavely (Cornell) Maneesh Agrawala(Berkeley)

Determining the structure of retroviral protease (HIV)

Video Frank to add Papers Frank to add

Extracting Structure and Semantics

CAD Model Points

Structures

People

Goals Enable context aware computing and automated content creation through the capture analysis and manipulation of real-world visual data PIs Steve Seitz (UW) Noah Snavely (Cornell) Tom Funkhouser (Princeton) Vladlen Koltun (Stanford) Jitendra Malik (Berkeley) Deva Ramanan (UV Irvine)

Video Frank to add Papers Frank to add

httpvisualstanfordedu

Computational Photography (Franken Camera)

Being adopted as a standard API for cellphone camera systems (Apple Android)

bull Goal Develop algorithms languages architectures and prototypes demonstrating the use of computation in the process of image capture and display

bull PIs Marc Levoy (Stanford) Mark Horowitz (Stanford) Pat Hanrahan (Stanford)

Video Frank to add Papers Frank to add

ISTC-VC SIGGRAPH Papers

Character Locomotion Monday 6 August 900 AM - 1030 AM Optimizing Locomotion Controllers Using Biologically Based Actuators and Objectives Jack M Wang Samuel R Hamner Scott L Delp Vladlen Koltun Continuous Character Control With Low-Dimensional Embeddings Sergey Levine Jack M Wang Alexis Haraux Zoran Popović Vladlen Koltun Shape Analysis Monday 6 August 900 AM - 1030 AM Schelling Points on 3D Surface Meshes Xiaobai Chen Abulhair Saparov Bill Pang Thomas Funkhouser Shape Transformation Wednesday 8 August 900 - 1030 AM An Algebraic Model for Parameterized Shape Editing Martin Bokeloh Michael Wand Hans-Peter Seidel Vladlen Koltun

42

ISTC-VC SIGGRAPH Papers

Image Processing Monday 6 August 2- 330 pm Decoupling Algorithms From Schedules for Easy Optimization of Image-Processing Pipelines Jonathan Ragan-Kelley Andrew Adams Sylvain Paris Marc Levoy Saman Amarasinghe Freacutedo Durand

Cloth

Monday 6 August 2-330 pm Specular Reflection From Woven Cloth Piti Irawan Steve Marschner Stitch Meshes for Modeling Knitted Clothing With Yarn-level Detail Cem Yuksel Jonathan M Kaldor Doug L James Steve Marschner

Appearance

Monday 6 August 345-535 pm Printing Spatially Varying Reflectance for Reproducing HDR Images Yue Dong Xin Tong Fabio Pellacini Baining Guo

43

ISTC-VC SIGGRAPH Papers (cont)

Hand Eye and Face Monday 6 August 345-535 pm Session Chair - Vladlen Koltun Discovery of Complex Behaviors through Contact-Invariant Optimization Igor Mordatch Emanuel Todorov Zoran Popovi1049029 Sketching Monday 6 August 345-535 pm HelpingHand Example-Based Stroke Stylization Jingwan Lu Fisher Yu Adam Finkelstein Stephen DiVerdi Fabrication Tuesday 7 August 9-1030 am Fabricating Articulated Characters From Skinned Meshes Moritz Baumlcher Bernd Bickel Doug L James Hanspeter Pfister

44

Sampling Reconstructing and Filtering Light Tuesday 7 August 1045 am-1215 pm A Theory of Monte Carlo Visibility Sampling Ravi Ramamoorthi John Anderson Mark Meyer Derek Nowrouzezahrai Reconstructing the Indirect Light Field for Global Illumination Jaakko Lehtinen Timo Aila Samuli Laine Freacutedo Durand

Geometry Reconstruction amp Tracking

Tuesday 7 August 1045 am-1215 pm Temporally Coherent Completion of Dynamic Shapes Hao Li Linjie Luo Daniel Vlasic Pieter Peers Jovan Popovic Mark Pauly Szymon Rusinkiewicz

Sets of Shapes

Tuesday 7 August 2-330 pm Exploring Collections of 3D Models Using Fuzzy Correspondence Vladimir G Kim Wilmot Li Niloy J Mitra Stephen DiVerdi Thomas Funkhouser A Probabilistic Model for Component-Based Shape Synthesis Evangelos Kalogerakis Siddhartha Chaudhuri Daphne Koller Vladlen Koltun

45

ISTC-VC SIGGRAPH Papers (cont)

Light Rays Tuesday 7 August 2-330 pm Manifold Exploration A Markov Chain Monte Carlo Technique for Rendering Scenes With Difficult Specular Transport Wenzel Jakob Steve Marschner Bidirectional Lightcuts Bruce Walter Pramook Khungurn Kavita Bala

Fun With Video

Tuesday 7 August 345-535 pm Session Chair Noah Snavely Video Deblurring for Hand-Held Cameras Using Patch-Based Synthesis Sunghyun Cho Jue Wang Seungyong Lee Eulerian Video Magnification for Revealing Subtle Changes in the World Hao-Yu Wu Michael Rubinstein Eugene Shih John Guttag Freacutedo Durand William T Freeman Selectively De-Animating Video Jiamin Bai Aseem Agarwala Maneesh Agrawala Ravi Ramamoorthi Tools for Placing Cuts and Transitions in Interview Video Floraine Berthouzoz Wilmot Li Maneesh Agrawala

46

ISTC-VC SIGGRAPH Papers (cont)

Noise and Texture Tuesday 7 August 345-535 pm Structure-Aware Synthesis for Predictive Woven Fabric Appearance Shuang Zhao Kavita Bala Steve Marschner Wenzel Jakob Symmetry-Guided Texture Synthesis and Manipulation Vladimir Kim Yaron Lipman Thomas Funkhouser

Shape Transformation Wednesday 8 August 900 - 1030 AM An Algebraic Model for Parameterized Shape Editing Martin Bokeloh Michael Wand Hans-Peter Seidel Vladlen Koltun

Stitching

Wednesday 8 August 1045 am-1215 pm Exposing Photo Manipulation With Inconsistent Reflections James F OrsquoBrien Hany Farid

47

ISTC-VC SIGGRAPH Papers (cont)

Maps Surfaces and Shapes

Wednesday 8 August 1045 am-1215 pm Simple Formulas For Quasiconformal Plane Deformations Yaron Lipman Vladimir G Kim Thomas Funkhouser

Interactive Systems amp Hardware Wednesday 8 August 2-330 pm Position-Correcting Tools for 2D Digital Fabrication Alec Rivers Ilan E Moyer Freacutedo Durand

48

ISTC-VC SIGGRAPH Papers (cont)

Collisions Wednesday 8 August 345-535 pm Energy-Based Self-Collision Culling for Arbitrary Mesh Deformations Changxi Zheng Doug L James

All About Images

Thursday 9 August 9-1030 am A Framework for Content-Adaptive Photo Manipulation Macros Application to Face Landscape and Global Manipulations Floraine Berthouzoz Wilmot Li Mira Dontcheva Maneesh Agrawala

Sound and Elements

Thursday 9 August 9-1030 am Motion-Driven Concatenative Synthesis of Cloth Sounds Steven S An Doug L James Steve Marschner Precomputed Acceleration Noise for Improved Rigid-Body Sound Jeffrey N Chadwick Changxi Zheng Doug L James Interactive Sound Propagation Using Compact Acoustic Transfer Operators Lakulish Antani Anish Chandak Lauri Savioja Dinesh Manocha Updated Sparse Cholesky Factors for Corotational Elastodynamics Florian Hecht Yeon Jin Lee Jonathan R Shewchuk James F OrsquoBrien

49

ISTC-VC SIGGRAPH Papers (cont)

Geometry amp Viewing Thursday 9 August 2-330 pm Perceptual Models of Viewpoint Preference Adrian Secordm Jingwan Lu Adam Finkelstein Manish Singh Andrew Nealen

Faces and Hair [Closing Session]

Thursday 9 August 345-515 pm Coupled 3D Reconstruction of Sparse Facial Hair and Skin Thabo Beeler Bernd Bickel Gioacchino Noris Paul Beardsley Steve Marschner Robert W Sumner Markus Gross Physical Face Cloning Bernd Bickel Peter Kaufmann Melina Skouras Bernhard Thomaszewski Derek Bradley Thabo Beeler Philip Jackson Steve Marschner Wojciech Matusik Markus Gross

50

ISTC-VC SIGGRAPH Papers (cont)

Siggraph Courses Optimizing Realistic Rendering With Many-Light Methods Sunday 5 August 2-515 pm Jaroslav Krivanek Milos Hasan Adam Arbree Carsten Dachsbacher Alexander Keller Bruce Walter State of the Art in Photon-Density Estimation Thursday 9 August 2-515 pm Toshiya Hachisuka Wojciech Jarosz Guillaume Bouchard Per Christensen Jeppe Revall Frisvad Wenzel Jakob Henrik Wann Jensen Jared M Johnson Michael Kaschalk Claude Knaus Andrew Selle Ben Spencer

Siggraph Talks

Silence Eliminate the Noise Thursday 9 August 9-1030 am Importance Sampling for Hair Scattering Jiawei Ou Feng Xie Parashar Krishnamachari Fabio Pellacini

Siggraph Exhibitor Sessions

Intel Corporation Wednesday 8 August 430-530 pm room 402B The Future of Visual Computing as Viewed by Intel Visual Computing Research Centers

51

Other ISTC-VC SIGGRAPH Participation

Page 33: Future of Visual Computing as viewed by Intel Visual ... · PDF fileFuture of Visual Computing as viewed by Intel Visual Computing Research Centers ... Justin Rattner Intel Science

Displays as a Service Large Scale Visualization Alexander Loumlffler

bull Virtualization of Displays ndash Virtual Framebuffer and Displays exposed to Internet

ndash Replacing cables by switched IP network

ndash Internet standards for video encoding and streaming

bull Fully Synchronized ndash 120 Hz active stereo sync over IP

ndash Accuracy of ~100us in software

ndash Drives GPU displays output

bull Results ndash 20-screen wall demonstrator

ndash 3-screen wall (thin-bezel)

ndash CE4100 based SW synchronization

SIGGRAPH 2012

Backup

The Intel Science and Technology Center (ISTC) and Intel Collaborative Research Institute (ICRI) Programs

35

The modern economy is an information economy and one that is driven by innovations that enhance productivity as well as create new modes of entertainment We need to invest in the basic research that will inspire future products and services and ensure long term health of our information economy Government and private foundations are helping but corporate America needs to step up and increase commitments to university research - Justin Rattner ndash Intel CTO

$140M investment over 5 years announced by Intel in 2011 and 2012

Centers of Excellence bull Each ISTC and ICRI will focus on one

research area eg visual computing secure computing

bull The ISTCs and ICRIs are meant to bring the best and brightest researchers across the US together

bull Each ISTC and ICRI will be led by a host university and will include thought leaders from other schools

Breaking Barriers to Collaboration

bull Open IP models and open source software to encourage free information exchange (In most of the Centers)

bull Favor projects that span multiple institutions to encourage collaboration among universities

bull Intel researches per center assigned to work on-campus to encourage collaboration between Intel and academia

Greater Impact to Future Tech bull Center research themes to

address essential needs of computing technology

bull Research agendas jointly defined and co-led by an Intel and a University Principal Investigator

bull After completing 3-5 year charters new ISTCs and ICRIs can be formed to respond to changing tech environment

httpfolditportal

Serious Gaming pplied to Content Creation

Highlighted by President Obama Winner of most-significant new visualization tool (NSF)

Goal Create high-quality content by casting creation activities as games in which large numbers of people are incentivized to perform simple tasks which in combination yield sophisticated content PIs Zoran Popovic (UW) Noah Snavely (Cornell) Maneesh Agrawala(Berkeley)

Determining the structure of retroviral protease (HIV)

Video Frank to add Papers Frank to add

Extracting Structure and Semantics

CAD Model Points

Structures

People

Goals Enable context aware computing and automated content creation through the capture analysis and manipulation of real-world visual data PIs Steve Seitz (UW) Noah Snavely (Cornell) Tom Funkhouser (Princeton) Vladlen Koltun (Stanford) Jitendra Malik (Berkeley) Deva Ramanan (UV Irvine)

Video Frank to add Papers Frank to add

httpvisualstanfordedu

Computational Photography (Franken Camera)

Being adopted as a standard API for cellphone camera systems (Apple Android)

bull Goal Develop algorithms languages architectures and prototypes demonstrating the use of computation in the process of image capture and display

bull PIs Marc Levoy (Stanford) Mark Horowitz (Stanford) Pat Hanrahan (Stanford)

Video Frank to add Papers Frank to add

ISTC-VC SIGGRAPH Papers

Character Locomotion Monday 6 August 900 AM - 1030 AM Optimizing Locomotion Controllers Using Biologically Based Actuators and Objectives Jack M Wang Samuel R Hamner Scott L Delp Vladlen Koltun Continuous Character Control With Low-Dimensional Embeddings Sergey Levine Jack M Wang Alexis Haraux Zoran Popović Vladlen Koltun Shape Analysis Monday 6 August 900 AM - 1030 AM Schelling Points on 3D Surface Meshes Xiaobai Chen Abulhair Saparov Bill Pang Thomas Funkhouser Shape Transformation Wednesday 8 August 900 - 1030 AM An Algebraic Model for Parameterized Shape Editing Martin Bokeloh Michael Wand Hans-Peter Seidel Vladlen Koltun

42

ISTC-VC SIGGRAPH Papers

Image Processing Monday 6 August 2- 330 pm Decoupling Algorithms From Schedules for Easy Optimization of Image-Processing Pipelines Jonathan Ragan-Kelley Andrew Adams Sylvain Paris Marc Levoy Saman Amarasinghe Freacutedo Durand

Cloth

Monday 6 August 2-330 pm Specular Reflection From Woven Cloth Piti Irawan Steve Marschner Stitch Meshes for Modeling Knitted Clothing With Yarn-level Detail Cem Yuksel Jonathan M Kaldor Doug L James Steve Marschner

Appearance

Monday 6 August 345-535 pm Printing Spatially Varying Reflectance for Reproducing HDR Images Yue Dong Xin Tong Fabio Pellacini Baining Guo

43

ISTC-VC SIGGRAPH Papers (cont)

Hand Eye and Face Monday 6 August 345-535 pm Session Chair - Vladlen Koltun Discovery of Complex Behaviors through Contact-Invariant Optimization Igor Mordatch Emanuel Todorov Zoran Popovi1049029 Sketching Monday 6 August 345-535 pm HelpingHand Example-Based Stroke Stylization Jingwan Lu Fisher Yu Adam Finkelstein Stephen DiVerdi Fabrication Tuesday 7 August 9-1030 am Fabricating Articulated Characters From Skinned Meshes Moritz Baumlcher Bernd Bickel Doug L James Hanspeter Pfister

44

Sampling Reconstructing and Filtering Light Tuesday 7 August 1045 am-1215 pm A Theory of Monte Carlo Visibility Sampling Ravi Ramamoorthi John Anderson Mark Meyer Derek Nowrouzezahrai Reconstructing the Indirect Light Field for Global Illumination Jaakko Lehtinen Timo Aila Samuli Laine Freacutedo Durand

Geometry Reconstruction amp Tracking

Tuesday 7 August 1045 am-1215 pm Temporally Coherent Completion of Dynamic Shapes Hao Li Linjie Luo Daniel Vlasic Pieter Peers Jovan Popovic Mark Pauly Szymon Rusinkiewicz

Sets of Shapes

Tuesday 7 August 2-330 pm Exploring Collections of 3D Models Using Fuzzy Correspondence Vladimir G Kim Wilmot Li Niloy J Mitra Stephen DiVerdi Thomas Funkhouser A Probabilistic Model for Component-Based Shape Synthesis Evangelos Kalogerakis Siddhartha Chaudhuri Daphne Koller Vladlen Koltun

45

ISTC-VC SIGGRAPH Papers (cont)

Light Rays Tuesday 7 August 2-330 pm Manifold Exploration A Markov Chain Monte Carlo Technique for Rendering Scenes With Difficult Specular Transport Wenzel Jakob Steve Marschner Bidirectional Lightcuts Bruce Walter Pramook Khungurn Kavita Bala

Fun With Video

Tuesday 7 August 345-535 pm Session Chair Noah Snavely Video Deblurring for Hand-Held Cameras Using Patch-Based Synthesis Sunghyun Cho Jue Wang Seungyong Lee Eulerian Video Magnification for Revealing Subtle Changes in the World Hao-Yu Wu Michael Rubinstein Eugene Shih John Guttag Freacutedo Durand William T Freeman Selectively De-Animating Video Jiamin Bai Aseem Agarwala Maneesh Agrawala Ravi Ramamoorthi Tools for Placing Cuts and Transitions in Interview Video Floraine Berthouzoz Wilmot Li Maneesh Agrawala

46

ISTC-VC SIGGRAPH Papers (cont)

Noise and Texture Tuesday 7 August 345-535 pm Structure-Aware Synthesis for Predictive Woven Fabric Appearance Shuang Zhao Kavita Bala Steve Marschner Wenzel Jakob Symmetry-Guided Texture Synthesis and Manipulation Vladimir Kim Yaron Lipman Thomas Funkhouser

Shape Transformation Wednesday 8 August 900 - 1030 AM An Algebraic Model for Parameterized Shape Editing Martin Bokeloh Michael Wand Hans-Peter Seidel Vladlen Koltun

Stitching

Wednesday 8 August 1045 am-1215 pm Exposing Photo Manipulation With Inconsistent Reflections James F OrsquoBrien Hany Farid

47

ISTC-VC SIGGRAPH Papers (cont)

Maps Surfaces and Shapes

Wednesday 8 August 1045 am-1215 pm Simple Formulas For Quasiconformal Plane Deformations Yaron Lipman Vladimir G Kim Thomas Funkhouser

Interactive Systems amp Hardware Wednesday 8 August 2-330 pm Position-Correcting Tools for 2D Digital Fabrication Alec Rivers Ilan E Moyer Freacutedo Durand

48

ISTC-VC SIGGRAPH Papers (cont)

Collisions Wednesday 8 August 345-535 pm Energy-Based Self-Collision Culling for Arbitrary Mesh Deformations Changxi Zheng Doug L James

All About Images

Thursday 9 August 9-1030 am A Framework for Content-Adaptive Photo Manipulation Macros Application to Face Landscape and Global Manipulations Floraine Berthouzoz Wilmot Li Mira Dontcheva Maneesh Agrawala

Sound and Elements

Thursday 9 August 9-1030 am Motion-Driven Concatenative Synthesis of Cloth Sounds Steven S An Doug L James Steve Marschner Precomputed Acceleration Noise for Improved Rigid-Body Sound Jeffrey N Chadwick Changxi Zheng Doug L James Interactive Sound Propagation Using Compact Acoustic Transfer Operators Lakulish Antani Anish Chandak Lauri Savioja Dinesh Manocha Updated Sparse Cholesky Factors for Corotational Elastodynamics Florian Hecht Yeon Jin Lee Jonathan R Shewchuk James F OrsquoBrien

49

ISTC-VC SIGGRAPH Papers (cont)

Geometry amp Viewing Thursday 9 August 2-330 pm Perceptual Models of Viewpoint Preference Adrian Secordm Jingwan Lu Adam Finkelstein Manish Singh Andrew Nealen

Faces and Hair [Closing Session]

Thursday 9 August 345-515 pm Coupled 3D Reconstruction of Sparse Facial Hair and Skin Thabo Beeler Bernd Bickel Gioacchino Noris Paul Beardsley Steve Marschner Robert W Sumner Markus Gross Physical Face Cloning Bernd Bickel Peter Kaufmann Melina Skouras Bernhard Thomaszewski Derek Bradley Thabo Beeler Philip Jackson Steve Marschner Wojciech Matusik Markus Gross

50

ISTC-VC SIGGRAPH Papers (cont)

Siggraph Courses Optimizing Realistic Rendering With Many-Light Methods Sunday 5 August 2-515 pm Jaroslav Krivanek Milos Hasan Adam Arbree Carsten Dachsbacher Alexander Keller Bruce Walter State of the Art in Photon-Density Estimation Thursday 9 August 2-515 pm Toshiya Hachisuka Wojciech Jarosz Guillaume Bouchard Per Christensen Jeppe Revall Frisvad Wenzel Jakob Henrik Wann Jensen Jared M Johnson Michael Kaschalk Claude Knaus Andrew Selle Ben Spencer

Siggraph Talks

Silence Eliminate the Noise Thursday 9 August 9-1030 am Importance Sampling for Hair Scattering Jiawei Ou Feng Xie Parashar Krishnamachari Fabio Pellacini

Siggraph Exhibitor Sessions

Intel Corporation Wednesday 8 August 430-530 pm room 402B The Future of Visual Computing as Viewed by Intel Visual Computing Research Centers

51

Other ISTC-VC SIGGRAPH Participation

Page 34: Future of Visual Computing as viewed by Intel Visual ... · PDF fileFuture of Visual Computing as viewed by Intel Visual Computing Research Centers ... Justin Rattner Intel Science

SIGGRAPH 2012

Backup

The Intel Science and Technology Center (ISTC) and Intel Collaborative Research Institute (ICRI) Programs

35

The modern economy is an information economy and one that is driven by innovations that enhance productivity as well as create new modes of entertainment We need to invest in the basic research that will inspire future products and services and ensure long term health of our information economy Government and private foundations are helping but corporate America needs to step up and increase commitments to university research - Justin Rattner ndash Intel CTO

$140M investment over 5 years announced by Intel in 2011 and 2012

Centers of Excellence bull Each ISTC and ICRI will focus on one

research area eg visual computing secure computing

bull The ISTCs and ICRIs are meant to bring the best and brightest researchers across the US together

bull Each ISTC and ICRI will be led by a host university and will include thought leaders from other schools

Breaking Barriers to Collaboration

bull Open IP models and open source software to encourage free information exchange (In most of the Centers)

bull Favor projects that span multiple institutions to encourage collaboration among universities

bull Intel researches per center assigned to work on-campus to encourage collaboration between Intel and academia

Greater Impact to Future Tech bull Center research themes to

address essential needs of computing technology

bull Research agendas jointly defined and co-led by an Intel and a University Principal Investigator

bull After completing 3-5 year charters new ISTCs and ICRIs can be formed to respond to changing tech environment

httpfolditportal

Serious Gaming pplied to Content Creation

Highlighted by President Obama Winner of most-significant new visualization tool (NSF)

Goal Create high-quality content by casting creation activities as games in which large numbers of people are incentivized to perform simple tasks which in combination yield sophisticated content PIs Zoran Popovic (UW) Noah Snavely (Cornell) Maneesh Agrawala(Berkeley)

Determining the structure of retroviral protease (HIV)

Video Frank to add Papers Frank to add

Extracting Structure and Semantics

CAD Model Points

Structures

People

Goals Enable context aware computing and automated content creation through the capture analysis and manipulation of real-world visual data PIs Steve Seitz (UW) Noah Snavely (Cornell) Tom Funkhouser (Princeton) Vladlen Koltun (Stanford) Jitendra Malik (Berkeley) Deva Ramanan (UV Irvine)

Video Frank to add Papers Frank to add

httpvisualstanfordedu

Computational Photography (Franken Camera)

Being adopted as a standard API for cellphone camera systems (Apple Android)

bull Goal Develop algorithms languages architectures and prototypes demonstrating the use of computation in the process of image capture and display

bull PIs Marc Levoy (Stanford) Mark Horowitz (Stanford) Pat Hanrahan (Stanford)

Video Frank to add Papers Frank to add

ISTC-VC SIGGRAPH Papers

Character Locomotion Monday 6 August 900 AM - 1030 AM Optimizing Locomotion Controllers Using Biologically Based Actuators and Objectives Jack M Wang Samuel R Hamner Scott L Delp Vladlen Koltun Continuous Character Control With Low-Dimensional Embeddings Sergey Levine Jack M Wang Alexis Haraux Zoran Popović Vladlen Koltun Shape Analysis Monday 6 August 900 AM - 1030 AM Schelling Points on 3D Surface Meshes Xiaobai Chen Abulhair Saparov Bill Pang Thomas Funkhouser Shape Transformation Wednesday 8 August 900 - 1030 AM An Algebraic Model for Parameterized Shape Editing Martin Bokeloh Michael Wand Hans-Peter Seidel Vladlen Koltun

42

ISTC-VC SIGGRAPH Papers

Image Processing Monday 6 August 2- 330 pm Decoupling Algorithms From Schedules for Easy Optimization of Image-Processing Pipelines Jonathan Ragan-Kelley Andrew Adams Sylvain Paris Marc Levoy Saman Amarasinghe Freacutedo Durand

Cloth

Monday 6 August 2-330 pm Specular Reflection From Woven Cloth Piti Irawan Steve Marschner Stitch Meshes for Modeling Knitted Clothing With Yarn-level Detail Cem Yuksel Jonathan M Kaldor Doug L James Steve Marschner

Appearance

Monday 6 August 345-535 pm Printing Spatially Varying Reflectance for Reproducing HDR Images Yue Dong Xin Tong Fabio Pellacini Baining Guo

43

ISTC-VC SIGGRAPH Papers (cont)

Hand Eye and Face Monday 6 August 345-535 pm Session Chair - Vladlen Koltun Discovery of Complex Behaviors through Contact-Invariant Optimization Igor Mordatch Emanuel Todorov Zoran Popovi1049029 Sketching Monday 6 August 345-535 pm HelpingHand Example-Based Stroke Stylization Jingwan Lu Fisher Yu Adam Finkelstein Stephen DiVerdi Fabrication Tuesday 7 August 9-1030 am Fabricating Articulated Characters From Skinned Meshes Moritz Baumlcher Bernd Bickel Doug L James Hanspeter Pfister

44

Sampling Reconstructing and Filtering Light Tuesday 7 August 1045 am-1215 pm A Theory of Monte Carlo Visibility Sampling Ravi Ramamoorthi John Anderson Mark Meyer Derek Nowrouzezahrai Reconstructing the Indirect Light Field for Global Illumination Jaakko Lehtinen Timo Aila Samuli Laine Freacutedo Durand

Geometry Reconstruction amp Tracking

Tuesday 7 August 1045 am-1215 pm Temporally Coherent Completion of Dynamic Shapes Hao Li Linjie Luo Daniel Vlasic Pieter Peers Jovan Popovic Mark Pauly Szymon Rusinkiewicz

Sets of Shapes

Tuesday 7 August 2-330 pm Exploring Collections of 3D Models Using Fuzzy Correspondence Vladimir G Kim Wilmot Li Niloy J Mitra Stephen DiVerdi Thomas Funkhouser A Probabilistic Model for Component-Based Shape Synthesis Evangelos Kalogerakis Siddhartha Chaudhuri Daphne Koller Vladlen Koltun

45

ISTC-VC SIGGRAPH Papers (cont)

Light Rays Tuesday 7 August 2-330 pm Manifold Exploration A Markov Chain Monte Carlo Technique for Rendering Scenes With Difficult Specular Transport Wenzel Jakob Steve Marschner Bidirectional Lightcuts Bruce Walter Pramook Khungurn Kavita Bala

Fun With Video

Tuesday 7 August 345-535 pm Session Chair Noah Snavely Video Deblurring for Hand-Held Cameras Using Patch-Based Synthesis Sunghyun Cho Jue Wang Seungyong Lee Eulerian Video Magnification for Revealing Subtle Changes in the World Hao-Yu Wu Michael Rubinstein Eugene Shih John Guttag Freacutedo Durand William T Freeman Selectively De-Animating Video Jiamin Bai Aseem Agarwala Maneesh Agrawala Ravi Ramamoorthi Tools for Placing Cuts and Transitions in Interview Video Floraine Berthouzoz Wilmot Li Maneesh Agrawala

46

ISTC-VC SIGGRAPH Papers (cont)

Noise and Texture Tuesday 7 August 345-535 pm Structure-Aware Synthesis for Predictive Woven Fabric Appearance Shuang Zhao Kavita Bala Steve Marschner Wenzel Jakob Symmetry-Guided Texture Synthesis and Manipulation Vladimir Kim Yaron Lipman Thomas Funkhouser

Shape Transformation Wednesday 8 August 900 - 1030 AM An Algebraic Model for Parameterized Shape Editing Martin Bokeloh Michael Wand Hans-Peter Seidel Vladlen Koltun

Stitching

Wednesday 8 August 1045 am-1215 pm Exposing Photo Manipulation With Inconsistent Reflections James F OrsquoBrien Hany Farid

47

ISTC-VC SIGGRAPH Papers (cont)

Maps Surfaces and Shapes

Wednesday 8 August 1045 am-1215 pm Simple Formulas For Quasiconformal Plane Deformations Yaron Lipman Vladimir G Kim Thomas Funkhouser

Interactive Systems amp Hardware Wednesday 8 August 2-330 pm Position-Correcting Tools for 2D Digital Fabrication Alec Rivers Ilan E Moyer Freacutedo Durand

48

ISTC-VC SIGGRAPH Papers (cont)

Collisions Wednesday 8 August 345-535 pm Energy-Based Self-Collision Culling for Arbitrary Mesh Deformations Changxi Zheng Doug L James

All About Images

Thursday 9 August 9-1030 am A Framework for Content-Adaptive Photo Manipulation Macros Application to Face Landscape and Global Manipulations Floraine Berthouzoz Wilmot Li Mira Dontcheva Maneesh Agrawala

Sound and Elements

Thursday 9 August 9-1030 am Motion-Driven Concatenative Synthesis of Cloth Sounds Steven S An Doug L James Steve Marschner Precomputed Acceleration Noise for Improved Rigid-Body Sound Jeffrey N Chadwick Changxi Zheng Doug L James Interactive Sound Propagation Using Compact Acoustic Transfer Operators Lakulish Antani Anish Chandak Lauri Savioja Dinesh Manocha Updated Sparse Cholesky Factors for Corotational Elastodynamics Florian Hecht Yeon Jin Lee Jonathan R Shewchuk James F OrsquoBrien

49

ISTC-VC SIGGRAPH Papers (cont)

Geometry amp Viewing Thursday 9 August 2-330 pm Perceptual Models of Viewpoint Preference Adrian Secordm Jingwan Lu Adam Finkelstein Manish Singh Andrew Nealen

Faces and Hair [Closing Session]

Thursday 9 August 345-515 pm Coupled 3D Reconstruction of Sparse Facial Hair and Skin Thabo Beeler Bernd Bickel Gioacchino Noris Paul Beardsley Steve Marschner Robert W Sumner Markus Gross Physical Face Cloning Bernd Bickel Peter Kaufmann Melina Skouras Bernhard Thomaszewski Derek Bradley Thabo Beeler Philip Jackson Steve Marschner Wojciech Matusik Markus Gross

50

ISTC-VC SIGGRAPH Papers (cont)

Siggraph Courses Optimizing Realistic Rendering With Many-Light Methods Sunday 5 August 2-515 pm Jaroslav Krivanek Milos Hasan Adam Arbree Carsten Dachsbacher Alexander Keller Bruce Walter State of the Art in Photon-Density Estimation Thursday 9 August 2-515 pm Toshiya Hachisuka Wojciech Jarosz Guillaume Bouchard Per Christensen Jeppe Revall Frisvad Wenzel Jakob Henrik Wann Jensen Jared M Johnson Michael Kaschalk Claude Knaus Andrew Selle Ben Spencer

Siggraph Talks

Silence Eliminate the Noise Thursday 9 August 9-1030 am Importance Sampling for Hair Scattering Jiawei Ou Feng Xie Parashar Krishnamachari Fabio Pellacini

Siggraph Exhibitor Sessions

Intel Corporation Wednesday 8 August 430-530 pm room 402B The Future of Visual Computing as Viewed by Intel Visual Computing Research Centers

51

Other ISTC-VC SIGGRAPH Participation

Page 35: Future of Visual Computing as viewed by Intel Visual ... · PDF fileFuture of Visual Computing as viewed by Intel Visual Computing Research Centers ... Justin Rattner Intel Science

The Intel Science and Technology Center (ISTC) and Intel Collaborative Research Institute (ICRI) Programs

35

The modern economy is an information economy and one that is driven by innovations that enhance productivity as well as create new modes of entertainment We need to invest in the basic research that will inspire future products and services and ensure long term health of our information economy Government and private foundations are helping but corporate America needs to step up and increase commitments to university research - Justin Rattner ndash Intel CTO

$140M investment over 5 years announced by Intel in 2011 and 2012

Centers of Excellence bull Each ISTC and ICRI will focus on one

research area eg visual computing secure computing

bull The ISTCs and ICRIs are meant to bring the best and brightest researchers across the US together

bull Each ISTC and ICRI will be led by a host university and will include thought leaders from other schools

Breaking Barriers to Collaboration

bull Open IP models and open source software to encourage free information exchange (In most of the Centers)

bull Favor projects that span multiple institutions to encourage collaboration among universities

bull Intel researches per center assigned to work on-campus to encourage collaboration between Intel and academia

Greater Impact to Future Tech bull Center research themes to

address essential needs of computing technology

bull Research agendas jointly defined and co-led by an Intel and a University Principal Investigator

bull After completing 3-5 year charters new ISTCs and ICRIs can be formed to respond to changing tech environment

httpfolditportal

Serious Gaming pplied to Content Creation

Highlighted by President Obama Winner of most-significant new visualization tool (NSF)

Goal Create high-quality content by casting creation activities as games in which large numbers of people are incentivized to perform simple tasks which in combination yield sophisticated content PIs Zoran Popovic (UW) Noah Snavely (Cornell) Maneesh Agrawala(Berkeley)

Determining the structure of retroviral protease (HIV)

Video Frank to add Papers Frank to add

Extracting Structure and Semantics

CAD Model Points

Structures

People

Goals Enable context aware computing and automated content creation through the capture analysis and manipulation of real-world visual data PIs Steve Seitz (UW) Noah Snavely (Cornell) Tom Funkhouser (Princeton) Vladlen Koltun (Stanford) Jitendra Malik (Berkeley) Deva Ramanan (UV Irvine)

Video Frank to add Papers Frank to add

httpvisualstanfordedu

Computational Photography (Franken Camera)

Being adopted as a standard API for cellphone camera systems (Apple Android)

bull Goal Develop algorithms languages architectures and prototypes demonstrating the use of computation in the process of image capture and display

bull PIs Marc Levoy (Stanford) Mark Horowitz (Stanford) Pat Hanrahan (Stanford)

Video Frank to add Papers Frank to add

ISTC-VC SIGGRAPH Papers

Character Locomotion Monday 6 August 900 AM - 1030 AM Optimizing Locomotion Controllers Using Biologically Based Actuators and Objectives Jack M Wang Samuel R Hamner Scott L Delp Vladlen Koltun Continuous Character Control With Low-Dimensional Embeddings Sergey Levine Jack M Wang Alexis Haraux Zoran Popović Vladlen Koltun Shape Analysis Monday 6 August 900 AM - 1030 AM Schelling Points on 3D Surface Meshes Xiaobai Chen Abulhair Saparov Bill Pang Thomas Funkhouser Shape Transformation Wednesday 8 August 900 - 1030 AM An Algebraic Model for Parameterized Shape Editing Martin Bokeloh Michael Wand Hans-Peter Seidel Vladlen Koltun

42

ISTC-VC SIGGRAPH Papers

Image Processing Monday 6 August 2- 330 pm Decoupling Algorithms From Schedules for Easy Optimization of Image-Processing Pipelines Jonathan Ragan-Kelley Andrew Adams Sylvain Paris Marc Levoy Saman Amarasinghe Freacutedo Durand

Cloth

Monday 6 August 2-330 pm Specular Reflection From Woven Cloth Piti Irawan Steve Marschner Stitch Meshes for Modeling Knitted Clothing With Yarn-level Detail Cem Yuksel Jonathan M Kaldor Doug L James Steve Marschner

Appearance

Monday 6 August 345-535 pm Printing Spatially Varying Reflectance for Reproducing HDR Images Yue Dong Xin Tong Fabio Pellacini Baining Guo

43

ISTC-VC SIGGRAPH Papers (cont)

Hand Eye and Face Monday 6 August 345-535 pm Session Chair - Vladlen Koltun Discovery of Complex Behaviors through Contact-Invariant Optimization Igor Mordatch Emanuel Todorov Zoran Popovi1049029 Sketching Monday 6 August 345-535 pm HelpingHand Example-Based Stroke Stylization Jingwan Lu Fisher Yu Adam Finkelstein Stephen DiVerdi Fabrication Tuesday 7 August 9-1030 am Fabricating Articulated Characters From Skinned Meshes Moritz Baumlcher Bernd Bickel Doug L James Hanspeter Pfister

44

Sampling Reconstructing and Filtering Light Tuesday 7 August 1045 am-1215 pm A Theory of Monte Carlo Visibility Sampling Ravi Ramamoorthi John Anderson Mark Meyer Derek Nowrouzezahrai Reconstructing the Indirect Light Field for Global Illumination Jaakko Lehtinen Timo Aila Samuli Laine Freacutedo Durand

Geometry Reconstruction amp Tracking

Tuesday 7 August 1045 am-1215 pm Temporally Coherent Completion of Dynamic Shapes Hao Li Linjie Luo Daniel Vlasic Pieter Peers Jovan Popovic Mark Pauly Szymon Rusinkiewicz

Sets of Shapes

Tuesday 7 August 2-330 pm Exploring Collections of 3D Models Using Fuzzy Correspondence Vladimir G Kim Wilmot Li Niloy J Mitra Stephen DiVerdi Thomas Funkhouser A Probabilistic Model for Component-Based Shape Synthesis Evangelos Kalogerakis Siddhartha Chaudhuri Daphne Koller Vladlen Koltun

45

ISTC-VC SIGGRAPH Papers (cont)

Light Rays Tuesday 7 August 2-330 pm Manifold Exploration A Markov Chain Monte Carlo Technique for Rendering Scenes With Difficult Specular Transport Wenzel Jakob Steve Marschner Bidirectional Lightcuts Bruce Walter Pramook Khungurn Kavita Bala

Fun With Video

Tuesday 7 August 345-535 pm Session Chair Noah Snavely Video Deblurring for Hand-Held Cameras Using Patch-Based Synthesis Sunghyun Cho Jue Wang Seungyong Lee Eulerian Video Magnification for Revealing Subtle Changes in the World Hao-Yu Wu Michael Rubinstein Eugene Shih John Guttag Freacutedo Durand William T Freeman Selectively De-Animating Video Jiamin Bai Aseem Agarwala Maneesh Agrawala Ravi Ramamoorthi Tools for Placing Cuts and Transitions in Interview Video Floraine Berthouzoz Wilmot Li Maneesh Agrawala

46

ISTC-VC SIGGRAPH Papers (cont)

Noise and Texture Tuesday 7 August 345-535 pm Structure-Aware Synthesis for Predictive Woven Fabric Appearance Shuang Zhao Kavita Bala Steve Marschner Wenzel Jakob Symmetry-Guided Texture Synthesis and Manipulation Vladimir Kim Yaron Lipman Thomas Funkhouser

Shape Transformation Wednesday 8 August 900 - 1030 AM An Algebraic Model for Parameterized Shape Editing Martin Bokeloh Michael Wand Hans-Peter Seidel Vladlen Koltun

Stitching

Wednesday 8 August 1045 am-1215 pm Exposing Photo Manipulation With Inconsistent Reflections James F OrsquoBrien Hany Farid

47

ISTC-VC SIGGRAPH Papers (cont)

Maps Surfaces and Shapes

Wednesday 8 August 1045 am-1215 pm Simple Formulas For Quasiconformal Plane Deformations Yaron Lipman Vladimir G Kim Thomas Funkhouser

Interactive Systems amp Hardware Wednesday 8 August 2-330 pm Position-Correcting Tools for 2D Digital Fabrication Alec Rivers Ilan E Moyer Freacutedo Durand

48

ISTC-VC SIGGRAPH Papers (cont)

Collisions Wednesday 8 August 345-535 pm Energy-Based Self-Collision Culling for Arbitrary Mesh Deformations Changxi Zheng Doug L James

All About Images

Thursday 9 August 9-1030 am A Framework for Content-Adaptive Photo Manipulation Macros Application to Face Landscape and Global Manipulations Floraine Berthouzoz Wilmot Li Mira Dontcheva Maneesh Agrawala

Sound and Elements

Thursday 9 August 9-1030 am Motion-Driven Concatenative Synthesis of Cloth Sounds Steven S An Doug L James Steve Marschner Precomputed Acceleration Noise for Improved Rigid-Body Sound Jeffrey N Chadwick Changxi Zheng Doug L James Interactive Sound Propagation Using Compact Acoustic Transfer Operators Lakulish Antani Anish Chandak Lauri Savioja Dinesh Manocha Updated Sparse Cholesky Factors for Corotational Elastodynamics Florian Hecht Yeon Jin Lee Jonathan R Shewchuk James F OrsquoBrien

49

ISTC-VC SIGGRAPH Papers (cont)

Geometry amp Viewing Thursday 9 August 2-330 pm Perceptual Models of Viewpoint Preference Adrian Secordm Jingwan Lu Adam Finkelstein Manish Singh Andrew Nealen

Faces and Hair [Closing Session]

Thursday 9 August 345-515 pm Coupled 3D Reconstruction of Sparse Facial Hair and Skin Thabo Beeler Bernd Bickel Gioacchino Noris Paul Beardsley Steve Marschner Robert W Sumner Markus Gross Physical Face Cloning Bernd Bickel Peter Kaufmann Melina Skouras Bernhard Thomaszewski Derek Bradley Thabo Beeler Philip Jackson Steve Marschner Wojciech Matusik Markus Gross

50

ISTC-VC SIGGRAPH Papers (cont)

Siggraph Courses Optimizing Realistic Rendering With Many-Light Methods Sunday 5 August 2-515 pm Jaroslav Krivanek Milos Hasan Adam Arbree Carsten Dachsbacher Alexander Keller Bruce Walter State of the Art in Photon-Density Estimation Thursday 9 August 2-515 pm Toshiya Hachisuka Wojciech Jarosz Guillaume Bouchard Per Christensen Jeppe Revall Frisvad Wenzel Jakob Henrik Wann Jensen Jared M Johnson Michael Kaschalk Claude Knaus Andrew Selle Ben Spencer

Siggraph Talks

Silence Eliminate the Noise Thursday 9 August 9-1030 am Importance Sampling for Hair Scattering Jiawei Ou Feng Xie Parashar Krishnamachari Fabio Pellacini

Siggraph Exhibitor Sessions

Intel Corporation Wednesday 8 August 430-530 pm room 402B The Future of Visual Computing as Viewed by Intel Visual Computing Research Centers

51

Other ISTC-VC SIGGRAPH Participation

Page 36: Future of Visual Computing as viewed by Intel Visual ... · PDF fileFuture of Visual Computing as viewed by Intel Visual Computing Research Centers ... Justin Rattner Intel Science

Centers of Excellence bull Each ISTC and ICRI will focus on one

research area eg visual computing secure computing

bull The ISTCs and ICRIs are meant to bring the best and brightest researchers across the US together

bull Each ISTC and ICRI will be led by a host university and will include thought leaders from other schools

Breaking Barriers to Collaboration

bull Open IP models and open source software to encourage free information exchange (In most of the Centers)

bull Favor projects that span multiple institutions to encourage collaboration among universities

bull Intel researches per center assigned to work on-campus to encourage collaboration between Intel and academia

Greater Impact to Future Tech bull Center research themes to

address essential needs of computing technology

bull Research agendas jointly defined and co-led by an Intel and a University Principal Investigator

bull After completing 3-5 year charters new ISTCs and ICRIs can be formed to respond to changing tech environment

httpfolditportal

Serious Gaming pplied to Content Creation

Highlighted by President Obama Winner of most-significant new visualization tool (NSF)

Goal Create high-quality content by casting creation activities as games in which large numbers of people are incentivized to perform simple tasks which in combination yield sophisticated content PIs Zoran Popovic (UW) Noah Snavely (Cornell) Maneesh Agrawala(Berkeley)

Determining the structure of retroviral protease (HIV)

Video Frank to add Papers Frank to add

Extracting Structure and Semantics

CAD Model Points

Structures

People

Goals Enable context aware computing and automated content creation through the capture analysis and manipulation of real-world visual data PIs Steve Seitz (UW) Noah Snavely (Cornell) Tom Funkhouser (Princeton) Vladlen Koltun (Stanford) Jitendra Malik (Berkeley) Deva Ramanan (UV Irvine)

Video Frank to add Papers Frank to add

httpvisualstanfordedu

Computational Photography (Franken Camera)

Being adopted as a standard API for cellphone camera systems (Apple Android)

bull Goal Develop algorithms languages architectures and prototypes demonstrating the use of computation in the process of image capture and display

bull PIs Marc Levoy (Stanford) Mark Horowitz (Stanford) Pat Hanrahan (Stanford)

Video Frank to add Papers Frank to add

ISTC-VC SIGGRAPH Papers

Character Locomotion Monday 6 August 900 AM - 1030 AM Optimizing Locomotion Controllers Using Biologically Based Actuators and Objectives Jack M Wang Samuel R Hamner Scott L Delp Vladlen Koltun Continuous Character Control With Low-Dimensional Embeddings Sergey Levine Jack M Wang Alexis Haraux Zoran Popović Vladlen Koltun Shape Analysis Monday 6 August 900 AM - 1030 AM Schelling Points on 3D Surface Meshes Xiaobai Chen Abulhair Saparov Bill Pang Thomas Funkhouser Shape Transformation Wednesday 8 August 900 - 1030 AM An Algebraic Model for Parameterized Shape Editing Martin Bokeloh Michael Wand Hans-Peter Seidel Vladlen Koltun

42

ISTC-VC SIGGRAPH Papers

Image Processing Monday 6 August 2- 330 pm Decoupling Algorithms From Schedules for Easy Optimization of Image-Processing Pipelines Jonathan Ragan-Kelley Andrew Adams Sylvain Paris Marc Levoy Saman Amarasinghe Freacutedo Durand

Cloth

Monday 6 August 2-330 pm Specular Reflection From Woven Cloth Piti Irawan Steve Marschner Stitch Meshes for Modeling Knitted Clothing With Yarn-level Detail Cem Yuksel Jonathan M Kaldor Doug L James Steve Marschner

Appearance

Monday 6 August 345-535 pm Printing Spatially Varying Reflectance for Reproducing HDR Images Yue Dong Xin Tong Fabio Pellacini Baining Guo

43

ISTC-VC SIGGRAPH Papers (cont)

Hand Eye and Face Monday 6 August 345-535 pm Session Chair - Vladlen Koltun Discovery of Complex Behaviors through Contact-Invariant Optimization Igor Mordatch Emanuel Todorov Zoran Popovi1049029 Sketching Monday 6 August 345-535 pm HelpingHand Example-Based Stroke Stylization Jingwan Lu Fisher Yu Adam Finkelstein Stephen DiVerdi Fabrication Tuesday 7 August 9-1030 am Fabricating Articulated Characters From Skinned Meshes Moritz Baumlcher Bernd Bickel Doug L James Hanspeter Pfister

44

Sampling Reconstructing and Filtering Light Tuesday 7 August 1045 am-1215 pm A Theory of Monte Carlo Visibility Sampling Ravi Ramamoorthi John Anderson Mark Meyer Derek Nowrouzezahrai Reconstructing the Indirect Light Field for Global Illumination Jaakko Lehtinen Timo Aila Samuli Laine Freacutedo Durand

Geometry Reconstruction amp Tracking

Tuesday 7 August 1045 am-1215 pm Temporally Coherent Completion of Dynamic Shapes Hao Li Linjie Luo Daniel Vlasic Pieter Peers Jovan Popovic Mark Pauly Szymon Rusinkiewicz

Sets of Shapes

Tuesday 7 August 2-330 pm Exploring Collections of 3D Models Using Fuzzy Correspondence Vladimir G Kim Wilmot Li Niloy J Mitra Stephen DiVerdi Thomas Funkhouser A Probabilistic Model for Component-Based Shape Synthesis Evangelos Kalogerakis Siddhartha Chaudhuri Daphne Koller Vladlen Koltun

45

ISTC-VC SIGGRAPH Papers (cont)

Light Rays Tuesday 7 August 2-330 pm Manifold Exploration A Markov Chain Monte Carlo Technique for Rendering Scenes With Difficult Specular Transport Wenzel Jakob Steve Marschner Bidirectional Lightcuts Bruce Walter Pramook Khungurn Kavita Bala

Fun With Video

Tuesday 7 August 345-535 pm Session Chair Noah Snavely Video Deblurring for Hand-Held Cameras Using Patch-Based Synthesis Sunghyun Cho Jue Wang Seungyong Lee Eulerian Video Magnification for Revealing Subtle Changes in the World Hao-Yu Wu Michael Rubinstein Eugene Shih John Guttag Freacutedo Durand William T Freeman Selectively De-Animating Video Jiamin Bai Aseem Agarwala Maneesh Agrawala Ravi Ramamoorthi Tools for Placing Cuts and Transitions in Interview Video Floraine Berthouzoz Wilmot Li Maneesh Agrawala

46

ISTC-VC SIGGRAPH Papers (cont)

Noise and Texture Tuesday 7 August 345-535 pm Structure-Aware Synthesis for Predictive Woven Fabric Appearance Shuang Zhao Kavita Bala Steve Marschner Wenzel Jakob Symmetry-Guided Texture Synthesis and Manipulation Vladimir Kim Yaron Lipman Thomas Funkhouser

Shape Transformation Wednesday 8 August 900 - 1030 AM An Algebraic Model for Parameterized Shape Editing Martin Bokeloh Michael Wand Hans-Peter Seidel Vladlen Koltun

Stitching

Wednesday 8 August 1045 am-1215 pm Exposing Photo Manipulation With Inconsistent Reflections James F OrsquoBrien Hany Farid

47

ISTC-VC SIGGRAPH Papers (cont)

Maps Surfaces and Shapes

Wednesday 8 August 1045 am-1215 pm Simple Formulas For Quasiconformal Plane Deformations Yaron Lipman Vladimir G Kim Thomas Funkhouser

Interactive Systems amp Hardware Wednesday 8 August 2-330 pm Position-Correcting Tools for 2D Digital Fabrication Alec Rivers Ilan E Moyer Freacutedo Durand

48

ISTC-VC SIGGRAPH Papers (cont)

Collisions Wednesday 8 August 345-535 pm Energy-Based Self-Collision Culling for Arbitrary Mesh Deformations Changxi Zheng Doug L James

All About Images

Thursday 9 August 9-1030 am A Framework for Content-Adaptive Photo Manipulation Macros Application to Face Landscape and Global Manipulations Floraine Berthouzoz Wilmot Li Mira Dontcheva Maneesh Agrawala

Sound and Elements

Thursday 9 August 9-1030 am Motion-Driven Concatenative Synthesis of Cloth Sounds Steven S An Doug L James Steve Marschner Precomputed Acceleration Noise for Improved Rigid-Body Sound Jeffrey N Chadwick Changxi Zheng Doug L James Interactive Sound Propagation Using Compact Acoustic Transfer Operators Lakulish Antani Anish Chandak Lauri Savioja Dinesh Manocha Updated Sparse Cholesky Factors for Corotational Elastodynamics Florian Hecht Yeon Jin Lee Jonathan R Shewchuk James F OrsquoBrien

49

ISTC-VC SIGGRAPH Papers (cont)

Geometry amp Viewing Thursday 9 August 2-330 pm Perceptual Models of Viewpoint Preference Adrian Secordm Jingwan Lu Adam Finkelstein Manish Singh Andrew Nealen

Faces and Hair [Closing Session]

Thursday 9 August 345-515 pm Coupled 3D Reconstruction of Sparse Facial Hair and Skin Thabo Beeler Bernd Bickel Gioacchino Noris Paul Beardsley Steve Marschner Robert W Sumner Markus Gross Physical Face Cloning Bernd Bickel Peter Kaufmann Melina Skouras Bernhard Thomaszewski Derek Bradley Thabo Beeler Philip Jackson Steve Marschner Wojciech Matusik Markus Gross

50

ISTC-VC SIGGRAPH Papers (cont)

Siggraph Courses Optimizing Realistic Rendering With Many-Light Methods Sunday 5 August 2-515 pm Jaroslav Krivanek Milos Hasan Adam Arbree Carsten Dachsbacher Alexander Keller Bruce Walter State of the Art in Photon-Density Estimation Thursday 9 August 2-515 pm Toshiya Hachisuka Wojciech Jarosz Guillaume Bouchard Per Christensen Jeppe Revall Frisvad Wenzel Jakob Henrik Wann Jensen Jared M Johnson Michael Kaschalk Claude Knaus Andrew Selle Ben Spencer

Siggraph Talks

Silence Eliminate the Noise Thursday 9 August 9-1030 am Importance Sampling for Hair Scattering Jiawei Ou Feng Xie Parashar Krishnamachari Fabio Pellacini

Siggraph Exhibitor Sessions

Intel Corporation Wednesday 8 August 430-530 pm room 402B The Future of Visual Computing as Viewed by Intel Visual Computing Research Centers

51

Other ISTC-VC SIGGRAPH Participation

Page 37: Future of Visual Computing as viewed by Intel Visual ... · PDF fileFuture of Visual Computing as viewed by Intel Visual Computing Research Centers ... Justin Rattner Intel Science

Breaking Barriers to Collaboration

bull Open IP models and open source software to encourage free information exchange (In most of the Centers)

bull Favor projects that span multiple institutions to encourage collaboration among universities

bull Intel researches per center assigned to work on-campus to encourage collaboration between Intel and academia

Greater Impact to Future Tech bull Center research themes to

address essential needs of computing technology

bull Research agendas jointly defined and co-led by an Intel and a University Principal Investigator

bull After completing 3-5 year charters new ISTCs and ICRIs can be formed to respond to changing tech environment

httpfolditportal

Serious Gaming pplied to Content Creation

Highlighted by President Obama Winner of most-significant new visualization tool (NSF)

Goal Create high-quality content by casting creation activities as games in which large numbers of people are incentivized to perform simple tasks which in combination yield sophisticated content PIs Zoran Popovic (UW) Noah Snavely (Cornell) Maneesh Agrawala(Berkeley)

Determining the structure of retroviral protease (HIV)

Video Frank to add Papers Frank to add

Extracting Structure and Semantics

CAD Model Points

Structures

People

Goals Enable context aware computing and automated content creation through the capture analysis and manipulation of real-world visual data PIs Steve Seitz (UW) Noah Snavely (Cornell) Tom Funkhouser (Princeton) Vladlen Koltun (Stanford) Jitendra Malik (Berkeley) Deva Ramanan (UV Irvine)

Video Frank to add Papers Frank to add

httpvisualstanfordedu

Computational Photography (Franken Camera)

Being adopted as a standard API for cellphone camera systems (Apple Android)

bull Goal Develop algorithms languages architectures and prototypes demonstrating the use of computation in the process of image capture and display

bull PIs Marc Levoy (Stanford) Mark Horowitz (Stanford) Pat Hanrahan (Stanford)

Video Frank to add Papers Frank to add

ISTC-VC SIGGRAPH Papers

Character Locomotion Monday 6 August 900 AM - 1030 AM Optimizing Locomotion Controllers Using Biologically Based Actuators and Objectives Jack M Wang Samuel R Hamner Scott L Delp Vladlen Koltun Continuous Character Control With Low-Dimensional Embeddings Sergey Levine Jack M Wang Alexis Haraux Zoran Popović Vladlen Koltun Shape Analysis Monday 6 August 900 AM - 1030 AM Schelling Points on 3D Surface Meshes Xiaobai Chen Abulhair Saparov Bill Pang Thomas Funkhouser Shape Transformation Wednesday 8 August 900 - 1030 AM An Algebraic Model for Parameterized Shape Editing Martin Bokeloh Michael Wand Hans-Peter Seidel Vladlen Koltun

42

ISTC-VC SIGGRAPH Papers

Image Processing Monday 6 August 2- 330 pm Decoupling Algorithms From Schedules for Easy Optimization of Image-Processing Pipelines Jonathan Ragan-Kelley Andrew Adams Sylvain Paris Marc Levoy Saman Amarasinghe Freacutedo Durand

Cloth

Monday 6 August 2-330 pm Specular Reflection From Woven Cloth Piti Irawan Steve Marschner Stitch Meshes for Modeling Knitted Clothing With Yarn-level Detail Cem Yuksel Jonathan M Kaldor Doug L James Steve Marschner

Appearance

Monday 6 August 345-535 pm Printing Spatially Varying Reflectance for Reproducing HDR Images Yue Dong Xin Tong Fabio Pellacini Baining Guo

43

ISTC-VC SIGGRAPH Papers (cont)

Hand Eye and Face Monday 6 August 345-535 pm Session Chair - Vladlen Koltun Discovery of Complex Behaviors through Contact-Invariant Optimization Igor Mordatch Emanuel Todorov Zoran Popovi1049029 Sketching Monday 6 August 345-535 pm HelpingHand Example-Based Stroke Stylization Jingwan Lu Fisher Yu Adam Finkelstein Stephen DiVerdi Fabrication Tuesday 7 August 9-1030 am Fabricating Articulated Characters From Skinned Meshes Moritz Baumlcher Bernd Bickel Doug L James Hanspeter Pfister

44

Sampling Reconstructing and Filtering Light Tuesday 7 August 1045 am-1215 pm A Theory of Monte Carlo Visibility Sampling Ravi Ramamoorthi John Anderson Mark Meyer Derek Nowrouzezahrai Reconstructing the Indirect Light Field for Global Illumination Jaakko Lehtinen Timo Aila Samuli Laine Freacutedo Durand

Geometry Reconstruction amp Tracking

Tuesday 7 August 1045 am-1215 pm Temporally Coherent Completion of Dynamic Shapes Hao Li Linjie Luo Daniel Vlasic Pieter Peers Jovan Popovic Mark Pauly Szymon Rusinkiewicz

Sets of Shapes

Tuesday 7 August 2-330 pm Exploring Collections of 3D Models Using Fuzzy Correspondence Vladimir G Kim Wilmot Li Niloy J Mitra Stephen DiVerdi Thomas Funkhouser A Probabilistic Model for Component-Based Shape Synthesis Evangelos Kalogerakis Siddhartha Chaudhuri Daphne Koller Vladlen Koltun

45

ISTC-VC SIGGRAPH Papers (cont)

Light Rays Tuesday 7 August 2-330 pm Manifold Exploration A Markov Chain Monte Carlo Technique for Rendering Scenes With Difficult Specular Transport Wenzel Jakob Steve Marschner Bidirectional Lightcuts Bruce Walter Pramook Khungurn Kavita Bala

Fun With Video

Tuesday 7 August 345-535 pm Session Chair Noah Snavely Video Deblurring for Hand-Held Cameras Using Patch-Based Synthesis Sunghyun Cho Jue Wang Seungyong Lee Eulerian Video Magnification for Revealing Subtle Changes in the World Hao-Yu Wu Michael Rubinstein Eugene Shih John Guttag Freacutedo Durand William T Freeman Selectively De-Animating Video Jiamin Bai Aseem Agarwala Maneesh Agrawala Ravi Ramamoorthi Tools for Placing Cuts and Transitions in Interview Video Floraine Berthouzoz Wilmot Li Maneesh Agrawala

46

ISTC-VC SIGGRAPH Papers (cont)

Noise and Texture Tuesday 7 August 345-535 pm Structure-Aware Synthesis for Predictive Woven Fabric Appearance Shuang Zhao Kavita Bala Steve Marschner Wenzel Jakob Symmetry-Guided Texture Synthesis and Manipulation Vladimir Kim Yaron Lipman Thomas Funkhouser

Shape Transformation Wednesday 8 August 900 - 1030 AM An Algebraic Model for Parameterized Shape Editing Martin Bokeloh Michael Wand Hans-Peter Seidel Vladlen Koltun

Stitching

Wednesday 8 August 1045 am-1215 pm Exposing Photo Manipulation With Inconsistent Reflections James F OrsquoBrien Hany Farid

47

ISTC-VC SIGGRAPH Papers (cont)

Maps Surfaces and Shapes

Wednesday 8 August 1045 am-1215 pm Simple Formulas For Quasiconformal Plane Deformations Yaron Lipman Vladimir G Kim Thomas Funkhouser

Interactive Systems amp Hardware Wednesday 8 August 2-330 pm Position-Correcting Tools for 2D Digital Fabrication Alec Rivers Ilan E Moyer Freacutedo Durand

48

ISTC-VC SIGGRAPH Papers (cont)

Collisions Wednesday 8 August 345-535 pm Energy-Based Self-Collision Culling for Arbitrary Mesh Deformations Changxi Zheng Doug L James

All About Images

Thursday 9 August 9-1030 am A Framework for Content-Adaptive Photo Manipulation Macros Application to Face Landscape and Global Manipulations Floraine Berthouzoz Wilmot Li Mira Dontcheva Maneesh Agrawala

Sound and Elements

Thursday 9 August 9-1030 am Motion-Driven Concatenative Synthesis of Cloth Sounds Steven S An Doug L James Steve Marschner Precomputed Acceleration Noise for Improved Rigid-Body Sound Jeffrey N Chadwick Changxi Zheng Doug L James Interactive Sound Propagation Using Compact Acoustic Transfer Operators Lakulish Antani Anish Chandak Lauri Savioja Dinesh Manocha Updated Sparse Cholesky Factors for Corotational Elastodynamics Florian Hecht Yeon Jin Lee Jonathan R Shewchuk James F OrsquoBrien

49

ISTC-VC SIGGRAPH Papers (cont)

Geometry amp Viewing Thursday 9 August 2-330 pm Perceptual Models of Viewpoint Preference Adrian Secordm Jingwan Lu Adam Finkelstein Manish Singh Andrew Nealen

Faces and Hair [Closing Session]

Thursday 9 August 345-515 pm Coupled 3D Reconstruction of Sparse Facial Hair and Skin Thabo Beeler Bernd Bickel Gioacchino Noris Paul Beardsley Steve Marschner Robert W Sumner Markus Gross Physical Face Cloning Bernd Bickel Peter Kaufmann Melina Skouras Bernhard Thomaszewski Derek Bradley Thabo Beeler Philip Jackson Steve Marschner Wojciech Matusik Markus Gross

50

ISTC-VC SIGGRAPH Papers (cont)

Siggraph Courses Optimizing Realistic Rendering With Many-Light Methods Sunday 5 August 2-515 pm Jaroslav Krivanek Milos Hasan Adam Arbree Carsten Dachsbacher Alexander Keller Bruce Walter State of the Art in Photon-Density Estimation Thursday 9 August 2-515 pm Toshiya Hachisuka Wojciech Jarosz Guillaume Bouchard Per Christensen Jeppe Revall Frisvad Wenzel Jakob Henrik Wann Jensen Jared M Johnson Michael Kaschalk Claude Knaus Andrew Selle Ben Spencer

Siggraph Talks

Silence Eliminate the Noise Thursday 9 August 9-1030 am Importance Sampling for Hair Scattering Jiawei Ou Feng Xie Parashar Krishnamachari Fabio Pellacini

Siggraph Exhibitor Sessions

Intel Corporation Wednesday 8 August 430-530 pm room 402B The Future of Visual Computing as Viewed by Intel Visual Computing Research Centers

51

Other ISTC-VC SIGGRAPH Participation

Page 38: Future of Visual Computing as viewed by Intel Visual ... · PDF fileFuture of Visual Computing as viewed by Intel Visual Computing Research Centers ... Justin Rattner Intel Science

Greater Impact to Future Tech bull Center research themes to

address essential needs of computing technology

bull Research agendas jointly defined and co-led by an Intel and a University Principal Investigator

bull After completing 3-5 year charters new ISTCs and ICRIs can be formed to respond to changing tech environment

httpfolditportal

Serious Gaming pplied to Content Creation

Highlighted by President Obama Winner of most-significant new visualization tool (NSF)

Goal Create high-quality content by casting creation activities as games in which large numbers of people are incentivized to perform simple tasks which in combination yield sophisticated content PIs Zoran Popovic (UW) Noah Snavely (Cornell) Maneesh Agrawala(Berkeley)

Determining the structure of retroviral protease (HIV)

Video Frank to add Papers Frank to add

Extracting Structure and Semantics

CAD Model Points

Structures

People

Goals Enable context aware computing and automated content creation through the capture analysis and manipulation of real-world visual data PIs Steve Seitz (UW) Noah Snavely (Cornell) Tom Funkhouser (Princeton) Vladlen Koltun (Stanford) Jitendra Malik (Berkeley) Deva Ramanan (UV Irvine)

Video Frank to add Papers Frank to add

httpvisualstanfordedu

Computational Photography (Franken Camera)

Being adopted as a standard API for cellphone camera systems (Apple Android)

bull Goal Develop algorithms languages architectures and prototypes demonstrating the use of computation in the process of image capture and display

bull PIs Marc Levoy (Stanford) Mark Horowitz (Stanford) Pat Hanrahan (Stanford)

Video Frank to add Papers Frank to add

ISTC-VC SIGGRAPH Papers

Character Locomotion Monday 6 August 900 AM - 1030 AM Optimizing Locomotion Controllers Using Biologically Based Actuators and Objectives Jack M Wang Samuel R Hamner Scott L Delp Vladlen Koltun Continuous Character Control With Low-Dimensional Embeddings Sergey Levine Jack M Wang Alexis Haraux Zoran Popović Vladlen Koltun Shape Analysis Monday 6 August 900 AM - 1030 AM Schelling Points on 3D Surface Meshes Xiaobai Chen Abulhair Saparov Bill Pang Thomas Funkhouser Shape Transformation Wednesday 8 August 900 - 1030 AM An Algebraic Model for Parameterized Shape Editing Martin Bokeloh Michael Wand Hans-Peter Seidel Vladlen Koltun

42

ISTC-VC SIGGRAPH Papers

Image Processing Monday 6 August 2- 330 pm Decoupling Algorithms From Schedules for Easy Optimization of Image-Processing Pipelines Jonathan Ragan-Kelley Andrew Adams Sylvain Paris Marc Levoy Saman Amarasinghe Freacutedo Durand

Cloth

Monday 6 August 2-330 pm Specular Reflection From Woven Cloth Piti Irawan Steve Marschner Stitch Meshes for Modeling Knitted Clothing With Yarn-level Detail Cem Yuksel Jonathan M Kaldor Doug L James Steve Marschner

Appearance

Monday 6 August 345-535 pm Printing Spatially Varying Reflectance for Reproducing HDR Images Yue Dong Xin Tong Fabio Pellacini Baining Guo

43

ISTC-VC SIGGRAPH Papers (cont)

Hand Eye and Face Monday 6 August 345-535 pm Session Chair - Vladlen Koltun Discovery of Complex Behaviors through Contact-Invariant Optimization Igor Mordatch Emanuel Todorov Zoran Popovi1049029 Sketching Monday 6 August 345-535 pm HelpingHand Example-Based Stroke Stylization Jingwan Lu Fisher Yu Adam Finkelstein Stephen DiVerdi Fabrication Tuesday 7 August 9-1030 am Fabricating Articulated Characters From Skinned Meshes Moritz Baumlcher Bernd Bickel Doug L James Hanspeter Pfister

44

Sampling Reconstructing and Filtering Light Tuesday 7 August 1045 am-1215 pm A Theory of Monte Carlo Visibility Sampling Ravi Ramamoorthi John Anderson Mark Meyer Derek Nowrouzezahrai Reconstructing the Indirect Light Field for Global Illumination Jaakko Lehtinen Timo Aila Samuli Laine Freacutedo Durand

Geometry Reconstruction amp Tracking

Tuesday 7 August 1045 am-1215 pm Temporally Coherent Completion of Dynamic Shapes Hao Li Linjie Luo Daniel Vlasic Pieter Peers Jovan Popovic Mark Pauly Szymon Rusinkiewicz

Sets of Shapes

Tuesday 7 August 2-330 pm Exploring Collections of 3D Models Using Fuzzy Correspondence Vladimir G Kim Wilmot Li Niloy J Mitra Stephen DiVerdi Thomas Funkhouser A Probabilistic Model for Component-Based Shape Synthesis Evangelos Kalogerakis Siddhartha Chaudhuri Daphne Koller Vladlen Koltun

45

ISTC-VC SIGGRAPH Papers (cont)

Light Rays Tuesday 7 August 2-330 pm Manifold Exploration A Markov Chain Monte Carlo Technique for Rendering Scenes With Difficult Specular Transport Wenzel Jakob Steve Marschner Bidirectional Lightcuts Bruce Walter Pramook Khungurn Kavita Bala

Fun With Video

Tuesday 7 August 345-535 pm Session Chair Noah Snavely Video Deblurring for Hand-Held Cameras Using Patch-Based Synthesis Sunghyun Cho Jue Wang Seungyong Lee Eulerian Video Magnification for Revealing Subtle Changes in the World Hao-Yu Wu Michael Rubinstein Eugene Shih John Guttag Freacutedo Durand William T Freeman Selectively De-Animating Video Jiamin Bai Aseem Agarwala Maneesh Agrawala Ravi Ramamoorthi Tools for Placing Cuts and Transitions in Interview Video Floraine Berthouzoz Wilmot Li Maneesh Agrawala

46

ISTC-VC SIGGRAPH Papers (cont)

Noise and Texture Tuesday 7 August 345-535 pm Structure-Aware Synthesis for Predictive Woven Fabric Appearance Shuang Zhao Kavita Bala Steve Marschner Wenzel Jakob Symmetry-Guided Texture Synthesis and Manipulation Vladimir Kim Yaron Lipman Thomas Funkhouser

Shape Transformation Wednesday 8 August 900 - 1030 AM An Algebraic Model for Parameterized Shape Editing Martin Bokeloh Michael Wand Hans-Peter Seidel Vladlen Koltun

Stitching

Wednesday 8 August 1045 am-1215 pm Exposing Photo Manipulation With Inconsistent Reflections James F OrsquoBrien Hany Farid

47

ISTC-VC SIGGRAPH Papers (cont)

Maps Surfaces and Shapes

Wednesday 8 August 1045 am-1215 pm Simple Formulas For Quasiconformal Plane Deformations Yaron Lipman Vladimir G Kim Thomas Funkhouser

Interactive Systems amp Hardware Wednesday 8 August 2-330 pm Position-Correcting Tools for 2D Digital Fabrication Alec Rivers Ilan E Moyer Freacutedo Durand

48

ISTC-VC SIGGRAPH Papers (cont)

Collisions Wednesday 8 August 345-535 pm Energy-Based Self-Collision Culling for Arbitrary Mesh Deformations Changxi Zheng Doug L James

All About Images

Thursday 9 August 9-1030 am A Framework for Content-Adaptive Photo Manipulation Macros Application to Face Landscape and Global Manipulations Floraine Berthouzoz Wilmot Li Mira Dontcheva Maneesh Agrawala

Sound and Elements

Thursday 9 August 9-1030 am Motion-Driven Concatenative Synthesis of Cloth Sounds Steven S An Doug L James Steve Marschner Precomputed Acceleration Noise for Improved Rigid-Body Sound Jeffrey N Chadwick Changxi Zheng Doug L James Interactive Sound Propagation Using Compact Acoustic Transfer Operators Lakulish Antani Anish Chandak Lauri Savioja Dinesh Manocha Updated Sparse Cholesky Factors for Corotational Elastodynamics Florian Hecht Yeon Jin Lee Jonathan R Shewchuk James F OrsquoBrien

49

ISTC-VC SIGGRAPH Papers (cont)

Geometry amp Viewing Thursday 9 August 2-330 pm Perceptual Models of Viewpoint Preference Adrian Secordm Jingwan Lu Adam Finkelstein Manish Singh Andrew Nealen

Faces and Hair [Closing Session]

Thursday 9 August 345-515 pm Coupled 3D Reconstruction of Sparse Facial Hair and Skin Thabo Beeler Bernd Bickel Gioacchino Noris Paul Beardsley Steve Marschner Robert W Sumner Markus Gross Physical Face Cloning Bernd Bickel Peter Kaufmann Melina Skouras Bernhard Thomaszewski Derek Bradley Thabo Beeler Philip Jackson Steve Marschner Wojciech Matusik Markus Gross

50

ISTC-VC SIGGRAPH Papers (cont)

Siggraph Courses Optimizing Realistic Rendering With Many-Light Methods Sunday 5 August 2-515 pm Jaroslav Krivanek Milos Hasan Adam Arbree Carsten Dachsbacher Alexander Keller Bruce Walter State of the Art in Photon-Density Estimation Thursday 9 August 2-515 pm Toshiya Hachisuka Wojciech Jarosz Guillaume Bouchard Per Christensen Jeppe Revall Frisvad Wenzel Jakob Henrik Wann Jensen Jared M Johnson Michael Kaschalk Claude Knaus Andrew Selle Ben Spencer

Siggraph Talks

Silence Eliminate the Noise Thursday 9 August 9-1030 am Importance Sampling for Hair Scattering Jiawei Ou Feng Xie Parashar Krishnamachari Fabio Pellacini

Siggraph Exhibitor Sessions

Intel Corporation Wednesday 8 August 430-530 pm room 402B The Future of Visual Computing as Viewed by Intel Visual Computing Research Centers

51

Other ISTC-VC SIGGRAPH Participation

Page 39: Future of Visual Computing as viewed by Intel Visual ... · PDF fileFuture of Visual Computing as viewed by Intel Visual Computing Research Centers ... Justin Rattner Intel Science

httpfolditportal

Serious Gaming pplied to Content Creation

Highlighted by President Obama Winner of most-significant new visualization tool (NSF)

Goal Create high-quality content by casting creation activities as games in which large numbers of people are incentivized to perform simple tasks which in combination yield sophisticated content PIs Zoran Popovic (UW) Noah Snavely (Cornell) Maneesh Agrawala(Berkeley)

Determining the structure of retroviral protease (HIV)

Video Frank to add Papers Frank to add

Extracting Structure and Semantics

CAD Model Points

Structures

People

Goals Enable context aware computing and automated content creation through the capture analysis and manipulation of real-world visual data PIs Steve Seitz (UW) Noah Snavely (Cornell) Tom Funkhouser (Princeton) Vladlen Koltun (Stanford) Jitendra Malik (Berkeley) Deva Ramanan (UV Irvine)

Video Frank to add Papers Frank to add

httpvisualstanfordedu

Computational Photography (Franken Camera)

Being adopted as a standard API for cellphone camera systems (Apple Android)

bull Goal Develop algorithms languages architectures and prototypes demonstrating the use of computation in the process of image capture and display

bull PIs Marc Levoy (Stanford) Mark Horowitz (Stanford) Pat Hanrahan (Stanford)

Video Frank to add Papers Frank to add

ISTC-VC SIGGRAPH Papers

Character Locomotion Monday 6 August 900 AM - 1030 AM Optimizing Locomotion Controllers Using Biologically Based Actuators and Objectives Jack M Wang Samuel R Hamner Scott L Delp Vladlen Koltun Continuous Character Control With Low-Dimensional Embeddings Sergey Levine Jack M Wang Alexis Haraux Zoran Popović Vladlen Koltun Shape Analysis Monday 6 August 900 AM - 1030 AM Schelling Points on 3D Surface Meshes Xiaobai Chen Abulhair Saparov Bill Pang Thomas Funkhouser Shape Transformation Wednesday 8 August 900 - 1030 AM An Algebraic Model for Parameterized Shape Editing Martin Bokeloh Michael Wand Hans-Peter Seidel Vladlen Koltun

42

ISTC-VC SIGGRAPH Papers

Image Processing Monday 6 August 2- 330 pm Decoupling Algorithms From Schedules for Easy Optimization of Image-Processing Pipelines Jonathan Ragan-Kelley Andrew Adams Sylvain Paris Marc Levoy Saman Amarasinghe Freacutedo Durand

Cloth

Monday 6 August 2-330 pm Specular Reflection From Woven Cloth Piti Irawan Steve Marschner Stitch Meshes for Modeling Knitted Clothing With Yarn-level Detail Cem Yuksel Jonathan M Kaldor Doug L James Steve Marschner

Appearance

Monday 6 August 345-535 pm Printing Spatially Varying Reflectance for Reproducing HDR Images Yue Dong Xin Tong Fabio Pellacini Baining Guo

43

ISTC-VC SIGGRAPH Papers (cont)

Hand Eye and Face Monday 6 August 345-535 pm Session Chair - Vladlen Koltun Discovery of Complex Behaviors through Contact-Invariant Optimization Igor Mordatch Emanuel Todorov Zoran Popovi1049029 Sketching Monday 6 August 345-535 pm HelpingHand Example-Based Stroke Stylization Jingwan Lu Fisher Yu Adam Finkelstein Stephen DiVerdi Fabrication Tuesday 7 August 9-1030 am Fabricating Articulated Characters From Skinned Meshes Moritz Baumlcher Bernd Bickel Doug L James Hanspeter Pfister

44

Sampling Reconstructing and Filtering Light Tuesday 7 August 1045 am-1215 pm A Theory of Monte Carlo Visibility Sampling Ravi Ramamoorthi John Anderson Mark Meyer Derek Nowrouzezahrai Reconstructing the Indirect Light Field for Global Illumination Jaakko Lehtinen Timo Aila Samuli Laine Freacutedo Durand

Geometry Reconstruction amp Tracking

Tuesday 7 August 1045 am-1215 pm Temporally Coherent Completion of Dynamic Shapes Hao Li Linjie Luo Daniel Vlasic Pieter Peers Jovan Popovic Mark Pauly Szymon Rusinkiewicz

Sets of Shapes

Tuesday 7 August 2-330 pm Exploring Collections of 3D Models Using Fuzzy Correspondence Vladimir G Kim Wilmot Li Niloy J Mitra Stephen DiVerdi Thomas Funkhouser A Probabilistic Model for Component-Based Shape Synthesis Evangelos Kalogerakis Siddhartha Chaudhuri Daphne Koller Vladlen Koltun

45

ISTC-VC SIGGRAPH Papers (cont)

Light Rays Tuesday 7 August 2-330 pm Manifold Exploration A Markov Chain Monte Carlo Technique for Rendering Scenes With Difficult Specular Transport Wenzel Jakob Steve Marschner Bidirectional Lightcuts Bruce Walter Pramook Khungurn Kavita Bala

Fun With Video

Tuesday 7 August 345-535 pm Session Chair Noah Snavely Video Deblurring for Hand-Held Cameras Using Patch-Based Synthesis Sunghyun Cho Jue Wang Seungyong Lee Eulerian Video Magnification for Revealing Subtle Changes in the World Hao-Yu Wu Michael Rubinstein Eugene Shih John Guttag Freacutedo Durand William T Freeman Selectively De-Animating Video Jiamin Bai Aseem Agarwala Maneesh Agrawala Ravi Ramamoorthi Tools for Placing Cuts and Transitions in Interview Video Floraine Berthouzoz Wilmot Li Maneesh Agrawala

46

ISTC-VC SIGGRAPH Papers (cont)

Noise and Texture Tuesday 7 August 345-535 pm Structure-Aware Synthesis for Predictive Woven Fabric Appearance Shuang Zhao Kavita Bala Steve Marschner Wenzel Jakob Symmetry-Guided Texture Synthesis and Manipulation Vladimir Kim Yaron Lipman Thomas Funkhouser

Shape Transformation Wednesday 8 August 900 - 1030 AM An Algebraic Model for Parameterized Shape Editing Martin Bokeloh Michael Wand Hans-Peter Seidel Vladlen Koltun

Stitching

Wednesday 8 August 1045 am-1215 pm Exposing Photo Manipulation With Inconsistent Reflections James F OrsquoBrien Hany Farid

47

ISTC-VC SIGGRAPH Papers (cont)

Maps Surfaces and Shapes

Wednesday 8 August 1045 am-1215 pm Simple Formulas For Quasiconformal Plane Deformations Yaron Lipman Vladimir G Kim Thomas Funkhouser

Interactive Systems amp Hardware Wednesday 8 August 2-330 pm Position-Correcting Tools for 2D Digital Fabrication Alec Rivers Ilan E Moyer Freacutedo Durand

48

ISTC-VC SIGGRAPH Papers (cont)

Collisions Wednesday 8 August 345-535 pm Energy-Based Self-Collision Culling for Arbitrary Mesh Deformations Changxi Zheng Doug L James

All About Images

Thursday 9 August 9-1030 am A Framework for Content-Adaptive Photo Manipulation Macros Application to Face Landscape and Global Manipulations Floraine Berthouzoz Wilmot Li Mira Dontcheva Maneesh Agrawala

Sound and Elements

Thursday 9 August 9-1030 am Motion-Driven Concatenative Synthesis of Cloth Sounds Steven S An Doug L James Steve Marschner Precomputed Acceleration Noise for Improved Rigid-Body Sound Jeffrey N Chadwick Changxi Zheng Doug L James Interactive Sound Propagation Using Compact Acoustic Transfer Operators Lakulish Antani Anish Chandak Lauri Savioja Dinesh Manocha Updated Sparse Cholesky Factors for Corotational Elastodynamics Florian Hecht Yeon Jin Lee Jonathan R Shewchuk James F OrsquoBrien

49

ISTC-VC SIGGRAPH Papers (cont)

Geometry amp Viewing Thursday 9 August 2-330 pm Perceptual Models of Viewpoint Preference Adrian Secordm Jingwan Lu Adam Finkelstein Manish Singh Andrew Nealen

Faces and Hair [Closing Session]

Thursday 9 August 345-515 pm Coupled 3D Reconstruction of Sparse Facial Hair and Skin Thabo Beeler Bernd Bickel Gioacchino Noris Paul Beardsley Steve Marschner Robert W Sumner Markus Gross Physical Face Cloning Bernd Bickel Peter Kaufmann Melina Skouras Bernhard Thomaszewski Derek Bradley Thabo Beeler Philip Jackson Steve Marschner Wojciech Matusik Markus Gross

50

ISTC-VC SIGGRAPH Papers (cont)

Siggraph Courses Optimizing Realistic Rendering With Many-Light Methods Sunday 5 August 2-515 pm Jaroslav Krivanek Milos Hasan Adam Arbree Carsten Dachsbacher Alexander Keller Bruce Walter State of the Art in Photon-Density Estimation Thursday 9 August 2-515 pm Toshiya Hachisuka Wojciech Jarosz Guillaume Bouchard Per Christensen Jeppe Revall Frisvad Wenzel Jakob Henrik Wann Jensen Jared M Johnson Michael Kaschalk Claude Knaus Andrew Selle Ben Spencer

Siggraph Talks

Silence Eliminate the Noise Thursday 9 August 9-1030 am Importance Sampling for Hair Scattering Jiawei Ou Feng Xie Parashar Krishnamachari Fabio Pellacini

Siggraph Exhibitor Sessions

Intel Corporation Wednesday 8 August 430-530 pm room 402B The Future of Visual Computing as Viewed by Intel Visual Computing Research Centers

51

Other ISTC-VC SIGGRAPH Participation

Page 40: Future of Visual Computing as viewed by Intel Visual ... · PDF fileFuture of Visual Computing as viewed by Intel Visual Computing Research Centers ... Justin Rattner Intel Science

Extracting Structure and Semantics

CAD Model Points

Structures

People

Goals Enable context aware computing and automated content creation through the capture analysis and manipulation of real-world visual data PIs Steve Seitz (UW) Noah Snavely (Cornell) Tom Funkhouser (Princeton) Vladlen Koltun (Stanford) Jitendra Malik (Berkeley) Deva Ramanan (UV Irvine)

Video Frank to add Papers Frank to add

httpvisualstanfordedu

Computational Photography (Franken Camera)

Being adopted as a standard API for cellphone camera systems (Apple Android)

bull Goal Develop algorithms languages architectures and prototypes demonstrating the use of computation in the process of image capture and display

bull PIs Marc Levoy (Stanford) Mark Horowitz (Stanford) Pat Hanrahan (Stanford)

Video Frank to add Papers Frank to add

ISTC-VC SIGGRAPH Papers

Character Locomotion Monday 6 August 900 AM - 1030 AM Optimizing Locomotion Controllers Using Biologically Based Actuators and Objectives Jack M Wang Samuel R Hamner Scott L Delp Vladlen Koltun Continuous Character Control With Low-Dimensional Embeddings Sergey Levine Jack M Wang Alexis Haraux Zoran Popović Vladlen Koltun Shape Analysis Monday 6 August 900 AM - 1030 AM Schelling Points on 3D Surface Meshes Xiaobai Chen Abulhair Saparov Bill Pang Thomas Funkhouser Shape Transformation Wednesday 8 August 900 - 1030 AM An Algebraic Model for Parameterized Shape Editing Martin Bokeloh Michael Wand Hans-Peter Seidel Vladlen Koltun

42

ISTC-VC SIGGRAPH Papers

Image Processing Monday 6 August 2- 330 pm Decoupling Algorithms From Schedules for Easy Optimization of Image-Processing Pipelines Jonathan Ragan-Kelley Andrew Adams Sylvain Paris Marc Levoy Saman Amarasinghe Freacutedo Durand

Cloth

Monday 6 August 2-330 pm Specular Reflection From Woven Cloth Piti Irawan Steve Marschner Stitch Meshes for Modeling Knitted Clothing With Yarn-level Detail Cem Yuksel Jonathan M Kaldor Doug L James Steve Marschner

Appearance

Monday 6 August 345-535 pm Printing Spatially Varying Reflectance for Reproducing HDR Images Yue Dong Xin Tong Fabio Pellacini Baining Guo

43

ISTC-VC SIGGRAPH Papers (cont)

Hand Eye and Face Monday 6 August 345-535 pm Session Chair - Vladlen Koltun Discovery of Complex Behaviors through Contact-Invariant Optimization Igor Mordatch Emanuel Todorov Zoran Popovi1049029 Sketching Monday 6 August 345-535 pm HelpingHand Example-Based Stroke Stylization Jingwan Lu Fisher Yu Adam Finkelstein Stephen DiVerdi Fabrication Tuesday 7 August 9-1030 am Fabricating Articulated Characters From Skinned Meshes Moritz Baumlcher Bernd Bickel Doug L James Hanspeter Pfister

44

Sampling Reconstructing and Filtering Light Tuesday 7 August 1045 am-1215 pm A Theory of Monte Carlo Visibility Sampling Ravi Ramamoorthi John Anderson Mark Meyer Derek Nowrouzezahrai Reconstructing the Indirect Light Field for Global Illumination Jaakko Lehtinen Timo Aila Samuli Laine Freacutedo Durand

Geometry Reconstruction amp Tracking

Tuesday 7 August 1045 am-1215 pm Temporally Coherent Completion of Dynamic Shapes Hao Li Linjie Luo Daniel Vlasic Pieter Peers Jovan Popovic Mark Pauly Szymon Rusinkiewicz

Sets of Shapes

Tuesday 7 August 2-330 pm Exploring Collections of 3D Models Using Fuzzy Correspondence Vladimir G Kim Wilmot Li Niloy J Mitra Stephen DiVerdi Thomas Funkhouser A Probabilistic Model for Component-Based Shape Synthesis Evangelos Kalogerakis Siddhartha Chaudhuri Daphne Koller Vladlen Koltun

45

ISTC-VC SIGGRAPH Papers (cont)

Light Rays Tuesday 7 August 2-330 pm Manifold Exploration A Markov Chain Monte Carlo Technique for Rendering Scenes With Difficult Specular Transport Wenzel Jakob Steve Marschner Bidirectional Lightcuts Bruce Walter Pramook Khungurn Kavita Bala

Fun With Video

Tuesday 7 August 345-535 pm Session Chair Noah Snavely Video Deblurring for Hand-Held Cameras Using Patch-Based Synthesis Sunghyun Cho Jue Wang Seungyong Lee Eulerian Video Magnification for Revealing Subtle Changes in the World Hao-Yu Wu Michael Rubinstein Eugene Shih John Guttag Freacutedo Durand William T Freeman Selectively De-Animating Video Jiamin Bai Aseem Agarwala Maneesh Agrawala Ravi Ramamoorthi Tools for Placing Cuts and Transitions in Interview Video Floraine Berthouzoz Wilmot Li Maneesh Agrawala

46

ISTC-VC SIGGRAPH Papers (cont)

Noise and Texture Tuesday 7 August 345-535 pm Structure-Aware Synthesis for Predictive Woven Fabric Appearance Shuang Zhao Kavita Bala Steve Marschner Wenzel Jakob Symmetry-Guided Texture Synthesis and Manipulation Vladimir Kim Yaron Lipman Thomas Funkhouser

Shape Transformation Wednesday 8 August 900 - 1030 AM An Algebraic Model for Parameterized Shape Editing Martin Bokeloh Michael Wand Hans-Peter Seidel Vladlen Koltun

Stitching

Wednesday 8 August 1045 am-1215 pm Exposing Photo Manipulation With Inconsistent Reflections James F OrsquoBrien Hany Farid

47

ISTC-VC SIGGRAPH Papers (cont)

Maps Surfaces and Shapes

Wednesday 8 August 1045 am-1215 pm Simple Formulas For Quasiconformal Plane Deformations Yaron Lipman Vladimir G Kim Thomas Funkhouser

Interactive Systems amp Hardware Wednesday 8 August 2-330 pm Position-Correcting Tools for 2D Digital Fabrication Alec Rivers Ilan E Moyer Freacutedo Durand

48

ISTC-VC SIGGRAPH Papers (cont)

Collisions Wednesday 8 August 345-535 pm Energy-Based Self-Collision Culling for Arbitrary Mesh Deformations Changxi Zheng Doug L James

All About Images

Thursday 9 August 9-1030 am A Framework for Content-Adaptive Photo Manipulation Macros Application to Face Landscape and Global Manipulations Floraine Berthouzoz Wilmot Li Mira Dontcheva Maneesh Agrawala

Sound and Elements

Thursday 9 August 9-1030 am Motion-Driven Concatenative Synthesis of Cloth Sounds Steven S An Doug L James Steve Marschner Precomputed Acceleration Noise for Improved Rigid-Body Sound Jeffrey N Chadwick Changxi Zheng Doug L James Interactive Sound Propagation Using Compact Acoustic Transfer Operators Lakulish Antani Anish Chandak Lauri Savioja Dinesh Manocha Updated Sparse Cholesky Factors for Corotational Elastodynamics Florian Hecht Yeon Jin Lee Jonathan R Shewchuk James F OrsquoBrien

49

ISTC-VC SIGGRAPH Papers (cont)

Geometry amp Viewing Thursday 9 August 2-330 pm Perceptual Models of Viewpoint Preference Adrian Secordm Jingwan Lu Adam Finkelstein Manish Singh Andrew Nealen

Faces and Hair [Closing Session]

Thursday 9 August 345-515 pm Coupled 3D Reconstruction of Sparse Facial Hair and Skin Thabo Beeler Bernd Bickel Gioacchino Noris Paul Beardsley Steve Marschner Robert W Sumner Markus Gross Physical Face Cloning Bernd Bickel Peter Kaufmann Melina Skouras Bernhard Thomaszewski Derek Bradley Thabo Beeler Philip Jackson Steve Marschner Wojciech Matusik Markus Gross

50

ISTC-VC SIGGRAPH Papers (cont)

Siggraph Courses Optimizing Realistic Rendering With Many-Light Methods Sunday 5 August 2-515 pm Jaroslav Krivanek Milos Hasan Adam Arbree Carsten Dachsbacher Alexander Keller Bruce Walter State of the Art in Photon-Density Estimation Thursday 9 August 2-515 pm Toshiya Hachisuka Wojciech Jarosz Guillaume Bouchard Per Christensen Jeppe Revall Frisvad Wenzel Jakob Henrik Wann Jensen Jared M Johnson Michael Kaschalk Claude Knaus Andrew Selle Ben Spencer

Siggraph Talks

Silence Eliminate the Noise Thursday 9 August 9-1030 am Importance Sampling for Hair Scattering Jiawei Ou Feng Xie Parashar Krishnamachari Fabio Pellacini

Siggraph Exhibitor Sessions

Intel Corporation Wednesday 8 August 430-530 pm room 402B The Future of Visual Computing as Viewed by Intel Visual Computing Research Centers

51

Other ISTC-VC SIGGRAPH Participation

Page 41: Future of Visual Computing as viewed by Intel Visual ... · PDF fileFuture of Visual Computing as viewed by Intel Visual Computing Research Centers ... Justin Rattner Intel Science

Computational Photography (Franken Camera)

Being adopted as a standard API for cellphone camera systems (Apple Android)

bull Goal Develop algorithms languages architectures and prototypes demonstrating the use of computation in the process of image capture and display

bull PIs Marc Levoy (Stanford) Mark Horowitz (Stanford) Pat Hanrahan (Stanford)

Video Frank to add Papers Frank to add

ISTC-VC SIGGRAPH Papers

Character Locomotion Monday 6 August 900 AM - 1030 AM Optimizing Locomotion Controllers Using Biologically Based Actuators and Objectives Jack M Wang Samuel R Hamner Scott L Delp Vladlen Koltun Continuous Character Control With Low-Dimensional Embeddings Sergey Levine Jack M Wang Alexis Haraux Zoran Popović Vladlen Koltun Shape Analysis Monday 6 August 900 AM - 1030 AM Schelling Points on 3D Surface Meshes Xiaobai Chen Abulhair Saparov Bill Pang Thomas Funkhouser Shape Transformation Wednesday 8 August 900 - 1030 AM An Algebraic Model for Parameterized Shape Editing Martin Bokeloh Michael Wand Hans-Peter Seidel Vladlen Koltun

42

ISTC-VC SIGGRAPH Papers

Image Processing Monday 6 August 2- 330 pm Decoupling Algorithms From Schedules for Easy Optimization of Image-Processing Pipelines Jonathan Ragan-Kelley Andrew Adams Sylvain Paris Marc Levoy Saman Amarasinghe Freacutedo Durand

Cloth

Monday 6 August 2-330 pm Specular Reflection From Woven Cloth Piti Irawan Steve Marschner Stitch Meshes for Modeling Knitted Clothing With Yarn-level Detail Cem Yuksel Jonathan M Kaldor Doug L James Steve Marschner

Appearance

Monday 6 August 345-535 pm Printing Spatially Varying Reflectance for Reproducing HDR Images Yue Dong Xin Tong Fabio Pellacini Baining Guo

43

ISTC-VC SIGGRAPH Papers (cont)

Hand Eye and Face Monday 6 August 345-535 pm Session Chair - Vladlen Koltun Discovery of Complex Behaviors through Contact-Invariant Optimization Igor Mordatch Emanuel Todorov Zoran Popovi1049029 Sketching Monday 6 August 345-535 pm HelpingHand Example-Based Stroke Stylization Jingwan Lu Fisher Yu Adam Finkelstein Stephen DiVerdi Fabrication Tuesday 7 August 9-1030 am Fabricating Articulated Characters From Skinned Meshes Moritz Baumlcher Bernd Bickel Doug L James Hanspeter Pfister

44

Sampling Reconstructing and Filtering Light Tuesday 7 August 1045 am-1215 pm A Theory of Monte Carlo Visibility Sampling Ravi Ramamoorthi John Anderson Mark Meyer Derek Nowrouzezahrai Reconstructing the Indirect Light Field for Global Illumination Jaakko Lehtinen Timo Aila Samuli Laine Freacutedo Durand

Geometry Reconstruction amp Tracking

Tuesday 7 August 1045 am-1215 pm Temporally Coherent Completion of Dynamic Shapes Hao Li Linjie Luo Daniel Vlasic Pieter Peers Jovan Popovic Mark Pauly Szymon Rusinkiewicz

Sets of Shapes

Tuesday 7 August 2-330 pm Exploring Collections of 3D Models Using Fuzzy Correspondence Vladimir G Kim Wilmot Li Niloy J Mitra Stephen DiVerdi Thomas Funkhouser A Probabilistic Model for Component-Based Shape Synthesis Evangelos Kalogerakis Siddhartha Chaudhuri Daphne Koller Vladlen Koltun

45

ISTC-VC SIGGRAPH Papers (cont)

Light Rays Tuesday 7 August 2-330 pm Manifold Exploration A Markov Chain Monte Carlo Technique for Rendering Scenes With Difficult Specular Transport Wenzel Jakob Steve Marschner Bidirectional Lightcuts Bruce Walter Pramook Khungurn Kavita Bala

Fun With Video

Tuesday 7 August 345-535 pm Session Chair Noah Snavely Video Deblurring for Hand-Held Cameras Using Patch-Based Synthesis Sunghyun Cho Jue Wang Seungyong Lee Eulerian Video Magnification for Revealing Subtle Changes in the World Hao-Yu Wu Michael Rubinstein Eugene Shih John Guttag Freacutedo Durand William T Freeman Selectively De-Animating Video Jiamin Bai Aseem Agarwala Maneesh Agrawala Ravi Ramamoorthi Tools for Placing Cuts and Transitions in Interview Video Floraine Berthouzoz Wilmot Li Maneesh Agrawala

46

ISTC-VC SIGGRAPH Papers (cont)

Noise and Texture Tuesday 7 August 345-535 pm Structure-Aware Synthesis for Predictive Woven Fabric Appearance Shuang Zhao Kavita Bala Steve Marschner Wenzel Jakob Symmetry-Guided Texture Synthesis and Manipulation Vladimir Kim Yaron Lipman Thomas Funkhouser

Shape Transformation Wednesday 8 August 900 - 1030 AM An Algebraic Model for Parameterized Shape Editing Martin Bokeloh Michael Wand Hans-Peter Seidel Vladlen Koltun

Stitching

Wednesday 8 August 1045 am-1215 pm Exposing Photo Manipulation With Inconsistent Reflections James F OrsquoBrien Hany Farid

47

ISTC-VC SIGGRAPH Papers (cont)

Maps Surfaces and Shapes

Wednesday 8 August 1045 am-1215 pm Simple Formulas For Quasiconformal Plane Deformations Yaron Lipman Vladimir G Kim Thomas Funkhouser

Interactive Systems amp Hardware Wednesday 8 August 2-330 pm Position-Correcting Tools for 2D Digital Fabrication Alec Rivers Ilan E Moyer Freacutedo Durand

48

ISTC-VC SIGGRAPH Papers (cont)

Collisions Wednesday 8 August 345-535 pm Energy-Based Self-Collision Culling for Arbitrary Mesh Deformations Changxi Zheng Doug L James

All About Images

Thursday 9 August 9-1030 am A Framework for Content-Adaptive Photo Manipulation Macros Application to Face Landscape and Global Manipulations Floraine Berthouzoz Wilmot Li Mira Dontcheva Maneesh Agrawala

Sound and Elements

Thursday 9 August 9-1030 am Motion-Driven Concatenative Synthesis of Cloth Sounds Steven S An Doug L James Steve Marschner Precomputed Acceleration Noise for Improved Rigid-Body Sound Jeffrey N Chadwick Changxi Zheng Doug L James Interactive Sound Propagation Using Compact Acoustic Transfer Operators Lakulish Antani Anish Chandak Lauri Savioja Dinesh Manocha Updated Sparse Cholesky Factors for Corotational Elastodynamics Florian Hecht Yeon Jin Lee Jonathan R Shewchuk James F OrsquoBrien

49

ISTC-VC SIGGRAPH Papers (cont)

Geometry amp Viewing Thursday 9 August 2-330 pm Perceptual Models of Viewpoint Preference Adrian Secordm Jingwan Lu Adam Finkelstein Manish Singh Andrew Nealen

Faces and Hair [Closing Session]

Thursday 9 August 345-515 pm Coupled 3D Reconstruction of Sparse Facial Hair and Skin Thabo Beeler Bernd Bickel Gioacchino Noris Paul Beardsley Steve Marschner Robert W Sumner Markus Gross Physical Face Cloning Bernd Bickel Peter Kaufmann Melina Skouras Bernhard Thomaszewski Derek Bradley Thabo Beeler Philip Jackson Steve Marschner Wojciech Matusik Markus Gross

50

ISTC-VC SIGGRAPH Papers (cont)

Siggraph Courses Optimizing Realistic Rendering With Many-Light Methods Sunday 5 August 2-515 pm Jaroslav Krivanek Milos Hasan Adam Arbree Carsten Dachsbacher Alexander Keller Bruce Walter State of the Art in Photon-Density Estimation Thursday 9 August 2-515 pm Toshiya Hachisuka Wojciech Jarosz Guillaume Bouchard Per Christensen Jeppe Revall Frisvad Wenzel Jakob Henrik Wann Jensen Jared M Johnson Michael Kaschalk Claude Knaus Andrew Selle Ben Spencer

Siggraph Talks

Silence Eliminate the Noise Thursday 9 August 9-1030 am Importance Sampling for Hair Scattering Jiawei Ou Feng Xie Parashar Krishnamachari Fabio Pellacini

Siggraph Exhibitor Sessions

Intel Corporation Wednesday 8 August 430-530 pm room 402B The Future of Visual Computing as Viewed by Intel Visual Computing Research Centers

51

Other ISTC-VC SIGGRAPH Participation

Page 42: Future of Visual Computing as viewed by Intel Visual ... · PDF fileFuture of Visual Computing as viewed by Intel Visual Computing Research Centers ... Justin Rattner Intel Science

ISTC-VC SIGGRAPH Papers

Character Locomotion Monday 6 August 900 AM - 1030 AM Optimizing Locomotion Controllers Using Biologically Based Actuators and Objectives Jack M Wang Samuel R Hamner Scott L Delp Vladlen Koltun Continuous Character Control With Low-Dimensional Embeddings Sergey Levine Jack M Wang Alexis Haraux Zoran Popović Vladlen Koltun Shape Analysis Monday 6 August 900 AM - 1030 AM Schelling Points on 3D Surface Meshes Xiaobai Chen Abulhair Saparov Bill Pang Thomas Funkhouser Shape Transformation Wednesday 8 August 900 - 1030 AM An Algebraic Model for Parameterized Shape Editing Martin Bokeloh Michael Wand Hans-Peter Seidel Vladlen Koltun

42

ISTC-VC SIGGRAPH Papers

Image Processing Monday 6 August 2- 330 pm Decoupling Algorithms From Schedules for Easy Optimization of Image-Processing Pipelines Jonathan Ragan-Kelley Andrew Adams Sylvain Paris Marc Levoy Saman Amarasinghe Freacutedo Durand

Cloth

Monday 6 August 2-330 pm Specular Reflection From Woven Cloth Piti Irawan Steve Marschner Stitch Meshes for Modeling Knitted Clothing With Yarn-level Detail Cem Yuksel Jonathan M Kaldor Doug L James Steve Marschner

Appearance

Monday 6 August 345-535 pm Printing Spatially Varying Reflectance for Reproducing HDR Images Yue Dong Xin Tong Fabio Pellacini Baining Guo

43

ISTC-VC SIGGRAPH Papers (cont)

Hand Eye and Face Monday 6 August 345-535 pm Session Chair - Vladlen Koltun Discovery of Complex Behaviors through Contact-Invariant Optimization Igor Mordatch Emanuel Todorov Zoran Popovi1049029 Sketching Monday 6 August 345-535 pm HelpingHand Example-Based Stroke Stylization Jingwan Lu Fisher Yu Adam Finkelstein Stephen DiVerdi Fabrication Tuesday 7 August 9-1030 am Fabricating Articulated Characters From Skinned Meshes Moritz Baumlcher Bernd Bickel Doug L James Hanspeter Pfister

44

Sampling Reconstructing and Filtering Light Tuesday 7 August 1045 am-1215 pm A Theory of Monte Carlo Visibility Sampling Ravi Ramamoorthi John Anderson Mark Meyer Derek Nowrouzezahrai Reconstructing the Indirect Light Field for Global Illumination Jaakko Lehtinen Timo Aila Samuli Laine Freacutedo Durand

Geometry Reconstruction amp Tracking

Tuesday 7 August 1045 am-1215 pm Temporally Coherent Completion of Dynamic Shapes Hao Li Linjie Luo Daniel Vlasic Pieter Peers Jovan Popovic Mark Pauly Szymon Rusinkiewicz

Sets of Shapes

Tuesday 7 August 2-330 pm Exploring Collections of 3D Models Using Fuzzy Correspondence Vladimir G Kim Wilmot Li Niloy J Mitra Stephen DiVerdi Thomas Funkhouser A Probabilistic Model for Component-Based Shape Synthesis Evangelos Kalogerakis Siddhartha Chaudhuri Daphne Koller Vladlen Koltun

45

ISTC-VC SIGGRAPH Papers (cont)

Light Rays Tuesday 7 August 2-330 pm Manifold Exploration A Markov Chain Monte Carlo Technique for Rendering Scenes With Difficult Specular Transport Wenzel Jakob Steve Marschner Bidirectional Lightcuts Bruce Walter Pramook Khungurn Kavita Bala

Fun With Video

Tuesday 7 August 345-535 pm Session Chair Noah Snavely Video Deblurring for Hand-Held Cameras Using Patch-Based Synthesis Sunghyun Cho Jue Wang Seungyong Lee Eulerian Video Magnification for Revealing Subtle Changes in the World Hao-Yu Wu Michael Rubinstein Eugene Shih John Guttag Freacutedo Durand William T Freeman Selectively De-Animating Video Jiamin Bai Aseem Agarwala Maneesh Agrawala Ravi Ramamoorthi Tools for Placing Cuts and Transitions in Interview Video Floraine Berthouzoz Wilmot Li Maneesh Agrawala

46

ISTC-VC SIGGRAPH Papers (cont)

Noise and Texture Tuesday 7 August 345-535 pm Structure-Aware Synthesis for Predictive Woven Fabric Appearance Shuang Zhao Kavita Bala Steve Marschner Wenzel Jakob Symmetry-Guided Texture Synthesis and Manipulation Vladimir Kim Yaron Lipman Thomas Funkhouser

Shape Transformation Wednesday 8 August 900 - 1030 AM An Algebraic Model for Parameterized Shape Editing Martin Bokeloh Michael Wand Hans-Peter Seidel Vladlen Koltun

Stitching

Wednesday 8 August 1045 am-1215 pm Exposing Photo Manipulation With Inconsistent Reflections James F OrsquoBrien Hany Farid

47

ISTC-VC SIGGRAPH Papers (cont)

Maps Surfaces and Shapes

Wednesday 8 August 1045 am-1215 pm Simple Formulas For Quasiconformal Plane Deformations Yaron Lipman Vladimir G Kim Thomas Funkhouser

Interactive Systems amp Hardware Wednesday 8 August 2-330 pm Position-Correcting Tools for 2D Digital Fabrication Alec Rivers Ilan E Moyer Freacutedo Durand

48

ISTC-VC SIGGRAPH Papers (cont)

Collisions Wednesday 8 August 345-535 pm Energy-Based Self-Collision Culling for Arbitrary Mesh Deformations Changxi Zheng Doug L James

All About Images

Thursday 9 August 9-1030 am A Framework for Content-Adaptive Photo Manipulation Macros Application to Face Landscape and Global Manipulations Floraine Berthouzoz Wilmot Li Mira Dontcheva Maneesh Agrawala

Sound and Elements

Thursday 9 August 9-1030 am Motion-Driven Concatenative Synthesis of Cloth Sounds Steven S An Doug L James Steve Marschner Precomputed Acceleration Noise for Improved Rigid-Body Sound Jeffrey N Chadwick Changxi Zheng Doug L James Interactive Sound Propagation Using Compact Acoustic Transfer Operators Lakulish Antani Anish Chandak Lauri Savioja Dinesh Manocha Updated Sparse Cholesky Factors for Corotational Elastodynamics Florian Hecht Yeon Jin Lee Jonathan R Shewchuk James F OrsquoBrien

49

ISTC-VC SIGGRAPH Papers (cont)

Geometry amp Viewing Thursday 9 August 2-330 pm Perceptual Models of Viewpoint Preference Adrian Secordm Jingwan Lu Adam Finkelstein Manish Singh Andrew Nealen

Faces and Hair [Closing Session]

Thursday 9 August 345-515 pm Coupled 3D Reconstruction of Sparse Facial Hair and Skin Thabo Beeler Bernd Bickel Gioacchino Noris Paul Beardsley Steve Marschner Robert W Sumner Markus Gross Physical Face Cloning Bernd Bickel Peter Kaufmann Melina Skouras Bernhard Thomaszewski Derek Bradley Thabo Beeler Philip Jackson Steve Marschner Wojciech Matusik Markus Gross

50

ISTC-VC SIGGRAPH Papers (cont)

Siggraph Courses Optimizing Realistic Rendering With Many-Light Methods Sunday 5 August 2-515 pm Jaroslav Krivanek Milos Hasan Adam Arbree Carsten Dachsbacher Alexander Keller Bruce Walter State of the Art in Photon-Density Estimation Thursday 9 August 2-515 pm Toshiya Hachisuka Wojciech Jarosz Guillaume Bouchard Per Christensen Jeppe Revall Frisvad Wenzel Jakob Henrik Wann Jensen Jared M Johnson Michael Kaschalk Claude Knaus Andrew Selle Ben Spencer

Siggraph Talks

Silence Eliminate the Noise Thursday 9 August 9-1030 am Importance Sampling for Hair Scattering Jiawei Ou Feng Xie Parashar Krishnamachari Fabio Pellacini

Siggraph Exhibitor Sessions

Intel Corporation Wednesday 8 August 430-530 pm room 402B The Future of Visual Computing as Viewed by Intel Visual Computing Research Centers

51

Other ISTC-VC SIGGRAPH Participation

Page 43: Future of Visual Computing as viewed by Intel Visual ... · PDF fileFuture of Visual Computing as viewed by Intel Visual Computing Research Centers ... Justin Rattner Intel Science

ISTC-VC SIGGRAPH Papers

Image Processing Monday 6 August 2- 330 pm Decoupling Algorithms From Schedules for Easy Optimization of Image-Processing Pipelines Jonathan Ragan-Kelley Andrew Adams Sylvain Paris Marc Levoy Saman Amarasinghe Freacutedo Durand

Cloth

Monday 6 August 2-330 pm Specular Reflection From Woven Cloth Piti Irawan Steve Marschner Stitch Meshes for Modeling Knitted Clothing With Yarn-level Detail Cem Yuksel Jonathan M Kaldor Doug L James Steve Marschner

Appearance

Monday 6 August 345-535 pm Printing Spatially Varying Reflectance for Reproducing HDR Images Yue Dong Xin Tong Fabio Pellacini Baining Guo

43

ISTC-VC SIGGRAPH Papers (cont)

Hand Eye and Face Monday 6 August 345-535 pm Session Chair - Vladlen Koltun Discovery of Complex Behaviors through Contact-Invariant Optimization Igor Mordatch Emanuel Todorov Zoran Popovi1049029 Sketching Monday 6 August 345-535 pm HelpingHand Example-Based Stroke Stylization Jingwan Lu Fisher Yu Adam Finkelstein Stephen DiVerdi Fabrication Tuesday 7 August 9-1030 am Fabricating Articulated Characters From Skinned Meshes Moritz Baumlcher Bernd Bickel Doug L James Hanspeter Pfister

44

Sampling Reconstructing and Filtering Light Tuesday 7 August 1045 am-1215 pm A Theory of Monte Carlo Visibility Sampling Ravi Ramamoorthi John Anderson Mark Meyer Derek Nowrouzezahrai Reconstructing the Indirect Light Field for Global Illumination Jaakko Lehtinen Timo Aila Samuli Laine Freacutedo Durand

Geometry Reconstruction amp Tracking

Tuesday 7 August 1045 am-1215 pm Temporally Coherent Completion of Dynamic Shapes Hao Li Linjie Luo Daniel Vlasic Pieter Peers Jovan Popovic Mark Pauly Szymon Rusinkiewicz

Sets of Shapes

Tuesday 7 August 2-330 pm Exploring Collections of 3D Models Using Fuzzy Correspondence Vladimir G Kim Wilmot Li Niloy J Mitra Stephen DiVerdi Thomas Funkhouser A Probabilistic Model for Component-Based Shape Synthesis Evangelos Kalogerakis Siddhartha Chaudhuri Daphne Koller Vladlen Koltun

45

ISTC-VC SIGGRAPH Papers (cont)

Light Rays Tuesday 7 August 2-330 pm Manifold Exploration A Markov Chain Monte Carlo Technique for Rendering Scenes With Difficult Specular Transport Wenzel Jakob Steve Marschner Bidirectional Lightcuts Bruce Walter Pramook Khungurn Kavita Bala

Fun With Video

Tuesday 7 August 345-535 pm Session Chair Noah Snavely Video Deblurring for Hand-Held Cameras Using Patch-Based Synthesis Sunghyun Cho Jue Wang Seungyong Lee Eulerian Video Magnification for Revealing Subtle Changes in the World Hao-Yu Wu Michael Rubinstein Eugene Shih John Guttag Freacutedo Durand William T Freeman Selectively De-Animating Video Jiamin Bai Aseem Agarwala Maneesh Agrawala Ravi Ramamoorthi Tools for Placing Cuts and Transitions in Interview Video Floraine Berthouzoz Wilmot Li Maneesh Agrawala

46

ISTC-VC SIGGRAPH Papers (cont)

Noise and Texture Tuesday 7 August 345-535 pm Structure-Aware Synthesis for Predictive Woven Fabric Appearance Shuang Zhao Kavita Bala Steve Marschner Wenzel Jakob Symmetry-Guided Texture Synthesis and Manipulation Vladimir Kim Yaron Lipman Thomas Funkhouser

Shape Transformation Wednesday 8 August 900 - 1030 AM An Algebraic Model for Parameterized Shape Editing Martin Bokeloh Michael Wand Hans-Peter Seidel Vladlen Koltun

Stitching

Wednesday 8 August 1045 am-1215 pm Exposing Photo Manipulation With Inconsistent Reflections James F OrsquoBrien Hany Farid

47

ISTC-VC SIGGRAPH Papers (cont)

Maps Surfaces and Shapes

Wednesday 8 August 1045 am-1215 pm Simple Formulas For Quasiconformal Plane Deformations Yaron Lipman Vladimir G Kim Thomas Funkhouser

Interactive Systems amp Hardware Wednesday 8 August 2-330 pm Position-Correcting Tools for 2D Digital Fabrication Alec Rivers Ilan E Moyer Freacutedo Durand

48

ISTC-VC SIGGRAPH Papers (cont)

Collisions Wednesday 8 August 345-535 pm Energy-Based Self-Collision Culling for Arbitrary Mesh Deformations Changxi Zheng Doug L James

All About Images

Thursday 9 August 9-1030 am A Framework for Content-Adaptive Photo Manipulation Macros Application to Face Landscape and Global Manipulations Floraine Berthouzoz Wilmot Li Mira Dontcheva Maneesh Agrawala

Sound and Elements

Thursday 9 August 9-1030 am Motion-Driven Concatenative Synthesis of Cloth Sounds Steven S An Doug L James Steve Marschner Precomputed Acceleration Noise for Improved Rigid-Body Sound Jeffrey N Chadwick Changxi Zheng Doug L James Interactive Sound Propagation Using Compact Acoustic Transfer Operators Lakulish Antani Anish Chandak Lauri Savioja Dinesh Manocha Updated Sparse Cholesky Factors for Corotational Elastodynamics Florian Hecht Yeon Jin Lee Jonathan R Shewchuk James F OrsquoBrien

49

ISTC-VC SIGGRAPH Papers (cont)

Geometry amp Viewing Thursday 9 August 2-330 pm Perceptual Models of Viewpoint Preference Adrian Secordm Jingwan Lu Adam Finkelstein Manish Singh Andrew Nealen

Faces and Hair [Closing Session]

Thursday 9 August 345-515 pm Coupled 3D Reconstruction of Sparse Facial Hair and Skin Thabo Beeler Bernd Bickel Gioacchino Noris Paul Beardsley Steve Marschner Robert W Sumner Markus Gross Physical Face Cloning Bernd Bickel Peter Kaufmann Melina Skouras Bernhard Thomaszewski Derek Bradley Thabo Beeler Philip Jackson Steve Marschner Wojciech Matusik Markus Gross

50

ISTC-VC SIGGRAPH Papers (cont)

Siggraph Courses Optimizing Realistic Rendering With Many-Light Methods Sunday 5 August 2-515 pm Jaroslav Krivanek Milos Hasan Adam Arbree Carsten Dachsbacher Alexander Keller Bruce Walter State of the Art in Photon-Density Estimation Thursday 9 August 2-515 pm Toshiya Hachisuka Wojciech Jarosz Guillaume Bouchard Per Christensen Jeppe Revall Frisvad Wenzel Jakob Henrik Wann Jensen Jared M Johnson Michael Kaschalk Claude Knaus Andrew Selle Ben Spencer

Siggraph Talks

Silence Eliminate the Noise Thursday 9 August 9-1030 am Importance Sampling for Hair Scattering Jiawei Ou Feng Xie Parashar Krishnamachari Fabio Pellacini

Siggraph Exhibitor Sessions

Intel Corporation Wednesday 8 August 430-530 pm room 402B The Future of Visual Computing as Viewed by Intel Visual Computing Research Centers

51

Other ISTC-VC SIGGRAPH Participation

Page 44: Future of Visual Computing as viewed by Intel Visual ... · PDF fileFuture of Visual Computing as viewed by Intel Visual Computing Research Centers ... Justin Rattner Intel Science

ISTC-VC SIGGRAPH Papers (cont)

Hand Eye and Face Monday 6 August 345-535 pm Session Chair - Vladlen Koltun Discovery of Complex Behaviors through Contact-Invariant Optimization Igor Mordatch Emanuel Todorov Zoran Popovi1049029 Sketching Monday 6 August 345-535 pm HelpingHand Example-Based Stroke Stylization Jingwan Lu Fisher Yu Adam Finkelstein Stephen DiVerdi Fabrication Tuesday 7 August 9-1030 am Fabricating Articulated Characters From Skinned Meshes Moritz Baumlcher Bernd Bickel Doug L James Hanspeter Pfister

44

Sampling Reconstructing and Filtering Light Tuesday 7 August 1045 am-1215 pm A Theory of Monte Carlo Visibility Sampling Ravi Ramamoorthi John Anderson Mark Meyer Derek Nowrouzezahrai Reconstructing the Indirect Light Field for Global Illumination Jaakko Lehtinen Timo Aila Samuli Laine Freacutedo Durand

Geometry Reconstruction amp Tracking

Tuesday 7 August 1045 am-1215 pm Temporally Coherent Completion of Dynamic Shapes Hao Li Linjie Luo Daniel Vlasic Pieter Peers Jovan Popovic Mark Pauly Szymon Rusinkiewicz

Sets of Shapes

Tuesday 7 August 2-330 pm Exploring Collections of 3D Models Using Fuzzy Correspondence Vladimir G Kim Wilmot Li Niloy J Mitra Stephen DiVerdi Thomas Funkhouser A Probabilistic Model for Component-Based Shape Synthesis Evangelos Kalogerakis Siddhartha Chaudhuri Daphne Koller Vladlen Koltun

45

ISTC-VC SIGGRAPH Papers (cont)

Light Rays Tuesday 7 August 2-330 pm Manifold Exploration A Markov Chain Monte Carlo Technique for Rendering Scenes With Difficult Specular Transport Wenzel Jakob Steve Marschner Bidirectional Lightcuts Bruce Walter Pramook Khungurn Kavita Bala

Fun With Video

Tuesday 7 August 345-535 pm Session Chair Noah Snavely Video Deblurring for Hand-Held Cameras Using Patch-Based Synthesis Sunghyun Cho Jue Wang Seungyong Lee Eulerian Video Magnification for Revealing Subtle Changes in the World Hao-Yu Wu Michael Rubinstein Eugene Shih John Guttag Freacutedo Durand William T Freeman Selectively De-Animating Video Jiamin Bai Aseem Agarwala Maneesh Agrawala Ravi Ramamoorthi Tools for Placing Cuts and Transitions in Interview Video Floraine Berthouzoz Wilmot Li Maneesh Agrawala

46

ISTC-VC SIGGRAPH Papers (cont)

Noise and Texture Tuesday 7 August 345-535 pm Structure-Aware Synthesis for Predictive Woven Fabric Appearance Shuang Zhao Kavita Bala Steve Marschner Wenzel Jakob Symmetry-Guided Texture Synthesis and Manipulation Vladimir Kim Yaron Lipman Thomas Funkhouser

Shape Transformation Wednesday 8 August 900 - 1030 AM An Algebraic Model for Parameterized Shape Editing Martin Bokeloh Michael Wand Hans-Peter Seidel Vladlen Koltun

Stitching

Wednesday 8 August 1045 am-1215 pm Exposing Photo Manipulation With Inconsistent Reflections James F OrsquoBrien Hany Farid

47

ISTC-VC SIGGRAPH Papers (cont)

Maps Surfaces and Shapes

Wednesday 8 August 1045 am-1215 pm Simple Formulas For Quasiconformal Plane Deformations Yaron Lipman Vladimir G Kim Thomas Funkhouser

Interactive Systems amp Hardware Wednesday 8 August 2-330 pm Position-Correcting Tools for 2D Digital Fabrication Alec Rivers Ilan E Moyer Freacutedo Durand

48

ISTC-VC SIGGRAPH Papers (cont)

Collisions Wednesday 8 August 345-535 pm Energy-Based Self-Collision Culling for Arbitrary Mesh Deformations Changxi Zheng Doug L James

All About Images

Thursday 9 August 9-1030 am A Framework for Content-Adaptive Photo Manipulation Macros Application to Face Landscape and Global Manipulations Floraine Berthouzoz Wilmot Li Mira Dontcheva Maneesh Agrawala

Sound and Elements

Thursday 9 August 9-1030 am Motion-Driven Concatenative Synthesis of Cloth Sounds Steven S An Doug L James Steve Marschner Precomputed Acceleration Noise for Improved Rigid-Body Sound Jeffrey N Chadwick Changxi Zheng Doug L James Interactive Sound Propagation Using Compact Acoustic Transfer Operators Lakulish Antani Anish Chandak Lauri Savioja Dinesh Manocha Updated Sparse Cholesky Factors for Corotational Elastodynamics Florian Hecht Yeon Jin Lee Jonathan R Shewchuk James F OrsquoBrien

49

ISTC-VC SIGGRAPH Papers (cont)

Geometry amp Viewing Thursday 9 August 2-330 pm Perceptual Models of Viewpoint Preference Adrian Secordm Jingwan Lu Adam Finkelstein Manish Singh Andrew Nealen

Faces and Hair [Closing Session]

Thursday 9 August 345-515 pm Coupled 3D Reconstruction of Sparse Facial Hair and Skin Thabo Beeler Bernd Bickel Gioacchino Noris Paul Beardsley Steve Marschner Robert W Sumner Markus Gross Physical Face Cloning Bernd Bickel Peter Kaufmann Melina Skouras Bernhard Thomaszewski Derek Bradley Thabo Beeler Philip Jackson Steve Marschner Wojciech Matusik Markus Gross

50

ISTC-VC SIGGRAPH Papers (cont)

Siggraph Courses Optimizing Realistic Rendering With Many-Light Methods Sunday 5 August 2-515 pm Jaroslav Krivanek Milos Hasan Adam Arbree Carsten Dachsbacher Alexander Keller Bruce Walter State of the Art in Photon-Density Estimation Thursday 9 August 2-515 pm Toshiya Hachisuka Wojciech Jarosz Guillaume Bouchard Per Christensen Jeppe Revall Frisvad Wenzel Jakob Henrik Wann Jensen Jared M Johnson Michael Kaschalk Claude Knaus Andrew Selle Ben Spencer

Siggraph Talks

Silence Eliminate the Noise Thursday 9 August 9-1030 am Importance Sampling for Hair Scattering Jiawei Ou Feng Xie Parashar Krishnamachari Fabio Pellacini

Siggraph Exhibitor Sessions

Intel Corporation Wednesday 8 August 430-530 pm room 402B The Future of Visual Computing as Viewed by Intel Visual Computing Research Centers

51

Other ISTC-VC SIGGRAPH Participation

Page 45: Future of Visual Computing as viewed by Intel Visual ... · PDF fileFuture of Visual Computing as viewed by Intel Visual Computing Research Centers ... Justin Rattner Intel Science

Sampling Reconstructing and Filtering Light Tuesday 7 August 1045 am-1215 pm A Theory of Monte Carlo Visibility Sampling Ravi Ramamoorthi John Anderson Mark Meyer Derek Nowrouzezahrai Reconstructing the Indirect Light Field for Global Illumination Jaakko Lehtinen Timo Aila Samuli Laine Freacutedo Durand

Geometry Reconstruction amp Tracking

Tuesday 7 August 1045 am-1215 pm Temporally Coherent Completion of Dynamic Shapes Hao Li Linjie Luo Daniel Vlasic Pieter Peers Jovan Popovic Mark Pauly Szymon Rusinkiewicz

Sets of Shapes

Tuesday 7 August 2-330 pm Exploring Collections of 3D Models Using Fuzzy Correspondence Vladimir G Kim Wilmot Li Niloy J Mitra Stephen DiVerdi Thomas Funkhouser A Probabilistic Model for Component-Based Shape Synthesis Evangelos Kalogerakis Siddhartha Chaudhuri Daphne Koller Vladlen Koltun

45

ISTC-VC SIGGRAPH Papers (cont)

Light Rays Tuesday 7 August 2-330 pm Manifold Exploration A Markov Chain Monte Carlo Technique for Rendering Scenes With Difficult Specular Transport Wenzel Jakob Steve Marschner Bidirectional Lightcuts Bruce Walter Pramook Khungurn Kavita Bala

Fun With Video

Tuesday 7 August 345-535 pm Session Chair Noah Snavely Video Deblurring for Hand-Held Cameras Using Patch-Based Synthesis Sunghyun Cho Jue Wang Seungyong Lee Eulerian Video Magnification for Revealing Subtle Changes in the World Hao-Yu Wu Michael Rubinstein Eugene Shih John Guttag Freacutedo Durand William T Freeman Selectively De-Animating Video Jiamin Bai Aseem Agarwala Maneesh Agrawala Ravi Ramamoorthi Tools for Placing Cuts and Transitions in Interview Video Floraine Berthouzoz Wilmot Li Maneesh Agrawala

46

ISTC-VC SIGGRAPH Papers (cont)

Noise and Texture Tuesday 7 August 345-535 pm Structure-Aware Synthesis for Predictive Woven Fabric Appearance Shuang Zhao Kavita Bala Steve Marschner Wenzel Jakob Symmetry-Guided Texture Synthesis and Manipulation Vladimir Kim Yaron Lipman Thomas Funkhouser

Shape Transformation Wednesday 8 August 900 - 1030 AM An Algebraic Model for Parameterized Shape Editing Martin Bokeloh Michael Wand Hans-Peter Seidel Vladlen Koltun

Stitching

Wednesday 8 August 1045 am-1215 pm Exposing Photo Manipulation With Inconsistent Reflections James F OrsquoBrien Hany Farid

47

ISTC-VC SIGGRAPH Papers (cont)

Maps Surfaces and Shapes

Wednesday 8 August 1045 am-1215 pm Simple Formulas For Quasiconformal Plane Deformations Yaron Lipman Vladimir G Kim Thomas Funkhouser

Interactive Systems amp Hardware Wednesday 8 August 2-330 pm Position-Correcting Tools for 2D Digital Fabrication Alec Rivers Ilan E Moyer Freacutedo Durand

48

ISTC-VC SIGGRAPH Papers (cont)

Collisions Wednesday 8 August 345-535 pm Energy-Based Self-Collision Culling for Arbitrary Mesh Deformations Changxi Zheng Doug L James

All About Images

Thursday 9 August 9-1030 am A Framework for Content-Adaptive Photo Manipulation Macros Application to Face Landscape and Global Manipulations Floraine Berthouzoz Wilmot Li Mira Dontcheva Maneesh Agrawala

Sound and Elements

Thursday 9 August 9-1030 am Motion-Driven Concatenative Synthesis of Cloth Sounds Steven S An Doug L James Steve Marschner Precomputed Acceleration Noise for Improved Rigid-Body Sound Jeffrey N Chadwick Changxi Zheng Doug L James Interactive Sound Propagation Using Compact Acoustic Transfer Operators Lakulish Antani Anish Chandak Lauri Savioja Dinesh Manocha Updated Sparse Cholesky Factors for Corotational Elastodynamics Florian Hecht Yeon Jin Lee Jonathan R Shewchuk James F OrsquoBrien

49

ISTC-VC SIGGRAPH Papers (cont)

Geometry amp Viewing Thursday 9 August 2-330 pm Perceptual Models of Viewpoint Preference Adrian Secordm Jingwan Lu Adam Finkelstein Manish Singh Andrew Nealen

Faces and Hair [Closing Session]

Thursday 9 August 345-515 pm Coupled 3D Reconstruction of Sparse Facial Hair and Skin Thabo Beeler Bernd Bickel Gioacchino Noris Paul Beardsley Steve Marschner Robert W Sumner Markus Gross Physical Face Cloning Bernd Bickel Peter Kaufmann Melina Skouras Bernhard Thomaszewski Derek Bradley Thabo Beeler Philip Jackson Steve Marschner Wojciech Matusik Markus Gross

50

ISTC-VC SIGGRAPH Papers (cont)

Siggraph Courses Optimizing Realistic Rendering With Many-Light Methods Sunday 5 August 2-515 pm Jaroslav Krivanek Milos Hasan Adam Arbree Carsten Dachsbacher Alexander Keller Bruce Walter State of the Art in Photon-Density Estimation Thursday 9 August 2-515 pm Toshiya Hachisuka Wojciech Jarosz Guillaume Bouchard Per Christensen Jeppe Revall Frisvad Wenzel Jakob Henrik Wann Jensen Jared M Johnson Michael Kaschalk Claude Knaus Andrew Selle Ben Spencer

Siggraph Talks

Silence Eliminate the Noise Thursday 9 August 9-1030 am Importance Sampling for Hair Scattering Jiawei Ou Feng Xie Parashar Krishnamachari Fabio Pellacini

Siggraph Exhibitor Sessions

Intel Corporation Wednesday 8 August 430-530 pm room 402B The Future of Visual Computing as Viewed by Intel Visual Computing Research Centers

51

Other ISTC-VC SIGGRAPH Participation

Page 46: Future of Visual Computing as viewed by Intel Visual ... · PDF fileFuture of Visual Computing as viewed by Intel Visual Computing Research Centers ... Justin Rattner Intel Science

Light Rays Tuesday 7 August 2-330 pm Manifold Exploration A Markov Chain Monte Carlo Technique for Rendering Scenes With Difficult Specular Transport Wenzel Jakob Steve Marschner Bidirectional Lightcuts Bruce Walter Pramook Khungurn Kavita Bala

Fun With Video

Tuesday 7 August 345-535 pm Session Chair Noah Snavely Video Deblurring for Hand-Held Cameras Using Patch-Based Synthesis Sunghyun Cho Jue Wang Seungyong Lee Eulerian Video Magnification for Revealing Subtle Changes in the World Hao-Yu Wu Michael Rubinstein Eugene Shih John Guttag Freacutedo Durand William T Freeman Selectively De-Animating Video Jiamin Bai Aseem Agarwala Maneesh Agrawala Ravi Ramamoorthi Tools for Placing Cuts and Transitions in Interview Video Floraine Berthouzoz Wilmot Li Maneesh Agrawala

46

ISTC-VC SIGGRAPH Papers (cont)

Noise and Texture Tuesday 7 August 345-535 pm Structure-Aware Synthesis for Predictive Woven Fabric Appearance Shuang Zhao Kavita Bala Steve Marschner Wenzel Jakob Symmetry-Guided Texture Synthesis and Manipulation Vladimir Kim Yaron Lipman Thomas Funkhouser

Shape Transformation Wednesday 8 August 900 - 1030 AM An Algebraic Model for Parameterized Shape Editing Martin Bokeloh Michael Wand Hans-Peter Seidel Vladlen Koltun

Stitching

Wednesday 8 August 1045 am-1215 pm Exposing Photo Manipulation With Inconsistent Reflections James F OrsquoBrien Hany Farid

47

ISTC-VC SIGGRAPH Papers (cont)

Maps Surfaces and Shapes

Wednesday 8 August 1045 am-1215 pm Simple Formulas For Quasiconformal Plane Deformations Yaron Lipman Vladimir G Kim Thomas Funkhouser

Interactive Systems amp Hardware Wednesday 8 August 2-330 pm Position-Correcting Tools for 2D Digital Fabrication Alec Rivers Ilan E Moyer Freacutedo Durand

48

ISTC-VC SIGGRAPH Papers (cont)

Collisions Wednesday 8 August 345-535 pm Energy-Based Self-Collision Culling for Arbitrary Mesh Deformations Changxi Zheng Doug L James

All About Images

Thursday 9 August 9-1030 am A Framework for Content-Adaptive Photo Manipulation Macros Application to Face Landscape and Global Manipulations Floraine Berthouzoz Wilmot Li Mira Dontcheva Maneesh Agrawala

Sound and Elements

Thursday 9 August 9-1030 am Motion-Driven Concatenative Synthesis of Cloth Sounds Steven S An Doug L James Steve Marschner Precomputed Acceleration Noise for Improved Rigid-Body Sound Jeffrey N Chadwick Changxi Zheng Doug L James Interactive Sound Propagation Using Compact Acoustic Transfer Operators Lakulish Antani Anish Chandak Lauri Savioja Dinesh Manocha Updated Sparse Cholesky Factors for Corotational Elastodynamics Florian Hecht Yeon Jin Lee Jonathan R Shewchuk James F OrsquoBrien

49

ISTC-VC SIGGRAPH Papers (cont)

Geometry amp Viewing Thursday 9 August 2-330 pm Perceptual Models of Viewpoint Preference Adrian Secordm Jingwan Lu Adam Finkelstein Manish Singh Andrew Nealen

Faces and Hair [Closing Session]

Thursday 9 August 345-515 pm Coupled 3D Reconstruction of Sparse Facial Hair and Skin Thabo Beeler Bernd Bickel Gioacchino Noris Paul Beardsley Steve Marschner Robert W Sumner Markus Gross Physical Face Cloning Bernd Bickel Peter Kaufmann Melina Skouras Bernhard Thomaszewski Derek Bradley Thabo Beeler Philip Jackson Steve Marschner Wojciech Matusik Markus Gross

50

ISTC-VC SIGGRAPH Papers (cont)

Siggraph Courses Optimizing Realistic Rendering With Many-Light Methods Sunday 5 August 2-515 pm Jaroslav Krivanek Milos Hasan Adam Arbree Carsten Dachsbacher Alexander Keller Bruce Walter State of the Art in Photon-Density Estimation Thursday 9 August 2-515 pm Toshiya Hachisuka Wojciech Jarosz Guillaume Bouchard Per Christensen Jeppe Revall Frisvad Wenzel Jakob Henrik Wann Jensen Jared M Johnson Michael Kaschalk Claude Knaus Andrew Selle Ben Spencer

Siggraph Talks

Silence Eliminate the Noise Thursday 9 August 9-1030 am Importance Sampling for Hair Scattering Jiawei Ou Feng Xie Parashar Krishnamachari Fabio Pellacini

Siggraph Exhibitor Sessions

Intel Corporation Wednesday 8 August 430-530 pm room 402B The Future of Visual Computing as Viewed by Intel Visual Computing Research Centers

51

Other ISTC-VC SIGGRAPH Participation

Page 47: Future of Visual Computing as viewed by Intel Visual ... · PDF fileFuture of Visual Computing as viewed by Intel Visual Computing Research Centers ... Justin Rattner Intel Science

Noise and Texture Tuesday 7 August 345-535 pm Structure-Aware Synthesis for Predictive Woven Fabric Appearance Shuang Zhao Kavita Bala Steve Marschner Wenzel Jakob Symmetry-Guided Texture Synthesis and Manipulation Vladimir Kim Yaron Lipman Thomas Funkhouser

Shape Transformation Wednesday 8 August 900 - 1030 AM An Algebraic Model for Parameterized Shape Editing Martin Bokeloh Michael Wand Hans-Peter Seidel Vladlen Koltun

Stitching

Wednesday 8 August 1045 am-1215 pm Exposing Photo Manipulation With Inconsistent Reflections James F OrsquoBrien Hany Farid

47

ISTC-VC SIGGRAPH Papers (cont)

Maps Surfaces and Shapes

Wednesday 8 August 1045 am-1215 pm Simple Formulas For Quasiconformal Plane Deformations Yaron Lipman Vladimir G Kim Thomas Funkhouser

Interactive Systems amp Hardware Wednesday 8 August 2-330 pm Position-Correcting Tools for 2D Digital Fabrication Alec Rivers Ilan E Moyer Freacutedo Durand

48

ISTC-VC SIGGRAPH Papers (cont)

Collisions Wednesday 8 August 345-535 pm Energy-Based Self-Collision Culling for Arbitrary Mesh Deformations Changxi Zheng Doug L James

All About Images

Thursday 9 August 9-1030 am A Framework for Content-Adaptive Photo Manipulation Macros Application to Face Landscape and Global Manipulations Floraine Berthouzoz Wilmot Li Mira Dontcheva Maneesh Agrawala

Sound and Elements

Thursday 9 August 9-1030 am Motion-Driven Concatenative Synthesis of Cloth Sounds Steven S An Doug L James Steve Marschner Precomputed Acceleration Noise for Improved Rigid-Body Sound Jeffrey N Chadwick Changxi Zheng Doug L James Interactive Sound Propagation Using Compact Acoustic Transfer Operators Lakulish Antani Anish Chandak Lauri Savioja Dinesh Manocha Updated Sparse Cholesky Factors for Corotational Elastodynamics Florian Hecht Yeon Jin Lee Jonathan R Shewchuk James F OrsquoBrien

49

ISTC-VC SIGGRAPH Papers (cont)

Geometry amp Viewing Thursday 9 August 2-330 pm Perceptual Models of Viewpoint Preference Adrian Secordm Jingwan Lu Adam Finkelstein Manish Singh Andrew Nealen

Faces and Hair [Closing Session]

Thursday 9 August 345-515 pm Coupled 3D Reconstruction of Sparse Facial Hair and Skin Thabo Beeler Bernd Bickel Gioacchino Noris Paul Beardsley Steve Marschner Robert W Sumner Markus Gross Physical Face Cloning Bernd Bickel Peter Kaufmann Melina Skouras Bernhard Thomaszewski Derek Bradley Thabo Beeler Philip Jackson Steve Marschner Wojciech Matusik Markus Gross

50

ISTC-VC SIGGRAPH Papers (cont)

Siggraph Courses Optimizing Realistic Rendering With Many-Light Methods Sunday 5 August 2-515 pm Jaroslav Krivanek Milos Hasan Adam Arbree Carsten Dachsbacher Alexander Keller Bruce Walter State of the Art in Photon-Density Estimation Thursday 9 August 2-515 pm Toshiya Hachisuka Wojciech Jarosz Guillaume Bouchard Per Christensen Jeppe Revall Frisvad Wenzel Jakob Henrik Wann Jensen Jared M Johnson Michael Kaschalk Claude Knaus Andrew Selle Ben Spencer

Siggraph Talks

Silence Eliminate the Noise Thursday 9 August 9-1030 am Importance Sampling for Hair Scattering Jiawei Ou Feng Xie Parashar Krishnamachari Fabio Pellacini

Siggraph Exhibitor Sessions

Intel Corporation Wednesday 8 August 430-530 pm room 402B The Future of Visual Computing as Viewed by Intel Visual Computing Research Centers

51

Other ISTC-VC SIGGRAPH Participation

Page 48: Future of Visual Computing as viewed by Intel Visual ... · PDF fileFuture of Visual Computing as viewed by Intel Visual Computing Research Centers ... Justin Rattner Intel Science

Maps Surfaces and Shapes

Wednesday 8 August 1045 am-1215 pm Simple Formulas For Quasiconformal Plane Deformations Yaron Lipman Vladimir G Kim Thomas Funkhouser

Interactive Systems amp Hardware Wednesday 8 August 2-330 pm Position-Correcting Tools for 2D Digital Fabrication Alec Rivers Ilan E Moyer Freacutedo Durand

48

ISTC-VC SIGGRAPH Papers (cont)

Collisions Wednesday 8 August 345-535 pm Energy-Based Self-Collision Culling for Arbitrary Mesh Deformations Changxi Zheng Doug L James

All About Images

Thursday 9 August 9-1030 am A Framework for Content-Adaptive Photo Manipulation Macros Application to Face Landscape and Global Manipulations Floraine Berthouzoz Wilmot Li Mira Dontcheva Maneesh Agrawala

Sound and Elements

Thursday 9 August 9-1030 am Motion-Driven Concatenative Synthesis of Cloth Sounds Steven S An Doug L James Steve Marschner Precomputed Acceleration Noise for Improved Rigid-Body Sound Jeffrey N Chadwick Changxi Zheng Doug L James Interactive Sound Propagation Using Compact Acoustic Transfer Operators Lakulish Antani Anish Chandak Lauri Savioja Dinesh Manocha Updated Sparse Cholesky Factors for Corotational Elastodynamics Florian Hecht Yeon Jin Lee Jonathan R Shewchuk James F OrsquoBrien

49

ISTC-VC SIGGRAPH Papers (cont)

Geometry amp Viewing Thursday 9 August 2-330 pm Perceptual Models of Viewpoint Preference Adrian Secordm Jingwan Lu Adam Finkelstein Manish Singh Andrew Nealen

Faces and Hair [Closing Session]

Thursday 9 August 345-515 pm Coupled 3D Reconstruction of Sparse Facial Hair and Skin Thabo Beeler Bernd Bickel Gioacchino Noris Paul Beardsley Steve Marschner Robert W Sumner Markus Gross Physical Face Cloning Bernd Bickel Peter Kaufmann Melina Skouras Bernhard Thomaszewski Derek Bradley Thabo Beeler Philip Jackson Steve Marschner Wojciech Matusik Markus Gross

50

ISTC-VC SIGGRAPH Papers (cont)

Siggraph Courses Optimizing Realistic Rendering With Many-Light Methods Sunday 5 August 2-515 pm Jaroslav Krivanek Milos Hasan Adam Arbree Carsten Dachsbacher Alexander Keller Bruce Walter State of the Art in Photon-Density Estimation Thursday 9 August 2-515 pm Toshiya Hachisuka Wojciech Jarosz Guillaume Bouchard Per Christensen Jeppe Revall Frisvad Wenzel Jakob Henrik Wann Jensen Jared M Johnson Michael Kaschalk Claude Knaus Andrew Selle Ben Spencer

Siggraph Talks

Silence Eliminate the Noise Thursday 9 August 9-1030 am Importance Sampling for Hair Scattering Jiawei Ou Feng Xie Parashar Krishnamachari Fabio Pellacini

Siggraph Exhibitor Sessions

Intel Corporation Wednesday 8 August 430-530 pm room 402B The Future of Visual Computing as Viewed by Intel Visual Computing Research Centers

51

Other ISTC-VC SIGGRAPH Participation

Page 49: Future of Visual Computing as viewed by Intel Visual ... · PDF fileFuture of Visual Computing as viewed by Intel Visual Computing Research Centers ... Justin Rattner Intel Science

Collisions Wednesday 8 August 345-535 pm Energy-Based Self-Collision Culling for Arbitrary Mesh Deformations Changxi Zheng Doug L James

All About Images

Thursday 9 August 9-1030 am A Framework for Content-Adaptive Photo Manipulation Macros Application to Face Landscape and Global Manipulations Floraine Berthouzoz Wilmot Li Mira Dontcheva Maneesh Agrawala

Sound and Elements

Thursday 9 August 9-1030 am Motion-Driven Concatenative Synthesis of Cloth Sounds Steven S An Doug L James Steve Marschner Precomputed Acceleration Noise for Improved Rigid-Body Sound Jeffrey N Chadwick Changxi Zheng Doug L James Interactive Sound Propagation Using Compact Acoustic Transfer Operators Lakulish Antani Anish Chandak Lauri Savioja Dinesh Manocha Updated Sparse Cholesky Factors for Corotational Elastodynamics Florian Hecht Yeon Jin Lee Jonathan R Shewchuk James F OrsquoBrien

49

ISTC-VC SIGGRAPH Papers (cont)

Geometry amp Viewing Thursday 9 August 2-330 pm Perceptual Models of Viewpoint Preference Adrian Secordm Jingwan Lu Adam Finkelstein Manish Singh Andrew Nealen

Faces and Hair [Closing Session]

Thursday 9 August 345-515 pm Coupled 3D Reconstruction of Sparse Facial Hair and Skin Thabo Beeler Bernd Bickel Gioacchino Noris Paul Beardsley Steve Marschner Robert W Sumner Markus Gross Physical Face Cloning Bernd Bickel Peter Kaufmann Melina Skouras Bernhard Thomaszewski Derek Bradley Thabo Beeler Philip Jackson Steve Marschner Wojciech Matusik Markus Gross

50

ISTC-VC SIGGRAPH Papers (cont)

Siggraph Courses Optimizing Realistic Rendering With Many-Light Methods Sunday 5 August 2-515 pm Jaroslav Krivanek Milos Hasan Adam Arbree Carsten Dachsbacher Alexander Keller Bruce Walter State of the Art in Photon-Density Estimation Thursday 9 August 2-515 pm Toshiya Hachisuka Wojciech Jarosz Guillaume Bouchard Per Christensen Jeppe Revall Frisvad Wenzel Jakob Henrik Wann Jensen Jared M Johnson Michael Kaschalk Claude Knaus Andrew Selle Ben Spencer

Siggraph Talks

Silence Eliminate the Noise Thursday 9 August 9-1030 am Importance Sampling for Hair Scattering Jiawei Ou Feng Xie Parashar Krishnamachari Fabio Pellacini

Siggraph Exhibitor Sessions

Intel Corporation Wednesday 8 August 430-530 pm room 402B The Future of Visual Computing as Viewed by Intel Visual Computing Research Centers

51

Other ISTC-VC SIGGRAPH Participation

Page 50: Future of Visual Computing as viewed by Intel Visual ... · PDF fileFuture of Visual Computing as viewed by Intel Visual Computing Research Centers ... Justin Rattner Intel Science

Geometry amp Viewing Thursday 9 August 2-330 pm Perceptual Models of Viewpoint Preference Adrian Secordm Jingwan Lu Adam Finkelstein Manish Singh Andrew Nealen

Faces and Hair [Closing Session]

Thursday 9 August 345-515 pm Coupled 3D Reconstruction of Sparse Facial Hair and Skin Thabo Beeler Bernd Bickel Gioacchino Noris Paul Beardsley Steve Marschner Robert W Sumner Markus Gross Physical Face Cloning Bernd Bickel Peter Kaufmann Melina Skouras Bernhard Thomaszewski Derek Bradley Thabo Beeler Philip Jackson Steve Marschner Wojciech Matusik Markus Gross

50

ISTC-VC SIGGRAPH Papers (cont)

Siggraph Courses Optimizing Realistic Rendering With Many-Light Methods Sunday 5 August 2-515 pm Jaroslav Krivanek Milos Hasan Adam Arbree Carsten Dachsbacher Alexander Keller Bruce Walter State of the Art in Photon-Density Estimation Thursday 9 August 2-515 pm Toshiya Hachisuka Wojciech Jarosz Guillaume Bouchard Per Christensen Jeppe Revall Frisvad Wenzel Jakob Henrik Wann Jensen Jared M Johnson Michael Kaschalk Claude Knaus Andrew Selle Ben Spencer

Siggraph Talks

Silence Eliminate the Noise Thursday 9 August 9-1030 am Importance Sampling for Hair Scattering Jiawei Ou Feng Xie Parashar Krishnamachari Fabio Pellacini

Siggraph Exhibitor Sessions

Intel Corporation Wednesday 8 August 430-530 pm room 402B The Future of Visual Computing as Viewed by Intel Visual Computing Research Centers

51

Other ISTC-VC SIGGRAPH Participation

Page 51: Future of Visual Computing as viewed by Intel Visual ... · PDF fileFuture of Visual Computing as viewed by Intel Visual Computing Research Centers ... Justin Rattner Intel Science

Siggraph Courses Optimizing Realistic Rendering With Many-Light Methods Sunday 5 August 2-515 pm Jaroslav Krivanek Milos Hasan Adam Arbree Carsten Dachsbacher Alexander Keller Bruce Walter State of the Art in Photon-Density Estimation Thursday 9 August 2-515 pm Toshiya Hachisuka Wojciech Jarosz Guillaume Bouchard Per Christensen Jeppe Revall Frisvad Wenzel Jakob Henrik Wann Jensen Jared M Johnson Michael Kaschalk Claude Knaus Andrew Selle Ben Spencer

Siggraph Talks

Silence Eliminate the Noise Thursday 9 August 9-1030 am Importance Sampling for Hair Scattering Jiawei Ou Feng Xie Parashar Krishnamachari Fabio Pellacini

Siggraph Exhibitor Sessions

Intel Corporation Wednesday 8 August 430-530 pm room 402B The Future of Visual Computing as Viewed by Intel Visual Computing Research Centers

51

Other ISTC-VC SIGGRAPH Participation