47
S5409: Custom Iray Applications and MDL for Consistent Visual Appearance Throughout Your Pipeline

S5409: Custom Iray Applications and MDL for ... - NVIDIAon-demand.gputechconf.com › gtc › 2015 › presentation › S5409-Dav… · Fast final render time VISUALISATION: APPLICATION

  • Upload
    others

  • View
    2

  • Download
    0

Embed Size (px)

Citation preview

Page 1: S5409: Custom Iray Applications and MDL for ... - NVIDIAon-demand.gputechconf.com › gtc › 2015 › presentation › S5409-Dav… · Fast final render time VISUALISATION: APPLICATION

S5409: Custom Iray Applications and MDL for Consistent Visual Appearance Throughout Your

Pipeline

Page 2: S5409: Custom Iray Applications and MDL for ... - NVIDIAon-demand.gputechconf.com › gtc › 2015 › presentation › S5409-Dav… · Fast final render time VISUALISATION: APPLICATION

DAVE

HUTCHINSON CHIEF TECHNOLOGY OFFICER

DAVE COLDRON PRODUCT DIRECTOR

Page 3: S5409: Custom Iray Applications and MDL for ... - NVIDIAon-demand.gputechconf.com › gtc › 2015 › presentation › S5409-Dav… · Fast final render time VISUALISATION: APPLICATION

Today we will cover...

Lightworks, Iray and Iray+

The different types of users and tasks we support

Integration implications from a task/user oriented perspective

AGENDA

Page 4: S5409: Custom Iray Applications and MDL for ... - NVIDIAon-demand.gputechconf.com › gtc › 2015 › presentation › S5409-Dav… · Fast final render time VISUALISATION: APPLICATION

LIGHTWORKS ARE 3D RENDERING TECHNOLOGY EXPERTS WE HELP COMPANIES GET THE MOST OUT OF IRAY

LIGHTWORKS SELL

NVIDIA IRAY AND

LIGHTWORKS IRAY+

LIGHTWORKS INTEGRATE AND

SUPPORT CUSTOM INTEGRATION

OF IRAY INTO 3D APPLICATIONS

LIGHTWORKS CREATE CUSTOM

IRAY SOLUTIONS

LIGHTWORKS CREATE

INTERACTIVE CONTENT USING

IRAY TECHNOLOGY

LIGHTWORKS PROVIDE CUSTOM

CLOUD RENDERING SUPPORT

FOR CONFIGURATORS

LIGHTWORKS OFFER FULL

ENTERPRISE LEVEL SUPPORT

INCLUDING DIGITAL SERVICES

Page 5: S5409: Custom Iray Applications and MDL for ... - NVIDIAon-demand.gputechconf.com › gtc › 2015 › presentation › S5409-Dav… · Fast final render time VISUALISATION: APPLICATION

WHAT IS NVIDIA IRAY?

NVIDIA Iray is a state-of-the-art physically based photorealistic rendering technology

provided as a toolkit.

Iray provides multiple rendering modes addressing a spectrum of use cases requiring realtime and interactive feedback to physically

based, photorealistic visualizations.

Page 6: S5409: Custom Iray Applications and MDL for ... - NVIDIAon-demand.gputechconf.com › gtc › 2015 › presentation › S5409-Dav… · Fast final render time VISUALISATION: APPLICATION

A contemporary and easy-to-use C++ SDK layer to make the integration of Iray technology as easy, fast and simple to support as possible.

fully documented with a range of examples and use-case scenarios

all objects are accessed in the same way, allowing easy UI build out

unique approach to building materials using physically based components that represent the material creation process in the real world

NVIDIA MDL (Material Definition Language) fully supported as standard

WHAT IS LIGHTWORKS IRAY+

Page 7: S5409: Custom Iray Applications and MDL for ... - NVIDIAon-demand.gputechconf.com › gtc › 2015 › presentation › S5409-Dav… · Fast final render time VISUALISATION: APPLICATION

Option to tailor the UI to your user requirements, hiding complexities where appropriate

Comprehensive material library and material components

The ability to generate new materials and material thumbnails without writing MDL

Ready-to-use lighting and environment options

All objects are easily streamed in either xml or binary formats, so you can easily save data directly into your own CAD files

Integration support available at all stages, from hotline support and technical consultancy, through to product design and full turnkey implementation

KEY DIFFERENTIATORS OF IRAY+

Page 8: S5409: Custom Iray Applications and MDL for ... - NVIDIAon-demand.gputechconf.com › gtc › 2015 › presentation › S5409-Dav… · Fast final render time VISUALISATION: APPLICATION

Visualization Professionals

CAD Professionals

Designers Game

developers

Engineers Scientists Consumers Educators

WHAT TYPES OF USER DO WE CATER FOR?

Page 9: S5409: Custom Iray Applications and MDL for ... - NVIDIAon-demand.gputechconf.com › gtc › 2015 › presentation › S5409-Dav… · Fast final render time VISUALISATION: APPLICATION

WHAT TASKS ARE THESE PEOPLE DOING?

Virtual prototyping/simulation

Lighting simulation

Crash testing

Training and documentation

Illustrations and animation for manuals

Consumer product customisation

Online configuration

In-store product experiences

Creating visualisations

Setting up lighting

Applying materials

Preview camera paths/viewpoints

Design evaluation

Material evaluation

Collaborative reviews

Validation and simulation

Lighting studies

Physics and material properties

Page 10: S5409: Custom Iray Applications and MDL for ... - NVIDIAon-demand.gputechconf.com › gtc › 2015 › presentation › S5409-Dav… · Fast final render time VISUALISATION: APPLICATION

TODAY WE FOCUS ON FOUR DIFFERENT INTEGRATIONS

Page 11: S5409: Custom Iray Applications and MDL for ... - NVIDIAon-demand.gputechconf.com › gtc › 2015 › presentation › S5409-Dav… · Fast final render time VISUALISATION: APPLICATION

VISUALISATION INTEGRATION

Page 12: S5409: Custom Iray Applications and MDL for ... - NVIDIAon-demand.gputechconf.com › gtc › 2015 › presentation › S5409-Dav… · Fast final render time VISUALISATION: APPLICATION

Visualisation is usually separate from design stage

Data may be a different and simplified version of the design data

Scalable compute resource desirable

Handling legacy data

VISUALISATION: REQUIREMENTS

Page 13: S5409: Custom Iray Applications and MDL for ... - NVIDIAon-demand.gputechconf.com › gtc › 2015 › presentation › S5409-Dav… · Fast final render time VISUALISATION: APPLICATION

Visualisation is the primary goal of the user

Power users understand visualisation algorithms and parameters

Good understanding of materials and lighting in multiple 3D systems

Will use multiple applications to get the job done

Use post processing often

Clearly defined workflow aimed at the highest quality results in the shortest time

May have visual stylistic preferences

Generally tight deadlines and billing by the hour – time is of the essence

VISUALISATION: USER PROFILE

Page 14: S5409: Custom Iray Applications and MDL for ... - NVIDIAon-demand.gputechconf.com › gtc › 2015 › presentation › S5409-Dav… · Fast final render time VISUALISATION: APPLICATION

Expose a high level of control in the UI

Fast feedback from settings

Fast final render time

VISUALISATION: APPLICATION DESIGN

Page 15: S5409: Custom Iray Applications and MDL for ... - NVIDIAon-demand.gputechconf.com › gtc › 2015 › presentation › S5409-Dav… · Fast final render time VISUALISATION: APPLICATION

VISUALISATION: APPLICATION DESIGN IMPLICATIONS

Implications for UI

Ability to author complex materials quickly

Support for post-process stages

Support for 3rd party plugin software

Page 16: S5409: Custom Iray Applications and MDL for ... - NVIDIAon-demand.gputechconf.com › gtc › 2015 › presentation › S5409-Dav… · Fast final render time VISUALISATION: APPLICATION

MATERIAL STRUCTURE

Page 17: S5409: Custom Iray Applications and MDL for ... - NVIDIAon-demand.gputechconf.com › gtc › 2015 › presentation › S5409-Dav… · Fast final render time VISUALISATION: APPLICATION

VISUALISATION: CREATING COMPLEX MATERIALS EASILY

Page 18: S5409: Custom Iray Applications and MDL for ... - NVIDIAon-demand.gputechconf.com › gtc › 2015 › presentation › S5409-Dav… · Fast final render time VISUALISATION: APPLICATION

Key Iray+ features

Consistent appearance of materials throughout the workflow

Interoperability of materials between different Iray applications

Physically accurate rendering

Support for multiple buffers

32 bit support

Scalability for production render

Interactive feedback

Iray+ for 3ds Max

VISUALISATION: KEY IRAY+ FEATURES

Page 19: S5409: Custom Iray Applications and MDL for ... - NVIDIAon-demand.gputechconf.com › gtc › 2015 › presentation › S5409-Dav… · Fast final render time VISUALISATION: APPLICATION
Page 20: S5409: Custom Iray Applications and MDL for ... - NVIDIAon-demand.gputechconf.com › gtc › 2015 › presentation › S5409-Dav… · Fast final render time VISUALISATION: APPLICATION

CAD INTEGRATION

Page 21: S5409: Custom Iray Applications and MDL for ... - NVIDIAon-demand.gputechconf.com › gtc › 2015 › presentation › S5409-Dav… · Fast final render time VISUALISATION: APPLICATION

Connections to Enterprise data systems

Lot of internal usage and design review

Collaboration between remote teams

Analysis and design verification is key

CAD: REQUIREMENTS

Requirement for scalable compute resources

Compatibility with other visualisation methods (real-time)

Data generally accessible worldwide through central data centres.

Page 22: S5409: Custom Iray Applications and MDL for ... - NVIDIAon-demand.gputechconf.com › gtc › 2015 › presentation › S5409-Dav… · Fast final render time VISUALISATION: APPLICATION

Visualisation is not always the users primary goal

Generally not power users who understand visualisation algorithms and parameters

Less understanding of digital content (eg materials and lights) and parameters

Keep data within their CAD application or network

Don’t use post processing

Clearly defined workflow aimed at designing the best product and getting it to market in the shortest possible time

Wants to see accurate representation in different situations

CAD: USER PROFILE

Page 23: S5409: Custom Iray Applications and MDL for ... - NVIDIAon-demand.gputechconf.com › gtc › 2015 › presentation › S5409-Dav… · Fast final render time VISUALISATION: APPLICATION

Use of predefined settings

Only expose key parameters for Materials and Lighting

Simple render controls pre-defined to support the particular stages of the design workflow

Use of automation/repeatability

Automated image generation from PLM systems

Hooks into internal animation/explosion

Variation control is key

CAD: APPLICATION DESIGN

Page 24: S5409: Custom Iray Applications and MDL for ... - NVIDIAon-demand.gputechconf.com › gtc › 2015 › presentation › S5409-Dav… · Fast final render time VISUALISATION: APPLICATION

CAD: APPLICATION DESIGN

Hooks into internal animation/explosion

consistency of content at an enterprise level

Ability to author content once then publish them company wide as non-editable

Tiered user levels provide the right amount of control for the task

Separate tools aimed at specific tasks eg Viewers, Advanced Material editors, Analysis

Lightweight Viewer

External material editor

CAD System

Page 25: S5409: Custom Iray Applications and MDL for ... - NVIDIAon-demand.gputechconf.com › gtc › 2015 › presentation › S5409-Dav… · Fast final render time VISUALISATION: APPLICATION

Key Iray+ features

Consistency of material representation across different apps using MDL

Accuracy of BRDF’s provided by measured materials

Ease of exposing editable parameters via MDL

CAD: KEY IRAY+ FEATURES

Key Iray+ features

Replacement of OGL viewport using interactive ray-traced modes

Iray+ layer simplifies the iray API to create simple controls easily

CPU fallback for both engines

Page 26: S5409: Custom Iray Applications and MDL for ... - NVIDIAon-demand.gputechconf.com › gtc › 2015 › presentation › S5409-Dav… · Fast final render time VISUALISATION: APPLICATION

Model is marked up with OpenGL materials

OpenGL materials are driven from MDL

Always get the best looking ray traced viewport

Single material description very important for data consistency

Enhancement of OpenGL Viewport with RayTraced view

Iray Interactive can be used for very fast high quality realtime navigation

As well as fast updates to lighting, geometry and material changes.

CAD: OPENGL/RAY TRACED REPRESENTATION

Realtime

Page 27: S5409: Custom Iray Applications and MDL for ... - NVIDIAon-demand.gputechconf.com › gtc › 2015 › presentation › S5409-Dav… · Fast final render time VISUALISATION: APPLICATION

CAD: OPENGL/RAY TRACED REPRESENTATION

Interactive

Model is marked up with OpenGL materials

OpenGL materials are driven from MDL

Always get the best looking ray traced viewport

Single material description very important for data consistency

Enhancement of OpenGL Viewport with RayTraced view

Iray Interactive can be used for very fast high quality realtime navigation

As well as fast updates to lighting, geometry and material changes.

Page 28: S5409: Custom Iray Applications and MDL for ... - NVIDIAon-demand.gputechconf.com › gtc › 2015 › presentation › S5409-Dav… · Fast final render time VISUALISATION: APPLICATION

CAD: OPENGL/RAY TRACED REPRESENTATION

Photoreal

Model is marked up with OpenGL materials

OpenGL materials are driven from MDL

Always get the best looking ray traced viewport

Single material description very important for data consistency

Enhancement of OpenGL Viewport with RayTraced view

Iray Interactive can be used for very fast high quality realtime navigation

As well as fast updates to lighting, geometry and material changes.

Page 29: S5409: Custom Iray Applications and MDL for ... - NVIDIAon-demand.gputechconf.com › gtc › 2015 › presentation › S5409-Dav… · Fast final render time VISUALISATION: APPLICATION

Iray+ material library (300+) gives great starting points for key CAD markets – auto/marine etc.

Most manufacturers will take these as starting points and create specific palettes of materials for use within whole company and their PLM

Ideally these materials can be used from design through to consumer by inserting the appropriate Iray enabled application into the process at each stage

i.e. NX->Teamcenter->export to Iray Configurator

CAD: PRE-DEFINED CONTENT IS KEY FOR CAD USER

Page 30: S5409: Custom Iray Applications and MDL for ... - NVIDIAon-demand.gputechconf.com › gtc › 2015 › presentation › S5409-Dav… · Fast final render time VISUALISATION: APPLICATION

Measured Data can be used just like any other BSDF

Measurement is prone to error at grazing angles

CAD: USING MEASURED BSDF DATA

BRDF measurement provided by Ford Motor Company Data directly from Radiant Zemax Imaging Spheres device

Page 31: S5409: Custom Iray Applications and MDL for ... - NVIDIAon-demand.gputechconf.com › gtc › 2015 › presentation › S5409-Dav… · Fast final render time VISUALISATION: APPLICATION

Measured Data can be used just like any other BSDF

Measurement prone to error at grazing angles

Can add fresnel layers to simulate clearcoat finish and address grazing issues

CAD: USING MEASURED BSDF DATA

BRDF measurement provided by Ford Motor Company Data directly from Radiant Zemax Imaging Spheres device

Page 32: S5409: Custom Iray Applications and MDL for ... - NVIDIAon-demand.gputechconf.com › gtc › 2015 › presentation › S5409-Dav… · Fast final render time VISUALISATION: APPLICATION

Now nearly everyone in the chain wants high quality

Manufacturers producing film quality animations for daily automated design review.

Automation and repeatable/scriptable processes.

Speed of production, scaling important

CAD: HIGH QUALITY VISUALS

Page 33: S5409: Custom Iray Applications and MDL for ... - NVIDIAon-demand.gputechconf.com › gtc › 2015 › presentation › S5409-Dav… · Fast final render time VISUALISATION: APPLICATION

Analysis – higher quality presentation of results

For architecture iray provides accurate lighting analysis including caustic effects

CAD: ACCURATE SIMULATION

Daylight Simulation of a London street at hourly intervals

Page 34: S5409: Custom Iray Applications and MDL for ... - NVIDIAon-demand.gputechconf.com › gtc › 2015 › presentation › S5409-Dav… · Fast final render time VISUALISATION: APPLICATION

CONFIGURATORS

Page 35: S5409: Custom Iray Applications and MDL for ... - NVIDIAon-demand.gputechconf.com › gtc › 2015 › presentation › S5409-Dav… · Fast final render time VISUALISATION: APPLICATION

In-store or online configuration of consumer products

Automated pre-render of segmented images where there are limited variations

Data input from or integration with a host design system

Live rendering where there are too many variations to pre-render

CONFIGURATORS: REQUIREMENTS

Page 36: S5409: Custom Iray Applications and MDL for ... - NVIDIAon-demand.gputechconf.com › gtc › 2015 › presentation › S5409-Dav… · Fast final render time VISUALISATION: APPLICATION

Render on cloud or in-store

Pre-authored data uploaded to a server

Scale across possible large numbers of concurrent users for web based applications

Minimise costs

Easy/automated update of product lines

Appropriate remote compute resource

Real-time is often not good enough quality. How real do you need?

CONFIGURATORS: REQUIREMENTS

Page 37: S5409: Custom Iray Applications and MDL for ... - NVIDIAon-demand.gputechconf.com › gtc › 2015 › presentation › S5409-Dav… · Fast final render time VISUALISATION: APPLICATION

Author

Generally will be a design professional working in an industry standard

visualisation, CAD or Games system.

End user

Consumers who have little or no knowledge or interest in the technicalities of the

system. They just want to configure their ring/headphones/car as quickly and

accurately as possible.

CONFIGURATORS: USER PROFILES

Page 38: S5409: Custom Iray Applications and MDL for ... - NVIDIAon-demand.gputechconf.com › gtc › 2015 › presentation › S5409-Dav… · Fast final render time VISUALISATION: APPLICATION

Authoring tool

Definition of rules for replacement of geometry

Define combinations that are not valid for commercial, stylistic or manufacture reasons

Support changing product lines

CONFIGURATORS: UI IMPLICATIONS

Configuration system

Browser or simple application based frontend

rendering backend OR pre-rendered images

Interactivity and frame-rate importance. Fast response to change

Page 39: S5409: Custom Iray Applications and MDL for ... - NVIDIAon-demand.gputechconf.com › gtc › 2015 › presentation › S5409-Dav… · Fast final render time VISUALISATION: APPLICATION

CONFIGURATOR: USED FOR DESIGN REVIEW

Page 40: S5409: Custom Iray Applications and MDL for ... - NVIDIAon-demand.gputechconf.com › gtc › 2015 › presentation › S5409-Dav… · Fast final render time VISUALISATION: APPLICATION

CONFIGURATORS: REQUIREMENTS

Page 41: S5409: Custom Iray Applications and MDL for ... - NVIDIAon-demand.gputechconf.com › gtc › 2015 › presentation › S5409-Dav… · Fast final render time VISUALISATION: APPLICATION

CONFIGURATORS: REQUIREMENTS

Page 42: S5409: Custom Iray Applications and MDL for ... - NVIDIAon-demand.gputechconf.com › gtc › 2015 › presentation › S5409-Dav… · Fast final render time VISUALISATION: APPLICATION

Representation of MDL materials with realtime (webGL) materials

Lightweight Cloud API

CPU fallback (cost)

Physically based

Can mix native CAD with Iray+ content at load time, easier to update

CONFIGURATORS: KEY IRAY+ FEATURES AND MDL

Can be image based or interactively generated

Images can be cached as they are generated for different configurations

Create automated Iray image output direct to site from the CAD

OR link Iray directly into the site for rendering

Page 43: S5409: Custom Iray Applications and MDL for ... - NVIDIAon-demand.gputechconf.com › gtc › 2015 › presentation › S5409-Dav… · Fast final render time VISUALISATION: APPLICATION

CONFIGURATORS: REQUIREMENTS

Page 44: S5409: Custom Iray Applications and MDL for ... - NVIDIAon-demand.gputechconf.com › gtc › 2015 › presentation › S5409-Dav… · Fast final render time VISUALISATION: APPLICATION

Clothing Simulation

CONFIGURATORS: REQUIREMENTS

Page 45: S5409: Custom Iray Applications and MDL for ... - NVIDIAon-demand.gputechconf.com › gtc › 2015 › presentation › S5409-Dav… · Fast final render time VISUALISATION: APPLICATION

• Photorealism is now commonplace

• High quality visualization is required in all aspects from Design to Consumer

• User requirements are radically different

• Type of integration is defined by user requirements

• Iray+ has the breadth of functionality to address a wide range of very different applications

• MDL provides a way to connect all your workflows with the same look and feel

CONCLUSIONS

Page 46: S5409: Custom Iray Applications and MDL for ... - NVIDIAon-demand.gputechconf.com › gtc › 2015 › presentation › S5409-Dav… · Fast final render time VISUALISATION: APPLICATION

GET IN TOUCH

STAND 529

[email protected]

www.lightworkdesign.com

[email protected]

CONTACT US

Page 47: S5409: Custom Iray Applications and MDL for ... - NVIDIAon-demand.gputechconf.com › gtc › 2015 › presentation › S5409-Dav… · Fast final render time VISUALISATION: APPLICATION

THANKYOU - ANY QUESTIONS PLEASE ASK!