Mirrorless and Lighting - NVIDIA · NVIDIA Design of Mirrorless Cars Line style-design Lamp defines brand-signature – especially DRL Side cameras replace mirrors

Mirrorless and Lighting

Dominic HillenbrandOctober, 2014

NVIDIA

Design of Headlamps

Round shape – like eyes

Line style-designLamp defines brand-signature – especially DRL

NVIDIA

Round shape – like eyes

Design of Headlamps


• Lamp design directly relates to sales

• First step in new car designs

NVIDIA

Design of Mirrorless Cars


Side cameras replace mirrors

NVIDIA

Design, Safety and Cost

Design

Safetye.g. glare, ghosting

Coste.g. LED replacement,

Camera repair/calibration

Vehicle Manufacturer

„Good design sells“

Government Customer

Regulations

Accidents

NVIDIA

Example: Upcoming Rear-Mirror CMS

• Flip-mirror due to liability/government approval

• Night time: head lamps cause halos

• Positions of cameras crucial - conflicts with design

• Display – limited dynamic range, requires tone mapping

Challenges:

Ref: http://nissannew

s.com/en-U

S/nissan/usa/releases/nissan-m

otor-develops-the-sm

art-rearview-m

irror-which-helps-provide-clear-rearw

ard-visibility-in-various-conditions

• CMS provides wider (unobstructed) field of view• Overlays feasible

ECU

Monitor

Camera

NVIDIA

Flip-mirror: Liability/Approval

Flip mirror: display vs. glass

Display

Glass

Lever

Ref: https://w

ww

.youtube.com/w

atch?v=2yxHA

j79kh8

NVIDIA


• Flip-mirror due to liability/government approval




Challenges:


s.com/en-U



art-rearview-m



• CMS provides wider (unobstructed) field of view• Overlays feasible

ECU

Monitor

Camera

NVIDIA


• Flip mirror due to liability/government approval




Challenges:


s.com/en-U



art-rearview-m



Side mirrors still present

NVIDIA

Bigger Challenge: Side mirrors

Side cameras replace mirrors

• Mirrorless affects design/sales…cars with mirrors may beperceived old-fashioned soon…

• Reduced wind resistance• Capability to eliminate blind spots• Impact hazard / No broken mirrors • Stricter regulation

(CMS can be sold - only if the side mirrors are retained!)

• UNECE Addendum 45: Regulation No. 46 refers to ISO/FDIS 16505

Ref: http://w

ww

.autonews.com

/article/20140407/OE

M06/304079935/teslas-push-to-

replace-side-view-m

irrors-sparks-safety-fears

Unique to side-mirrors:

NVIDIA

bast study 2014 - tunnel

Ref: “S

tudy on Cam

era Monitor S

ystems” -E

ike A. S

chmidt, R

ainer Krautscheid -

Informal G

roup on Cam

era Monitor S

ystems in R

eg. No. 46

Berlin, 27.03.2014 -B

undesanstalt für Straßenw

esen

Vehicle disappears for about 1s

NVIDIA

bast study 2014 – direct sun light

Ref: “S

tudy on Cam

era Monitor S

ystems” -E

ike A. S

chmidt, R

ainer Krautscheid -

Informal G

roup on Cam

era Monitor S

ystems in R

eg. No. 46

Berlin, 27.03.2014 -B


esen

No meaningful picture for about 2s

NVIDIA

bast study 2014 – night

Ref: “S

tudy on Cam

era Monitor S

ystems” -E

ike A. S

chmidt, R

ainer Krautscheid -

Informal G

roup on Cam

era Monitor S

ystems in R

eg. No. 46

Berlin, 27.03.2014 -B


esen

• Smear / blooming

• No discomfort glare

• Point light sources are displayed as points light sources

NVIDIA

UNECE Regulation No. 46: Monitor Placement

withMirrors

Based on: A

nnex 12 #2.6.4 -Cam

era Monitor arrangem

ent –O

ICA

Link https://ww

w2.unece.org/w

iki/download/attachm

ents/17760482/IGC

MS

-II-03-12%

20Monitor%

20Arrangement_V6%

20-%20O

ICA

.pptx?api=v2R

ef: UK

proposal for CM

S m

onitor arrangement -P

aris, 5th June 2014 –D

epartment for Transport

NVIDIA


CMS1:1 monitorplacement

Based on: A

nnex 12 #2.6.4 -Cam


ent –O

ICA

Link https://ww

w2.unece.org/w


ents/17760482/IGC

MS

-II-03-12%

20Monitor%

20Arrangement_V6%

20-%20O

ICA

.pptx?api=v2R

ef: UK

proposal for CM

S m




NVIDIA


OICA proposal

from June 2014

Central DisplayContinuous view

Based on: A

nnex 12 #2.6.4 -Cam


ent –O

ICA

Link https://ww

w2.unece.org/w


ents/17760482/IGC

MS

-II-03-12%

20Monitor%

20Arrangement_V6%

20-%20O

ICA

.pptx?api=v2R

ef: UK

proposal for CM

S m




NVIDIA

Takeaways

Upcoming CMSReplace rear mirrors1:1 camera to monitorProcessing – e.g.

Tone mappingColor calibrationLens undistortion

Future CMS Replace side and rear-mirrors Continuous central monitorsProcessing

Stitching of multiple FOVs

ChallengesNight time –Halos/blooming/flickerDynamic rangeMotion blur

ChallengesGhosting / ArtefactsProcessor performanceRegulationLiability

Step from image processing to advanced computer vision/graphics

NVIDIA

Front Lighting Technology - Innovations

1991-94

HIDLow beamHigh Intensity Discharge (HID)

HIDlow + high beam

2001 2006-2008

LEDlow + High beam

LASERHigh beam booster

2014

AFSNo. 123AdaptiveFront Lighting

HIDNo. 98

LED No. 112 rev2.

- Headlamp leveling- Change of LED/light

source- Color boundaries- Dynamic turn indicator- Variable Intensity DRL- Adaptive Driving Beam

System

LED „Matrix“

UNECEregulations

Regulation &Technology always in flux

“hot topics”DRL No. 87

201X

„Pixel-Light“Research

NVIDIA

Adaptive Driving Beam

Ref: “R

egulatory Impacts of A

dvanced Lighting System

s” -Stephan B

erlitz R

ef: https://ww

w.youtube.com

/watch?v=kw

LiY-J0bJQ

Ref: Lighting R

oadmap 2020 -S

tephan Berlitz -IS

AL 2013 P

roceedings

Preventglare foroncomingvehicles

LED „Matrix“

NVIDIA

Compute Optimal light distribution

System Architecture of a fully adaptive Headlamp System

(Stereo)-Camera

Radar

LIDAR

Navigation System

Vehicle Speed

SteeringWheel-Angle

Yaw-Rate

Rain-Sensor

Light Sensor

Car-2-X

Sensor Fusion

3D-Environment

ModelActuation of Light Module

Translate lightdistribution

Sensing Processing Actuation

Ref: “First approach to reach the goal of a fully adaptive

Headlam

p” -Ingo Hoffm

ann et al. ISA

L 2013 Proceedings

NVIDIA

Parallels: CG- and automotive Lighting

„Pixel“ LightProgram controls

physical lighting of scene

Computer graphics scene e.g. rendered to 1024x768 pixels

„Shader-Programs“ determine virtual lighting

3D-models required for accurate lighting

NVIDIA

Outlook

Pixel-LightResearch group of Prof. Dr. Cornelius Neumann at KITMatrix light: 50 pixelResearch prototype: 12 million pixel

Acquiring 3D-environment models Passive: Stereo-camera Active – Feedback Camera & Head lamp

Head lamp emits structured lightHead lamp pulses - time of flight

Ref: “Pixel Lighting – An Automotive Lighting ResearchHead Lamp” - Steffen Michenfelder, Prof. Dr. Cornelius NeumannISAL 2013 Proceedings

Ref: “Automatische Justage eines hochauflösenden Scheinwerfers” –Boris Kubitza et al.ISAL 2013 Proceedings

Pixel Light – 6 HD projectors

NVIDIA

Documents

Mirrorless and Lighting - NVIDIA · NVIDIA Design of Mirrorless Cars Line style-design Lamp defines brand-signature – especially DRL Side cameras replace mirrors