29
The Reinvention of the Car How to Consider Safety Aspects for Launching Autonomous Driving Dr. Michael Hafner, 10.10.2018 Vice President Drive Technologies and Automated Driving Daimler AG

The Reinvention of the Car How to Consider Safety Aspects ...on-demand.gputechconf.com/gtc-eu/2018/pdf/e8399-the-reinvention … · The Reinvention of the Car How to Consider Safety

  • Upload
    others

  • View
    2

  • Download
    0

Embed Size (px)

Citation preview

Folie in Ursprungsform

Wechsel des Folienlayouts

im Menü über:

Start // Absatz // Listenebene

Wechsel zwischen weißem und

schwarzem Folienlayout über Menü:

oder

The Reinvention of the Car

How to Consider Safety Aspects for Launching Autonomous Driving

Dr. Michael Hafner, 10.10.2018

Vice President Drive Technologies and Automated Driving

Daimler AG

Folie in Ursprungsform

Wechsel des Folienlayouts

im Menü über:

Start // Absatz // Listenebene

Wechsel zwischen weißem und

schwarzem Folienlayout über Menü:

oder

ADAS: advanced driver assistance systems The Reinvention of the Car | Dr. Michael Hafner | 10.10.2018 2

The Reinvention of the car … happens in four main pillars

Folie in Ursprungsform

Wechsel des Folienlayouts

im Menü über:

Start // Absatz // Listenebene

Wechsel zwischen weißem und

schwarzem Folienlayout über Menü:

oder

1. Innovations in series cars: ADAS Update

2. Why full vehicle automation makes sense: Motives

3. Where are we heading to: SAFE Technology

ADAS: advanced driver assistance systems The Reinvention of the Car | Dr. Michael Hafner | 10.10.2018 3

The Reinvention of the car – autonomous and accident free

Folie in Ursprungsform

Wechsel des Folienlayouts

im Menü über:

Start // Absatz // Listenebene

Wechsel zwischen weißem und

schwarzem Folienlayout über Menü:

oder

Mercedes-Benz has the

longest history in ADAS1997 Sandwich Concept

2002 PRE-SAFE®

2003 Active Light Functions

1996 Brake Assist System

2006 PRE-SAFE® Brake, Intelligent Light System

2007 Blind Spot Assist2008 Active Park Assist

1995 ESP®, Sidebag

1998 Distronic Windowbag, Adaptive Airbags

2009 Attention Assist, Adaptive Highbeam Assist, Lane Keeping Assist, Speed Limit Assist, Self-Adaptive Rear Belt Force Limiters

2000 Integral Safety Approach

2005 Adaptive Brake Lights, Brake Assist System BAS PLUS,

NECK-PRO Head Restraint

2010 Active Blind Spot Assist, Active Lane Keeping Assist

1978 ABS1980 Airbag, Belt Tensioner

1989 Automatic Rollover Bar

2011 COLLISION PREVENTION ASSIST, PRE-SAFE® Brake with City Braking Function, Night View Assist with

Spotlight-Function

2012 360° Camera, Side Wind Assist by ESP®

2013 Intelligent Drive: DISTRONIC PLUS with Steering Assist and Stop&GoPilot, PRE-SAFE® Brake with

Pedestrian Detection, BAS PLUS with Cross Traffic Assist, PRE-SAFE® PLUS, PRE-SAFE® Impulse, Beltbag, MAGIC

BODY CONTROL, Adaptive Highbeam Assist Plus

2014 COLLISION PREVENTION ASSIST PLUS

2016/17/18 Intelligent Drive Next Level: Map enhanced Active Distance Assist DISTRONIC and Active Steering

Assist, Active Lane Change Assist, Active Speed Limit Assist, Active Emergency Stop

Assist, Active Brake Assist with Cross Traffic Function, Evasive Steering Assist, PRE-SAFE®

Sound, PRE-SAFE® Impulse Side

The Reinvention of the Car | Dr. Michael Hafner | 10.10.2018 4

Folie in Ursprungsform

Wechsel des Folienlayouts

im Menü über:

Start // Absatz // Listenebene

Wechsel zwischen weißem und

schwarzem Folienlayout über Menü:

oder

Mercedes-Benz Driver Assistance Package

Active Distance Assist DISTRONICo Route based speed adjustment

o Active Speed Limit Assist

Car-to-X Communication

Active Blind Spot Assist

PRE-SAFE®

Sound

PRE-SAFE® PLUS

Evasive Steering Assist

Active Lane Keeping Assist

Active Steering Assisto Active Lane Change Assist

o Active Emergency Stop Assist

MULTIBEAM LEDo ULTRA RANGE high beam

ATTENTION ASSIST

Active Brake Assistwith Pedestrian Detection, Cross-Traffic Function and

Congestion Emergency Braking Function

The Reinvention of the Car | Dr. Michael Hafner | 10.10.2018 5

Folie in Ursprungsform

Wechsel des Folienlayouts

im Menü über:

Start // Absatz // Listenebene

Wechsel zwischen weißem und

schwarzem Folienlayout über Menü:

oder

Map Based Speed Adjustment

Driver Assistance Package: Route Based Speed Adaption for advanced comfort

• Predictive speed reduction before curves, intersections, roundabouts, tollbooths

and for turning based on map data

• Speed adaption is related to DRIVE SELECT (ECO/COMFORT/SPORT) incl. sailing downhill in ECO-Mode in selected engines

• Vehicle will not be stopped due to oncoming or crossing traffic, e.g. at roundabouts or intersections

The Reinvention of the Car | Dr. Michael Hafner | 10.10.2018 6

Folie in Ursprungsform

Wechsel des Folienlayouts

im Menü über:

Start // Absatz // Listenebene

Wechsel zwischen weißem und

schwarzem Folienlayout über Menü:

oder

Intelligent Real-Life-Safety… only assist if neccessary

Animation Active Braking Assist with Cross-Traffic-Function

The Reinvention of the Car | Dr. Michael Hafner | 10.10.2018 7

Folie in Ursprungsform

Wechsel des Folienlayouts

im Menü über:

Start // Absatz // Listenebene

Wechsel zwischen weißem und

schwarzem Folienlayout über Menü:

oder

Animation Evasive Steering Assist

Folie in Ursprungsform

Wechsel des Folienlayouts

im Menü über:

Start // Absatz // Listenebene

Wechsel zwischen weißem und

schwarzem Folienlayout über Menü:

oder

Animation Intelligent Drive

Folie in Ursprungsform

Wechsel des Folienlayouts

im Menü über:

Start // Absatz // Listenebene

Wechsel zwischen weißem und

schwarzem Folienlayout über Menü:

oder

Field Validation of Driver Assistance Systems at Mercedes-Benz

Testing around the World

© OpenStreetMap contributors The Reinvention of the Car | Dr. Michael Hafner | 10.10.2018 10

Folie in Ursprungsform

Wechsel des Folienlayouts

im Menü über:

Start // Absatz // Listenebene

Wechsel zwischen weißem und

schwarzem Folienlayout über Menü:

oder

Why full vehicle automation makes sense:

Motives

The Reinvention of the Car | Dr. Michael Hafner | 10.10.2018 11

Reset the slide back to its

Change the slide layout

via menu bar:

Alternating between white and black

slide layouts via menu bar:

The Reinvention of the Car | Dr. Michael Hafner | 10.10.2018 12

Different Reasons for Vehicle Automation

Shared Mobility =

Lower Traffic Density

Growing mobility

needs & urbanization

Towards

Zero Emissions

Customer centered

mobility = Comfort

Use Time more

effectively

Seamless customer

journeys

Maturity of

Technology

More affordable

Transportation

Max. connectivity of

vehicle / services

Improved Road

Safety

‘The last 130 years of automobile were exciting, but the

next few years will be much more interesting.’

Folie in Ursprungsform

Wechsel des Folienlayouts

im Menü über:

Start // Absatz // Listenebene

Wechsel zwischen weißem und

schwarzem Folienlayout über Menü:

oder

The Reinvention of the Car | Dr. Michael Hafner | 10.10.2018 14

SAFE TechnologyWhere are we heading to?

15The Reinvention of the Car | Dr. Michael Hafner | 10.10.2018

Folie in Ursprungsform

Wechsel des Folienlayouts

im Menü über:

Start // Absatz // Listenebene

Wechsel zwischen weißem und

schwarzem Folienlayout über Menü:

oder

Self Driving Car Sensor Set to handle all relevant Use Cases

The Reinvention of the Car | Dr. Michael Hafner | 10.10.2018 16

Lidars + Cameras on the rooftop Stereo and Traffic Light Camera behind windscreen

Radar, Lidar and Ultrasonic

at the front

SVS and Radar around the car

Radar and Ultrasonic at the rear

Detect end of laneLost cargoLane change at night

Traffic lightsEmergency vehicles

Parking and driveaway

Reset the slide back to its

Change the slide layout

via menu bar:

Alternating between white and black

slide layouts via menu bar: Safe system architecture by redundancies in sensors, processors,

actuators, power supply and functional algorithms

17ECU= Electronic Control Unit, CPU= Central Processing Unit, GPU= Graphics Processing Unit The Reinvention of the Car | Dr. Michael Hafner | 10.10.2018 17

Sourround Cam

Lidar

Radar

GPUStereo CameraSensor ECUs

fail-safe

Sensor-Fusion

& Driving

fail-safe

AI

AI

AI

AI

Actuation

fail-operational

GPU

GPU

GPU

Reset the slide back to its

Change the slide layout

via menu bar:

Alternating between white and black

slide layouts via menu bar: Artificial Intelligence (AI) is Key to understand Sensor Data

Dense Data ClassificationMotion DetectionFusion &

Localization

Situation

Analysis

Maneuver

Planning

The Reinvention of the Car | Dr. Michael Hafner | 10.10.2018 18

Cross

Modality

Fusion

Mic Fusion

Video

Perc.

Lidar

Perc.

Radar

Perc.

Env. Model

Beh. Gen.

Planning

USS Fusion

Loc

HD Map

MAP DOWNLOAD

Radar

Camera

Lidar

ECU

AI

CloudAI

AI

AI

Reset the slide back to its

Change the slide layout

via menu bar:

Alternating between white and black

slide layouts via menu bar: Test your own perception capabilities vs. a Neural Network

Check the image for three (3!) seconds and then have a look at the result of the Neural Network, which had

only a mere 30 milliseconds glance at it. Ready to start?

The Reinvention of the Car | Dr. Michael Hafner | 10.10.2018 19

Not sure whether some “New Players” would have detected the crossing truck ...

Reset the slide back to its

Change the slide layout

via menu bar:

Alternating between white and black

slide layouts via menu bar: Daimler has published the Cityscapes Dataset

50 major German Cities

5000 precisely labeled frames

>4000 downloads

www.cityscapes-dataset.com

CNN

AI

The Reinvention of the Car | Dr. Michael Hafner | 10.10.2018 20

Universities/Experts can compare the performance of their CNNs

Reset the slide back to its

Change the slide layout

via menu bar:

Alternating between white and black

slide layouts via menu bar: Relevant data is needed to finalize the Software Development

Complete Scene Book Adequate Training Data Set Independent Validation Data Set

Sequences

Sequences

Ground Truth

The Reinvention of the Car | Dr. Michael Hafner | 10.10.2018 21

Reset the slide back to its

Change the slide layout

via menu bar:

Alternating between white and black

slide layouts via menu bar: Image Understanding: CNNs only perform well,

if training data and training parameters are chosen carefully

Example: Night performance of CNN: if trained with day data…

… and if trained with proper night data

The Reinvention of the Car | Dr. Michael Hafner | 10.10.2018 22

Reset the slide back to its

Change the slide layout

via menu bar:

Alternating between white and black

slide layouts via menu bar:

The Reinvention of the Car | Dr. Michael Hafner | 10.10.2018 23

Intelligent World Drive – experience and data from five continents

Reset the slide back to its

Change the slide layout

via menu bar:

Alternating between white and black

slide layouts via menu bar: ISO 26262 Development: Safe Setup and full validation of

Lev. 4-5 is key

Safety Diver is responsible driver!

Driver qualification - DAI

• Safety driver training and qualification

based on evaluation of take over

maneuvers

• Second person in car for system

operation

• Regular safety driver instruction

• Safety concept approved by TÜV

SW-Testing

EE HiL test rigs

proving grounds,

test facilities

24

The Reinvention of the Car | Dr. Michael Hafner | 10.10.2018 25

Daimler joined forces with Bosch in common Project House to

combine strenths of OEM and Tier1

• Vehicles

• Integration of systems

in vehicle line

Common Development of AD-Kit to be used in Robo Cars

+

Sensor Algorithms

Motion Control

Environment Fusion

Behavior Generation

System

Testing

IT & Process Support

Vehicle Control Center

• Hardware (Sensors,

Actors, ECUs)

• Software for HW

components

Embed. SW Infrastr.

Project House with locations in Germany and USA

Functionally SAVE acc. to ISO26262

Artificial Intelligence enabler for Autonomous Driving (Nvidia)

Nvidia – partner in key technologies

The Reinvention of the Car | Dr. Michael Hafner | 10.10.2018 26

Nvidia on Technology level:

• Object Detection and Classification, e.g. Vulnerable Road Users

• Functional Safety Hardware Architecture

Nvidia on Device level:

• Used in distributed domain architecture

• Xavier as main brain

• AI 30 TOPS* at 30watts

Nvidia on System level:

• Drive Peagasus Reference Platform

• AI Processors, Frameware & Toolchain

* Trillion operations per second

Reset the slide back to its

Change the slide layout

via menu bar:

Alternating between white and black

slide layouts via menu bar: Enjoy a short demo drive … through the eyes of a car

The Reinvention of the Car | Dr. Michael Hafner | 10.10.2018 27

Reset the slide back to its

Change the slide layout

via menu bar:

Alternating between white and black

slide layouts via menu bar:

The Reinvention of the Car | Dr. Michael Hafner | 10.10.2018 28

The Reinvention of the car is happening right now …

… and will revolutionize future mobility …

Reset the slide back to its

Change the slide layout

via menu bar:

Alternating between white and black

slide layouts via menu bar:

The Reinvention of the Car | Dr. Michael Hafner | 10.10.2018 29

… in order to provide space and time smartly used for essential things.