29
mentor.com/embedded Phil Burr, Director, HMI Product Marketing Developing Embedded Automotive HMI & IVI

Developing the Next Generation Embedded HMIs

Embed Size (px)

DESCRIPTION

Developing the Next Generation Embedded HMIs – Phil Burr With more and more people using smartphones it is no surprise that more and more people are demanding better HMIs in other products: whether it is in their set top box, refrigerator, or car, users have come to expect graphically rich dynamic HMIs. This is all very well, but what is a humble developer to do when confronted with the constraints of their embedded device. This presentation examines the options for embedded developers needing to implement these latest HMIs and looks at tools and techniques which can help developers meet or exceed their customer’s HMI expectations.

Citation preview

Page 1: Developing the Next Generation Embedded HMIs

mentor.com/embedded

Phil Burr,

Director, HMI Product Marketing

Developing Embedded

Automotive HMI & IVI

Page 2: Developing the Next Generation Embedded HMIs

Overview

Mentor Embedded

Comprehensive product and services for embedded development

Solutions include Nucleus, software, tools, and services

Independent software provider with 300 engineers and worldwide support

Acquired Montavista automotive business - Mentor now #1 automotive

Linux company!

Mentor Graphics

Established in 1981

Over 4,700 Employees

Annual Revenues of ~$1Bn

The only EDA company with embedded

software since 1996

Award winning support in 53 locations

worldwide

Page 3: Developing the Next Generation Embedded HMIs

When HMI was simple

3

Page 4: Developing the Next Generation Embedded HMIs

HMIs today

4

Page 5: Developing the Next Generation Embedded HMIs

Embedded Software in Transportation Complexity & Cost Rising…

Mill

ion

s o

f L

ine

s

5

Source: http://spectrum.ieee.org/green-tech/advanced-cars/this-car-runs-on-code

Page 6: Developing the Next Generation Embedded HMIs

IVI Design Challenges …

Open Source

Migration to Linux Best

Hardware

Multi-Mode

User Inputs

Android

Support

Connected

Car

Function

Consolidation

HMI

Performance

Telematics

Apps

Driver

Distraction

Page 7: Developing the Next Generation Embedded HMIs

Linux-based IVI systems now available

Linux has strong pedigree in consumer electronics and

enterprise networking

– A natural fit for advanced IVI systems

Rather than adding consumer features to a traditional

―automotive OS,‖ OEMs using Linux can

– Take advantage of a vibrant ecosystem

– Work with active communities of world-class developers

– Re-use mountains of pre-existing open source code, which

can be modified for automotive use

Page 8: Developing the Next Generation Embedded HMIs

Cultural challenges

The automotive industry is very competitive.

Sharing even non-differentiating software elements

among competitors is a relatively new phenomenon.

Putting your own work, your own code, your own IP

into the ―wilds‖ of open source

– The benefits difficult to grasp versus the risks

– Often a hard sell within any company, even those with

some Linux experience in their enterprise

Page 9: Developing the Next Generation Embedded HMIs

A second challenge: IVI is different than consumer

In-vehicle infotainment can

– work side-by-side with consumer device

– share many of the same features

– even compete with consumer products

Good fit for Linux-based software found in CE devices

But IVI devices

– have more stringent requirements

– include automotive-specific functions

– will almost always have features proprietary to the device maker

– require a long product life

Page 10: Developing the Next Generation Embedded HMIs

The GENIVI Alliance

A non-profit organization of over 130 of the top

automotive OEMs and their suppliers

Driving adoption of open source in IVI

– Addressing automotive/cultural concerns

– Providing a collaboration environment for its members to

contribute jointly on essential but non-differentiating

middleware

GENIVI members then each build competitive products

with unique HMI and advanced applications

Page 11: Developing the Next Generation Embedded HMIs

HTML5

Page 12: Developing the Next Generation Embedded HMIs

What is HTML5?

HTML

Javascript

CSS3

Audio &

Video

SVG

Drag &

Drop

Geo

Location

Web

Storage

Web

Sockets

Web

Workers WebGL

Touch

events

Canvas

2D

…and

more!

Core app execution and GUI rendering model

Additional APIs for functions, services, utilities, connectivity etc.

Supports offline as well as connected apps

Browser-specific app packaging and installation

Page 13: Developing the Next Generation Embedded HMIs

HTML5 platform

HTML5 APPS

HTML

Javascript

CSS3

HTML5

APIs

Vehicle

APIs

WEB CORE

BROWSER

- Navigation

- Tabs

- Bookmarks

- History

- Cache

- Cookies

- Etc.

- Execution

- Rendering

- App lifecycle

- Security

- Performance

- Etc.

Page 14: Developing the Next Generation Embedded HMIs

Why HTML5?

Ubiquitous technology

Open (de-facto) standard

Guaranteed longevity

Wide availability of skills

High-level, easy app development

Native system secure from app layer

Good for enabling app ecosystems

Model for late app deployment/customization

Portability of apps

HTML

Javascript

CSS3

Audio &

Video

SVG

Drag &

Drop

Geo

Location

Web

Storage

Web

Sockets

Web

Workers WebGL

Touch

events

Canvas

2D

…and

more!

Page 15: Developing the Next Generation Embedded HMIs

Challenges with HTML5

Performance

Resource requirements

Weak for high-end 3D graphics

Security concerns

Mentor provides technology and services to OEMs

and Tier-1 suppliers to enable our customers to

successfully make the transition to HTML5

HTML

Javascript

CSS3

Audio &

Video

SVG

Drag &

Drop

Geo

Location

Web

Storage

Web

Sockets

Web

Workers WebGL

Touch

events

Canvas

2D

…and

more!

Page 16: Developing the Next Generation Embedded HMIs

Mentor Embedded Tools and Services for

IVI

Page 17: Developing the Next Generation Embedded HMIs

Hardware

• High-performance CPU,

GPU, Peripherals

Operating System

• GENIVI Linux and

Software Device Drivers

IVI Foundation

• Services, Libraries and

middleware

Applications

• Demo templates & 3rd-

party Alliances

HMI

• 3D Design Tools

• HTML5, Qt

• Smart Phone Integration

Infotainment Solution Components

Page 18: Developing the Next Generation Embedded HMIs

Mentor’s HTML5 Solution

HTML5 application platform based on Chromium

– Integrated and tested as a component of Mentor

Embedded IVI Platform

– GENIVI compliant or integrated through GENIVI APIs, as

appropriate

Our global team of HTML5 and Linux professionals

– Support, maintenance and updates

– Porting and testing services on new platforms

– Integration and development services

Page 19: Developing the Next Generation Embedded HMIs

GENIVI Participation

Mentor is on main GENIVI board

GENIVI Expert Group tracking / participation

– System Infrastructure (Loaders, Initialization)

– Automotive (Diagnostics, Software tools)

– Media and Graphics (Tuners, Broadcast, DVD)

– Location Based Services (Positioning, Navigation)

– Networking

– Consumer Electronics, Social Media, Connectivity, Bluetooth, iPad,..

– Mobile Office

– Application Framework (Speech Recognition, HMI, Text to speech)

19

Page 20: Developing the Next Generation Embedded HMIs

Making the transition to open source

Mentor Embedded is helping both OEMs and Tier One

suppliers make this transition

– Simplifying the design process

– Cost-effective differentiated solutions

– Silicon supplier choice, HMI differentiation, and overall cost

savings

– Open innovation without sacrificing product control

Page 21: Developing the Next Generation Embedded HMIs

Mentor Beyond GENIVI

Human Machine Interface – HMI

Inflexion, Qt, HTML5

3rd party User Applications / Integration Services

Hardware Platform and software drivers (BSPs)

Other domains

Android, AutoSAR, ADAS

System Integration and Test

Design Tool Support

Services

21

Page 22: Developing the Next Generation Embedded HMIs

HMI Design – Mentor Inflexion

Inflexion Runtime Inflexion UI Express

Design Host Run-time target

Page 23: Developing the Next Generation Embedded HMIs

HMI Design : Inflexion UI Express

23

Desktop solution for capturing HMIs, later driven by run-time engine

Features include: 3D, Glossing, Shading, Reflections

OpenGL ES Support

Page 24: Developing the Next Generation Embedded HMIs

Connected Smart Phone with CCC

IVI

Stack Entertainment

Mobile Office

Networking

Navigation

■ Benefits:

— In-Car Internet

— In-Car Android App Access

— Technology Refresh solved

■ CCC connection via USB, WiFi

■ Android Phones now

— Galaxy III

— Nokia

■ Apple iOS also needed

Telephony

Cloud

Speech Engine

Audio

Page 25: Developing the Next Generation Embedded HMIs

Android Guest OS via Hypervisor

HyperVisor

SoC

IVI

Stack Entertainment

Mobile Office

Networking

Navigation

Hypervisor Partner

ARM Multi-core CPU

GPU, Peripherals

Android OS

Android

Apps.

Linux OS

25

Common HMI

Graphics Layer Management

Page 26: Developing the Next Generation Embedded HMIs

Linux Container (LXC) Android Solution

Hardware Layer

Common HMI

IVI Stack Entertainment

Mobile Office

Networking

Navigation

Multi-Core CPU GPU

Android OS

Android Apps

Mentor IVI Linux OS / LXC Resource Management

Linux Container

Graphics Layer Management

Page 27: Developing the Next Generation Embedded HMIs

Mentor advantages …

• We Understand HMI

• We know how to build complex, performant HMI’s, implementing Graphics Layer

Manager technology, with multiple video sources, (Qt, HTML5, Ifx etc).

• Complete Solution Stack

• We have the relationships and expertise from HMI down to hardware platforms.

Tools, Product IP, OSS, Services

• Safe Choice

• Mentor Graphics is a global > $1bn company, able to manage the risk and

commit to on-time, on-budget deliveries

• Embedded OS

• We have a GENIVI compliant Linux, Nucleus RTOS, Android and Automotive

Autosar solutions

• Design Environment

• Market-leading design capture and debug with Codebench , MESA, Probes

• BSP

• Close relationships with SoC vendors, BSP hardening

Page 28: Developing the Next Generation Embedded HMIs

Integrated IVI Solutions from Mentor

GENIVI LINUX HTML5 & Qt

Open Source

Software

Mentor Software

Mentor Services

SoC

Platforms

3rd-party software

IVI

Page 29: Developing the Next Generation Embedded HMIs

mentor.com/embedded

Thank you!

Questions?

For more information, please contact:

[email protected]