87
NXP and the NXP logo are trademarks of NXP B.V. All other product or service names are the property of their respective owners. © 2017 NXP B.V. PUBLIC MANAGER, AMERICAS PROFESSIONAL ENGINEERING SERVICES DENNIS THOMPSON i.MX 8 SOFTWARE IP DESIGNED TO ACCELERATE OUR CUSTOMER’S DESIGNS AMF-AUT-T2782 | AUGUST 2017

i.MX 8 SOFTWARE IP DESIGNED TO ACCELERATE

  • Upload
    others

  • View
    4

  • Download
    0

Embed Size (px)

Citation preview

Page 1: i.MX 8 SOFTWARE IP DESIGNED TO ACCELERATE

NXP and the NXP logo are trademarks of NXP B.V. All other product or service names are the property

of their respective owners. © 2017 NXP B.V.

PUBLIC

MANAGER, AMERICAS PROFESSIONAL ENGINEERING SERVICES

DENNIS THOMPSON

i.MX 8 SOFTWARE IP

DESIGNED TO ACCELERATE

OUR CUSTOMER’S DESIGNS

AMF-AUT-T2782 | AUGUST 2017

Page 2: i.MX 8 SOFTWARE IP DESIGNED TO ACCELERATE

PUBLIC 1

AGENDA• Introduction and Strategy

• Graphic Optimizations

• TRLE

• FastBoot / HAB

• AUTOSAR MCAL for i.MX

• Trusted Execution Environment (TEE)

• Audio Video Bridging (AVB)

• Miracast

• Apple CarPlay

• Android Auto

• Rear View Camera (RVC)

• IVI GENIVI Platform

• Support and Engineering Services

• Business Models

• Case Histories

Page 3: i.MX 8 SOFTWARE IP DESIGNED TO ACCELERATE

PUBLIC 2

Developing Innovative Software

Products and Solutions Enhancing the

Hardware IP

Accelerate our customers' time to market and

reduce project risk by:

Providing Knowledge and Value through

Professional Support and Services

Delivering Comprehensive Seamless

Building Components with Ease of Use to

Jump Start Projects

Embedded Processing

Solutions

Microcontroller Software, Support & Services Strategy

Page 4: i.MX 8 SOFTWARE IP DESIGNED TO ACCELERATE

PUBLIC 3

Software IP (integrated)IVI Platform,CarPlay, Android Auto, AVB, Miracast, HDCP,

TRLE, TEE, Home Kit, Autosar MCAL, Graphic Tools,

Complimentary SupportCommunities

Technical Information Center

Distributor Apps Engineers

Field Application Engineers

Complimentary Software & ToolsKinetis Design Studio, THREAD, BLE, RTOS, Linux & Android BSP

Professional SupportRisk Reduction

Hot Fixes

Professional ServicesManaging Skills Gaps & Engineering Capacity

Global Staffing Capability

Vested Interest in Mutual Success

Hardware SupportSchematics & Layout Review

Embedded Processing

Solutions

Software, Professional Support & Services

Page 5: i.MX 8 SOFTWARE IP DESIGNED TO ACCELERATE

PUBLIC 4

Graphic Optimizations & Packages

01.

Page 6: i.MX 8 SOFTWARE IP DESIGNED TO ACCELERATE

PUBLIC 5

i.MX Production Graphics Service Package

Service Package for Linux or Green Hills Integrity

• Enables production quality version of graphics stack for i.MX 6

• Staffed with experts on i.MX 6 GPUs and graphics

Services Provided

• Test application exercises graphics stack to customer specific requirements

• Injects CAN use cases into the test application to stress test the stack

• Runs selected Kronos API unit tests

Page 7: i.MX 8 SOFTWARE IP DESIGNED TO ACCELERATE

PUBLIC 6

Heads Up Display Warping Algorithms

• Distortion correction software system transparently cancels

deformations from physical parts

− Lenses, mirrors, windshield

• Easily integrated in to industry standard OpenGL SW

application

Page 8: i.MX 8 SOFTWARE IP DESIGNED TO ACCELERATE

PUBLIC 7

Tessellation Run Length Encoding (TRLE)

Image Compression

02.

Page 9: i.MX 8 SOFTWARE IP DESIGNED TO ACCELERATE

PUBLIC 8

• tes·sel·la·tion (tesəˈlāSH(ə)n/)

1. an arrangement of shapes closely fitted together, particularly of polygons, in a

repeated pattern without gaps or overlapping.

Tessellation Run Length Encoding (TRLE): Defined

Page 10: i.MX 8 SOFTWARE IP DESIGNED TO ACCELERATE

PUBLIC 9

Tessellation Run Length Encoding (TRLE) Image Compression

• NXP patent pending technology

• Utilizes geometrical tessellation image compression

• Leverages 3D graphics engines

• Optimized for i.MX applications processors

• Target graphics intensive interfaces. EX: auto instrument clusters

Input

Image Output

Page 11: i.MX 8 SOFTWARE IP DESIGNED TO ACCELERATE

PUBLIC 10

Benefits of NXP TRLE Compression Technology

Pixel accurate 2D compression perfect for

computer generated graphics

Up to 9x compression of textures for lower storage

costs

Smaller overall RAM size and bandwidth

requirements for lower system costs

Leverages 3D GPU hardware for faster, smoother rendering

Page 12: i.MX 8 SOFTWARE IP DESIGNED TO ACCELERATE

PUBLIC 11

Fast & High Assurance Boot (HAB)

03.

Page 13: i.MX 8 SOFTWARE IP DESIGNED TO ACCELERATE

PUBLIC 12

Automotive Fast Boot Linux Scenarios

• Full Graphics Instrument Cluster

− Cold start to needles within 900ms

− High Assurance Boot to authenticate the booted image

• Fast CAN response

− Receive and store CAN messages in ~50ms from a cold start

− A Fast Boot solution on i.MX allows eliminating the CAN management microcontroller

• Rearview camera

− Cold start to camera image in less than 1s

Page 14: i.MX 8 SOFTWARE IP DESIGNED TO ACCELERATE

PUBLIC 13

Fast Boot Typical Approach

• Specific to customer requirements and hardware

− Boot Flow Analysis:

Power sequencing (can be optimized, but fixed time for power up)

ROM Code (fixed time)

Preloader (NXP IP optimization)

U-boot (can be optimized)

Authentication (varies based on size of encrypted images)

Kernel boot (can be optimized)

− U-Boot and Kernel Optimizations:

Memory initialization

Upgrades to the eMMC and NAND drivers

Remove or delay startup services and driver unit not required during boot

Load drivers as modules in specific order

Fine tune the file system for performance

Page 15: i.MX 8 SOFTWARE IP DESIGNED TO ACCELERATE

PUBLIC 14

Fast Boot is Customer Specific Engagement

• No off-the-shelf “Fast Boot solution” or number

• Dependent on boot memories, power sequencing, image sizes, etc.

− NOR is generally faster

− eMMC can vary significantly

− i.MX device CPU speed

• Definition of “booted” varies based on application

• Authentication takes time!

Page 16: i.MX 8 SOFTWARE IP DESIGNED TO ACCELERATE

PUBLIC 15

AUTOSAR MCAL for i.MX

04.

Page 17: i.MX 8 SOFTWARE IP DESIGNED TO ACCELERATE

PUBLIC 16

i.MX AUTOSAR MCAL

Page 18: i.MX 8 SOFTWARE IP DESIGNED TO ACCELERATE

PUBLIC 17

• AUTOSAR ASR 4.0 MCAL: Tested Running from RAM using NXP EVB

• EB tresos StudioTM Configuration Tool and Plugins are a part of the software

• Components configurable in any AUTOSAR-Compliant Configuration Tool

i.MX AUTOSAR MCAL Software

Page 19: i.MX 8 SOFTWARE IP DESIGNED TO ACCELERATE

PUBLIC 18

i.MX MCAL Complex Drivers/Services

Page 20: i.MX 8 SOFTWARE IP DESIGNED TO ACCELERATE

PUBLIC 19

Software Lifecycle Methodologies & Quality: Engineering

Discipline

Page 21: i.MX 8 SOFTWARE IP DESIGNED TO ACCELERATE

PUBLIC 20

Trusted Execution Environment (TEE)

05.

Page 22: i.MX 8 SOFTWARE IP DESIGNED TO ACCELERATE

PUBLIC 21

Trusted Execution Environment (TEE)

Definition

• Provide safe environment for developing and executing secure applications

• GlobalPlatform Association Specifications (www.globalplatform.org)

Advantages

• TEE provides protection against attacks from the rich OS

• Easy to Audit small footprint

• Execute only trusted/authorized software

• Sensitive data are protected from the rest of the application processor software and outside world

Page 23: i.MX 8 SOFTWARE IP DESIGNED TO ACCELERATE

PUBLIC 22

ARM TrustZone

TEE Relies on ARM TrustZone Technology

• Provides hardware isolation

• Each physical processor core provides 2 virtualcores

− Secure World

− Normal World

• New Monitor mode:

− Mechanism to switch between the 2 worlds

− Gatekeeper for secure World

− Entered via new SMC instruction or via exceptions

• CPU state is carried out to the AXI bus

− AxProt [1] 0= Secure , 1= Non-secure

− Allows implementation of secure-aware memory and peripherals

Security

Kernel

Rich

OS

Normal

Mon

itor

Security

Services

Normal World Secure World

User Mode

Privileged

User Mode

Privileged

Applications

MonitorMode ModeMode

NormalMemory &

Peripherals

SecureMemory &Peripherals

Page 24: i.MX 8 SOFTWARE IP DESIGNED TO ACCELERATE

PUBLIC 23

Client

Applications(using secure

services)

Client

Applications(using secure

services)

TEE Software Stack

Trusted OS BSP

Secure Applications

Rich OS

Trusted

Applications

BSP support

Processor

Secure Timer Secure RAM

Crypto

EnginesDrivers….

Trusted OS

Crypto

operationData storage

Task

dispatcher

GlobalPlatform Internal API

OTP

Crypto service

Key derivation

DRM service

HDCP

DTCP-IP …

Monitor

BSP support

Rich OS

Trustzone Library

GlobalPlatform Client API

Trustzone

Driver

Client

Applications(using secure

services)

Rich OS Libraries

Rich OS Applications

TEE Stack

Normal World Secure World

Binaries

Sources

Page 25: i.MX 8 SOFTWARE IP DESIGNED TO ACCELERATE

PUBLIC 24

NXP TEE Software Stack

Multi-platform

• Runs on complete NXP SoC family: i.MX 6, i.MX 7, i.MX 8 (roadmap)

• SoC agnostic: supported on ARM cores with TrustZone capability

Integrated with Yocto i.MX Linux BSP

• Linux running in non secure mode, TEE in secure mode

• Integration with secure/non-secure modes (boot, power management)

• TEE stack delivered as binary and secure applications as sources

Integrated with i.MX Security Features

• TZ, HAB, CSU, TZASC, CAAM, SNVS Tamper… are integrated with TEE

Based on GlobalPlatform Association Specifications

• Standard API open to customer or 3rd party to develop Secure Applications

Professional Services

• Available for customization and Secure Application development

Page 26: i.MX 8 SOFTWARE IP DESIGNED TO ACCELERATE

PUBLIC 25

TEE & High Assurance Boot (HAB)

• TEE firmware is located in the boot

partition along with the kernel image

and the device tree

• U-boot, linux and TEE are signed

• HAB infrastructure used for u-boot,

Linux and TEE firmware

authentication

U-Booti.MX6 Boot

ROM

Reset

HAB Library

Boot Device Driver

CSF

TEE

Firmware

Linux,

dtb, TEE

CSF

Linux OS

Normal World Secure World

Trusted OS

U-boot

Page 27: i.MX 8 SOFTWARE IP DESIGNED TO ACCELERATE

PUBLIC 26

Audio Video Bridging (AVB)

06.

Page 28: i.MX 8 SOFTWARE IP DESIGNED TO ACCELERATE

PUBLIC 27

Audio Video Bridging (AVB)

• High quality transport services over Ethernet to time sensitive streams: audio/video

− Guaranteed and short latency

− Guaranteed network resources (bandwidth, queuing)

− Time synchronization

• Replaces complex and costly wiring with a single technology

− Ethernet is commonly deployed

− Co-exists with legacy IP data traffic

• Defined by IEEE standards on existing OSI layer 2 standards (802.1)

− IEEE 1722, 1722.1

− 802.1AS, 802.1Qav, 802.1Qat

− Media Clock Synchronization

Page 29: i.MX 8 SOFTWARE IP DESIGNED TO ACCELERATE

PUBLIC 28

AVB Stack Diagram

All AVB components defined by IEEE

Scalable as per AVnu profiles (Automotive, ProAudio)

Available for Endpoint and/or Bridge nodes

OS Abstract: Linux as reference, portable to other RT OSs

HW Abstract: to run on NXP MPU/MCU platform families: i.MX, Kinetis

Control application

IEEE 1722

AVTP

Media

IEEE802.1Qat

SRP

Bandwidth

Reservation

Ethernet IEEE 802.3 MAC

IEEE802.1Qav FQTSS

Queuing & Shaping

IEEE 1722

MAAP

IEEE 1722.1

AVDECC

AVB Management

& Control

IEEE 802.1AS

gPTP

Timing &

SynchronizationTCP/IP

stack

Streamer

DMA I/O

Audio/Video

Driver

Control API

Media API

Operating

System Media

Clock

Recovery

Licensed components

IEEE 1722 AVTP Control

OS

Ab

str

act

HW

Ab

str

act

Media Application Support

AVB API customized Media Applications

Demo integration with ALSA & gstreamer, implementing

Media Server, Audio Amplifier, Video Player…

Page 30: i.MX 8 SOFTWARE IP DESIGNED TO ACCELERATE

PUBLIC 29

Host Controller Software Block Diagram (i.MX6/SJA1105/Linux)

TJA1100

Multi-PHY Driver

AVB Platform Abstraction Layer

AVB Switch StackAVB Endpoint Stack

Ethernet Driver

AVB Driver

1722

AVTP,

MAAP

ENET MAC

A/V Media Stack Application

SRP gPTPAVDECC

API

MCR

Regular

TCP/IP

Network Stack

Other

processes

Bridge Protocols

(gPTP, SRP)

SJA1105 SPI

Driver

Bridge

Control & Diagnostics

(QoS)

Switch SJA1105

Port 4

Port 0 Port 1 Port 2 Port 3

SM

I

xM

II

SJA/TJA HAL & LL

SP

I

Page 31: i.MX 8 SOFTWARE IP DESIGNED TO ACCELERATE

PUBLIC 30

Head Unit Media Serveri.MX 6Quad / Linux

Ethernet IEEE 100Base-T1

- Movie: AVTP IEC 61883-4 (MPEG2-TS AAC / H.264)

- Camera: AVTP Compressed Video (MJPEG)

- SR Class A (2 ms AVB latency)

- gPTP Time Synchronization, Media Clock Recovery

- SRP Stream Reservation, AVDECC Talker, Listener, Control

SD Flash

Rear Seat Entertainmenti.MX 6Quad / Linux

Rear View CameraQoriva MPC5604

Instrument Clusteri.MX 6Quad / Linux

AVB Audio/Video Proof of Concept on NXP Platforms

Ethernet AVB SwitchSJA1105T / TJA1100

Page 32: i.MX 8 SOFTWARE IP DESIGNED TO ACCELERATE

PUBLIC 31

Miracast (Wi-Fi Display)

07.

Page 33: i.MX 8 SOFTWARE IP DESIGNED TO ACCELERATE

PUBLIC 32

What is Miracast?

• Standard for wireless peer-to-peer screen casting/mirroring

− Follows Wi-Fi Direct (WFD) specification v1.1

− Certified by the Wi-Fi alliance

− Wireless replacement of HDMI/MHL

• Built on existing standards

− H.264 (MPEG-4 AVC) video compression

− Wi-Fi Direct / Wi-Fi P2P

− AAC ( Advanced Audio Coding) audio compression

− LPCM lossless audio

• NOT DLNA or ChromeCast

• NOT supported by iOS (requires CarPlay)

Page 34: i.MX 8 SOFTWARE IP DESIGNED TO ACCELERATE

PUBLIC 33

Example Markets and Applications for Miracast

• Consumer Audio/Video

• Auto Infotainment

• Electronic Signage and Displays

• Entertainment Displays

Page 35: i.MX 8 SOFTWARE IP DESIGNED TO ACCELERATE

PUBLIC 34

Miracast Media Stream Principles

NXP Miracast Sink

Stack for i.MX

Page 36: i.MX 8 SOFTWARE IP DESIGNED TO ACCELERATE

PUBLIC 35

NXP Enhanced Features

• Optional content protection with HDCP 2.x

• Multi-display and multi-connection

− One or more sources

− One or more displays

− Ability to choose one or more sources to one or more displays

• GStreamer dynamic latency

− Optimized GStreamer plugins and dynamic latency feature to reduce source/sink latency

• Optional UIBC (User Interface Back Channel) Join Feature

− Multiple displays can join a session, drop off, and rejoin

Page 37: i.MX 8 SOFTWARE IP DESIGNED TO ACCELERATE

PUBLIC 36

NXP Linux Miracast Sink: Multi-Source/Display

Multiple sources can be connected to the i.MX sink and content may be cast to

multiple displays

User selects source screen/display through the UI buttons

Page 38: i.MX 8 SOFTWARE IP DESIGNED TO ACCELERATE

PUBLIC 37

Miracast Source Devices Tested

• Sony Xperia Z3 - Android 6.0.1

• Sony Xperia Z4 - Android 6.0.1

• Sony Xperia Z5 - Android 6.0.1

• Sony Xperia Z1 - Android 4.3 / 5.1.1

• Sony Xperia Z2 - Android 4.4 / 5.1.1

• Sony Xperia T - Android 4.3

• Samsung S3 - Android 4.3 / 5.1.1

• Samsung S4 - Android 4.4.2 / 5.0.1

• Samsung S5 - Android 5.1.1 / 6.0.1

• Samsung S6 - Android 5.1.1 / 6.0.1

• Samsung Galaxy TabS - Android 4.4.2 / 6.0.1

• Motorola X - Android 4.4.4

• Microsoft Surface Pro 3 - Windows 10

• Microsoft Surface Pro 4 - Windows 10

• Microsoft Surface - Windows 8.1

• HTC one M8: Android 4.4.4

• HTC 10 - Android 6.0.1

• Nexus 4 - Android 4.4.4

• Nexus 5 - Android 4.4.4 / 5.1.1

• Nexus 7 - Android 4.4.4 / 5.1.1 / 6.0.1

• Kindle fire HDX - Fire OS 4.5.5.2

• Archos Helium - Android 4.3

• Asus PC - Windows 8.1

• Nokia Lumia D630 - Windows 8.1

• Huawei P8 - Android 5.1.1

Page 39: i.MX 8 SOFTWARE IP DESIGNED TO ACCELERATE

PUBLIC 38

Linux Miracast Certification

• Linux Miracast stack (v2.19) is pre-certified

− Wi-Fi CERTIFIED™ Miracast® Interoperability Test Plan v 1.7

− AT4Wireless Test Lab (Nov 2016)

− Manual testing required

CAPI automated testing is not implemented in the stack.

− Atheros-Qualcomm chipset and standard drivers used

Basic Miracast operation and demo is operational for Murata/Cypress chipset

• Customer Final Product Requirements

− Final product will require Miracast certification

− Additional Wi-Fi Certification prerequisites for Miracast not pre-tested with NXP Miracast stack

Page 40: i.MX 8 SOFTWARE IP DESIGNED TO ACCELERATE

PUBLIC 39

Apple CarPlay

08.

Page 41: i.MX 8 SOFTWARE IP DESIGNED TO ACCELERATE

PUBLIC 40

DISCLAIMER

All software, document and discussion of MFi technology is

restricted to MFi licensees and subject to the MFi license terms and

conditions

Demos require SABRE AI or i.MX7 board with MFi Auth Device and

cannot be left with customer unless they are approved licensee.

Provide customer MFi licensee number to Rudan Bettelheim for

approval to discuss and share info with customers.

Page 42: i.MX 8 SOFTWARE IP DESIGNED TO ACCELERATE

PUBLIC 41

What is Apple CarPlay?

• User Interface optimized for the Driver

− Uses car’s built-in display

− Large user interface icons

− Simplified apps

− Voice activation with Siri

• Limited functionality appropriate for a Driver

− Navigation, hands-free phone, audio playback, hands-free messaging

− Restricts video playback, keypad usage, social media apps, web browsing

Page 43: i.MX 8 SOFTWARE IP DESIGNED TO ACCELERATE

PUBLIC 42

NXP Software for Apple CarPlay

• Functions

− Supports up to 1080P 60 FPS resolution

− Voice input for Siri and phone calls

− Manage USB and Wi-Fi connection

− Provide user input from touch screen to iPhone

− Manage audio streams, instructions & calls from iPhone

− Audio entertainment from iPhone, radio tuner or other sources

• NXP target processors

− i.MX 6 product line (requires VPU)

− i.MX 8 product line

Page 44: i.MX 8 SOFTWARE IP DESIGNED TO ACCELERATE

PUBLIC 43

i.MX6

LVDS or HDMI

HS USB

Audio

Codec

Power

Amp

Power ManagementiPhone charging

System power

Siri

Volume

Optional

Radio Tuner

I2S

I/O

I/O or A/D

I2C/I2S

I2C

i.MX6 SABRE for Automotive

USB/I2C

NXP System Block Diagram for Apple CarPlay

Page 45: i.MX 8 SOFTWARE IP DESIGNED TO ACCELERATE

PUBLIC 44

NXP LINUX SDK for Apple CarPlay

• i.MX CarPlay API library provides APIs to present and interact with the digital

contents streamed from the Apple device

• i.MX MFi device library provides APIs to detect, identify and authenticate a

connected Apple device

• i.MX MFi library provides private iAP2 functions to allow identification and

authentication of Apple device

• Apple CarPlay Communications Plugin (Apple proprietary) provide functions to

transport digital content over an NCM interface with an Apple device

• Bonjour Service (Apple open source) implements a zero configuration network

service that allows the Apple CarPlay communications Plug-in to “discover” the

Apple device connected to the accessory

• Provided as a Yocto layer for NXP Linux BSPs

Page 46: i.MX 8 SOFTWARE IP DESIGNED TO ACCELERATE

PUBLIC 45

Android Auto

09.

Page 47: i.MX 8 SOFTWARE IP DESIGNED TO ACCELERATE

PUBLIC 46

What is Android Auto?

• Smartphone projection standard developed by

Google

−Android Auto Projection (AAP)

• Enables mobile devices running Android OS

• Operate Android device through dashboard’s head

unit

• Designed with safety in mind

−Simple, intuitive interface

−Voice actions

−Focus on driving

Page 48: i.MX 8 SOFTWARE IP DESIGNED TO ACCELERATE

PUBLIC 47

NXP Software for Android Auto

• Functions

− Supports up to 1080P 60 FPS resolution

− Voice input for Google Now and phone calls

− User input from touch screen to Android device

− Manage audio streams, instructions and calls from phone

− Audio entertainment from Android phone, radio tuner or other sources

− GPS and vehicle movement data sharing between phone and vehicle (for OEM radios)

• NXP target processors

− i.MX 6 product line (requires VPU)

− i.MX 8 product line

Page 49: i.MX 8 SOFTWARE IP DESIGNED TO ACCELERATE

PUBLIC 48

Android Auto System

i.MX6

HS USB

Audio

Codec

Power

Amp

Power ManagementPhone charging

System power

Volume

Bluetooth

I2S

I/O

I/O or A/D

I2C/I2S

i.MX6 SABRE for Automotive

LVDS or HDMIUSB/SPI

Bluetooth

UART

Note: Android Auto requires Bluetooth

for hands-free phone operation to be

handled outside the Android Auto stack.

OK Google

Page 50: i.MX 8 SOFTWARE IP DESIGNED TO ACCELERATE

PUBLIC 49

SafeAssure Rear View Camera (RVC)

10.

Page 51: i.MX 8 SOFTWARE IP DESIGNED TO ACCELERATE

PUBLIC 50

RVC (Rearview Camera) Market and Legal Requirements

• National Highway Traffic Safety Administration (NHTSA), May 2018

• All vehicles under 10,000 lbs. will include a backup camera

• Display 10 x 20 foot zone behind the vehicle

• Image must display within 2.0 seconds when vehicle is in reverse

• Camera robustness and determinism ensures images are accurate, timely and not

frozen

• Safeguard video stream

Page 52: i.MX 8 SOFTWARE IP DESIGNED TO ACCELERATE

PUBLIC 51

SafeAssure Rear View Camera (RVC) Solution

• Solution Goal:

− Robust RVC Software Solution removing need for external video analysis IC

− Competitive solution can be built rapidly and maintained easily by i.MX8 customers

− Offer out-of-the-box SW Components that utilizes the i.MX 8 M4 core

• Safety Components

− Mcore Low-Level drivers, Mcore executable functionality- Application, Mcore Rendering Library

− Video Analysis Monitoring

− Watchdog timers

− DPU Remote Procedure Call (RPC)

− Debugging and Diagnostic Application

− I2C Remote Procedure Call (RPC)

Page 53: i.MX 8 SOFTWARE IP DESIGNED TO ACCELERATE

PUBLIC 52

Production Quality Software Package (ASIL-A)

• License SafeAssure RVC solution on i.MX 8 family and provide integration services

• Implemented in hardware/software safety partition assures camera image displays in various error conditions

• Includes imaging, display, composition, interrupt control using Cortex-M4 w/ RTOS for performance, standardization and safety

SafeAssure

RVC Camera

ASIL -A

• FMEDA

• SafeAssure

Camera Safety

Manual

• Code & Supporting

Documentation

Complete

Documentation

Package

Page 54: i.MX 8 SOFTWARE IP DESIGNED TO ACCELERATE

PUBLIC 53

High Level Data Flow

• M4 displays RVC overlay image

• A35 displays base image

• Image is still displayed even if there is an issue with the A35

M4

Display

Camera

A35

Page 55: i.MX 8 SOFTWARE IP DESIGNED TO ACCELERATE

PUBLIC 54

SafeAssure RVC Architecture

i.MX8 Fast Camera Path:

Boot Time Setup (≤ 1 sec.)

Fast Boot Initialization (Using M4):

Initialize Camera

Initialize Image Capture

Initialize Display Output

Camera Flow to Display:

1) Imaging Subsystem reads and writes

camera frame to memory

2) Image Subsystem provides interrupt for

frame complete

3) Update Shadow Register for new address

pointer to Display Controller

4) Upon Display Frame Complete, increment

address pointer to Shadow Register

5) Mark imaging source frame complete

M4

Image

Capture

Block

Image

Display

Controller

In case of error, secondary

source frame error message

is displayed instead of camera

image

Page 56: i.MX 8 SOFTWARE IP DESIGNED TO ACCELERATE

PUBLIC 55

IVI GENIVI Platform

11.

Page 57: i.MX 8 SOFTWARE IP DESIGNED TO ACCELERATE

PUBLIC 56

IVI Market

• Increased Complexity in IVI market

• TTM decreased from 5 to 2-3 years

• Tier 1s are moving to:

− Open system model (user can install apps)

− Standard interfaces/open source

− Complete ownership of the SW stack

• Technologies and features coming from CE world

• Increasing reliance on 3rd party middleware and

platform reuse

NXP is ideally positioned to offer a significant part of the SW stack used in a typical IVI product.

Page 58: i.MX 8 SOFTWARE IP DESIGNED TO ACCELERATE

PUBLIC 57

NXP IVI Solution

• Modular Approach

− SW Components Strongly Tied to HW IP

− Performance Optimization

• Eliminating Costly/Complex Tier 1 Development

Effort

• Helping Customers Differentiate Where it

Matters:

− Customizable Production Grade, Feature Rich SW

Stack

− Maintained on the Customer Specific HW

Page 59: i.MX 8 SOFTWARE IP DESIGNED TO ACCELERATE

PUBLIC 58

IVI Platform Components

Hardware

USB

DrvWiFi

DrvEth Drv

TCP/IP

AVBiAP2

BT Drv

BlueZ

Connectivity

QT

Kernel

Audio

Drv

ALSA

VPU Drv

GStreame

r

Media

V4L

Screen Replication

CarPlay Android Auto

Miracast SDL

NAND

Drv

File systems

Storage

eMMC

Drv

CAAM Drv

Open

SSL

Security – open partition

HAB

Secur

e FS

Inter

Domain

Service

s

Trusted Kernel

Trusted Execution

Environment

Security – trusted partition

Genivi Framework

GPU

core

DRV

OpenGL

Weston/

Wayland

tools

GPU

Ftrace

perf

valgrind

gdbSer

v

Debug&

Profile tools

Toolchain

XYZ NXP Linux BSP

XYZ NXP Software IP

XYZ 3rd Party IP

Early

VideoRVC

360

VIEW

Audio

Radio

Page 60: i.MX 8 SOFTWARE IP DESIGNED TO ACCELERATE

PUBLIC 59

IVI Platform – Proof of Concept Architecture

System architecture for Distributed IVI Platform – CES2017

Page 61: i.MX 8 SOFTWARE IP DESIGNED TO ACCELERATE

PUBLIC 60

Support and Engineering Services

12.

Page 62: i.MX 8 SOFTWARE IP DESIGNED TO ACCELERATE

PUBLIC 61

NXP Professional Support

Learn more at: www.NXP.com/prosupport

Private and timely responses to accelerate your time to market

Accelerating Time to Market• Direct access to Expert Knowledge

• Managed, Secure, Confidential portal

• Hot Fixes: Direct resolution

Supported Platforms• Android

• Linux

• MQX

• FreeRTOS

Annual Subscriptions• 50 / 100 / 200 hour options

Benefits of Professional Support• Accelerates design win and reduces project risk

• Bridges the Gap between Standard Enablement and

Customer Specific Needs

• Kinetis

• LPC

• i.MX

• SCM

Customer is Executing the Project Internally or w/ 3rd Party

Page 63: i.MX 8 SOFTWARE IP DESIGNED TO ACCELERATE

PUBLIC 62

Pri

ma

ry F

oc

us

Are

ai.MX LPC

Hardware Services

Software Services

Linux®, Android™, MQX, Stacks, Graphics,

Audio/Video, Middleware, Drivers, AUTOSAR,

Modeling & Automatic Code Generation

- Customization

- Integration

- Development

- Porting

- Testing

- Optimization

- Issue Analysis, Debug & Fix

Application Migration

Frozen Branch Support

Schematic & Layout Review

On-site Board Bring-up

Kinetis

Service Team Executes the Project Per Customer’s Requirements on Statement of Work, Milestone Based Delivery Model

OS Kernel

NXP BSP

Drivers

UI & Applications

Middleware

Platform Provider, with Reach to the Middleware and Graphics Layers

Professional Services Technical Competency

Page 64: i.MX 8 SOFTWARE IP DESIGNED TO ACCELERATE

PUBLIC 63

Business Models

13.

Page 65: i.MX 8 SOFTWARE IP DESIGNED TO ACCELERATE

PUBLIC 64

Licensing Options

License Description Support Upgrade options

Evaluation License Binary version of the product, on NXP reference HW only.

Limited time, evaluation purposes only.

Limited to the replication of the

evaluation setup.

To any other license.

Development License(50 Hrs. or 6 Months)

Provides all necessary elements to start developing, on any supported

NXP silicon and OS. Limited deployment – not suitable for production.

50 Hrs. Support or 6 Mths. Support To any production license.

Project License One NXP Target Product only for one Customer Target Project. One

OS.

1 year support included, 20% of the

license price year 2 and beyond.

To any higher priced production

license. Additional OS/SoC at a

discount.

Product Line License One NXP Target Product only for one Customer Product Line

(Clusters), One OS

1 year support included, 20% of the

license price year 2 and beyond.

To any higher priced production

license. Additional OS/SoC at a

discount.

Family Multi-Project

License

One NXP Target Product Family, (ex. i.MX6 Family, i.MX8 Family, etc.), only

for Customer Target Project or Customer Product Line, no restrictions.

One OS

1 year support included, 20% of the

license price year 2 and beyond.

Additional OS/SoC at a discount.

Page 66: i.MX 8 SOFTWARE IP DESIGNED TO ACCELERATE

PUBLIC 65

Software, Support & Services Focused on Delivering Valuable

Solutions to our Customers & Accelerating Time to Market

Bridging the Gap between Standard Enablement and Customer

Specific Needs

Support Options from Knowledgeable Engineers

Engineering Services Deep Experience and History of Success

NXP has a Vested Interest in our Customer’s Overall Success

Microcontroller Support & Services Summary

Page 67: i.MX 8 SOFTWARE IP DESIGNED TO ACCELERATE

PUBLIC 66

Case Histories

14.

Page 68: i.MX 8 SOFTWARE IP DESIGNED TO ACCELERATE

PUBLIC 67

Solution

i.MX6DualPlus

+

Linux BSP

+

Professional Services

Tier 1 Instrument Cluster

Page 69: i.MX 8 SOFTWARE IP DESIGNED TO ACCELERATE

PUBLIC 68

Tier 1 IVI Proof of Concept

Solution

i.MX8DV

+

Demo

+

Professional Services

and Consulting

Page 70: i.MX 8 SOFTWARE IP DESIGNED TO ACCELERATE

PUBLIC 69

Solution

i.MX6D

+

Linux BSP

+

Professional Services

Aeronautics GIS Payload

Page 71: i.MX 8 SOFTWARE IP DESIGNED TO ACCELERATE

PUBLIC 70

Solution

KV31

+

KSDK Porting

+

Motor Control Library

https://youtu.be/NmS0N1b8qW4

Medical Heart Pump

Page 72: i.MX 8 SOFTWARE IP DESIGNED TO ACCELERATE

PUBLIC 71

Solution

Kinetis K31

+

Kinetis K65

+

KSDK

+

KMS GUI

+

FreeRTOS

+

Custom Drivers

Medical SprayView

Page 73: i.MX 8 SOFTWARE IP DESIGNED TO ACCELERATE

PUBLIC 72

Tier 1 IVI Platform

• i.MX6 IVI platform with CarPlay

• Short Schedule: June 2016 kick-off, SOP July 2017

• NXP Solution and Services Critical to Silicon Decision

• Complete Linux BSP, plus Software for Key Performance Domains: Audio, Video, GPU,

Fast Boot, NVM

Page 74: i.MX 8 SOFTWARE IP DESIGNED TO ACCELERATE

PUBLIC 73

Tier Backup Camera

Solution

i.MX 6DualLite

+

Autosar MCALs

+

Integration

Consulting

Page 75: i.MX 8 SOFTWARE IP DESIGNED TO ACCELERATE

PUBLIC 74

Solution

i.MX6 D

+

Linux 3.10.53 BSP

+

Miracast Sink

+

HDCP 2.2

+

MSFT PlayReady

+

Professional Services

Major Consumer Electronics Micro Projector

Page 76: i.MX 8 SOFTWARE IP DESIGNED TO ACCELERATE

PUBLIC 75

Solution

i.MX6 D

+

Linux 3.14.28 BSP

+

MQX 4.2.0 BSP with

OpenAmp

+

V2X & V2Store

+

Professional

Services

Dispenser Manufacturing Fuel Dispenser

(Gas Pump)

Page 77: i.MX 8 SOFTWARE IP DESIGNED TO ACCELERATE

PUBLIC 76

Solution

WTC100XA

+

bare metal

+

Professional

Services

Tier 1 Wireless Charging

Page 78: i.MX 8 SOFTWARE IP DESIGNED TO ACCELERATE

PUBLIC 77

Major Consumer Electronics Ethernet AVB Audio

Equipment• High-end consumer in-home media and

automation

• AVB stack solution with multiple audio

streams

• Engagement:

− AVB stack integration

− Application optimization

• Next:

− Moving to i.MX 7

− Integrating the NXP AVB switch with switch

stackSAVANT PRO AUDIO 4

Page 79: i.MX 8 SOFTWARE IP DESIGNED TO ACCELERATE

PUBLIC 78

Tier 1 AVM Platform

Function Required

Time (sec)

Measure Time (sec)

i.MX6 D

3.0.0 + Audio Patch

Splash screen 0.5 0.266

Park assist

Camera Video

1.5 1.39

Park assist

Camera Audio

1.5 1.41

Splash Video 2.0 1.6

Park assist HMI 4.6 2.8

Solution

i.MX6 D

i.MX6 DL

+

Linux 3.14.28 BSP

+

Fast Boot/HAB

+

Professional

Services

Page 80: i.MX 8 SOFTWARE IP DESIGNED TO ACCELERATE

PUBLIC 79

Tier 1 IVI Platform

Solution

i.MX6 Q

+

Linux 3.14.28 BSP

+

Professional

Services

Page 81: i.MX 8 SOFTWARE IP DESIGNED TO ACCELERATE

NXP and the NXP logo are trademarks of NXP B.V. All other product or service names are the property of their respective owners. © 2017 NXP B.V.

Page 82: i.MX 8 SOFTWARE IP DESIGNED TO ACCELERATE

PUBLIC 81

V2X with TEE to Protect Message Authentication

Trusted OS BSP

Secure V2X Applications (not included in TEE product, added by customers)

Current Software offering

BSP support

Processor

Secure Clock Secure RAM

CAAM

Trusted OS

Cryptography Data storage

GlobalPlatform Internal API

OCOTP

Monitor

BSP support

Linux OS

Trustzone Library

GlobalPlatform Client API

Trustzone Driver

V2X

Message Authentication

Application

TEE Stack

Normal World Secure World

RNG

Wifi DrivereMMC

Driver

File System Networking stack

Ethernet

Driver

Tee supplicant

V2X Secure Authentication Services

ECDSA

sign / verify

Key

ManagementCipher

Task dispatcher

Page 83: i.MX 8 SOFTWARE IP DESIGNED TO ACCELERATE

PUBLIC 82

MIRACAST with HDCP on TEE to Protect the HDCP Keys

Trusted OS BSP

Secure Applications

Rich OS Software

BSP support

Processor

Secure Clock Secure RAM

CAAM

Trusted OS

Crypto operation Data storage Task dispatcher

GlobalPlatform Internal API

OCOTP

HDCP Service

Monitor

BSP support

Linux OS

Trustzone Library

GlobalPlatform Client API

Trustzone Driver

HDCP Controller

Session Manager

TEE Stack

Normal World Secure World

Locality

CheckSKE AKE Cipher

RNG

Wifi Driver

WPA supplicant

Miracast

Wifi-direct

Wifi-display

Video Player

Gstreamer

ffmpeg

GPU libraries

Video libraries

VPU Driver

IPU Driver

ALSA Driver

GPU Driver

Page 84: i.MX 8 SOFTWARE IP DESIGNED TO ACCELERATE

PUBLIC 83

Fast Boot and HAB (High Assurance Boot) Services

• Extensive experience, particularly with automotive use cases

• Typically involves HAB with failsafe (redundant images)

• Preloader IP optimizes U-Boot loading and authentication

• Guidance for using HAB in development vs production modes

• Authentication is part of boot sequence and boot time

− Included during fast boot analysis and optimizations

Page 85: i.MX 8 SOFTWARE IP DESIGNED TO ACCELERATE

PUBLIC 84

NXP Android Auto Functions - Linux

• NXP supports Android Auto Projection v1.2 (v1.3 is in progress)

• Present digital video streamed by Android Device to car display

− GStreamer framework used for H264 video stream decode, audio output mixing and audio input

management

• Touch screen management and transfer to Android device

− wayland protocol is used for graphics and input management

− Optionally, wayland support can be disabled and either application send input events to the AAP

library, or library uses libinput to handle input events internally

• Digital audio streamed by Android Device to car audio output(s)

• Audio record from car microphone and forward to Android Device (e.g. Google Now)

− Uses ALSA for audio playback and record

• AAP receiver library provides functionality:

− USB communications channel establishment

− Android phone identification and authentication

Page 86: i.MX 8 SOFTWARE IP DESIGNED TO ACCELERATE

PUBLIC 85

i.MX AUTOSAR MCAL Options

Page 87: i.MX 8 SOFTWARE IP DESIGNED TO ACCELERATE

NXP and the NXP logo are trademarks of NXP B.V. All other product or service names are the property of their respective owners. © 2017 NXP B.V.