04. Technology Review _ Greg Zaoui

8/13/2019 04. Technology Review _ Greg Zaoui

1/56


2/56

IN-VEHICLE CONNECTTECHNOLOGY


3/56

WHAT'S ON ?

Connectivity SystemsIVI Infotainment OSSmartphone Solution or Gateway ?OBD On-board Computer and diagnosis tools

OEM Value chainPosition your system/application ?How to work with OEMs ?

HMIConstraintsRegulations

Connected ServicesSelectionIHU Specification through an example

Big DataValue


4/56

OS HMI NAV BANDWIDTH

Android, MeeGo O QNX B

A S E

H M

I Automot UX (high

N A V Nokia/N

Tomtom Google

B D W

M2M Op voda, ora

S E M I TI

Intel

Freescale


5/56

SYSTEMSCONNECTIVITY TYP


6/56

CONNECTED CARS ARCHITECTUR

TCU-basedInfotainment-centricProvides services, content for both drivers and passengersHotspot/LTE/wifiAutomotive and Operator driven

BYOD-based (tethered mode)Smartphone-centric

Needs to be adapted to local needs and availabilityTethering/pairing technology dependentNeeds to be deployed by service technology companies

CAN basedDonglesConnectivity


7/56

3 COMPUTERS BEHIND 1 WHEEL

OBD computerCommunicates with the cloud to upload information from the car

Smartphone Integration tethered solutionUses the smartphone as a modemReplicates the phone screen onto the IVI screen (smartphone is not only a modem also the brain

IVI systemsAutonomous and connectedBased on embedded systems and software


8/56

A NON-OSMOTIC BARRIER

Separates the On board Computer from the Infotainment Systems (where the visiblevalue is)

The 2 systems are operating autonomouslySome communication is permitted via the OBD portMainly to read values and retrieve information

Vast sets of protocols are available to access (even write) mechatronics informationBut each set is different from OEM to OEMAccess Engine Control Unit deals with

Cruise control, transmission, anti-skid, anti-theft

OEMs can provide whichever access they want across the barrier (pending regulations)but this means long validation and development cycles not including CR management

Can only be considered at very early stage of project


9/56

Online ServiceS

PoGoEnhanced UI

Fleet & DiagnosisServiceS

WEB Access

CONNECTED IVI ARCHITECTURE - CURRENTLY D

Online Services


10/56

LOW-END CONNECTED IVI PLATFORM


11/56

OBD CONNECTED DONGLES - AFTERM

Whats inside ? Connected vehicle technologyDiagnostic interfaces (OBD/J1939)Wifi, Bluetooth, cellularAccelerometer / GPS

What is it for ?Usage based insurance (UBI)Driver and vehicle performanceDiagnosticsOccupant information services

A vehicles self-diareporting ability exa standardized convehicle cabin

Check behind yourthe carpet !

Required in the USall cars and light trDefined by a collestandards include JJ1978, J1979,J201Defines a large setelements about theengine and emissio

Only a few data elesupported


12/56

OBD II PROTOCOL

5 different physical networks arerepresented on the connectorThis was simplified to one protocol in 2008Vehicles may use more than one physical network

SAE Spec J1979 defines a list of ParameterIdentification Numbers (PIDs) used torequest data from a network.

The network is a transaction basednetwork. Send a PID, get a result.

Other information may appear on the network butit is for other ECUs and varies from vehicle tovehicle

10 modes of operation$01 used to identify what PIDs$02 Freeze Frame Data (informduring a fault)$03 Emissions related confirmestored.$04 Used to clear emissions rela

information.$05 Oxygen sensor monitor and$06 Request for On-Board Mon$07 Emission related troubles dlast drive cycle$08 Enable off-board test devicon-board system

$09 Request VIN and other veh$0A List permanent trouble cod


13/56

SMARTPHONES CONNECTIVITY

Cradle vs. handleDistraction vs. regulation

Password, LockScreenBT phone

Tethering vs. Contracting

It is good enough for (free) navigationBut navigation is entering the car through the IVICannot access cars internals

Caveat: OBD + SP + ServerTried by Verizon in US

Do we use or LTE phones as hotspots in the living room for smart TVs ?


14/56

MIRRORLINK SMARTPHONE CONNECTIV

Consists of a VNC-type architecture whereas the phone replicates its screen oinfotainment screen

CCC Driven (nokia initiative)Car connectivity Consortium

Uses RTP and uPnP

Putting the "Mirror" in MirrorLink ... and then the " Link Only approved apps can work obviously no playing your torrents on the big screenWho approves it ? How much ?

How does your car communicate when you take your phone out?


15/56

ARCHITECTURE MIRROR-LINK

Flow andRelationship

SWArchitectur


16/56

VNC THE SYSTEM BEHIND ML


17/56

SMARTPHONES AS A COMPANION A

OEM specific apps to be available for driver when not driving

Use cases:Remote access (lock/unlock)Pre-heat and pre-con the carTrack the car PAYD informationGeneric information such as fuel consumption, diagnosis status, driving behavior

Server-Meddling Architecturecar reports condition to secure cloud and smartphone accesses secure cloudLimited direct communication except for R/C (alarm, lights, windows, lock precon)

The smartphone is a relay of information between driver and car and in-no-way aControl Unit


18/56

COMPANION APP ARCHITECTUROnline Services

Fleet & DiagnosisServiceS

WEB Access

SMARTPHONES FOR COMPANION A


19/56

SEMCOS INITIATIVES & PLATFORMS


20/56

CARS SW ENVIRONMEOS & HMI


21/56

OPERATING SYSTEMS

QNX owned by RIM/BlackberryQNX OS;HMI framework supporting HTML5, QT, and other native UI toolsetsSDK for app environments

Support for audio and environment controlsacoustic, noise reductionhands-free solution, voice recognition

Climate controlVehicle Diagnosis

Car Resources access (customized only)Project dependent CustKitOEM proprietary: needs 3-party agreement


22/56

EMBEDDED ARCHITECTURE

The trick is to have access to APIs Many are restricted to prevent meddling

with car systems gps info Environment control Open in SDK does not mean available

in cars final SW architecture Not just security but cost of recalls and

customer satisfaction Tablet on wheels When buying a car the infotainment

control and comfort count heavily inthe buying decision process


23/56

FRAGMENTED ENVIRONMENT GLUED

HW HW HW

Linux WinCE QNX Android

Infotainment Suite / Proprietary

TCPIP over wifi, BT, 3G/4G,

AppModule

AppModule

AppModule

AppModule

DriverAssistanc

eNavi

Maps

CanBus / mecatronics

MMEngine

TTS/VREngine

DrivingBehavi

our

Climate

CTRLDiagnosis Engine

Onboard Computer


24/56

USE CASE: ONSTAR IN-VEHICLE A

I/O commands control for connected filesystems, or IHU FS

Read/Write/WriteB/getRes/deleteFile

CommunicationBT profile, watchNetworkConnectivity, watchForData ,

Media commands control the vehicles audioand video playback functionality

Play/Stop/Pause/Sync

Navigation commands control thefunctionality of the GPS navigation unit

Destination: Get/Set/watch/Clear

Phone command controls the infotainmentunit's built-in telephone, to make outboundcalls

Dial

System commands allow infotainment unit's systemhandling abilities

Speed/Focus AppClose/Update

User Interface command screen alerts and message

showAlert

Utilities command allows foexceptions and analytics inf

getLogEvent

Vehicle Info getPosition (watch, clear)/ getvehicleData, ActiveDevice

getVin, getRadioInfo, getvehic


25/56

USE CASE: ONSTAR - REMOTE AP

Consent methods allows for the addition and removal ofconsent for select vehicles and accounts

AccountConsent/ VehicleConsent/ FleetConsent/ Revoke

Subscriber Data provides detailed information aboutOnStar subscribers, accounts, and supported vehicles

SubscribersInfo, VehicleInfo, VehicleCommands, Vehicle Features

Telemetry methods allow for the use of a vehicle'stelemetry data

TelemetryEnable / TelemetryDisable / History / Callback

Batch methods allow fleet customers to handle multiplecommands with a single requestDestination:

Submit/Status/Results

Vechicle Commands provide services whichcommunicate with the vehicle to perform an action.

Do things like unlock the doors, start navigation, or sound the alarm all withthe call of a methodStartVehicle, CancelStart, Lock/UnlockDoor, VehicleLocation, TurnByTurnRoute,


26/56

USE CASE: OTHERS

OPENCarNokia, Pandora, InrixAPI library backed by documentationApp submission guidelines, dashboard and certification process to support third-party deveProfiles supporting vehicle-specific graphics design/resolutions/capabilities, extensible vehtouch and voice interaction devices/models

GeneviPan-industry initiativeMore about compliance andstandards than about platform


27/56

USE CASE: OPENCAR

The center console is both the brain and heart of themodern driving experience. Creating a custom, brandedexperience leveraging the latest software standards willtransform customer engagement.

Drivers love their smartphones and want the always-connected, digital entertainment lifestyle that is one touchaway." But simply replicating this experience in the car isneither safe or properly integrated with the vehicle's dataand controls..

Nokia


28/56

A CONTROLLED AND CLOSED ENVIRO

OS and HMI fixes to be rolled out through dedicated bandwidth as RupdatesCreates unavailability of the system for some timeCustomer/driver expectations must be managed

Automotive in-apps store to be operated by OEMs and integrators toand push new apps/services to drivers:

HMI consistency, usage learning curveLooking for apps in menu can result in distraction and loss of control

Semi-open market such as android or apple cannot be replicated heresystems are linked to life-critical systems

Even if controlling breaks or stirring from rogue app is highly unlikelyNo-one wants to be the first one to deal with this


29/56

OEMSSERVICES ENABLER


30/56

IN-VEHICLE CONNECTIVITY VALUE C


31/56

HOW TO WORK WITH THE OEM VALUE

1. Target a model/region the higher up you are in the value chain (internet layer) the more diversified is2. Understand all their suppliers because your product will create dependencies on their systems

inevitably create conflict with already existing offer OEMs policy is heavily multi-source biased tallow for contingency

3. OEMS are locked in heavy complex dealer distribution flows and very few solutions (if any) can beintegrated post sales

a. Involves re-training

b. Very expensivec. Must be bullet proof4. OEMs are subcontracting all app-store/cloud services to large integrators or directly to Network

operatora. They understand appsb. They do not want to cut their margin for youc. IT/Firewall structure & Security are unnegotiable (what if you have a licensing or distribution

server?)


32/56

OEMS ARE BECOMING SERVICE PROV


33/56

HMI INSIGHTS FOR WHEN YOU DEVAN APP

Manufacturer requirementsWindow on automotive valuesNeeds to be tightly integrated with Look and Feel and to respect ergonomicsMust address ease-of-access requirements (cannot be smartphone-like)

Industry/Regulators regulationsCannot distract drivers

Huge consequences risk of accidentsRisk of failing validation

Movement-locked featuresNeeds tight integration with solution providerAccess to HW info is critical and not always disclosed (CANBUS read-access needed)


34/56

HMI INSIGHTS FOR WHEN YOU DEVAN APP

VR/TTSAlready availableNuance is leading the dance

Camera/sensor basedAlready available for detection preventions (rear-view camera)Brought over for driver monitoring

Gesture and eye-movementsPupil dilatation (snoozing on the wheel)

Reading the roadCracks in pavement, sign post recognitions


35/56

HMI AND DISTRACTION

There is a dedicated website in the UShttp://www.distraction.gov/content/get-the-facts/state-laws.html

Stringency is the key word

California Court Rules Anti-Texting Laws Apply to Checking Maps While Driving

National Highway Traffic Safety Administration has issued its first set of voluntaryguidelines that encourage automobile manufacturers to limit the distraction risk

connected to electronic devices . feb 2013Guidelines recommend that automakers develop infotainment system that limit the timedrivers have to take their eyes off the road to two seconds for each input (for, say, findinaddress using a navigation system) and 12 seconds to perform an overall task (such asinputting a destination and routing to it).NHTSA Recommends Getting Rid of Moving Navigation Maps

HMIIS NOT JUST TOUCHING IT IS ABO


36/56

HMIIS NOT JUST TOUCHING IT IS ABOPASSIVE

VR/TTSAlready availableNuance is leading the dance

Camera/sensor basedAlready available for detection preventions (rear-view camera)Brought over for driver monitoring

Gesture and eye-movementsPupil dilatation (snoozing on the wheel)

Reading/Sensing the roadCracks in pavement, sign post recognitions


37/56

THE FIRST BATCH OF SERVICES VS BAN


38/56

THE FIRST BATCH OF SERVICES VS. BANNEEDS

Transiting through TCU

Smartphone tethering unlikely in

pre-built market due to regulations

and operator consent

After-market tethering is open but muchless lucrative

- although a very good play-ground

- needs integration with navigation apps


39/56


40/56

TECHNICAL CLUSTERING TO ENSURE

Trend is to offer navigation, maps and services as one supplierTechnical updates and synchronization rationale

One OEM uses different suppliers for different modelautomotive multi-sourcing policyProvide many verticals transversally

Multiplication of Standards, semi-proprietaryTpeg vs HTMLOLR, ULR, Agoras'Tight with map formats to optimize data transfer while reducing efficiency of mixingsuppliersRoute computation, map matching done on server behind OEM/Supplier firewall80/20 rule. Most maps updates and live information are needed in high-coverage netwoareas


41/56

WHAT PEOPLE WANT IN THEIR CA


42/56

4SQ APPLICATION FOR INFOTAINM

The 4SQ service shall be integrated within the navigation application

Users will be offered a 4SQ-enabled experience to enhance navigation with Community-based features User-generated POIs and information trail

This implementation is for connected infotainment unit and OEMs Co-marketing: navigation to the power of community Port smartphone-like features to car built-in environment

Implement essential features to be developed such as TTS, VR andmessaging capabilities


43/56

MAJOR COMPONENTS OF SERVIC

Explore POIsaround me@ destination (only displayed if a route isavailable) Along route (only displayed if a route isavailable)\Ability to select a free search by selecting

top categories and specifying location in asearch box

Check-inSimple functionality, user clicks and ischecked-inFunction is grayed if user is not logged in

Display Nearby friendsAround me @ destination (only displayavailable)Along route (only displayedavailable)Function is grayed if user is

Settings Control PanelCredentialsAlways Show friends YesPre-Select categories for POlevel categories defined in csheets)Show reviews and Picture


44/56

FOURSQUARE CONTROL SCREEN

Application in IHU Screen


45/56


46/56

POI - EXPLORE SCREEN

Showing POIs on map around me, for all categories pre-selected in settings Around me @ destination (only displayed if a route is active) Along route (only displayed if a route is available)

Select a free search by clicking on categories and by specifying

location in a search box Eat & Drink, Sleep, Community, Fun Health, Wellbeing, Shop, Transports Each top category might suggest dynamically associated

subcategories if available (TBD with 4SQ) Friends @ location will be displayed as a specific category


47/56

IN-VEHICLE POI SEARCH SCREE


48/56

IN-VEHICLE POI DETAILED INFORMA

Available detailed information of POI listed on POI screen

Each entry shall be expandable to display the full details of each POI as proviby 4SQ

pics, reviews, map snapshotsMight show reviews of friends or FoF (closer connection) first

check with 4SQ if profile affinity function is available

Add Navigate to button for each entry Navigates to selected POINavigates to friend

Feedback to server when navigating to POI/Friend

Feedback to server when selecting explored POIs


49/56

IN-VEHICLE FRIENDS PLACES AROUN

This feature enables users to view friends (and FoF ) favorite places around:reviewedstarredcreated

Friends places appear in a list as for other POIs

All functions as for regular POIs are applicable (if applicable) InfoNavigate to option

C S C S O


50/56

IN-VEHICLEFRIENDS PLACES AROU


51/56

IN-VEHICLE CHECK-IN ONCE A


52/56

IN VEHICLE CHECK IN ONCE ADESTINATION

Arrival at the final destination screen + check-in to the 4SQ venuepromptYou have arrived at destination, would you like to check-in ?Check-in button appears on the screen for user to activate

If not automated


53/56

BIG DATA

THE INTRINSIC VALUE OF CAR


54/56

THE INTRINSIC VALUE OF CARCONNECTIVITY

LocationDevices know where they are and we know where they are too. Its true for the vehicle andwhatever devices drivers and passengers carry around with them.

ContextWe can build a picture of the situation at any given time. This may be about who is driving,may be about how the car itself is performing. It may be about points of relevant interest al

ConnectivityWe can make this information work together to make good things happen for the driver; to the bond between the driver and the automotive brand; and to generate and collect revenue contributing businesses.

THE HIDDEN VALUE: TRACING & PRO


55/56

BIG DATA

Thats where and when the car becomes a smartphone on wheels Driving behavior and location patterns have a considerable marketing valueProvides customer profiled information to OEMs, dealers and to a larger extent, to market analysis compSimilar to location-based advertising on mobile phones

Real-time on devices through ads feedbackWill be hidden and asynchronous for cars

Security driven initiativeE111, e-callPro- diagnosis, maintain good quality of fleet (and a dealers portfolio is a virtual fleet

Car can self-book itself to garageDealer can order parts in advance and optimize stock

Control of metropolitan flows

Guarantees privacyScrambled identity for profilingDrivers confirmation for diagnosis

WHATS NEXT FOR CONNECTED CAR


56/56

WHATS NEXT FOR CONNECTED CAR

Within the next three years, every new car will, to a greater olesser extent, be a connected car. When most drivers alreadyhave a smart-phone in a cradle on the dashboard, this deeperconnectivity is inevitable. The real question is not if itsquestion of how far can we go ?

The car is no longer a capsule - for drivers and passengers, thvehicle must be a safely connected extension of theirenvironment, for automotive manufacturers and their partnerconnectivity drives a shift from product to service relationshi

Documents

04. Technology Review _ Greg Zaoui