‘Audio Sensing: The search for AV’s Alexa’

Edoardo GallizioSr. Product Marketing Manager

STMicroelectronics

Agenda• Challenges • Opportunities• Key Growth Enablers• New Applications driven by Accuracy• Amazon Alexa now in your vehicle• Road Noise Sensing: Audio & Inertial MEMS Fusion• Voice is just the beginning …!

3Connected Era

Data ChallengeThe Cloud Voice Recognition Example

4

Courtesy Dday.it

Courtesy Tecnoandroid.it

….

Source: Wired, Aug 2017

If any android user would use 3 minutes of voice recognition per daythey would need to double computing power into the cloud

The Sustainability Challenge

5

Security Challenge

011100101001

011100101001

011100101001

011100101001

011100101001

Distributed: Block Chain

Register new devices

Negotiate to exchange power w/ other devices

Authenticateusers

Centralized

HW &/or SW Enforced Security

Smart Driving Node

IoT Node

Cloud

Smartphone / Gateway

IoT Protocols….

Web Protocols….

6

The Privacy Challenge

7

More Intelligent ?

8

Cognitive & Autonomous thinking…on the way!

THINK

1990 2000 2010 2020

Global Semiconductor Market

Digital Age• Data Storage• PCs

Internet Age• Internet search• Online video• Gaming

Mobile Age• Smartphones• Mobile networks• Social media

Cloud/ IoT Age• Cloud services• IoT services

Automation Age• Smart Industry• Smart Driving• Automation everywhere

First MEMS Wave

Next MEMS Wave

Value

Growth Enablers of the Semiconductor Market

9

Increased Accuracy Required

New Applications Driven by Accuracy

10

VIRTUAL & AUGMENTED

REALITY

OPTICAL IMAGESTABILIZATION

AUTONOMOUSDRIVING

CARNAVIGATION

INCLINATION/LEVEL

INDICATION

HUMIDITY & TEMPERATUREMONITORING

Automotive Personal Electronics Industrial

Sensor Pervasion in Smart Driving

11

CameraLIDARRadarUltrasound

Motion SensorsEnvironment Sensors

MicrophoneFusion

360° Surround View

ParkingParking

Cruise Control

Collision Avoidance

Traffic Signs

Lane Change

Collision AvoidanceParking

360° Surround View

360° Surround View

360° Surround View

Vehicle Dynamics

Navigation

Safety

Amazon Alexa — Now in Your Vehicle

InfotainmentDrive w/ GPS DirectionsRemotely Control Home DeviceKeep Traveling Companions EntertainedConnect with Your Car Stereo

Audio and Motion Fusion…Vehicle-cabin noise-cancelling application

13

H(s)Cabin cleaned

• Accelerometer with wide bandwidth

• High SNR, High AOP microphone

Product requirements

Road noise is picked up by accelerometer and microphones allow the engine to estimate the transfer function from vibration to noise into the cabin. Signal shifted 180° is then injected into the cabin to cancel the noise

Road-Noise Sensing

Road-Noise Sensing:Microphones & Inertial Sensors Fusion

Audio and Motion Fusion: Demo

16

Sound

+

Speak in a windy environment

Fusion ON

Fusion OFF

Ingredients for Success for MEMS Makers

17

Ability to design & produce MEMS sensors meeting needed quality, reliability & accuracy requirements

Complete solution approach to address fragmented market segments.Ability to provide products that perfectly fit the solution requirements in Automotive

Broad portfolio of products with underlying system knowhow to be able to provide complete solutions

Expertise in designing and manufacturing high-volume MEMS sensors

Long experience in industrial and automotive markets; Longevity Commitment

Ability to produce sensors in large volumes with a secure supply chain

Ability to produce cost efficient and high quality sensors

Success in consumer markets w/ leading products sold in very high volumes

Accuracy & High Volumes manufacturing

Voice is just the beginning …!

18

• Challenges posed by Autonomous & Electric Vehicles

• Opportunities for Semiconductors due to pervasion of sensors

• New applications enabled by Accuracy and Fusion algos.

• Audio and Inertial Fusion for optimal comfort inside vehicles

• The VOICE is just the beginning !

Takeaways

19

Thank You!

edoardo.gallizio@st.com