21
Confidential and Proprietary | Copyright © by Fastree3D | All Rights Reserved 1 System on Chip LiDAR Lucio Carrara [email protected] +41 78 601 19 58 21.06.2018

System on Chip LiDAR - Swissphotonics · 2018-06-22 · System on Chip Averaging / compression Software control Pulsed laser array VCSEL array Fast / < 3ns / >2MHz Single photon

  • Upload
    others

  • View
    8

  • Download
    0

Embed Size (px)

Citation preview

Page 1: System on Chip LiDAR - Swissphotonics · 2018-06-22 · System on Chip Averaging / compression Software control Pulsed laser array VCSEL array Fast / < 3ns / >2MHz Single photon

Confidential and Proprietary | Copyright © by Fastree3D | All Rights Reserved 1

System on ChipLiDAR

Lucio [email protected]

+41 78 601 19 58

21.06.2018

Page 2: System on Chip LiDAR - Swissphotonics · 2018-06-22 · System on Chip Averaging / compression Software control Pulsed laser array VCSEL array Fast / < 3ns / >2MHz Single photon

Confidential and Proprietary | Copyright © by Fastree3D | All Rights Reserved 2

Outline

• Set the problem(define characteristics)

1

2

3

Rationale of a complete solution(Flash LIDAR SoC)

    Conclusions (Lidar solution is collaborative)

Page 3: System on Chip LiDAR - Swissphotonics · 2018-06-22 · System on Chip Averaging / compression Software control Pulsed laser array VCSEL array Fast / < 3ns / >2MHz Single photon

Confidential and Proprietary | Copyright © by Fastree3D | All Rights Reserved 3

Outline

• Set the problem(define characteristics)

1

Page 4: System on Chip LiDAR - Swissphotonics · 2018-06-22 · System on Chip Averaging / compression Software control Pulsed laser array VCSEL array Fast / < 3ns / >2MHz Single photon

Confidential and Proprietary | Copyright © by Fastree3D | All Rights Reserved 4

Key issues: speed, reliability

Automate the “sense, think and act” cycle

Page 5: System on Chip LiDAR - Swissphotonics · 2018-06-22 · System on Chip Averaging / compression Software control Pulsed laser array VCSEL array Fast / < 3ns / >2MHz Single photon

Confidential and Proprietary | Copyright © by Fastree3D | All Rights Reserved 5

• Extreme illumination conditions

• Low contrast

• No direct depth information

2D imaging

• Slow, short range, poor spatial resolution (x,y)

• Environmentally sensitive (wind, temperature and humidity)

• No direct image

Ultrasounds

• Form-factor vs depth resolution

• Shadowing (correspondence problem)

• Heavy computation (low speed, correlation problem)

Stereoscopy

Current solutions

Page 6: System on Chip LiDAR - Swissphotonics · 2018-06-22 · System on Chip Averaging / compression Software control Pulsed laser array VCSEL array Fast / < 3ns / >2MHz Single photon

Confidential and Proprietary | Copyright © by Fastree3D | All Rights Reserved 6

Improving machine vision solutions

Reliability of data Quality of result

Acquisition speed Low latency

Complementary to image processing and stereo

Page 7: System on Chip LiDAR - Swissphotonics · 2018-06-22 · System on Chip Averaging / compression Software control Pulsed laser array VCSEL array Fast / < 3ns / >2MHz Single photon

Confidential and Proprietary | Copyright © by Fastree3D | All Rights Reserved 7

Time correlated measurements

Flash Lidar

Single-Photon imaging

TCSPC

• High sensitivity

• High data throughput

• Statistical approach

• Quality of results

Flash Lidar

Page 8: System on Chip LiDAR - Swissphotonics · 2018-06-22 · System on Chip Averaging / compression Software control Pulsed laser array VCSEL array Fast / < 3ns / >2MHz Single photon

Confidential and Proprietary | Copyright © by Fastree3D | All Rights Reserved 8

Fastree3D flash Lidar solution

System on Chip

Averaging / compression

Software control

Pulsed laser array

VCSEL array

Fast / < 3ns / >2MHz

Single photon detector (SPAD)

Time digital converter 50ps

High frame rate > 100 fps

14 patents(4 granted)

1 cm

Processing Single photon detector Laser

Page 9: System on Chip LiDAR - Swissphotonics · 2018-06-22 · System on Chip Averaging / compression Software control Pulsed laser array VCSEL array Fast / < 3ns / >2MHz Single photon

Confidential and Proprietary | Copyright © by Fastree3D | All Rights Reserved 9

System on a Chip (SoC)

Monolithic integration↑Processing

Compression of 99.84%

↑Reliability

Point-cloud tagged with quality information

↑Flexibility

Software control over sensor

Page 10: System on Chip LiDAR - Swissphotonics · 2018-06-22 · System on Chip Averaging / compression Software control Pulsed laser array VCSEL array Fast / < 3ns / >2MHz Single photon

Confidential and Proprietary | Copyright © by Fastree3D | All Rights Reserved 10

Processing: compression

Compressed distanceprocessing  

 

0  

 

2 PATENTS

Page 11: System on Chip LiDAR - Swissphotonics · 2018-06-22 · System on Chip Averaging / compression Software control Pulsed laser array VCSEL array Fast / < 3ns / >2MHz Single photon

Confidential and Proprietary | Copyright © by Fastree3D | All Rights Reserved 11

Reliability: Quality of Result

Distance- QoR

2-bit encoded → 4 possibilities

max=12

bckg=1.5

 

0 0 0 1 1 0 1 1

QoR2 6 10

σ1 σ2 σ3

σ1

σ2

σ3

Page 12: System on Chip LiDAR - Swissphotonics · 2018-06-22 · System on Chip Averaging / compression Software control Pulsed laser array VCSEL array Fast / < 3ns / >2MHz Single photon

Confidential and Proprietary | Copyright © by Fastree3D | All Rights Reserved 12

Reliability: interference suppression

DirectMultiple reflection effect:

• Create a sequence of pulses

• The back-scattered pulses are spaced over time (no overlap)

• Their intensity is proportional to the reflectivity of the objects.

Page 13: System on Chip LiDAR - Swissphotonics · 2018-06-22 · System on Chip Averaging / compression Software control Pulsed laser array VCSEL array Fast / < 3ns / >2MHz Single photon

Confidential and Proprietary | Copyright © by Fastree3D | All Rights Reserved 13

Flexibility: data format (1)

Distance

• Point cloud• Quality of result

Page 14: System on Chip LiDAR - Swissphotonics · 2018-06-22 · System on Chip Averaging / compression Software control Pulsed laser array VCSEL array Fast / < 3ns / >2MHz Single photon

Confidential and Proprietary | Copyright © by Fastree3D | All Rights Reserved 14

Flexibility: data format (2)

IntensityDistance

• Photon counting• Quality of result

Page 15: System on Chip LiDAR - Swissphotonics · 2018-06-22 · System on Chip Averaging / compression Software control Pulsed laser array VCSEL array Fast / < 3ns / >2MHz Single photon

Confidential and Proprietary | Copyright © by Fastree3D | All Rights Reserved 15

Flexibility: data format (3)

Intensity SpeedDistance

• Distance differential• Quality of result

Page 16: System on Chip LiDAR - Swissphotonics · 2018-06-22 · System on Chip Averaging / compression Software control Pulsed laser array VCSEL array Fast / < 3ns / >2MHz Single photon

Confidential and Proprietary | Copyright © by Fastree3D | All Rights Reserved 16

Flexibility: data format (4)

Intensity Speed MotionDistance

• Intensity differential• Quality of result

Page 17: System on Chip LiDAR - Swissphotonics · 2018-06-22 · System on Chip Averaging / compression Software control Pulsed laser array VCSEL array Fast / < 3ns / >2MHz Single photon

Confidential and Proprietary | Copyright © by Fastree3D | All Rights Reserved 17

Fastree3D – Hardware Development Kit (HDK)

Page 18: System on Chip LiDAR - Swissphotonics · 2018-06-22 · System on Chip Averaging / compression Software control Pulsed laser array VCSEL array Fast / < 3ns / >2MHz Single photon

Confidential and Proprietary | Copyright © by Fastree3D | All Rights Reserved 18

• 30ps laser pulse

• Gaussian

• Pixel + TDC

• FWHM:• Median: 62 ps• Worst: 260 ps

FWHM62 ps

Fastree3D – Sensor jitter

Page 19: System on Chip LiDAR - Swissphotonics · 2018-06-22 · System on Chip Averaging / compression Software control Pulsed laser array VCSEL array Fast / < 3ns / >2MHz Single photon

Confidential and Proprietary | Copyright © by Fastree3D | All Rights Reserved 19

FWHM2 ns

Fastree3D – Digitally controlled laser

Page 20: System on Chip LiDAR - Swissphotonics · 2018-06-22 · System on Chip Averaging / compression Software control Pulsed laser array VCSEL array Fast / < 3ns / >2MHz Single photon

Confidential and Proprietary | Copyright © by Fastree3D | All Rights Reserved 20

2017 2018 2019 2020+

Line sensor 60x2 pxTDC / readoutIlluminatorAlgorithms / system

Hardware development kitPartner engagementIntegrationSystem developmentASIC → array

Camera moduleLIDAR SoC

- Up to QQVGAFlexible illuminators

- Up to 4 sourcesSingle board

3D stackingPerformance optimization

NIR → SWIREye safetyBackground rejection

Lidar technology roadmap

Page 21: System on Chip LiDAR - Swissphotonics · 2018-06-22 · System on Chip Averaging / compression Software control Pulsed laser array VCSEL array Fast / < 3ns / >2MHz Single photon

Confidential and Proprietary | Copyright © by Fastree3D | All Rights Reserved 21

THANK YOU!