18
Towards Geographical Referencing of Monocular SLAM Reconstruction Using 3D City Models: Application to Real-Time Accurate Vision-Based Localization Reporter : 鄒鄒鄒 Date : 2010/05/04 CVPR ‘09

Towards Geographical Referencing of Monocular SLAM Reconstruction Using 3D City Models: Application to Real- Time Accurate Vision-Based Localization Reporter

Embed Size (px)

Citation preview

Page 1: Towards Geographical Referencing of Monocular SLAM Reconstruction Using 3D City Models: Application to Real- Time Accurate Vision-Based Localization Reporter

Towards Geographical Referencing of Monocular

SLAM Reconstruction Using 3D City Models: Application

to Real-Time Accurate Vision-Based Localization

Reporter : 鄒嘉恆Date : 2010/05/04

CVPR ‘09

Page 2: Towards Geographical Referencing of Monocular SLAM Reconstruction Using 3D City Models: Application to Real- Time Accurate Vision-Based Localization Reporter

Introduction

Page 3: Towards Geographical Referencing of Monocular SLAM Reconstruction Using 3D City Models: Application to Real- Time Accurate Vision-Based Localization Reporter

Outline

MotivationCoarse SLAM ReconstructionBundle adjustmentExperimental resultsApplicationConclusion

Page 4: Towards Geographical Referencing of Monocular SLAM Reconstruction Using 3D City Models: Application to Real- Time Accurate Vision-Based Localization Reporter

Motivation

Current SLAM methods are still prone to drift errors, which prevent their use in large-scale applications.

Page 5: Towards Geographical Referencing of Monocular SLAM Reconstruction Using 3D City Models: Application to Real- Time Accurate Vision-Based Localization Reporter

Coarse SLAM Reconstruction

Page 6: Towards Geographical Referencing of Monocular SLAM Reconstruction Using 3D City Models: Application to Real- Time Accurate Vision-Based Localization Reporter

Coarse SLAM Reconstruction

Page 7: Towards Geographical Referencing of Monocular SLAM Reconstruction Using 3D City Models: Application to Real- Time Accurate Vision-Based Localization Reporter

Coarse SLAM Reconstruction

SLAM(Simultaneous localization and mapping)

Page 8: Towards Geographical Referencing of Monocular SLAM Reconstruction Using 3D City Models: Application to Real- Time Accurate Vision-Based Localization Reporter

Coarse SLAM Reconstruction

Page 9: Towards Geographical Referencing of Monocular SLAM Reconstruction Using 3D City Models: Application to Real- Time Accurate Vision-Based Localization Reporter

Coarse SLAM Reconstruction-SLAM reconstruction fragmentation

Use the idea suggested by Lowe in [11] to segment the trajectory.

[11]D. G. Lowe. Three-dimensional object recognition from single two-dimensional images. Artificial Intelligence, 31(3):355–395, 1987.

3D points

Page 10: Towards Geographical Referencing of Monocular SLAM Reconstruction Using 3D City Models: Application to Real- Time Accurate Vision-Based Localization Reporter

Coarse SLAM Reconstruction

Page 11: Towards Geographical Referencing of Monocular SLAM Reconstruction Using 3D City Models: Application to Real- Time Accurate Vision-Based Localization Reporter

Coarse SLAM Reconstruction-Non-rigid ICP

Goal:

Point-plane association :

Robust estimation :

3D Model

Page 12: Towards Geographical Referencing of Monocular SLAM Reconstruction Using 3D City Models: Application to Real- Time Accurate Vision-Based Localization Reporter

Coarse SLAM Reconstruction

Result

Page 13: Towards Geographical Referencing of Monocular SLAM Reconstruction Using 3D City Models: Application to Real- Time Accurate Vision-Based Localization Reporter

Bundle adjustment

Page 14: Towards Geographical Referencing of Monocular SLAM Reconstruction Using 3D City Models: Application to Real- Time Accurate Vision-Based Localization Reporter

Bundle adjustment

Advantages to use the barycentre of backprojections:The movement of Qi’ is then directly linked to

the displacement of the cameras.Qi position is not used in the cost function.

Page 15: Towards Geographical Referencing of Monocular SLAM Reconstruction Using 3D City Models: Application to Real- Time Accurate Vision-Based Localization Reporter

Experimental results

Synthetic sequence

Page 16: Towards Geographical Referencing of Monocular SLAM Reconstruction Using 3D City Models: Application to Real- Time Accurate Vision-Based Localization Reporter

Experimental results

Real sequence640x480, 1500 meters

Page 17: Towards Geographical Referencing of Monocular SLAM Reconstruction Using 3D City Models: Application to Real- Time Accurate Vision-Based Localization Reporter

Application

Page 18: Towards Geographical Referencing of Monocular SLAM Reconstruction Using 3D City Models: Application to Real- Time Accurate Vision-Based Localization Reporter

Conclusion

Proposed a new approach to correct large-scale SLAM reconstructions.

Proposed AR application shows that the obtained reconstruction precision is sufficient.