25
IMAGE RE-SEGMENTATION A new approach applied to Urban Imagery Thales Sehn Korting Leila Maria Garcia Fonseca Luciano Vieira Dutra Felipe Castro da Silva

IMAGE RE-SEGMENTATION A new approach applied to Urban Imagery Thales Sehn Korting Leila Maria Garcia Fonseca Luciano Vieira Dutra Felipe Castro da Silva

Embed Size (px)

Citation preview

Page 1: IMAGE RE-SEGMENTATION A new approach applied to Urban Imagery Thales Sehn Korting Leila Maria Garcia Fonseca Luciano Vieira Dutra Felipe Castro da Silva

IMAGE RE-SEGMENTATIONA new approach applied to Urban Imagery

Thales Sehn KortingLeila Maria Garcia Fonseca

Luciano Vieira DutraFelipe Castro da Silva

Page 2: IMAGE RE-SEGMENTATION A new approach applied to Urban Imagery Thales Sehn Korting Leila Maria Garcia Fonseca Luciano Vieira Dutra Felipe Castro da Silva

Introduction

• Image segmentation is the identification of homogeneous regions in the image

Page 3: IMAGE RE-SEGMENTATION A new approach applied to Urban Imagery Thales Sehn Korting Leila Maria Garcia Fonseca Luciano Vieira Dutra Felipe Castro da Silva

Traditional approaches

• Few versions available for end users

• Algorithms don’t consider the application context– Urban– Agriculture– etc

Page 4: IMAGE RE-SEGMENTATION A new approach applied to Urban Imagery Thales Sehn Korting Leila Maria Garcia Fonseca Luciano Vieira Dutra Felipe Castro da Silva

Urban Segmentation

Page 5: IMAGE RE-SEGMENTATION A new approach applied to Urban Imagery Thales Sehn Korting Leila Maria Garcia Fonseca Luciano Vieira Dutra Felipe Castro da Silva

Objective

• Development of a re-segmentation system, based on rectangular shapes

• Re-Segmentation– Rearrangement of a polygon set, merging

some elements to generate objects with particular characteristics, applied to a specific context

Page 6: IMAGE RE-SEGMENTATION A new approach applied to Urban Imagery Thales Sehn Korting Leila Maria Garcia Fonseca Luciano Vieira Dutra Felipe Castro da Silva

Re-Segmentation Approach

Band 1

Band 2

Band ...Band ...Band ...Band n

Input

Output

Ove

r-S

egm

enta

tion

Page 7: IMAGE RE-SEGMENTATION A new approach applied to Urban Imagery Thales Sehn Korting Leila Maria Garcia Fonseca Luciano Vieira Dutra Felipe Castro da Silva

Segmentation Based on Graph

• Region Adjacency Graph

Page 8: IMAGE RE-SEGMENTATION A new approach applied to Urban Imagery Thales Sehn Korting Leila Maria Garcia Fonseca Luciano Vieira Dutra Felipe Castro da Silva

Re-Segmentation Diagram

Page 9: IMAGE RE-SEGMENTATION A new approach applied to Urban Imagery Thales Sehn Korting Leila Maria Garcia Fonseca Luciano Vieira Dutra Felipe Castro da Silva

Finding Rectangles

Pi

x

y

AV

ANG(Pi)Ri

BOX(Ri)

AREA(Pi)AREA(BOX(Ri))

RET(Pi) =

Page 10: IMAGE RE-SEGMENTATION A new approach applied to Urban Imagery Thales Sehn Korting Leila Maria Garcia Fonseca Luciano Vieira Dutra Felipe Castro da Silva

Results

• Original image• Rectangular shapes highlighted• Classified regions• Resultant polygons

• Hardware– AMD Athlontm 3000+– 512MB RAM– Linux Mandriva 2006

Page 11: IMAGE RE-SEGMENTATION A new approach applied to Urban Imagery Thales Sehn Korting Leila Maria Garcia Fonseca Luciano Vieira Dutra Felipe Castro da Silva

1st – Original

Page 12: IMAGE RE-SEGMENTATION A new approach applied to Urban Imagery Thales Sehn Korting Leila Maria Garcia Fonseca Luciano Vieira Dutra Felipe Castro da Silva

Over-Segmentation

1998 polygons

Page 13: IMAGE RE-SEGMENTATION A new approach applied to Urban Imagery Thales Sehn Korting Leila Maria Garcia Fonseca Luciano Vieira Dutra Felipe Castro da Silva

Classification

trees

roofs

buildings

streets

others

Page 14: IMAGE RE-SEGMENTATION A new approach applied to Urban Imagery Thales Sehn Korting Leila Maria Garcia Fonseca Luciano Vieira Dutra Felipe Castro da Silva

Resultant Re-Segmentation

634 polygons

317 seconds

Page 15: IMAGE RE-SEGMENTATION A new approach applied to Urban Imagery Thales Sehn Korting Leila Maria Garcia Fonseca Luciano Vieira Dutra Felipe Castro da Silva

2nd – Original

Page 16: IMAGE RE-SEGMENTATION A new approach applied to Urban Imagery Thales Sehn Korting Leila Maria Garcia Fonseca Luciano Vieira Dutra Felipe Castro da Silva

Over-Segmentation

2028 polygons

Page 17: IMAGE RE-SEGMENTATION A new approach applied to Urban Imagery Thales Sehn Korting Leila Maria Garcia Fonseca Luciano Vieira Dutra Felipe Castro da Silva

Classification

trees

roofs

buildings

streets

others

Page 18: IMAGE RE-SEGMENTATION A new approach applied to Urban Imagery Thales Sehn Korting Leila Maria Garcia Fonseca Luciano Vieira Dutra Felipe Castro da Silva

Resultant Re-Segmentation

695 polygons

243 seconds

Page 19: IMAGE RE-SEGMENTATION A new approach applied to Urban Imagery Thales Sehn Korting Leila Maria Garcia Fonseca Luciano Vieira Dutra Felipe Castro da Silva

3rd – Original

Page 20: IMAGE RE-SEGMENTATION A new approach applied to Urban Imagery Thales Sehn Korting Leila Maria Garcia Fonseca Luciano Vieira Dutra Felipe Castro da Silva

Over-Segmentation

2264 polygons

Page 21: IMAGE RE-SEGMENTATION A new approach applied to Urban Imagery Thales Sehn Korting Leila Maria Garcia Fonseca Luciano Vieira Dutra Felipe Castro da Silva

Classification

trees

roofs

buildings

streets

others

Page 22: IMAGE RE-SEGMENTATION A new approach applied to Urban Imagery Thales Sehn Korting Leila Maria Garcia Fonseca Luciano Vieira Dutra Felipe Castro da Silva

Resultant Re-Segmentation

750 polygons

196 seconds

Page 23: IMAGE RE-SEGMENTATION A new approach applied to Urban Imagery Thales Sehn Korting Leila Maria Garcia Fonseca Luciano Vieira Dutra Felipe Castro da Silva

Drawbacks

Page 24: IMAGE RE-SEGMENTATION A new approach applied to Urban Imagery Thales Sehn Korting Leila Maria Garcia Fonseca Luciano Vieira Dutra Felipe Castro da Silva

Conclusions

• New approach for image re-segmentation

• Algorithm developed using the Free C++ Library TerraLib (http://www.terralib.org/)

Page 25: IMAGE RE-SEGMENTATION A new approach applied to Urban Imagery Thales Sehn Korting Leila Maria Garcia Fonseca Luciano Vieira Dutra Felipe Castro da Silva

IMAGE RE-SEGMENTATIONA new approach applied to Urban Imagery

END