Chad Voegele - University of Texas at Austin

Preview:

Citation preview

Chad Voegele

Selective Search for Object Recognition

Outline

1. Individual contribution of region similarity measures2. Importance of good base segmentation3. Box overlap correspondence to recognition

3

Outline

1. Individual contribution of region similarity measures2. Importance of good base segmentation3. Box overlap correspondence to recognition

4

Similarity Measures

Color

Texture

Size

Fill

5

Color Similarity

6

Color Similarity

7

Color Similarity

8

Color Similarity

9

Texture Similarity

10

Texture Similarity

11

Texture Similarity

12

Texture Similarity

13

Size Similarity

14

Size Similarity

15

Size Similarity

16

Size Similarity

17

Fill Similarity

18

Fill Similarity

19

Fill Similarity

20

Outline

1. Individual contribution of region similarity measures2. Importance of good base segmentation3. Box overlap correspondence to recognition

21

Success Case

22

Success Case

23

Failure Cases

24

Failure Cases

25

Failure Cases

26

Failure Cases

27

Outline

1. Individual contribution of region similarity measures2. Importance of good base segmentation3. Box overlap correspondence to recognition

28

Box Overlaps

29

Box Overlaps

30

1. ostrich2. Arabian camel3. black stork4. llama

1. zebra2. tiger3. triceratops4. tiger cat

1. chime, gong2. plate rack3. snake fence4. organ

Box Overlaps

31

Score: 0.851. ostrich2. black stork3. vulture4. Arabian camel

Score: 0.951. chime, gong2. snake fence3. organ4. thatched roof

Score: 0.891. zebra2. tiger3. trcieratops4. tiger cat

Box Overlaps

32

Score: 0.501. zebra2. tiger3. gazelle4. impala

Score: 0.501. ostrich2. llama3. Arabian camel4. vulture

Score: 0.501. snake fence2. plate rack3. bannister4. picket fence

Box Overlaps

33

Score: 0.511. zebra2. fire screen3. gazelle4. patas (monkey)

Score: 0.501. borzoi (dog)2. timber wolf3. red wolf4. badger

Score: 0.501. plate rack2. chime, gong3. shoji (Japanese door)4. window shade

Issues

● Author released half p-code, half m-code.● Optimal segmentation coloring problem.● AlexNet output very sensitive to image patch size.

34

Sources

Code- http://koen.me/research/selectivesearch/ - http://caffe.berkeleyvision.org/

Pictures- PASCAL Visual Object Class Challenge 2007: http://host.robots.ox.ac.uk/pascal/VOC/voc2007/index.html- http://artisanhardware.com/wp-content/uploads/2015/09/47c6ebf4-7a3e-4345-acb5-6a23c9b0b405.jpg - https://upload.wikimedia.org/wikipedia/en/9/93/Pacersoriginallogo.gif - http://animaliaz-life.com/data_images/koala/koala4.jpg - http://www.synlawngolf.com/wp-content/gallery/golf-installations/golf-027.jpg - https://indierevolver.files.wordpress.com/2015/07/chewbacca-han-solo-e1436634523782.jpg - http://cdn0.sbnation.com/imported_assets/196372/200803231600576549171-p2.jpeg - http://www.planetizen.com/files/images/ChicagoEl.jpg- https://www.flickr.com/photos/128888346@N02/24927420741 - https://upload.wikimedia.org/wikipedia/commons/5/52/Madrid_Zoo.jpg 35

Appendix

Initial Segmentations

37

Initial Segmentations

38

Initial Segmentations

39

Initial Segmentations

40

Box Overlap

41

1. oxcart2. ox3. horse cart4. zebra5. llama6. bighorn sheep7. ram8. water buffalo9. warthog

10. dogsled

Recommended