19
Human Skin Colour Clustering for Face Detection “15 Seconds of Fame” Jure Kovač, Peter Peer, Franc Solina Computer Vision Laboratory Faculty of Computer and Information Science University of Ljubljana, Slovenia

Human Skin Colour Clustering for Face Detection “15 Seconds of Fame” Jure Kovač, Peter Peer, Franc Solina Computer Vision Laboratory Faculty of Computer

Embed Size (px)

Citation preview

Page 1: Human Skin Colour Clustering for Face Detection “15 Seconds of Fame” Jure Kovač, Peter Peer, Franc Solina Computer Vision Laboratory Faculty of Computer

Human Skin Colour Clustering for Face

Detection

“15 Seconds of Fame”

Jure Kovač, Peter Peer, Franc Solina

Computer Vision LaboratoryFaculty of Computer and Information ScienceUniversity of Ljubljana, Slovenia

Page 2: Human Skin Colour Clustering for Face Detection “15 Seconds of Fame” Jure Kovač, Peter Peer, Franc Solina Computer Vision Laboratory Faculty of Computer

“In the future everybody will be famous for 15 minutes.”

Andy Warhol

Marilyn Monroe (Andy Warhol, 1964)

Application Contribution Skin models Tested using our

algorithm Purpose

Page 3: Human Skin Colour Clustering for Face Detection “15 Seconds of Fame” Jure Kovač, Peter Peer, Franc Solina Computer Vision Laboratory Faculty of Computer

An interactive art installation 15 second of fame

Page 4: Human Skin Colour Clustering for Face Detection “15 Seconds of Fame” Jure Kovač, Peter Peer, Franc Solina Computer Vision Laboratory Faculty of Computer

Hardware

Digital camera LCD monitor

computer

USB

Page 5: Human Skin Colour Clustering for Face Detection “15 Seconds of Fame” Jure Kovač, Peter Peer, Franc Solina Computer Vision Laboratory Faculty of Computer

Software

input photo

finding faces

transformation color filter

pop-art portrait

illumination compensation learning

15 second loop

Page 6: Human Skin Colour Clustering for Face Detection “15 Seconds of Fame” Jure Kovač, Peter Peer, Franc Solina Computer Vision Laboratory Faculty of Computer

Roadmap

Face detection algorithm Skin labeling approaches Illumination compensation

approaches Pop-art color transformations Summary

Page 7: Human Skin Colour Clustering for Face Detection “15 Seconds of Fame” Jure Kovač, Peter Peer, Franc Solina Computer Vision Laboratory Faculty of Computer

Face detection method #1Our original face detection method

Page 8: Human Skin Colour Clustering for Face Detection “15 Seconds of Fame” Jure Kovač, Peter Peer, Franc Solina Computer Vision Laboratory Faculty of Computer

Face detection method #2Simplified face detection method

Page 9: Human Skin Colour Clustering for Face Detection “15 Seconds of Fame” Jure Kovač, Peter Peer, Franc Solina Computer Vision Laboratory Faculty of Computer

Skin labeling approaches #1

Our modelin RGB colour space

Page 10: Human Skin Colour Clustering for Face Detection “15 Seconds of Fame” Jure Kovač, Peter Peer, Franc Solina Computer Vision Laboratory Faculty of Computer

Skin labeling approaches #2

Model #1in UV colour space

Hsu et al(TPAMI’02)

Cb Cr

Y Y

Page 11: Human Skin Colour Clustering for Face Detection “15 Seconds of Fame” Jure Kovač, Peter Peer, Franc Solina Computer Vision Laboratory Faculty of Computer

Skin labeling approaches #3

Model #2in UV colour space

Hsu et al(TPAMI’02)

Cb

Cr

Page 12: Human Skin Colour Clustering for Face Detection “15 Seconds of Fame” Jure Kovač, Peter Peer, Franc Solina Computer Vision Laboratory Faculty of Computer

Skin labeling approaches #4 –Results #1

Page 13: Human Skin Colour Clustering for Face Detection “15 Seconds of Fame” Jure Kovač, Peter Peer, Franc Solina Computer Vision Laboratory Faculty of Computer

Skin labeling approaches #4 –Results #2

Page 14: Human Skin Colour Clustering for Face Detection “15 Seconds of Fame” Jure Kovač, Peter Peer, Franc Solina Computer Vision Laboratory Faculty of Computer

Skin labeling approaches #4 –Results #3

Page 15: Human Skin Colour Clustering for Face Detection “15 Seconds of Fame” Jure Kovač, Peter Peer, Franc Solina Computer Vision Laboratory Faculty of Computer

Eliminating the influence of non-standard illumination

Grey World Modified Grey World White-Patch Retinex

Color by Correlation

Page 16: Human Skin Colour Clustering for Face Detection “15 Seconds of Fame” Jure Kovač, Peter Peer, Franc Solina Computer Vision Laboratory Faculty of Computer

Color transformations

+ color-balance

+ random coloring

+ posterize+ hue-saturation

+ color-balance+ posterize+ hue-saturation

= 17 universal filters

Different displayingE-mail ordering of portraits

Page 17: Human Skin Colour Clustering for Face Detection “15 Seconds of Fame” Jure Kovač, Peter Peer, Franc Solina Computer Vision Laboratory Faculty of Computer

Conclusions

Graz (Austria), Zagreb (Croatia) Leonardo (MIT Press) Rent/Buy

For our detection scheme the 3D Color space proved better!!!

The people accepted application very well

Page 18: Human Skin Colour Clustering for Face Detection “15 Seconds of Fame” Jure Kovač, Peter Peer, Franc Solina Computer Vision Laboratory Faculty of Computer

The gallery of famous people

from the project web page: black.fri.uni-lj.si/15sec

Page 19: Human Skin Colour Clustering for Face Detection “15 Seconds of Fame” Jure Kovač, Peter Peer, Franc Solina Computer Vision Laboratory Faculty of Computer

The first public showing