Computer Vision and the WebComputer Vision and the Web

Images on the Web Movies, news, sports

916,271 titles

10 mil. videos, 65,000 added daily

350 mil. photos, 1 mil. added daily

1.6 bil. images indexed as of summer 2005

Satellite imagery City streets

Exploring online photo collections: Exploring online photo collections: Flickr.comFlickr.com

• Flickrvision • Flickr tag browser • Flickr time graphs

Artistic VisualizationArtistic Visualization• Jason Salavon

– 100 Special Moments

– Homes for Sale

– Every Playboy centerfold

Problems with image access on the WebProblems with image access on the Web• To find anything on the Web, you must search with words!

• But what if the question is a picture?Small sand-colored

African mammal?Small furry animal with

pointy snout and long tail?

Cute gopher-like beastie that likes to stand up and hang out

in groups?

Beige-colored animal with dark eyespots, ears,

and tip of tail?

Short-term solution: Human computationShort-term solution: Human computation

• Identifying bugs and birds

• Labeling images: ESP Game, Peekaboom

Where does computer vision come in?Where does computer vision come in?

Visual searchVisual search

• Linking physical objects to the web: Microsoft Lincoln project

• Product search: Like.com

• Searching personal photo albums: Riya.com

Visual sentiment analysisVisual sentiment analysis

• Attractiveness: Hot or Not (research project)

• Cuteness: Cute overload

• Interestingness: Flickr

Exploring photo collections in 3DExploring photo collections in 3D

• Photo tourismSnavely, Seitz and Szeliski (SIGGRAPH 2006)

• Automatic photo pop-upHoiem and Efros (SIGGRAPH 2005)

Practical detailsPractical details

• Tuesdays at 3:30, room SN 115• Basic format: weekly discussion group• Paper list: http://www.cs.unc.edu/~lazebnik/fall07• Variable credit: talk to me about doing extra work!