Eyes on the World: Putting Your Photos in Context

Eyes on the World:Putting Your Photos in Context

Mor Naaman

Yahoo! Research Berkeley

http://zonetag.research.yahoo.com 2

Attraction Map of Paris

Stanley Milgram, 1976. Psychological Maps of Paris


Attraction Map of London

Jaffe et al, 2006.


Outline

• Wisdom of the tags – mining information from geo-tagged photos

• ZoneTag – your photos in context

• Why we tag – a user study of tagging


Alternative Outline

How?

What?

Why?


Information Overload?

Flickr “geotagged”


What can we derive?

• Dataset:

(photo_id, user_id, latitude, longitude)

(photo_id, tag)

Given all photos from a geographic region,- find a “representative” summary set- generate a meaningful visualization


Issues to Tackle

• Noisy data

• Photographer biases– In locations– In Tags

• Wrong data

Whatever, color, city, spectrum, santa barbara, california, usa, Lookatme, Herbert Bayer Chromatic Gate


Intuition

More “activity” in a certain location indicates importance of that location

Tag that are unique to a certain location can suggest importance of that location


(Very) Simple Example


Summary of San Francisco

Golden Gate Bridge TransAmerica

AT&T Baseball Park

Golden Gate Twin Peaks Golden Gate

Bay BridgeOcean Beach Chinatown


Tag Maps


Tag Maps


Outline





Outline

How?

What?

Why?


Another Look at the Tag Map


ZoneTag(?)

How would we:Create/store?Find?Share?Discover?

“Everything in the world exists to end up in a photograph” -- Susan Sontag


• Programmable

• Context-aware

• Network-connected

• Quality… it’s getting there

Why Cameraphones?

• Numbers, numbers…– 500,000,000

(Source: Future Image Inc.)


Current Mobile Experience

• Difficult to share (or even save!)

• Hard to find– No context– No semantic

information


ZoneTag Experience

• 2-click upload (same key!)

• Photo uploaded with location and time metadata


ZoneTag Experience

• Tagging made easy– Tag/annotate your photos from the phone


Where do locations come from?

• Bluetooth GPS (when available)

• User-contributed cell tower mapping


Where do tags come from?

• Tags I used in this context (`home’)

• Tags my friends used in this context (`Research Meeting’)

• Tags other people used in this context (`PARC’, ‘Mor Naaman’, `This talk sucks’)


Where do tags come from?

• Stuff around you: – Yahoo! Local – Upcoming.org (`Mor Naaman @ PARC’, `PARC

George E. Pake Auditorium’)

• Stuff from you (any RSS 2.0 feed):– Calendar (G, Upcoming.org, Kiko,…)– Favorite hangouts


Suggested Tags

“When I went to upload, there were already all these exotic tags like

"Bill Graham Civic

Auditorium" and "Bob dylan

live" available...it

sure was convenient to just select and go…”


Where do tags go?

• Back to the original RSS items– Upcoming.org

• Action Tags– Trigger a call to a web service

• With parameters

– Command line - from your phone

Rotate:right Email:dad Group:zonetag Scanr:document


I’m Too Lazy (you’re not alone)

• Tagging is the means, not the goal

• Benefits even if you never tagged a single image

(Bradley Horowitz, elatable.com)

(?)

(?)

(?)


Things We Learned

• “Best” feature: 2-click upload– Even users that often tag

• For some, last chance to annotate

• Mobile tagging - not just experts, not all experts…


Things We Learned

• Tagging behavior: – All over the place

– More than Shozu– Connected to privacy

The relative number of users for different ranges of tag usage (n=172)

0%

5%

10%

15%

20%

25%

30%

<0.5 <1 <1.5 <2 <2.5 <3 <3.5 <4 <4.5 <5 5+


Outline





Outline

How?

What?

Why?


Why Tag?

• What are tags?


Why Tag?

Bay Bridge, Fog, [San Francisco, 94105]


Why Tag?

RedSox, Fenway, GreenMonster, [Boston, 02215], …


Why Tag?

Liz, sunbathing, sunny, sunglasses, concrete, [Palo Alto, 94306], …


Tag Affordances on Flickr

• Displayed next to photo

• Can be used to search:– Your own photos– Others’ photos– Public photos


Tags on ZoneTag

• By default, tags are kept from one photo to next

• Tags used in a location will be suggested in that location– To you– To others

• Immediate (i.e., during event)

• Place name tags added automatically


User Study

• 13 ZoneTag users (23-45, 9m, 4f)

• All “taggers” (no use to ask non-taggers why they tag)

• Structured interviews


Expected…

• Organization/retrieval

• Creator/synthesizer

• “Tagging for community”


Found…

• Motivation taxonomy• No “synthesizers”• Inspired by community

• Organization/retrieval• Creator/Synthesizer• “Tagging for community”X


Motivation Taxonomy

QuickTime™ and aTIFF (LZW) decompressor

are needed to see this picture.

“If I tagged ahead of time I can go back and get all my pictures of [my children]

…”

“…I then think “well, maybe I should tag

this” so I can find it again

later”“I’m

obsessive-compulsive”


Motivation Taxonomy



“I want at least one hook of association in there that can help me reconstruct…”


Motivation Taxonomy



“I tag photos with what I think might

be interesting to other

people, stuff I think

people will like”

“I know that tagging can connect my photos to activities, and get more interest”

“I want to look at all

[my neighborhood’s] tags. … That’s

definitely a reason I’m

putting these tags in ”

“...at night, by the fires all around the market, ... at each word that one man says -- such as 'wolf', 'sister', 'hidden

treasure', 'battle', 'scabies', 'lovers' -- the others tell, each

one, his tale of wolves, sisters, treasures, scabies, lovers,

battles.” -- Italo Calvino,

Invisible Cities


Motivation Taxonomy



“…so that my friends can see what I am

up to” I can tell my mom [with the tag] “look, we

went to…”

“I left reviews of

places – like at the

airport, when my flight was delayed, I

tagged “Aloha Air sucks.”


Breakdown

Organization Communication

Self P2,P6,P10, P12, P3, P8, P11

P1, P6, P2

Social (friends/family)

P8, P6

P1, P4, P7, P11, P6, P8

(public) P3, P9, P13, P2, P4, P6, P7, P8, P11, P12


Suggested Tags

• Useful for entry, when they “work”– Critical mass needed– Better filtering

• Inspire and give example

• Overtagging may be issue

“Tag suggestions were huge for

me; they really cut down on typing”

“I thought: this is how I want it to work all the

time!”

“This person was in my phone for a

month - who is she???”

“I try to use as many

suggested tags that apply. … I also use it for auto-

completion – I type “s” to get San

Francisco”


Open Questions

• Those who don’t…

• Better filtering, tag suggestions

• Longer usage trends

• Effect of community on usage

• …


Final Notes

• All Flickr/ZT photos, Creative Commons or with author permission

• http://www.flickr.com/photos/frozenquack/106111967/• http://www.flickr.com/photos/bryce_edwards/272002447/• http://www.flickr.com/photos/plasticbag/188818779/• http://www.flickr.com/photos/groovymother/131591824/• http://www.flickr.com/photos/deaneckles/220482624/


ZoneTag For All

• Everything we can do, you can do (better?)– Cell ID translation– Suggested Tags– More…

• Use ZT-technology with your app!

• Email me


Thanks

With: Shane Ahern, Simon King, Rahul Nair, Nathan Good, Marc Davis, Morgan Ames, Dean Eckles, Alex Jaffe, Tamir Tassa

Download, sign up, get the full scoop:http://zonetag.research.yahoo.com

Become an intern, get involved:Email me.

Mor [email protected]

Documents

Eyes on the World: Putting Your Photos in Context