64
All of this not entirely made by me Jaggeree /think /help /create /work All these things not entirely made by me me Thank you so much for inviting me, I thought I’d never really attend a science conference again despite being trained as a computational immunologist. I work with Crowdsourcing, is essentially what this conference is about. I’m interested in data, but I’m also interested in people and why and how they get involved in communities and give their time to make things together. I wanted to talk about some of the underlying mechanisms we use in building crowdsourced apps in the hope that there is some crossover.

All these things not entirely made by me

Embed Size (px)

DESCRIPTION

A talk on crowdsourcing mechanics and examples given to the 3rd BioCuration conference in Berlin

Citation preview

Page 1: All these things not entirely made by me

All of this not entirely made by me

Jaggeree/think/help/create/work

All these thingsnot entirely made by me

me

Thank you so much for inviting me, I thought I’d never really attend a science conference again despite being trained as a computational immunologist. I work with Crowdsourcing, is essentially what this conference is about. I’m interested in data, but I’m also interested in people and why and how they get involved in communities and give their time to make things together.

I wanted to talk about some of the underlying mechanisms we use in building crowdsourced apps in the hope that there is some crossover.

Page 2: All these things not entirely made by me

http://en.wikipedia.org/wiki/Crowdsourcing

Crowdsourcing is a neologism for the act of taking a task traditionally performed by an employee or contractor, and outsourcing it to an undefined, generally large group of people or community in the form of an open call. For example, the public may be invited to develop a new technology, carry out a design task (also known as community-based design[1] and distributed participatory design), refine or carry out the steps of an algorithm (see Human-based computation), or help capture, systematize or analyze large amounts of data (see also citizen science).

All of this not entirely made by me

Jaggeree/think/help/create/work

This is a definition from Wikipedia which itself is community annotated or crowdsourced

Page 3: All these things not entirely made by me

http://www.threadless.com/

All of this not entirely made by me

Jaggeree/think/help/create/work

Threadless, crowdsourced clothing company, people submit designs, others say they’ll buy them, when enough people commit they make them and you can buy too

Page 4: All these things not entirely made by me

http://maps.google.com

All of this not entirely made by me

Jaggeree/think/help/create/work

And for me one of best examples is not this, but it’s much better replacement. This is this area as seen by Google Maps

Page 5: All these things not entirely made by me

http://www.bgbm.org/bgbm/

All of this not entirely made by me

Jaggeree/think/help/create/work

I found this better map on a leaflet in my hotel room last night

Page 6: All these things not entirely made by me

http://www.openstreetmap.org/

All of this not entirely made by me

Jaggeree/think/help/create/work

And this is what Open Streetmap, a crowd sourced community can do. Open Streetmap grew out of a university final year project. Steve Coast was at UCL and the Ordinance Survery wanted £100,000 for a license for a map, so he created an alternative

Page 7: All these things not entirely made by me

http://maps.google.com

All of this not entirely made by me

Jaggeree/think/help/create/work

People can map better than organisations, they can go on foot places vehicles can’t and they’re not restricted by rights

Page 8: All these things not entirely made by me

http://www.openstreetmap.org/

All of this not entirely made by me

Jaggeree/think/help/create/work

Which means that the quality is amazing

Page 9: All these things not entirely made by me

http://www.flickr.com/photos/nick_bl/

All of this not entirely made by me

Jaggeree/think/help/create/work

They have mapping parties and even have high score tables for who maps the most. Every GPS point is attributed to a user

Page 10: All these things not entirely made by me

http://www.flickr.com/photos/peterito/

All of this not entirely made by me

Jaggeree/think/help/create/work

These are the actual GPS trails for New York

Page 11: All these things not entirely made by me

http://www.flickr.com/photos/peterito/

All of this not entirely made by me

Jaggeree/think/help/create/work

This is the last year... as you can see Germany has been fairly busy

Page 12: All these things not entirely made by me

All of this not entirely made by me

Jaggeree/think/help/create/work

crowdsourcing where political boundaries are as the ordinance survey restricts access

Page 13: All these things not entirely made by me

Game mechanicsOpenness Linked dataActivity surfacingIdentity/social graph

All of this not entirely made by me

Jaggeree/think/help/create/work

For me there are some key mechanisms at work and I try to build as many of them in as possible, I’ll go through them one by one

Page 14: All these things not entirely made by me

Game mechanicsLinked dataOpenness Activity surfacingIdentity/social graph

All of this not entirely made by me

Jaggeree/think/help/create/work

Game mechanics, learning from play and the games industry

Page 15: All these things not entirely made by me

All of this not entirely made by me

Jaggeree/think/help/create/work

A couple of fascinating things happened last year

Obama got elected on crowdsourced funding and by saying “we” rather than I, oh and the previous chap wasn’t too popular

Obama for America iPhone app

See nationwide 08 Call Friends total and find our how your call totals compare to leading callers

Oh my god, it’s a high score table... it’s a game of electioneering

Page 16: All these things not entirely made by me

“Obama for America just launched an Massively Multiplayer Online Game, and nobody noticed.”>Tom Armitage, infovore

http://www.flickr.com/photos/pdcawley/

All of this not entirely made by me

Jaggeree/think/help/create/work

Tom Armitage said it best, there is a leader board function from multiplayer games built right into the Obama campaign

Page 17: All these things not entirely made by me

Health Sciences Literature Review Made Easy by Judith Garrard

All of this not entirely made by me

Jaggeree/think/help/create/work

We’ve had games in science for a while... the points mean prizes mechanism of grant funding based on citation analysis and journals

Page 18: All these things not entirely made by me

http://fah-web.stanford.edu/cgi-bin/main.py?qtype=teamstats

All of this not entirely made by me

Jaggeree/think/help/create/work

and folding at home, crowdsourced application through and through

Page 19: All these things not entirely made by me

Game mechanicsOpenness Linked dataActivity surfacingIdentity/social graph

All of this not entirely made by me

Jaggeree/think/help/create/work

Secondly is openness

Page 20: All these things not entirely made by me

All of this not entirely made by me

Jaggeree/think/help/create/work

Twitter was open in that it just allowed you 140 characters... any 140 characters

Page 21: All these things not entirely made by me

All of this not entirely made by me

Jaggeree/think/help/create/work

which allowed The Guardian to make this...

Page 22: All these things not entirely made by me

http://www.flickr.com/photos/carthorse/

All of this not entirely made by me

Jaggeree/think/help/create/work

This is another great example of openness, Amanda Rose on the right created this idea of a festival for people who use twitter... she then made it open and asked anyone in the world to create a festival and raise money for a charity called charitywater

Page 23: All these things not entirely made by me

http://vimeo.com/charitywater

All of this not entirely made by me

Jaggeree/think/help/create/work

it raised $250,000 and they’re now sinking clean drinking water wells in Africa

I don’t really need to tell you about openness... it happens with everything from genomes, sequences, cell lines, mouse strains

Page 24: All these things not entirely made by me

Game mechanicsOpenness Linked dataActivity surfacingIdentity/social graph

All of this not entirely made by me

Jaggeree/think/help/create/work

Page 25: All these things not entirely made by me

OpenPlatform

All of this not entirely made by me

Jaggeree/think/help/create/workAll of this not entirely made by me

Jaggeree/think/help/create/work

Project I’m proud to be a part of, opening out all The Guardian content we can, data from infographics, and articles all on a search API like PubMed

Page 26: All these things not entirely made by me

Weaving The Guardian into the fabric of the internet.>Matt McAlister

Building a content mashup with The Guardian, Delicious, Freebase and App Engine

http://www.flickr.com/photos/pigsaw/

All of this not entirely made by me

Jaggeree/think/help/create/work

opening gambit for what we were trying to achieve, what it actually means is The Guardian is crowdsourcing some new business models in the newspaper industry

Page 27: All these things not entirely made by me

Building a content mashup with The Guardian, Delicious, Freebase and App Engine

id

Content

id

Tag

id

TaggedContent

id

Bookmark

id

BookmarkTag

id

UserTag

id

UserTaggedContent

We also wanted to show off about linked data possibilities, here’s a fun sort of application

Page 28: All these things not entirely made by me

Building a content mashup with The Guardian, Delicious, Freebase and App Engine

id

Content

id

Tag

id

TaggedContent

id

Bookmark

id

BookmarkTag

id

UserTag

id

UserTaggedContent

Guardian

Page 29: All these things not entirely made by me

Building a content mashup with The Guardian, Delicious, Freebase and App Engine

id

Content

id

Tag

id

TaggedContent

id

Bookmark

id

BookmarkTag

id

UserTag

id

UserTaggedContent

Guardian

Delicious

Page 30: All these things not entirely made by me

Building a content mashup with The Guardian, Delicious, Freebase and App Engine

id

Content

id

Tag

id

TaggedContent

id

Bookmark

id

BookmarkTag

id

UserTag

id

UserTaggedContent

Guardian

Delicious

Bespoke

Content tagger

Page 31: All these things not entirely made by me

Building a content mashup with The Guardian, Delicious, Freebase and App Engine

id

Content

id

Tag

id

TaggedContent

id

Bookmark

id

BookmarkTag

id

UserTag

id

UserTaggedContent

Guardian

Delicious

Bespoke

Freebase

Page 32: All these things not entirely made by me

All of this not entirely made by me

Jaggeree/think/help/create/work

This was my demo for Open Platform launch, something I’m really proud of... Built in 8 hours

You can find bits of Guardian content you want to help annotate... it shows you the Guardian tags and also shows you what people have tagged that content on Delicious.

You can also do controlled vocabulary tagging with the tag this article box, searching Freebase for tags and then saying if the article is about that tag or just mentions it.

Weaving The Guardian into the fabric of the internet.

Page 33: All these things not entirely made by me

Building a content mashup with The Guardian, Delicious, Freebase and App Engine

Guardian

Delicious

Bespoke?

Freebase

Content APIContent API Python Library

Delicious APIDelicious Python Library

AppEngineJQuerySome Python/HTML/Javascript

Freebase APIFreebase Suggests

by stitching together blocks of lego, I just wrote about 200 lines of code in total

I’m not really a programmer, I make things out of the possibility lego of libraries and apis

Page 34: All these things not entirely made by me

All of this not entirely made by me

Jaggeree/think/help/create/work

yet built something quite rich

science has linked data, pubmed ids, gene names, mouse strains, cell lines, also has synonym tables

Page 35: All these things not entirely made by me

Game mechanicsOpenness Linked dataActivity surfacingIdentity/social graph

All of this not entirely made by me

Jaggeree/think/help/create/work

Last two go together in a way

Page 36: All these things not entirely made by me

http://www.flickr.com/photos/wishymom/

we are a herd animal

All of this not entirely made by me

Jaggeree/think/help/create/work

We are a herd animal. We are essentially the social ape. We cannot escape our biology and in some ways that’s useful as if it didn’t there would be no social networks.

We respond to influence, we migrate from place to place within digital networks following others.

Page 37: All these things not entirely made by me

social proof/influence

http://www.flickr.com/photos/sovietuk/

All of this not entirely made by me

Jaggeree/think/help/create/work

it’s always more tempting to eat at a restaurant with a queue, rather than an empty one

social networks surface activity constantly in newsfeeds and activity streams, we can harness that for science

Page 38: All these things not entirely made by me

All of this not entirely made by me

Jaggeree/think/help/create/work

this is my twitter stream, my thoughts and what I’m doing, people see what I say do and think and some follow me... like bizarrely a cornish restaurant

Page 39: All these things not entirely made by me

All of this not entirely made by me

Jaggeree/think/help/create/work

last.fm/lastgraph

and this is the output of a service called last.fm which watches what you play on iTunes, it has an API and Andrew Godwin made this lovely thing which visualizes how your listening changes

Page 40: All these things not entirely made by me

Someone you know is helping to map routes around cities based on their personal view of accessibility.

Tell us your story on AccessCity

http://www.acesscity.co.uk/

All of this not entirely made by me

Jaggeree/think/help/create/work

AccessCity, project I’m proud to have been involved in. Started at Social Innovation Camp with a team of just 6.

Aim is to build a crowdsourced map of London from an accessibility standpoint which relates to real time user-centric information.

Page 41: All these things not entirely made by me

http://www.acesscity.co.uk/

All of this not entirely made by me

Jaggeree/think/help/create/work

Geography is all about your personal involvement with a location and this can only be gathered by people not machines and by users not surveyors.

It’s also totally time based as anyone who tries to use Kings Cross station on a Friday night can attest

we’re letting people use accounts they already have and surfacing their activity back to Facebook

Page 42: All these things not entirely made by me

http://www.acesscity.co.uk/

All of this not entirely made by me

Jaggeree/think/help/create/work

And we’re giving people profiles and soon you’ll be able to follow people so you can see what travel issues they have

Page 43: All these things not entirely made by me

Game mechanicsOpenness Linked dataActivity surfacingIdentity/social graph

All of this not entirely made by me

Jaggeree/think/help/create/work

Identity is key

Page 44: All these things not entirely made by me

All of this not entirely made by me

Jaggeree/think/help/create/work

This is my identity on a travel network called dopplr, you tell it where you go

Page 45: All these things not entirely made by me

All of this not entirely made by me

Jaggeree/think/help/create/work

and it tells you about coincidences where friends are in the same place as you at the same time

Page 46: All these things not entirely made by me

All of this not entirely made by me

Jaggeree/think/help/create/work

It’s also becoming a social atlas of places from a human centric point of view, people say where they’ve eaten, stayed and answer questions... and linked data to Flickr and Zagat improve the depth of data

Page 47: All these things not entirely made by me

So what can we crowdsource?

All of this not entirely made by me

Jaggeree/think/help/create/work

What could work for science

Page 48: All these things not entirely made by me

So what can we crowdsource?Identity/activity

All of this not entirely made by me

Jaggeree/think/help/create/work

I think a key thing is identity and activity

Page 49: All these things not entirely made by me

http://www.flickr.com/photos/pdcawley/

You can now build working software in less time than it takes to have the meeting to describe it.>Simon Willison

All of this not entirely made by me

Jaggeree/think/help/create/work

Simon’s quote

Page 50: All these things not entirely made by me

All of this not entirely made by me

Jaggeree/think/help/create/work

ScienceIDgiving science a sense of identity

http://scienceid-demo.appspot.com

so I thought I’d play

why a science ID

Can disambiguate literature

Can reward people for actions, not just publications... hopefully in the future people could be funded through all they do

Page 51: All these things not entirely made by me

All of this not entirely made by me

Jaggeree/think/help/create/work

PubMed + OpenID + OAuth + APIs + AppEngine (Python)

ScienceIDgiving science a sense of identity

Page 52: All these things not entirely made by me

All of this not entirely made by me

Jaggeree/think/help/create/work

Biopython Tutorial and Cookbook

Je! Chang, Brad Chapman, Iddo Friedberg, Thomas Hamelryck,Michiel de Hoon, Peter Cock, Tiago Antao

Last Update – 3 April 2009 (Biopython 1.50 beta)

Some lovely person made this

Page 53: All these things not entirely made by me

All of this not entirely made by me

Jaggeree/think/help/create/work

this is where I’m at after about 8 hours... not there yet, but about quarter the way there... the idea is that people can claim science they did, over time that will make a rich profile and they eventually if you can drive adoption they can use that profile to log into other sites enriching those sites with the data held against the ID and enriching their profile through their actions (last.fm for science). This could include submitting data and papers.

Page 54: All these things not entirely made by me

All of this not entirely made by me

Jaggeree/think/help/create/work

this is my twitter graph visualised by my data and that of my friends, it’s scarily accurate, I’ve told it nothing about my social graph explicitly, just think how useful this could be for science

Page 55: All these things not entirely made by me

All of this not entirely made by me

Jaggeree/think/help/create/work

so here’s the flow so far

Page 56: All these things not entirely made by me

All of this not entirely made by me

Jaggeree/think/help/create/work

login with an existing id

Page 57: All these things not entirely made by me

All of this not entirely made by me

Jaggeree/think/help/create/work

create a very minimal profile

Page 58: All these things not entirely made by me

All of this not entirely made by me

Jaggeree/think/help/create/work

Simon’s quote

Page 59: All these things not entirely made by me

All of this not entirely made by me

Jaggeree/think/help/create/work

get started with it... note social sites have very friendly copy, it’s a conversation

Page 60: All these things not entirely made by me

All of this not entirely made by me

Jaggeree/think/help/create/work

search for your stuff

Page 61: All these things not entirely made by me

All of this not entirely made by me

Jaggeree/think/help/create/work

search for your stuff

Page 62: All these things not entirely made by me

All of this not entirely made by me

Jaggeree/think/help/create/work

Simon’s quote

Page 63: All these things not entirely made by me

All of this not entirely made by me

Jaggeree/think/help/create/work

Simon’s quote

Page 64: All these things not entirely made by me

http://www.flickr.com/photos/blackbeltjones/

All of this not entirely made by me

Jaggeree/think/help/create/work

Chris [email protected]

Thank you

would love to thank all of my collaborators, however you’d probably not know any of them apart from the lovely BioPython people, but thank you for the invite and for listening