Alex Quinnwww.cs.umd.edu/~aq

aq@cs.umd.edu

Crowdsourcing to Build Lists of Things

make a list of ….

Photo: Wikipedia

Relay

Ramen noodle shops in Kobe, Japan

Ramen noodle shops in Kobe, Japan

Professors researching online education

Professors researching online education

Articles about food safety

Articles about food safety

Cost

# of items cost per item hourly rate

Ramenentered 105 $0.15 / item

$6.95 / hourgood 69 $0.28 / item

Professorsentered 155 $0.20 / item

$6.91 / hourgood 131 $0.27 / item

Articlesentered 661 $0.20 / item

$13.93 / hourgood 420 $0.32 / item

Ideas

Design to facilitate clean, unique data items

For unbounded tasks, give workers just enough information about what the others are doing

Crowdsourcing lets you buy time with money

Crowd workers are workers; pay fairly