CrowdSem 2013 Workshop @ISWC2013

1st International Workshop on “Crowdsourcing the Semantic Web”

Sydney, Australia21 October 2013

CrowdSem 2013

Follow us on Twitter: @crowdsem Spread the news from today: #crowdsem2013

Monday, October 21, 13

Maribel Acosta, Institute AIFB, Karlsruhe Institute of Technology, Germany

Lora Aroyo, VU University Amsterdam, the Netherlands

Abraham Bernstein, University of Zurich, Switzerland

Jens Lehmann, University of Leipzig, Germany

Natasha Noy, Stanford University, US

Elena Simperl, University of Southampton, United Kingdom

Who are we


Workshop Program

“Dr. Detective”: combining gamification techniques and crowdsourcing to create a gold standard in medical text, Anca Dumitrache, Lora Aroyo, Chris Welty, Robert-Jan Sips and Anthony Levas , (Discussant: Natasha Noy)

11:00 – 11:30 Crowdsourced Semantics with Semantic Tagging: “Don’t just tag it, LexiTag it!”, Csaba Veres, (Discussant: Lora Aroyo)

11: 30 – 12:00 SLUA: Towards Semantic Linking of Users with Actions in Crowdsourcing, Umair Ul Hassan, Sean O’Riain and Edward Curry, (Discussant: Maribel Acosta)

12:00 – 12:30 Experiment paper: Crowdsourced Entity Markup, Lili Jiang, Yafang Wang, Johannes Hoffart and Gerhard Weikum, (Discussant: Abraham Bernstein)

12:30 – 12:45 Position paper: A Role for Provenance in Social Computation, Milan Markovic, Peter Edwards and David Corsar, (Discussant: Lora Aroyo)


http://ceur-ws.org/Vol-1030/paper-02.pdf












1:45 – 2:15 Experiment paper: Frame Semantics Annotation Made Easy with DBpedia, Marco Fossati, Sara Tonelli and Claudio Giuliano, (Discussant: Maribel Acosta)

2:15 – 2:45 Experiment paper: Developing Crowdsourced Ontology Engineering Tasks: An iterative process, Jonathan Mortensen, Mark Musen and Natasha F. Noy, (Discussant: Elena Simperl)

2:45 – 3:15 Content and Behaviour Based Metrics for Crowd Truth, Guillermo Soberon, Lora Aroyo, Chris Welty, Oana Inel, Manfred Overmeen and Hui Lin, (Discussant: Abraham Bernstein)

3:15 – 3:30 Position paper: Information Reputation, Peter Davis and Salman Haq, (Discussant: Elena Simperl)

Papers accessible at: http://ceur-ws.org/Vol-1030/

Workshop Program












http://ceur-ws.org/Vol-1030/

http://ceur-ws.org/Vol-1030/

4:00 – 5:00 Big Data meets Big Social: Social Machines and the Semantic Web David De Roure, University of Oxford

This talk will discuss this opportunity for Semantic Web approaches to underpin the design and construction of future Social Machines against a backdrop of increasing scale and increasing automation.

David De Roure is Professor of e-Research at University of Oxford and Director of the Oxford e-Research Centre. Throughout his career he has worked closely in and across multiple disciplines to foster innovation in digital methods and scholarship. His current projects range from Web Science (Social Machines and Web Observatories) to Digital Humanities (computational musicology). He has a coordinating role in Digital Humanities at Oxford and is a UK strategic adviser for data resources in social media.

Invited Talk


Task: Gather structured information about the three keynotes at ISWC2013, e.g. find picturesfind research interestsfind publicationsetc.

Form groups of experienced and novices in practical crowdsourcing experienceChoose whether you would want to run the task on CrowdFlower or AMTCreate a simple design of the task (20 mins)One group member presents the design to the whole workshop (5 mins)

Selected tasks will be performed on either AMT or CrowdFlower and we will discuss the results at the wrap-up session

Crowdsourcing Exercise


Initial Designs ...


Initial Designs ...


Initial Designs ...


Stay tuned on Twitter for the results

Follow us on Twitter: @crowdsem Spread the news from today: #crowdsem2013
