2013-10-10 robust and trusted crowd-sourcing and crowd-tasking in the future internet

“ENVIROfying” the Future Internet

THE ENVIRONMENTAL OBSERVATION WEBFOR THE CROSS-DOMAIN FI-PPP APPLICATIONS

Robust and trusted crowd-sourcing and crowd-tasking in the Future Internet

ISESS 2013, Oct. 09-11 2013

Denis Havlik, Maria Egly, Hermann Huber, Peter Kutschera, Markus

Falgenhauer, Markus Cizek (all AIT Austrian Institute of Technology GmbH.)

Image from: http://favim.com/image/270658/ 2

Copyright © ENVIROFI Project Consortium 3

Enviromatics meet Future Internet

Future Internet• Networking technology• Infrastructure as a Service• Internet of Things, Content,

People

INSPIRE, GMES, SISE• Geospatial• Environmental Observations• Model Web, Sensor Web, • Data Fusion, Uncertainty

ENVIROFI

FI-PPP Environmental Usage Area

• FI Requirements• Specific Enablers• Envirofied cross-area Applications

ENVIROFI Scenarios

1. Bringing Biodiversity into the Future Internet• Enabled biodiversity surveys with advanced ontologies• Analysis, quality assurance and dissemination of biodiversity data

2. Personal Information System for Air Pollutants, allergens and meteorological conditions

• Enhance human to environment interaction• Atmospheric conditions and pollution in “the palm of your hand”

3. Collaborative Usage of Marine Data Assets• Assess needs of key marine user communities• Selection of representative marine use cases for further trial:

leisure and tourism, ocean energy devices, aquaculture, oil spill alert

Copyright © 2013 ENVIROFI Project Consortium 4

Copyright © 2013 Denis Havlik, AIT Austrian Institute of Technology GmbH. 5

Challenge: human sensors

Copyright © 2013 Denis Havlik, AIT Austrian Institute of Technology GmbH.

Illustration by Scoobay (http://www.flickr.com/photos/scoobay/224565711/)6

Motivation matters!


Challenge: plausibility and QA

8

Image Classifier SEQuality Assessment SE

classify & check images

Image Archive SEmanage images

MDAF servermobile acquisition

General Userleaf images

metadata (e.g. geotag)

Expertleaf species

manual assessment

© 2013 ENVIROFI Project Consortium

Microlearning helps!


Objective Possible approach

How to use the application? Tooltips or popup messages on first use (implemented)

Training to recognise objects

Scavenger hunt for known and tagged objects

Learn to avoid misidentifications

control questions & feedback

A-posteriori feedback Notify user when more info on the object is available (implemented)

Classify data & assess users knowledge

Generalized re-capcha principle

Microlearning in a sense of „learning while doing“ is crucial for quality of information but still not sufficiently taken into account. On TODO list.

Observation DB

Challenges: no single truth

10

Plausibility/Confidence checks

Consensus buildingPrevious situation

knowledge

HabitatInformatio

n

Image Recognition

Reporters Reputation

Observ. on things(independent,

conflicting, incomplete)

Observations on observations

(identification, plausibility, annotation)

Application specific views

(fusion, meaning uncertainty)

Sensor Networks

ENVIROFI observations

ENVIROFI observations

Integrate existing data

Integrate existing data

USE


Challenge: FI-Ware integration

11

„Cloud Edge“ GE: Field-deployment of observations server; (P2P?) information exchange over local

WLAN

„Cloud Edge“ GE: Field-deployment of observations server; (P2P?) information exchange over local

WLAN

11

Observations & Situation

Awareness

Cloud StorageStoring of BLOBS (photos, videos)

Cloud StorageStoring of BLOBS (photos, videos)

Marketplace GEs: sales, revenue

sharing

Marketplace GEs: sales, revenue

sharing

Pub/sub GE: Events processing

& dissemination

Pub/sub GE: Events processing

& dissemination

Security GEs: user & right mgm.; legal compliance

Security GEs: user & right mgm.; legal compliance

IoT GEs: Smart sensors?

IoT GEs: Smart sensors?

Environmental SEs

Meaning

Data Fusion, Forecasting

Harvestors, Connectors

Observations

Big data GEs: Annotation & processing

Big data GEs: Annotation & processing

Cloud mgm. GEs: automated

deployment, scaling

Cloud mgm. GEs: automated

deployment, scaling

I2ND GEs: Network reliability,

Hardware abstraction,

I2ND GEs: Network reliability,

Hardware abstraction,

Mashup GE: Ad-hoc applications

Mashup GE: Ad-hoc applications


Challenge: adding features

12

ENVIROFI web-mashup PoC: http://youtu.be/yEXlLQYq7s4

Challenges: user interactionView existing knowledge•Map view•Table view•Detailed View•Areas of Interest

View existing knowledge•Map view•Table view•Detailed View•Areas of Interest

Receive information (events!)•Requests for more observations, •Warnings, e.g. “pollen warning”•Interests, e.g. “monumental tree in vicinity”

Receive information (events!)•Requests for more observations, •Warnings, e.g. “pollen warning”•Interests, e.g. “monumental tree in vicinity”

Report observations•“New” things, e.g. “here and now I see a tree”•Personal, e.g. “I have a headache”•Obs. on existing thing, e.g. “this tree currently blossoms

Report observations•“New” things, e.g. “here and now I see a tree”•Personal, e.g. “I have a headache”•Obs. on existing thing, e.g. “this tree currently blossoms

Inform

Server Backend(or proxy)

Alert!Request Action!


Crowd tasking workflow

14

Mobile Users

Sensors

AutomatedTasking

External Data

ManualTasking

Decision

maker

Experts Algorithms


Mobile Users

Challenges: tracking of users?

Work with „Areas of Interest“: •defined by users•Could be automatically generated when user significantly moves

Why AOIs?1.pre-fetching of data => allows offline use2.Server-side filtering of events

No tracking!Current users position is taken into account by the Mobile app logic!


1 23

4 5

67 8

AOIAOI

AOIAOI

AOIAOI

Do it on the phone!


Do you really need to process users sensitive

data (e.g. health-related) on the backend

server?

Environmental Georeferenced

Observation App


Observation App


Observation Service


Observation Service

Challenges: unreliable networks

Copyright © 2013 Maria Egly, AIT Austrian Institute of Technology GmbH. 17

ServerClient

CouchDB/GeoCouch

CouchDB/GeoCouch

continuousreplication

standardized technologies

GeoJSON

HTTP

Storage/Retrieval via http RESTful Interface

Changes Notification API used for app GUI updates

Created on user‘s first login

Filtered replication to Environmental Georeferenced Observation Service


Observation Service


Observation Service

Environmental Georeferenced Observation Proxy Service

Environmental Georeferenced Observation Proxy Service

ClientClient

Challenges: platform dependence

Copyright © 2013 Maria Egly, AIT Austrian Institute of Technology GmbH. 18

ServerServer

Sencha Touch

AndroidBlackberry OS

Apple IOS Windows Phone

PhoneGap =

Apache Cordova

Presentation LayerPresentation Layer

Application LogicApplication Logic

VisualizationVisualization

standardized technologies

Javascript

HTML 5

CSS

Platform independent*

*to a large extent;minor porting effort necessary

HTTP Interfaces:

OpenStreetMap

Google Service API

FI-Ware Object Storage

FI-Ware Identity Management


Lessons learned?

Ultimate challenge: industrialization

We are transforming the ENVIROFI experiments into a

reliable and scalable FOSS product.

Ultimate challenge: industrialization

First public presentation of “UBICITY” by Jan von Oort is

tomorrow! (11:20-11:40 - during coffee break)

hint: http://xkcd.com/1110/

1. The ideas presented today were developed and partially realized as Mobile Data Acquisition System (MDAF) in the scope of the European Community's Seventh Framework Programme (FP7/2007-2013) under Grant Agreement Number 284898 (ENVIROFI)

2. The importance of microlearning really became clear to me very recently, thanks to Dr. Christian Voigt and the microlearning 7.0 conference.

3. MDAF contributors: Eun Yu, Clemens Bernhard Geyer, Peter Kutschera, Markus Falgenhauer, Markus Cizek, Ralf Vamosi, Maria Egly, Hermann Huber and most recently Jan von Oort.• Currently active developers are underlined.

Acknowledgements

22

• All slides which are marked as © 2013 Denis Havlik or © 2013 Maria Egly can be re-used under the terms of the Creative Commons ”Attribution-ShareAlike 3.0“ license.

• Illustration on the pages 2 and 6 have been marked for free re-use by their authors. To the best of my knowledge the licenses are compatible with CC.

• Disclaimer: I am not a lawyer. Please follow the links for more info.

• The logos on slides 17 and 23 are of course IPR of the respective companies. To the best of my knowledge this falls into “fair use”

IPR and fair re-use

23

Thank you for your attentionDr. Denis Havlik

[email protected]

The research leading to these results has received funding from the European Community's Seventh

Framework Programme (FP7/2007-2013) under Grant Agreement Number 284898

www.envirofi.eu