Mdaf biodiv app tutorial

THE ENVIRONMENTAL OBSERVATION WEB AND ITS SERVICE APPLICATIONS WITHIN THE FUTURE INTERNET BIODIVERSITY APPLICATION OVERVIEW

Denis Havlik and Maria Egly

AIT Austrian Institute of Technology GmbH.

“ENVIROfying” the Future Internet

1. ENVIROFI Project and FI-PPP

2. Biodiversity Scenario

3. ENVIROFI-Bio App Walkthrough

4. Future Applications

5. TODO list

Contents

Copyright © 2013 Denis Havlik, AIT Austrian Institute of Technology GmbH.

2

1. We envision …

• a system with dynamic understanding of the Earth’s

atmospheric, marine and terrestrial spheres for the benefit

of all European citizens

ENVIROFI Project Vision

Copyright © 2013 ENVIROFI 3

1. Bringing Biodiversity into the Future Internet

• Enables biodiversity surveys with advanced ontologies

• Analysis, quality assurance and dissemination of biodiversity

data

2. Personal Information System for Air Pollutants,

allergens and meteorological conditions

• Enhance human to environment interaction

• Atmospheric conditions and pollution in “the palm of your hand”

3. Collaborative Usage of Marine Data Assets

• Assess needs of key marine user communities

• Selection of representative marine use cases for further trial:

leisure and tourism, ocean energy devices, aquaculture, oil spill

alert

ENVIROFI Scenarios

Copyright © 2013 ENVIROFI 4

1. Enable users to provide objective, semi-objective and subjective observations on biodiversity

often in remote areas and under unfavorable weather conditions

2. Integrate additional (possible contradictory) observations from third-party databases

3. Assess the quality and meaning of the correlated observation collections

Through combination of automated methods and crowdsourcing

4. Assure the users are aware of the findings and able to use them in own activities.

Biodiversity Scenario Requirenments


5

Typed Observations • a photo could be “leaf

photo” or a “tree photo”; a • number could be “tree

height in meters

Mobile App Functionality

View existing knowledge • Map view • Table view • Detailed View • Areas of Interest

Receive information (events!) • Requests for more observations, • Warnings, e.g. “pollen warning” • Interests, e.g. “monumental tree

in vicinity”

Report observations • “New” things, e.g. “here and

now I see a tree” • Obs. on existing thing, e.g. “this

tree currently blossoms

NFC-Tags: • User interface (usability) • Identification of things • Authentication

Alert!

Cac

hin

g; o

fflin

e m

od

e

Means of Reporting: • Free/controlled text (name, report) • Multiple choice (text, photo, ..) • Interval (from-to; area, …) • Sensor Input (camera, microphone,

position, pressure) • NFC Tag (offline user Interface)

Server

Backend

(or proxy)


Background Functionality


7

Plausibility/Confidence checks

Consensus building Similar & Related Observations?

Habitat Information

Image Recognition

Reporters Reputation

Observation DB

Observ. on things (independent,

conflicting, incomplete)

Observations on observations

(identification, plausibility, annotation)

Application specific views

(fusion, meaning uncertainty)

Sensor Networks

Observation Access & Management (Observation == Event!)

Mobile client App

Integrate existing data

Other:

Users, rights

Resource discovery

Data Fusion

Reasoning

Visualization

Event handling

FI-Ware “Generic Enablers” already fulfill several

requirements common to many environmental application

scenarios:

1. “Single sign on" and authorization (Identity

Management GE)

2. Event handling (Complex Event Processing GE,

Publish/Subscribe Context Broker GE)

3. On demand scaling (cloud hosting GEs)

4. BLOB storage and retrieval (cloud storage GE)

5. Ad-hoc applications for specific users (composition &

Mashup Ges)

See: http://www.fi-ppp.eu/, http://www.fi-ware.eu/

ENVIROFI and the FI-Ware


8

http://www.fi-ppp.eu/



http://www.fi-ware.eu/




9

Application Architecture

Copyright © 2013 Maria Egly, AIT Austrian Institute of Technology GmbH.

ENVIROFI-BIO APP

Walkthrough

App version 0.52, from 28.02.2013

Download and documentation on: http://catalogue.envirofi.eu

Note:

• Developed and tested on Android 4.1; not compatible with 4.0

• Expected to work (but not tested) on android v 2.3.3 and higher

App Download & Instalation

Copyright © 2013 Denis Havlik, AIT Austrian Institute of Technology GmbH. 11

http://catalogue.envirofi.eu/

Login Screen


12

Login

1. Login using previously

registered account

2. Select from list of accounts

stored on phone

Demo Login

1. Choose one of the

“DemoUser” accounts

2. Press login Note2: data entered by DemoUser

accounts will eventually be deleted

Popup Messages


13

The app uses two types of

popups

Help Messages

Most popup messages are

educational. These popups

can be safely turned off by

the user.

Warnings

In addition, the app will warn

users before performing

some “dangerous” operation

such as deleting the data or

starting a large data transfer.

Main Menu


14

List Observations

Browse through Objects of

Interest (trees), report new

objects and observations, define

new areas of interest.

Settings

Some user-selectable options

Areas of Interest

Shortcut to previously defined Areas of Interest

Press „List

Observations“

button!

Map View


15

Zoom buttons

Single OoI (tree)

Tap to show

details OoI group (11 trees)

Tap to zoom in

Add OOI button

Tap to add new tree

„My position“ button

Tap to re-center the

map on GPS position

New AoI button

Tap to add new

Area of Interest

• double-tap to zoom-in,

• stretch to zoom-out,

• drag map to pan

Adding an Area of Interest (1)


16

First login & Areas of Interest

On fist login, the app will show

an empty map. User has to

define some areas of interest

before proceeding.

Note: if you choose an existing

account (e.g. demo 1), the app will

immediately start downloading the

users data in the background.

Pan and zoom to define

AoI position and size,

then press “Save” button

Adding an Area of Interest (2)


17

Behind the Scene: AoI


18

Environmental

Georeferenced

Observation App

Environmental

Georeferenced

Observation Service

Environmental Georeferenced Observation

Proxy Service

Client Server

Area of Interest { Bounding Box

Coordinates }

Web MapTile Server Area of Interest

{ Occurrences &

Observations }

Ready to go!


19

Your data and AOIs

The app will now display the

known objects of interests

(previously reported trees) within

the new Area of Interest on a

map. New AoI appears in the

AoI list and can be used to

display the same area on a map

later.

Note: from now on, you can start

using the application offline. The

app will synchronize the list of OOIs

and observations within your AoI as

needed, whenever a network

connection is available

List View and Filters


20

List View

List view is synchronized with

the Map View and presents an

alternative view of the trees

within currently active map area.

Hint: press on a tree name to show

tree details

Filter View

Filter view can be used to pre-

select the trees corresponding to

filter criteria. The filter is

honoured by map and list view

Tree Details View


21

OOI versus observations

Most Objects of Interest in our

database are trees imported

from the tree cadastres of

Vienna and Florence.

Users can add new OOIs

(trees) as well as the

observations on existing OOIs.

Note: Our app currently displays

each report as a separate block

on tree details view, starting with

initial OOI. We plan to present a

fused view on all available

information in the future

Adding Objects of Interest


22

Why OOI?

Object of Interest is a concept

closely aligned with OGCs’

“Feature of Interest” and a

concept of “Thing” in Internet

of Things.

OOI is one of the main data

element of the Environmental

Georeferenced Observation

Service SE, and used to

represent trees in this app.

Tap here, to enter

the „add OOI“ mode.

Pan & zoom the map to

choose OOI location

Press the crosshair to report

a new OOI at this position

http://www.opengeospatial.org/

http://catalogue.envirofi.eu/?q=enablers/environmental-georeferenced-observation-service



Adding Observations on OOIs


23

Why Observations?

Concept of observation originates

from the OGC Sensor Web

Enablement.

The “Observation” data element in

the Environmental Georeferenced

Observation Service SE and in

this app corresponds to

“observation collection” rather than

to a single O&M observation.

Note: mapping to standard O&M

schema is straightforward but

working with larger documents is

more efficient in our applications.

First open a „Tree

Details“ view, e.g. by

pressing on a tree icon

on a map.

Then Press

this button

http://www.opengeospatial.org/ogc/markets-technologies/swe

http://www.opengeospatial.org/ogc/markets-technologies/swe



Supported Observed Properties


24

LTER connection

ENVIROFI-Bio app has been

designed in cooperation with

the Austrian Long Term

Ecological Research Network

(LTER).

Starting with an empty sheet

The long list of observation

properties foreseen in the

LTER data model is grouped in

logical groups and each group

can be easily displayed or

hidden as needed.

http://131.130.57.239/LTER_cms/index.php

Supported Observed Properties (2)


25

Behind the Scene: Add OoI


26

Environmental

Georeferenced

Observation App

Environmental

Georeferenced

Observation Service

Environmental Georeferenced Observation

Proxy Service

Client Server

Object of Interest { time,

geolocation,

provider,

properties }

Environmental

Georeferenced

Observation App

Behind the Scene: Leaf Image Classification


27

Environmental


Service

Environmental Georeferenced

Observation Proxy Service

Server Client

Environmental

image sample

classification

service

MDAF Image

Storage

FI-Ware Object

Storage GE

Observation { …

imagetype ‘leaf’

… }

Environmental

georeferenced

Observation App

Behind the Scene: Access Broker


28

Environmental


Service


Observation Proxy Service

Server Client

Access Broker

Observation { …

species

… }

Events in ENVIROFI applications


29

Working with Events

Propagation of Observations

and new OOIs is faciliated by

event-driven architecture of the


Observation Service SE. This

is already used to trigger

external processing services.

TODO

• Event-driven requests of

actions from users

• Pushing of events to FI-

Ware event processing

services

Event

Propagate data

Trigger services

Request actions

Alerts





Working with NFC tags


30

Offline User interfaces

GUI handling of mobile apps

can be frustrating, especially in

bad weather conditions. Our

idea is to provide an alternative

method for user input using

external objects such as NFC

tags and 2D barcodes.

OOI identification with NFC

User can associate a tree with

an NFC tag. This tag can be

used as a shortcut to open a

tree details view later.

Environmental

Georeferenced

Observation

Service

Environmental

Georeferenced

Observation

Proxy Service

Client

Technology: Environmental Georeferenced Observation App


31

Server

Sencha Touch

Android Blackberry OS

Apple IOS Windows Phone

PhoneGap

=

Apache Cordova

Presentation Layer

Application Logic

Visualization

standardized

technologies

Javascript

HTML 5

CSS

Platform

independent*

*to a large extent;

minor porting effort necessary

HTTP Interfaces:

OpenStreetMap

Google Service

API

FI-Ware Object

Storage

FI-Ware Identity

Management

Environmental

Georeferenced

Observation

App

Environmental

Georeferenced

Observation

Service

Technology: Environmental Georeferenced Observation Proxy


32

Server Client

CouchDB/

GeoCouch

CouchDB/

GeoCouch

continuous

replication

standardized

technologies

GeoJSON

HTTP

Storage/Retrieval via

http RESTful Interface

Changes Notification

API used for app GUI

updates

Created on user‘s first

login

Filtered replication to

Environmental

Georeferenced

Observation Service

Technology: Environmental Georeferenced Observation Service


33

Environmental

Georeferenced

Observation

App

Environmental

Georeferenced

Observation

Proxy Service

Client Server

CouchDB/

GeoCouch

Image Store CouchDB/

GeoCouch

Observation Store Utilities*

Data Import

WFS

SOS

XML

User Registration

GeoCouch Utilities

* implementation in Perl, Java

Information provided via

HTTP RESTful Interface

API implemented as

JavaScript Views in CouchDB

Geospatial queries available,

results encoded in

(Geo)JSON

Interface extendable for any

kind of data retrieval

requirements

Prototype implementation of

SOS available

Event interface provided for

creation of observations

• Biodiversity: plants and animal sightings, seasonal changes, invasive species, educational

• Forestry & agriculture: invasive species, spread of pests & infections

• Administration: state of inventory, need for actions (e.g. „this tree is about to fall“)

• Health: environment/health correlation, allergene plants (see ENVIROFI PEIS pilot), light & noise pollution

• Crisis Management: augmented reality for training, improved situation awareness, coordination of volunteers and field workers.

Possible Future Applications


34

http://catalogue.envirofi.eu/?q=applications/bringing-biodiversity-into-the-future-internet

• Produce and consume FI-Ware events

• „Best guess“ fused view on OOI based on all available observations (instead of showing all observations).

• Request QA observations from users as needed

• GUI changes to simplify quality-assurance by users (“this an apple-tree, not pine-tree”)

• “Find/Locate a tree” function

• Deleting own OOIs and observations, deleting Areas of Interest

• Publicly accessible Environmental Georeferenced Observation (Proxy) Service

And more… We are looking for new projects to continue development beyond ENVIROFI

TODO list


35

Coming soon …


36

Consensus Building

Other users

are asked to

check/rate the

observation

A user

makes an

observation