Data Strategies: Metadata, Open Data, Linked Data

Preview:

DESCRIPTION

In the age of Big Data, filtering mechanisms have to professionalized to increase accessibility to data. This presentation, held at Knowledge Management Academy in Vienna, shows how technologies derived from the Semantic Web can help to establish more efficient means to manage data and information.

Citation preview

Data StrategiesMetadata, Open Data & Linked Data

Andreas BlumauerCEO, Semantic Web Company

www.semantic-web.atwww.poolparty.biz

About Semantic Web Company

Company was founded 2001 in Vienna, Austria

>20 experts in linked data technologies

Product: PoolParty Suite (launched 2009)

Serving global 500 companies & large NGOs

EU- & US-based consulting services

Some customers we serve

• Pearson• GBPN• World Bank

• Daimler• Credit Suisse• Roche

• Wolters Kluwer• Council of EU• Wood Mackenzie

• Ministry of Finance (AUT)• Education Services (AUS)• REEEP

Agenda

Intro

Data management – the current situation

Potential & Benefits of Linked Open Data (LOD) – what is metadata, open data, linked data, what is linked open data?

Use Cases

Global Buildings Performance Network (GBPN) & BPIE

World Bank Thesauri

EIP on Water: Marketplace

Renewable Energy & Energy Efficiency Partnership (REEEP)

Q & A

Every day, we create 2.5 quintillion bytes of data — so much that 90% of the data in the world today has been created in the last two years

alone.That are 3,4 billion HD movies.

Which problems can be solved on top of big data?

Common interests. Common topics.

WaterManagement

Common vocabulary? Common understanding?

Wastewatertreatment Wastewater

treatment

WaterManagement

Globalisation + Localisation = Glocalisation

CertificationRating

(Europe) (U.S.)

Common data? Questions in common?

Energy management policiesSearc

h

WaterManagement

The Semantic Puzzle

Data Analytics 2.0 -The islands are now open for the experts

Data management in the environmental sector – The current situation

Example: Buildings performance “2012 saw the launch of an impressive

number of online portals sharing data and analysis on energy efficiency in buildings” (Ingeborg Nolte, Senior Communication Manager at BPIE)

However: how can the value be leveraged of so many (open) data sets which are actually isolated from each other?

Will Excel be the ultimate solution?

What’s wrong with Open Data?

Syntactic heterogenity – different trees

Semantic heterogenity – different tags and attributes (e.g. kindergarten, child_care, daycare)

<kindergarten>

<name>Seven Dwarfs</name>

<location>...</location>

<description>...</description>

</kindergarten>

<child_care name=„Seven Dwarfs“>

<address>

<street>...</street>

<zip>...</zip>

</address>

<text>...</text>

</child_care>

<daycare id=„Seven Dwarfs“

address=„...“>

. . .

</ daycare >

What is metadata, open data or linked data? What is linked open data?

Metadata

This is an important document about solar

energy

solar energy

renewable energy

Data & Information

Metadata

Meta-metadata

Thesaurus / Ontology

Wien

Vindobona

http://voc.org.com/core/54

Places

prefLabel (de)

prefLabel

bro

ader

CoffeehousealtLabel

http://voc.org.com/core/176

prefLabelInnere Stadt

nar

row

er

GastronomyprefLabel

bro

ader

Vienna

hiddenLabel

prefLabel (en)

related

http://voc.org.com/core/77

Das CentralaltLabel

http://voc.org.com/core/44

http://voc.org.com/core/355

Café prefLabel

http://voc.org.com/core/97

nar

row

er

related

Café Central prefLabel

Data Analytics 3.0 –Connected islands based on standards

What is linked data, what is linked open data?

The Free Universal Construction Kit connectsLego®, Duplo®, Fischertechnik®, Gears! Gears! Gears!®, K’Nex®, Krinkles®, Bristle Blocks®, Lincoln Logs®, Tinkertoys®, Zome®, ZomeTool® and Zoob®

with a low cost 3D printed adapter set

CC by Golan Levin (US), Shawn Sims (US)

LOD as a giant knowledge base

Which policies in the area of renewable energy have helped to initiate projects and programmes in the agricultural sector which finally have improved substantially the nutritional situation in a certain country?

Application example #1: Energy Market Intelligence

http://integrator.poolparty.biz/report_renewable/

Scenario #1:

I am an energy market researcher at the International Energy Agency (IEA).

I inform policy makers about the situation in specific renewable energy areas to develop targeted energy support programs.

For my research I need indicators about utilisation levels of all alternative forms of energy with regards to geographical and political categories.

How does it work?

Articles about Renewable Energy 72,018 documents From ~300 web sources

Reegle Thesaurus: ~3,000 concepts Traverse hierarchies below main categories (wind, solar,

etc.) and classify documents

Geonames Annotate documents with regards to their geographical

entities

DBpedia Lookup several Yago classes to all extracted geographical

entities to assert additional categories, e.g.: EU-countries, French-speaking countries etc.

How does it work?

Semantic Search

PoolParty Semantic Integrator

Geospatial Search

Data Visualisation

SPARQL

….

Application example #2: Health Care

Scenario #2:

I am an information officer at the Global Health Observatory of the World Health Organisation.

I inform policy makers about the global situation in specific disease areas to direct support to the required health support programs.

For my research I need data about disease prevalence in relation to socio-economic factors.

http://integrator.poolparty.biz/report_medicine/

How does it work?

PubMed Articles Cardiovascular Diseases: 39,911 documents

Neoplasms: 69,937 documents

Nervous System Diseases: 48,128 documents

MeSH: 26,700 concepts / 346,600 triples Traverse hierarchies below disease main categories and classify

documents

Geonames Annotate documents with regards to their geographical entities

DBpedia Lookup HDI (The Human Development Index (HDI) is a composite

statistic of life expectancy, education, and income indices used to rank countries into four tiers of human development)

How does it work?

Semantic Search

PoolParty Semantic Integrator

Geospatial Search

Data Visualisation

SPARQL

Data management in the environmental sector – The current situation

Example: Energy data

“It’s necessary to split the responsibility for different data sets between different data providers.” (Florian Bauer)

However: how can this ‘splitting’ be co-ordinated and hwo can additional positive network effects be stimulated?

5 stars of data standards

• Publish Open Data in RDF reusing vocabularies which can be understood and combined by apps in unforeseen ways (e.g. visualization widgets)

make your stuff available on the Web (whatever format) under an open license

link your data

use URIs to denote things

use non-proprietary formats(e.g., CSV instead of Excel)

make it available as structured data(e.g., Excel instead of image scan of a table)

Licensing is key for open dataKind of license

Num. %

Not specified 132 39%

Public Domain

69 21%

Attribution 66 20%

Share alike 35 10%

Closed 16 5%

With restrictions

5 2%

Other 3 1%

Source: http://www.licensius.com/blog/lodlicenses

Use Cases

Global Buildings Performance Network (GBPN)

The Global Buildings Performance Network (GBPN) is a globally organised and regionally focused network whose mission is to advance best practice policies that can significantly reduce energy consumption and associated CO2 emissions from buildings.

Goals

Launch of the GBPN global Knowledge Platform for the Energy Performance of Buildings (www.gbpn.org)

Share Knowledge

Build Awareness & showcase best practise

Stimulate collective research

Stimulate collective analysis from experts worldwide

Promote better decision-making

Help the building sector effectively reduce its impact on climate change

Linked Open Data successfully services these objectives!

Technical Solution

Drupal CMS DB

publish

enrich

Integrated view (& search index) GBPN

KnowledgePlattform

annotation & mapping

The GBPN Knowledge Plattform

LOD based GBPN Terminology http://bit.ly/YSbD9S

GBPN News Aggregator Tool: http://bit.ly/13JLJqk

GBPN Policy Comparative Tool: http://bit.ly/X9Vihm

The GBPN Knowledge Platform is a Linked Open Data project that aims to open and connect with the best resources, data and information on buildings energy performance policies worldwide.

Report Database: http://www.gbpn.org/reports

The Laboratory: http://www.gbpn.org/laboratory

GBPN web blog: http://bit.ly/X9VSeW

Live-Demo

The Worldbank Taxonomies & Thesauri

http://vocabulary.worldbank.org/

EIP on Water - Marketplace

http://www.eip-water.eu

reegle – country profiles

http://reegle.info/countries

Same document tagged: PV

Document tagged:

photovoltaic

Understanding synonyms & relations?

Standardisation and consistency is key

Based on our experience in establishing knowledge broker portals we know:

There is a strong need to increase consistency when tagging climate and energy resources

We need to ensure the consistency of message being delivered to the public to avoid confusion using terms in different ways

This needs standardization of the used categories and tags

reegle thesaurus

The trusted Clean Energy LOD Cloud

http://blog.semantic-web.at/

reegle tagging API

Have a look on http://api.reegle.info – using the API is free!

blog.okfn.org/2013/04/08/sustainable-energy-policy-demands-sustainable-open-data/

Impact

2008 2009 2010 2011 20120

500,000

1,000,000

1,500,000

2,000,000

2,500,000

3,000,000

reegle.info users per year (not including datasets re-used on other sites)

Recommended