OpenDataMonitor Monitoring, Analysis and Visualisation of Open Data Catalogues, Hubs and Repositories

The Challenges

2

Current Open Data Challenges

Numerous organisations and public bodies already publish open data or currently start to do so but use different systems and vocabularies.

Open data of relevant stakeholders is stored either on a local, regional, national or pan-European level.

Entered metadata is often incomplete or inaccurate.

On all levels the open data situation appears to be very fractured and hard to overlook. This lead to planning problems and raises questions such as:

Which catalogues/datasets are available?

Quality of available resources?

Which gaps reduce re-use of open data?

3

The OpenDataMonitor Consortium

4

research on open data topologies, sources,

parameters and categorisation models.

scalable open data

monitoring concept

using metadata,

parameters and key-

indicators.

open data analysis and monitoring tool

with intuitive dashboards and

visualisations.

Identify technologies, processes

and methods on open data

monitoring as well as open data

stakeholder requirements.

Main Objectives of OpenDataMonitor

The Objectives

5

The Process

Harvest

Harmonize

Analyse

Visualize

CKAN harvester extracting metadata from CKAN-based catalogues

HTML harvester extracts metadata from the HTML pages

Socrata harvester collect metadata from catalogues built upon Socrata platform

Handle the heterogeneity of collected metadata

- transforms and maps different metadata sets to an internal common schema

- make it possible to interpret, aggregate and use the metadata in a consistent way

The analysis is based on the extracted and harmonised metadata

Quality metrics (e.g. Open licence, Machine readable, Open access, Open formats)

Quantity metrics (e.g Total distribution size, Number of distributions, Number of datasets,

Number of unique publishers, Catalogues harvested)

Present the data and the analytics using intuitive:

- dashboards

- Charts

- filterable lists

- comparable statistics

6

Overview

315 data catalogues collected

161 harmonised data catalogues

27 countries + International

3 platform [CKAN, Socrata, HTML]

733,437 Total Distributions

283,269 Total Datasets

1,240GB Total Size Distribution

4,044 Unique publishers

European Dashboard

7

Get a quick overview on metrics on an European level

Country Dashboard

8

See aggregated metrics and catalogues for each country

Catalogue Dashboard

9

Learn more about each data catalogue

List of Datasets / Dataset Details

10

See all datasets of one catalogue and metadata for each dataset

Search for Catalogues

11

Filter data catalogues by country, platform …

Search for Datasets

12

Filter datasets for categories, licenses, format …

Compare Countries

13

Compare metrics of two or more countries

Compare Catalogues

14

Compare metrics of two or more catalogues

Alert Monitor

15

Find datasets with missing but important metadata

Methodology / About

16

Details on used methods and where to find more information

17

Knowledge Base

General Insights on Open Data

OpenDataMonitor Background Knowledge

Instructions and Trainings

FAQs

Technical Resources

18

Web Presence

Project Website: http://project.opendatamonitor.eu/

Platform: http://opendatamonitor.eu/

Knowledge Base: http://knowhow.opendatamonitor.eu/

Twitter: https://twitter.com/opendatamonitor

Github: https://github.com/opendatamonitor

19