41
[email protected] OpenStreetMap data quality analysis Martin Raifer, Michael Auer, Lukas Loos, Rafael Troilo, Fabian Kowatsch, Johannes Visintini & Alexander Zipf 3rd International Workshop on Spatial Data Quality Valetta (Malta) · 28.01. - 29.01.2020

OpenStreetMap data quality analysis - EuroGeographics · OpenStreetMap data quality analysis Martin Raifer, Michael Auer, Lukas Loos, Rafael Troilo, Fabian Kowatsch, Johannes Visintini

  • Upload
    others

  • View
    19

  • Download
    0

Embed Size (px)

Citation preview

Page 1: OpenStreetMap data quality analysis - EuroGeographics · OpenStreetMap data quality analysis Martin Raifer, Michael Auer, Lukas Loos, Rafael Troilo, Fabian Kowatsch, Johannes Visintini

[email protected]

OpenStreetMap data quality analysisMartin Raifer, Michael Auer, Lukas Loos, Rafael Troilo, Fabian Kowatsch,

Johannes Visintini & Alexander Zipf

3rd International Workshop on Spatial Data QualityValetta (Malta) · 28.01. - 29.01.2020

Page 2: OpenStreetMap data quality analysis - EuroGeographics · OpenStreetMap data quality analysis Martin Raifer, Michael Auer, Lukas Loos, Rafael Troilo, Fabian Kowatsch, Johannes Visintini

[email protected]

platformOpenStreetMap History Data Analyzing Platform

OSM History

OSM History

Explorer

Flexibility

Flexibility

UsabilityUsability

dashboard

API

OSHDB API

OSHDB

Page 3: OpenStreetMap data quality analysis - EuroGeographics · OpenStreetMap data quality analysis Martin Raifer, Michael Auer, Lukas Loos, Rafael Troilo, Fabian Kowatsch, Johannes Visintini

[email protected]

Agenda

Page 4: OpenStreetMap data quality analysis - EuroGeographics · OpenStreetMap data quality analysis Martin Raifer, Michael Auer, Lukas Loos, Rafael Troilo, Fabian Kowatsch, Johannes Visintini

[email protected]

Prof. Dr. Alexander Zipf

Page 5: OpenStreetMap data quality analysis - EuroGeographics · OpenStreetMap data quality analysis Martin Raifer, Michael Auer, Lukas Loos, Rafael Troilo, Fabian Kowatsch, Johannes Visintini

[email protected]

Focus areas:

Page 6: OpenStreetMap data quality analysis - EuroGeographics · OpenStreetMap data quality analysis Martin Raifer, Michael Auer, Lukas Loos, Rafael Troilo, Fabian Kowatsch, Johannes Visintini

[email protected]

Agenda

Page 7: OpenStreetMap data quality analysis - EuroGeographics · OpenStreetMap data quality analysis Martin Raifer, Michael Auer, Lukas Loos, Rafael Troilo, Fabian Kowatsch, Johannes Visintini

[email protected]

What is OSM?

Page 8: OpenStreetMap data quality analysis - EuroGeographics · OpenStreetMap data quality analysis Martin Raifer, Michael Auer, Lukas Loos, Rafael Troilo, Fabian Kowatsch, Johannes Visintini

[email protected]

What is OSM? A Map

OSM© OpenStreetMap contributors

Bing© OpenStreetMap contributors© HERE

HERE© 2020 HERE, Deutschland

Google Maps© 2020 Geobasis-DE/BKG (© 2009), Google

Page 9: OpenStreetMap data quality analysis - EuroGeographics · OpenStreetMap data quality analysis Martin Raifer, Michael Auer, Lukas Loos, Rafael Troilo, Fabian Kowatsch, Johannes Visintini

[email protected]

What is OSM? Data

OSM Data fetched from Overpass Turbo© OpenStreetMap contributors

Page 10: OpenStreetMap data quality analysis - EuroGeographics · OpenStreetMap data quality analysis Martin Raifer, Michael Auer, Lukas Loos, Rafael Troilo, Fabian Kowatsch, Johannes Visintini

[email protected]

What is OSM? An SDI

PostgreSQLPostGIS

Web APIMap Tiles

DataMetadata

Download serverCurrent OSMFull History

WIKI

Documentation

maps ... editors

5700 million nodes 635 million ways 7 million relations

https://www.openstreetmap.org/stats/data_stats.html

January 2020

Page 11: OpenStreetMap data quality analysis - EuroGeographics · OpenStreetMap data quality analysis Martin Raifer, Michael Auer, Lukas Loos, Rafael Troilo, Fabian Kowatsch, Johannes Visintini

[email protected]

What is OSM? Contributors

https://www.openstreetmap.org/stats/data_stats.html

Page 12: OpenStreetMap data quality analysis - EuroGeographics · OpenStreetMap data quality analysis Martin Raifer, Michael Auer, Lukas Loos, Rafael Troilo, Fabian Kowatsch, Johannes Visintini

[email protected]

What is OSM? Community

Page 13: OpenStreetMap data quality analysis - EuroGeographics · OpenStreetMap data quality analysis Martin Raifer, Michael Auer, Lukas Loos, Rafael Troilo, Fabian Kowatsch, Johannes Visintini

[email protected]

What is OSM? Business

Anderson, J.; Sarkar, D.; Palen, L. Corporate Editors in the Evolving Landscape of OpenStreetMap. ISPRS Int. J. Geo-Inf. 2019, 8, 232

Page 14: OpenStreetMap data quality analysis - EuroGeographics · OpenStreetMap data quality analysis Martin Raifer, Michael Auer, Lukas Loos, Rafael Troilo, Fabian Kowatsch, Johannes Visintini

[email protected]

OSM Data Model

nodes ways relations

tags

k = v

Page 15: OpenStreetMap data quality analysis - EuroGeographics · OpenStreetMap data quality analysis Martin Raifer, Michael Auer, Lukas Loos, Rafael Troilo, Fabian Kowatsch, Johannes Visintini

[email protected]

Agenda

Page 16: OpenStreetMap data quality analysis - EuroGeographics · OpenStreetMap data quality analysis Martin Raifer, Michael Auer, Lukas Loos, Rafael Troilo, Fabian Kowatsch, Johannes Visintini

[email protected]

Considerations

Scepticism

imprecise

laymen’s workvandalism

heterogeneous coverage

Page 17: OpenStreetMap data quality analysis - EuroGeographics · OpenStreetMap data quality analysis Martin Raifer, Michael Auer, Lukas Loos, Rafael Troilo, Fabian Kowatsch, Johannes Visintini

[email protected]

Considerations

TRUST

Thematical

Accuracy

Completeness

Positional

Consistencyi

Page 18: OpenStreetMap data quality analysis - EuroGeographics · OpenStreetMap data quality analysis Martin Raifer, Michael Auer, Lukas Loos, Rafael Troilo, Fabian Kowatsch, Johannes Visintini

[email protected]

Considerations

2 complementing approaches

Extrinsic methods Intrinsic methods

Compare OSM with reference

datasetConsider the history of OSM

Page 19: OpenStreetMap data quality analysis - EuroGeographics · OpenStreetMap data quality analysis Martin Raifer, Michael Auer, Lukas Loos, Rafael Troilo, Fabian Kowatsch, Johannes Visintini

[email protected]

Considerations

TRUST

UsersProcesses

Data development

Page 20: OpenStreetMap data quality analysis - EuroGeographics · OpenStreetMap data quality analysis Martin Raifer, Michael Auer, Lukas Loos, Rafael Troilo, Fabian Kowatsch, Johannes Visintini

[email protected]

Agenda

Page 21: OpenStreetMap data quality analysis - EuroGeographics · OpenStreetMap data quality analysis Martin Raifer, Michael Auer, Lukas Loos, Rafael Troilo, Fabian Kowatsch, Johannes Visintini

[email protected]

Data Extraction: Heidelberg 2008-2018

http://k1z.blog.uni-heidelberg.de/files/2018/12/buildings_addrcity-not-null.gif

buildings

+ address info(addr:city)

Page 22: OpenStreetMap data quality analysis - EuroGeographics · OpenStreetMap data quality analysis Martin Raifer, Michael Auer, Lukas Loos, Rafael Troilo, Fabian Kowatsch, Johannes Visintini

[email protected]

Aggregation: health facilities

http://k1z.blog.uni-heidelberg.de/2019/05/16/exploring-osm-history-the-example-of-health-realted-amenities/

FranceFrance Germany

doctorsclinichospital

amenity

Page 23: OpenStreetMap data quality analysis - EuroGeographics · OpenStreetMap data quality analysis Martin Raifer, Michael Auer, Lukas Loos, Rafael Troilo, Fabian Kowatsch, Johannes Visintini

[email protected]

Strong community impactNepal Earthquake 2015

Auer et al. 2018: Towards Using the Potential of OpenStreetMap History for Disaster Activation Monitoring. Proceedings of the 15th ISCRAM Conference – Rochester, NY, USA May 2018

Page 24: OpenStreetMap data quality analysis - EuroGeographics · OpenStreetMap data quality analysis Martin Raifer, Michael Auer, Lukas Loos, Rafael Troilo, Fabian Kowatsch, Johannes Visintini

[email protected]

Central concepts

● Lossless● Simple, but powerful● High performance● Levels of usability● Flexible deployment: run it local or distributed

Page 25: OpenStreetMap data quality analysis - EuroGeographics · OpenStreetMap data quality analysis Martin Raifer, Michael Auer, Lukas Loos, Rafael Troilo, Fabian Kowatsch, Johannes Visintini

[email protected]

ohsome query

Aggregation

OSM Elements

Users (contributors)

Data extraction

Snapshots

Full History

Page 29: OpenStreetMap data quality analysis - EuroGeographics · OpenStreetMap data quality analysis Martin Raifer, Michael Auer, Lukas Loos, Rafael Troilo, Fabian Kowatsch, Johannes Visintini

[email protected]

ohsomeHeXohsomeHeX

Page 30: OpenStreetMap data quality analysis - EuroGeographics · OpenStreetMap data quality analysis Martin Raifer, Michael Auer, Lukas Loos, Rafael Troilo, Fabian Kowatsch, Johannes Visintini

[email protected]

ohsomeHeX

Page 31: OpenStreetMap data quality analysis - EuroGeographics · OpenStreetMap data quality analysis Martin Raifer, Michael Auer, Lukas Loos, Rafael Troilo, Fabian Kowatsch, Johannes Visintini

[email protected]

ohsomeHeX

Page 32: OpenStreetMap data quality analysis - EuroGeographics · OpenStreetMap data quality analysis Martin Raifer, Michael Auer, Lukas Loos, Rafael Troilo, Fabian Kowatsch, Johannes Visintini

[email protected]

api.ohsome.org

Page 33: OpenStreetMap data quality analysis - EuroGeographics · OpenStreetMap data quality analysis Martin Raifer, Michael Auer, Lukas Loos, Rafael Troilo, Fabian Kowatsch, Johannes Visintini

[email protected]

Recap

OSM has:

… Manpower, transparency of concepts, processes and technology

OSM is:

… Diverse, biased, heterogeneous, rich, poor

BUT: dynamic, thus, able to improve and capable to adapt and innovate

… opens the OSM-History to be included in spatial data quality analyses… can complement extrinsic approaches with novel intrinsic quality indicators… can help you to find out if OSM is fit for your purpose… can give you TRUST

Page 34: OpenStreetMap data quality analysis - EuroGeographics · OpenStreetMap data quality analysis Martin Raifer, Michael Auer, Lukas Loos, Rafael Troilo, Fabian Kowatsch, Johannes Visintini

[email protected]

Questions ?

?

?

?

?

Dr. Michael [email protected]

https://ohsome.org

Page 35: OpenStreetMap data quality analysis - EuroGeographics · OpenStreetMap data quality analysis Martin Raifer, Michael Auer, Lukas Loos, Rafael Troilo, Fabian Kowatsch, Johannes Visintini

[email protected]

Leveraging the Potential of

Open Crowd-Generated Geoinformation and

innovative Geoinformation Technologies

for Citizens and Environment

Page 37: OpenStreetMap data quality analysis - EuroGeographics · OpenStreetMap data quality analysis Martin Raifer, Michael Auer, Lukas Loos, Rafael Troilo, Fabian Kowatsch, Johannes Visintini

[email protected]

Data model

Data partitioning Grid cells with local spatial index OSH Data Entity

Page 38: OpenStreetMap data quality analysis - EuroGeographics · OpenStreetMap data quality analysis Martin Raifer, Michael Auer, Lukas Loos, Rafael Troilo, Fabian Kowatsch, Johannes Visintini

[email protected]

https://downloads.ohsome.org

Page 39: OpenStreetMap data quality analysis - EuroGeographics · OpenStreetMap data quality analysis Martin Raifer, Michael Auer, Lukas Loos, Rafael Troilo, Fabian Kowatsch, Johannes Visintini

[email protected]

OSHDB Java API

Page 40: OpenStreetMap data quality analysis - EuroGeographics · OpenStreetMap data quality analysis Martin Raifer, Michael Auer, Lukas Loos, Rafael Troilo, Fabian Kowatsch, Johannes Visintini

[email protected]

ohsome query - aggregation

Entity Filter

Aggregation

Transformation

Result Filter

Grouping

Page 41: OpenStreetMap data quality analysis - EuroGeographics · OpenStreetMap data quality analysis Martin Raifer, Michael Auer, Lukas Loos, Rafael Troilo, Fabian Kowatsch, Johannes Visintini

[email protected]

ohsome query - aggregation

Entity Filter

Aggregation

Area of Interest

Timerange and resolution

OSM type (node, way, relation)

Thematic selection

Custom filter

Transformation

Result Filter

Grouping By timestamp / boundary / tag / key

Access to all properties (geom, tags, metadata)

Optional, e.g. cleanup

Count, average, sum, count unique, etc.