Embed Size (px)
Citation preview
Transport DataMapping Data
Michael Hörz – [email protected] - @data_meining
HTW BerlinJune 25, 2014
This work is licensed under a Creative Commons Attribution-ShareAlike 3.0 Germany License
Open Data: Session 14 – Transport & Mapping Data
Public Transport Data
● Basics● Open Transit Data● Formats● Repositories● Use Cases
Open Data: Session 14 – Transport & Mapping Data
Transport Data: Basics● Timetables in machine-readable form
○ Where is which line at which time?○ List of stations/stops including geolocation
● Different level of detail depending on country○ How strong is public transport spread out?○ Is there a national policy?○ Are the transport companies state-owned?○ Is data provided on a national level?○ Is data as well provided for states and cities?○ Is the data open in terms of the Open Definition?
Open Data: Session 14 – Transport & Mapping Data
Open Transit Data
● Available to anyone● Data in machine-readable form● No costs charged howsoever● Commercial (re-)use allowed● Apparent (easily findable) license● Complies to standard formats● Different levels of compliance -
USA/UK vs. Germany, Switzerland
Open Data: Session 14 – Transport & Mapping Data
● German Standard: VDV 452● Also covers internal information, work schedules etc.
● Industry Standard: GTFS(General Transit Feed Specification)● Developed by Google + Portland TriMet
(Public Transport Operator) - Launched 2005● Under CC-BY 3.0 License● GTFS-realtime for real-time updates
developers.google.com/transit/gtfs-realtime
Transit Data: Formats
Open Data: Session 14 – Transport & Mapping Data
Transit Data: Formats IIRequired
● agency.txt● stops.txt● routes.txt● trips.txt● stop_times.txt● calendar.txt
developers.google.com/transit/gtfs
developers.google.com/transit/gtfs/reference
Optional● calendar_dates.txt● fare_attributes.txt● fare_rules.txt● shapes.txt● frequencies.txt● transfers.txt● feed_info.txt
Open Data: Session 14 – Transport & Mapping Data
Transit Data: Formats IIIComma delimited, UTF-8 encodedHow they relate:● stops.txt with name, lat, long● routes.txt with route ID + names, type● trips.txt with route ID, service ID + trip ID● stop_times.txt with trip ID, arrival + departure time
and stop ID● calendar.txt with service ID + weekdays + start
and stop day of service (exceptions possible via calendar_dates.txt)
Open Data: Session 14 – Transport & Mapping Data
Transit Data: APIs● Proprietary
○ HAFAS (HaCon Ingenieurgesesellschaft) for
Deutsche Bahn, SBB (Switzerland) and others:hacon.de/hafas/daten/datendrehscheibe
● Open
○ Ruter Labs (Norway):labs.trafikanten.no/how-to-use-the-api.aspx
○ Verkehrsverbund Berlin-Brandenburg: vbb.de/labs
○ Switzerland: transport.opendata.ch
Open Data: Session 14 – Transport & Mapping Data
● GTFS Data Exchange: gtfs-data-exchange.com
● Traveline National Dataset (UK):data.gov.uk/dataset/traveline-national-dataset
● VBB (Berlin & Brandenburg)○ berlin.appsandthecity.net/daten○ daten.berlin.de/datensaetze/vbb-fahrplan-2013
● Stadtwerke Ulm:swu.de/privatkunden/swu-nahverkehr/gtfs-daten.html
● City of Vienna:open.wien.at/site/datensatz/?id=add66f20-d033-4eee-b9a0-47019828e698
Data Sources
Open Data: Session 14 – Transport & Mapping Data
● VBB Live Map:fahrinfo.vbb.de/bin/help.exe/dn?L=vs_mobilitymap&tpl=fullmap&tabApp=show
● Mapnificent: mapnificent.net
● App Examples: citygoround.org/apps
● (ÖPNV Karte: öpnvkarte.de)
● Broken Lifts (Berlin): brokenlifts.org (relaunch coming)
● Google Maps with GTFS-Realtime:maps.google.de (since Fall 2012)
Transit Applications
Open Data: Session 14 – Transport & Mapping Data
Mapping Data
● Open Street Map ● Mapping Examples
Open Data: Session 14 – Transport & Mapping Data
Background: OSM
Open Street Map● Started in 2004● Presently 1 mio users● Import a number of sources, i.e. TIGER
database in the USA● Manual editing and GPS data import● Enormous amount of additional data
(Points of Interest: bus stops, traffic lights, ATMs ...)
Open Data: Session 14 – Transport & Mapping Data
Open Street Map II
● Data available under CC license
● Editor for OSM users● Now iD, Potlatch before
● Specific Data can be retrieved via APIs● Example: overpass-turbo.eu
Open Data: Session 14 – Transport & Mapping Data
Mapping: Examples● New York - 1936 vs. Today:
smithsonianmag.com/history-archaeology/This_Interactive_Map_Compares_the_New_York_City_of_1836_to_Today.html
● Offenes Köln - Accident Map:offeneskoeln.de/lab/unfallkarte
● NYC: Flood Map: projects.propublica.org/nyc-flood
● Stamen Design - Map Tiles:maps.stamen.com/#watercolor/12/37.7706/-122.3779
Open Data: Session 14 – Transport & Mapping Data
Mapping: Examples II● Skobbler: maps.skobbler.de
● Income + public transport usage in New York City:nofarehikes.net/map
● Election Map - See who didn’t vote for De Blasio (NYC):huffingtonpost.com/2013/11/06/who-voted-for-joe-lhota_n_4227989.html
● Twin Cities Crime Map: stpaulcrime.twincities.com
● Wahlatlas: vis.uell.net/wahlatlas
Open Data: Session 14 – Transport & Mapping Data
Further Info: Transit Data● How GTFS evolved:
sf.streetsblog.org/2010/01/05/how-google-and-portlands-trimet-set-the-standard-for-open-transit-data
● Google or VDV Interfaces? Swiss Examples:de.slideshare.net/wayneswiss/vdv-45x-oder-google-neue-schnittstellen-fr-den-datenaustausch
● Data models by VDV: vdv.de/oepnv-datenmodell.aspx
● Crowd sourced documentation of HAFAS XML API:github.com/mphasize/vbb-hafas-docs
● openPlanB (by Michael Kreil): openplanb.tumblr.com
● Munich’s Non-Plans for Open Transit Data:ris-muenchen.de/RII2/RII/DOK/ANTRAG/2914292.pdf
Open Data: Session 14 – Transport & Mapping Data
Further Info: Mapping● School of Data: schoolofdata.org/2013/11/09/web-mapping
● Mike Bostock (D3) - Let’s make a map: bost.ocks.org/mike/map
● Mapping (Noah Veltman):github.com/veltman/learninglunches/tree/master/maps
● Maps with QGIS + Tilemill: ulrichlang.de/?p=384
● Matthew Ericson - When Maps Shouldn’t Be Maps:ericson.net/content/2011/10/when-maps-shouldnt-be-maps
● Changing Demographies of Germany:viewsoftheworld.net/?p=2719
● Mike Migurski (formerly Stamen): mike.teczno.com
● Polymaps (partly by Stamen): polymaps.org
