37
ONS and Linked Data Using the semantic web to link geography and statistics

ONS and Linked Datainspire.ec.europa.eu/events/conferences/inspire_2014/... · 2014. 6. 25. · “Everything happens somewhere” –UK ... Tell me everything you know about London

  • Upload
    others

  • View
    2

  • Download
    0

Embed Size (px)

Citation preview

Page 1: ONS and Linked Datainspire.ec.europa.eu/events/conferences/inspire_2014/... · 2014. 6. 25. · “Everything happens somewhere” –UK ... Tell me everything you know about London

ONS and Linked Data

Using the semantic webto link geography and statistics

Page 2: ONS and Linked Datainspire.ec.europa.eu/events/conferences/inspire_2014/... · 2014. 6. 25. · “Everything happens somewhere” –UK ... Tell me everything you know about London

“Location is the connective tissue of open data” – Sir Nigel Shadbolt

“Everything happens somewhere” – UK Location Strategy

Page 3: ONS and Linked Datainspire.ec.europa.eu/events/conferences/inspire_2014/... · 2014. 6. 25. · “Everything happens somewhere” –UK ... Tell me everything you know about London

Why do we need linked data

Ordnance Survey(National Mapping Agency)

Office for National Statistics(National Statistical Institute)

National Records Scotland(National Statistical Institute)

NI Land and Property Services(National Mapping Agency)

NI Statistics and Research Agency(National Statistical Institute)

Department for Communities and Local Government

Department for Business,Innovation and Skills

Department for Transport

Department for  Environment,Forestry and Rural Affairs

Experian

Equifax

CACI

Local Government Association

Page 4: ONS and Linked Datainspire.ec.europa.eu/events/conferences/inspire_2014/... · 2014. 6. 25. · “Everything happens somewhere” –UK ... Tell me everything you know about London

Why do we need linked data

What is the difference between the age classifications 

• 0 to 5 • 0‐5 • 0 – 5

Page 5: ONS and Linked Datainspire.ec.europa.eu/events/conferences/inspire_2014/... · 2014. 6. 25. · “Everything happens somewhere” –UK ... Tell me everything you know about London

What is linked data

http://location.gov.uk/England/Cities/London

http://location.gov.uk/geography/Capital#hascapitalcity

http://location.gov.uk/England/Countries/UnitedKingdom

subject

predicate

object

TRIPLE

Tell me everything you know about London

Tell me everything you know about the United Kingdom

Tell me every capital city

Page 6: ONS and Linked Datainspire.ec.europa.eu/events/conferences/inspire_2014/... · 2014. 6. 25. · “Everything happens somewhere” –UK ... Tell me everything you know about London
Page 7: ONS and Linked Datainspire.ec.europa.eu/events/conferences/inspire_2014/... · 2014. 6. 25. · “Everything happens somewhere” –UK ... Tell me everything you know about London
Page 8: ONS and Linked Datainspire.ec.europa.eu/events/conferences/inspire_2014/... · 2014. 6. 25. · “Everything happens somewhere” –UK ... Tell me everything you know about London
Page 9: ONS and Linked Datainspire.ec.europa.eu/events/conferences/inspire_2014/... · 2014. 6. 25. · “Everything happens somewhere” –UK ... Tell me everything you know about London
Page 10: ONS and Linked Datainspire.ec.europa.eu/events/conferences/inspire_2014/... · 2014. 6. 25. · “Everything happens somewhere” –UK ... Tell me everything you know about London
Page 11: ONS and Linked Datainspire.ec.europa.eu/events/conferences/inspire_2014/... · 2014. 6. 25. · “Everything happens somewhere” –UK ... Tell me everything you know about London

Open Data

Put your data on the web (any format)

Link your data to other people’s data

Make it available as structured data (csv)

Use open standard formats (XML, RDF)

Use URIs to identify things

Page 12: ONS and Linked Datainspire.ec.europa.eu/events/conferences/inspire_2014/... · 2014. 6. 25. · “Everything happens somewhere” –UK ... Tell me everything you know about London

Background• 2 year project to develop a linked data system 

• Create a geographic framework that statistics can be linked in to

• Take data that is currently in different products and link it together into one system

• Use URIs so that the data can be published directly to the internet

• Link our data to data from other organisations

Page 13: ONS and Linked Datainspire.ec.europa.eu/events/conferences/inspire_2014/... · 2014. 6. 25. · “Everything happens somewhere” –UK ... Tell me everything you know about London

Triplestore

GIS Server‐ published products‐ product maintenance

published products

API API

GIS to

ols

Data Explorer Product Explorer

3rd party application

ONS

EXTERN

AL

clientclient client

Linked Data System

Page 14: ONS and Linked Datainspire.ec.europa.eu/events/conferences/inspire_2014/... · 2014. 6. 25. · “Everything happens somewhere” –UK ... Tell me everything you know about London

Completed Tasks• A linked data supplier (TSO) was appointed in the first open procurement of a 

linked data solution

• Translation scripts for converting CSV files to linked data were developed in Python as it is open source and used existing skills within the organisation

• Code History product, boundaries and lookups were converted to linked data

• The RDF files were loaded into the triplestore (linked data solution) using a secure FTP site

• An existing Linked Data API was put over the top of the data but configured to include ONS branding

• Developed of a front‐end explorer tool was handed to the contractor to develop

Page 15: ONS and Linked Datainspire.ec.europa.eu/events/conferences/inspire_2014/... · 2014. 6. 25. · “Everything happens somewhere” –UK ... Tell me everything you know about London

CSV files

Page 16: ONS and Linked Datainspire.ec.europa.eu/events/conferences/inspire_2014/... · 2014. 6. 25. · “Everything happens somewhere” –UK ... Tell me everything you know about London

Python

Page 17: ONS and Linked Datainspire.ec.europa.eu/events/conferences/inspire_2014/... · 2014. 6. 25. · “Everything happens somewhere” –UK ... Tell me everything you know about London

RDF

Page 18: ONS and Linked Datainspire.ec.europa.eu/events/conferences/inspire_2014/... · 2014. 6. 25. · “Everything happens somewhere” –UK ... Tell me everything you know about London
Page 19: ONS and Linked Datainspire.ec.europa.eu/events/conferences/inspire_2014/... · 2014. 6. 25. · “Everything happens somewhere” –UK ... Tell me everything you know about London
Page 20: ONS and Linked Datainspire.ec.europa.eu/events/conferences/inspire_2014/... · 2014. 6. 25. · “Everything happens somewhere” –UK ... Tell me everything you know about London
Page 21: ONS and Linked Datainspire.ec.europa.eu/events/conferences/inspire_2014/... · 2014. 6. 25. · “Everything happens somewhere” –UK ... Tell me everything you know about London
Page 22: ONS and Linked Datainspire.ec.europa.eu/events/conferences/inspire_2014/... · 2014. 6. 25. · “Everything happens somewhere” –UK ... Tell me everything you know about London
Page 23: ONS and Linked Datainspire.ec.europa.eu/events/conferences/inspire_2014/... · 2014. 6. 25. · “Everything happens somewhere” –UK ... Tell me everything you know about London
Page 24: ONS and Linked Datainspire.ec.europa.eu/events/conferences/inspire_2014/... · 2014. 6. 25. · “Everything happens somewhere” –UK ... Tell me everything you know about London
Page 25: ONS and Linked Datainspire.ec.europa.eu/events/conferences/inspire_2014/... · 2014. 6. 25. · “Everything happens somewhere” –UK ... Tell me everything you know about London
Page 26: ONS and Linked Datainspire.ec.europa.eu/events/conferences/inspire_2014/... · 2014. 6. 25. · “Everything happens somewhere” –UK ... Tell me everything you know about London
Page 27: ONS and Linked Datainspire.ec.europa.eu/events/conferences/inspire_2014/... · 2014. 6. 25. · “Everything happens somewhere” –UK ... Tell me everything you know about London
Page 28: ONS and Linked Datainspire.ec.europa.eu/events/conferences/inspire_2014/... · 2014. 6. 25. · “Everything happens somewhere” –UK ... Tell me everything you know about London
Page 29: ONS and Linked Datainspire.ec.europa.eu/events/conferences/inspire_2014/... · 2014. 6. 25. · “Everything happens somewhere” –UK ... Tell me everything you know about London
Page 30: ONS and Linked Datainspire.ec.europa.eu/events/conferences/inspire_2014/... · 2014. 6. 25. · “Everything happens somewhere” –UK ... Tell me everything you know about London
Page 31: ONS and Linked Datainspire.ec.europa.eu/events/conferences/inspire_2014/... · 2014. 6. 25. · “Everything happens somewhere” –UK ... Tell me everything you know about London
Page 32: ONS and Linked Datainspire.ec.europa.eu/events/conferences/inspire_2014/... · 2014. 6. 25. · “Everything happens somewhere” –UK ... Tell me everything you know about London
Page 33: ONS and Linked Datainspire.ec.europa.eu/events/conferences/inspire_2014/... · 2014. 6. 25. · “Everything happens somewhere” –UK ... Tell me everything you know about London

System Usage

0

5000

10000

15000

20000

25000

30000

Week 1

Week 2

Week 3

Week 4

Week 5

Week 6

Week 7

Week 8

Week 9

Week 10

Week 11

Week 12

Week 13

Week 14

Week 15

Week 16

Week 17

Week 18

Week 19

Week 20

Week 21

Week 22

Week 23

Week 24

Week 25

Week 26

Week 27

Week 28

Week 29

Week 30

Week 31

Week 32

Week 33

Week 34

Week 35

Week 36

Week 37

Week 38

Week 39

Visits

Visitsusertesting

systemlaunch

Twitter

?

Page 34: ONS and Linked Datainspire.ec.europa.eu/events/conferences/inspire_2014/... · 2014. 6. 25. · “Everything happens somewhere” –UK ... Tell me everything you know about London
Page 35: ONS and Linked Datainspire.ec.europa.eu/events/conferences/inspire_2014/... · 2014. 6. 25. · “Everything happens somewhere” –UK ... Tell me everything you know about London

Central Government

9%

Local Government

37%

Academia34%

Private Sector10%

Other10%

Organisations

Page 36: ONS and Linked Datainspire.ec.europa.eu/events/conferences/inspire_2014/... · 2014. 6. 25. · “Everything happens somewhere” –UK ... Tell me everything you know about London

OS Postcodes

ONS Geographies

DCLG Deprivation

Page 37: ONS and Linked Datainspire.ec.europa.eu/events/conferences/inspire_2014/... · 2014. 6. 25. · “Everything happens somewhere” –UK ... Tell me everything you know about London

Ian CoadyGeography Policy and Research ManagerTel: 01329 447897  E‐Mail: [email protected]

@iancoady

ANY QUESTIONS???

uk.linkedin.com/pub/ian‐coady/11/425/423

http://statistics.data.gov.uk