Visualization Open Data :: From Insight to · Director, OECD (Organisation for Economic...

Open Data :: From Insight to Visualization

Thomas Park :: developer, Google BigQueryLinuxCon Japan 2016

1

2

3

4

Introduction

Open Data : value

Open Data : applications

Examples and demos

ここはどこ？　私はだれ？

Data is moneyFree and open data is everywhere

LET’SMAKE

MONEY

Director, OECD (Organisation for Economic Co-operation and Development)

Graham Vickery

The estimated value of Open Data in the European Union in 2006 was 27 billion Euro.

Ben Wellington

Statistician, Analyst (Pratt Institute NYC, Two Sigma)

David Eaves

Berkman Centre for Internet and Society (Harvard University)

« Open Data » What is it,

and why now ?

Foto Jeremy Thomas - https://unsplash.com/photos/rMmibFe4czY

«Open Data» is raw data published in a manner that is :

● Complete● Primary● Timely● Accessible● Exploitable● Non-Discriminatory● Non-Proprietary● Rights-free● Permanent● Free

(definition by LiberTIC, Nantes)

1979. 250 MB45.000 USD

1980.

2016.

1 GB / month:

Foto CC https://www.flickr.com/photos/slgc/8213370161

«Open Data» applications

Foto https://unsplash.com/photos/45sjAjSjArQ

Transparencyand health

Air Quality Index (aqicn.org)

Participationand community

MapMyWalk (mapmywalk.com)

Civicimprovements

Ben Wellington

Who are these mysterious hydrants ?

Foto

CC

http

s://w

ww

.flic

kr.c

om/p

hoto

s/w

smon

ty/4

1817

3863

3

Bicycle path

Ben Wellington

No Parking

Foto AP Images

STREAMING INGESTION

SEPARATE BILLING !

STORAGE AND QUERY ?

Foto

CC

http

s://w

ww

.flic

kr.c

om/p

hoto

s/ca

lliop

e/51

7716

589

速いいいいい~~~!

のぞみ のように

Foto

CC

http

s://w

ww

.flic

kr.c

om/p

hoto

s/sh

odan

/211

6587

15

https://bigquery.cloud.google.com/dataset/gdelt-bq:full

Foto

CC

http

s://w

ww

.flic

kr.c

om/p

hoto

s/th

raxi

l/291

5977

5

7月14日は何だ?

ヒント：

フランス

http://opendata.paris.fr/explore/dataset/accidentologie/

7月14日: パリ祭

https://cloud.google.com/bigquery/query-reference#windowfunctions

Lukas Eder

10 SQL TRICKS YOU DIDN’T

THINK WERE POSSIBLE

#3 : WINDOW FUNCTIONS

https://www.youtube.com/watch?v=yuuhkHORzfM&t=15m34s

東京ありがとう !

@thmsprk

Foto

http

s://u

nspl

ash.

com

/pho

tos/

h3vR

1F8-

caI