Upload
tim-hong
View
53
Download
0
Embed Size (px)
Citation preview
2016 10.9 10.16
https://www.youtube.com/watch?v=_Nua3Cjdik0
DSP OpenData
Tim HongE-mail: [email protected] https://tw.linkedin.com/in/hongtim
Geek MakerSeeker
App 3+yearsData RD 2 Startup1 NPO2 Apps 1st
2016 Intel pre-IoT Roadshow London
2015 Emirates Travel Hackathon SF
2015 AT&T Mobile App Hackathon - Bay Area (IoT)
2015 HackingEDU
2015 Integrate 2015 Hackathon
2014 Hackathon
2013 CfT Open data day Hackathon
2013 G0V Hackathon
DATA / URBAN DATA
WHAT IS DATA?
WHAT IS DATA?
WHAT IS DATA?
WHAT IS DATA?
http://upload.lsforum.net/users/public/q41674nba2k13%208-07p190.jpg
Geneva
http://youtu.be/ZSt9tm3RoUU
http://youtu.be/ZSt9tm3RoUU
https://www.youtube.com/watch?v=dOlLm5V0HFo
https://www.youtube.com/watch?v=tLqPEzpAR_4
Words or Fact?
DATA / URBAN DATA
>>....world
>>>....world
Through the actual city data mapping urban graphic Population
lining
amount
>>>....world
Through the actual city data mapping urban graphic Population
lining
amount
Through the actual city data mapping urban graphic
Medical (main hospital)
hospital
Through the actual city data mapping urban graphic
Education (kindergarten ~ University)
Through the actual city data mapping urban graphic
Security (Police, fire stations, monitors, accident)
Gotta Catch em All~~~
HOW
DATA ENGINEERING
Extract, transform, load(ETL) (ETL)
DATA ENGINEERING
Extract, transform, load(ETL) (ETL)
80%
DATA ENGINEERING
Extract, transform, load(ETL) (ETL)
80%
http://data.gov.tw/
Gotta Catch em All~~~
DATA ENGINEERING
Extract, transform, load(ETL) (ETL)
80%
20,000
THERE IS NO EASY WAY
PNGCSVXMLPDFXLS
1051005105/10/510510 NAnull
1051005
vs
DATA ENGINEERING
Extract, transform, load(ETL) (ETL)
80%
DATA ENGINEERING
Extract, transform, load(ETL) (ETL)
80%
vs
Why
WhyWhy
WhyWhy
What
What
What
What
WhereHow
WhatAnswer
DATA ENGINEERING
Extract, transform, load(ETL) (ETL)
XMLCSVJSON
Extensible Markup LanguageXML
Comma-Separated ValuesCSV
JSONJavaScript Object Notation
Application Programming InterfaceAPI
API
A: API ? B:A: JsonB OS: ...
()
XMLCSV
Extensible Markup LanguageXML
Comma-Separated ValuesCSV
SHOW TO OTHERS
https://carto.com/
https://timdream.org/wordcloud/
https://carto.com/
https://goo.gl/tsk4i
Geocode by Awesome Table
https://goo.gl/7NzfZX
https://goo.gl/tsk4i
https://goo.gl/7NzfZX
1 23
https://carto.com/
JSONJSONJavaScript Object Notation
googlejson
Paul Gambill https://goo.gl/zb6OQPCode https://goo.gl/TaWGNN
https://goo.gl/zb6OQPhttps://goo.gl/TaWGNN
API 1 2
https://timdream.org/wordcloud/http://ckipsvr.iis.sinica.edu.tw/
https://timdream.org/wordcloud/
1691 531
1108 528
963 521
853 493
844 480
795 473
787 460
780 456
739 452
670 450
642 443
613 431
610 425
603 424
588 414
568 413
567 405
543 399
537 373
532 366
2971 899
2811 860
2646 822
2560 815
1954 814
1834 813
1809 803
1706 797
1597 778
1514 777
1505 728
1503 694
1400 685
1372 654
1276 636
1275 629
1022 618
998 604
984 596
909 595
1691 531
1108 528
963 521
853 493
844 480
795 473
787 460
780 456
739 452
670 450
642 443
613 431
610 425
603 424
588 414
568 413
567 405
543 399
537 373
532 366
2971 899
2811 860
2646 822
2560 815
1954 814
1834 813
1809 803
1706 797
1597 778
1514 777
1505 728
1503 694
1400 685
1372 654
1276 636
1275 629
1022 618
998 604
984 596
909 595
302 43
200 41
156 41
135 40
110 39
91 38
90 38
83 37
82 36
80 36
69 34
69 34
61 33
61 33
56 32 OS
55 32
51 32
49 32
47 31
44 30
662 745
vs
Team Work
SQL 0~
Python
https://goo.gl/T5CDw7
https://goo.gl/T5CDw7
https://goo.gl/T5CDw7
https://goo.gl/T5CDw7
https://goo.gl/T5CDw7
https://goo.gl/T5CDw7
20
http://bit.ly/2016scdc
Statistics are like bikinis.
What they reveal is suggestive,
but what they conceal is vital. -Aaron Levenstein, Business Professor at Baruch Colleg
\