Upload
guy-hadash
View
133
Download
2
Embed Size (px)
Citation preview
USING BIG DATA AND OPEN SOURCE FOR SMART CITY PLANNINGGUY HADASH, PAULA TA-SHMA
BIG DATA-IOT
The IoT market will grow to $1.7 trillion in 2020 (IDC)
Sens
ors
(Inter
net o
f Thin
gs)
VoIPSocial Media
(video, audio and text)
Enterprise Data
By 2020 the number of networked devices will be 30 billion (IDC), more than 4 times the entire global population
2005 2012 2017
WE DON’T KNOW HOW TO USE IT
So much data, that we don’t know how to make sense of it• We archive as much data as we can• In order to get value from that data we need to process it• Not as easy as it seems
Cultivate Resilient Smart Objects for Sustainable City Applications
EU funded project for developing smart-city infrastructure
USE CASE – MADRID TRANSPORTATION
Many sensors, a lot of data
MONITORING TRAFFIC IN MADRID TODAY
Uses only current datain the old-fashioned way
WHAT WE DIDWe analysed data from 300 sensors on a specific highway.
We developed a POC for Madrid Council in order to show how to learn from the historical data, in order to optimize the way it handles online data.
We created dashboard which handles some of the sensors.
It monitors the traffic speed and intensity (vehicles per hour).
Using results of an ML algorithm applied to the historical data, the system decides if anything is wrong and reports it using the dashboard.
OUR SOLUTION
HOW WE DID IT
SWIFTMLLib & SQL
Secor
SwiftObject Store
Freeboard DashboardSeco
rMQTT Broker
Data Sources
Apache Spark
Node-RED
SecorCEP
CEP
Message Bus
Data Storage
Data Transformati
onData
AnalyticsData
Visualization
Freeboard Dashboard
Object Storage
Message Hub
10THE FLOW & BLUEMIX
POSSIBLE FUTURE PLANS• Calculate “bottle necks” using historical data, and use that data when
planning new roads• Predict the correlation of traffic with other data sources (such as weather
data)• Help Madrid Council make the processed historical data available through
an external API• Re-route public transportation automatically when special events
happens• Etc…