12
Oct 31-Nov 2 2017 Powering Smart Cities with IoT, Real-Time and an Agile Data Platform Cloud Expo

Powering Smart Cities with IoT, Real-Time and an Agile ...res.cdn.sys-con.com/session/3646/Nick_Piette.pdf•Integrated some 200 + Systems into the newly minted data lake ... real-time,

Embed Size (px)

Citation preview

Page 1: Powering Smart Cities with IoT, Real-Time and an Agile ...res.cdn.sys-con.com/session/3646/Nick_Piette.pdf•Integrated some 200 + Systems into the newly minted data lake ... real-time,

Oct 31-Nov 2 2017

Powering Smart Cities with IoT, Real-Time and an Agile Data Platform

Cloud Expo

Page 2: Powering Smart Cities with IoT, Real-Time and an Agile ...res.cdn.sys-con.com/session/3646/Nick_Piette.pdf•Integrated some 200 + Systems into the newly minted data lake ... real-time,

By 2050, around 70% of the world’s population will be

concentrated in urban areas, compared with 54% in 2014

Page 3: Powering Smart Cities with IoT, Real-Time and an Agile ...res.cdn.sys-con.com/session/3646/Nick_Piette.pdf•Integrated some 200 + Systems into the newly minted data lake ... real-time,

Opportunities at Scale

Smart City:

$27.5B Market& $174B

Investment

$1.9 TrillionImpact on

GlobalEconomy

180 Zetabytesof actionable

data

9.7 BillionConnectedDevices by

2020

2020 - 2025

Page 4: Powering Smart Cities with IoT, Real-Time and an Agile ...res.cdn.sys-con.com/session/3646/Nick_Piette.pdf•Integrated some 200 + Systems into the newly minted data lake ... real-time,

The Challenge

Complex Technology

LimitedAccess

IT struggle to deliver fast

enough

How to get VALUE

quicker?

Page 5: Powering Smart Cities with IoT, Real-Time and an Agile ...res.cdn.sys-con.com/session/3646/Nick_Piette.pdf•Integrated some 200 + Systems into the newly minted data lake ... real-time,

Johnson Controls

InternationalA global leader in building products and technology,

integrated solutions and energy storage.

Page 6: Powering Smart Cities with IoT, Real-Time and an Agile ...res.cdn.sys-con.com/session/3646/Nick_Piette.pdf•Integrated some 200 + Systems into the newly minted data lake ... real-time,

JCI Smart Building

Page 7: Powering Smart Cities with IoT, Real-Time and an Agile ...res.cdn.sys-con.com/session/3646/Nick_Piette.pdf•Integrated some 200 + Systems into the newly minted data lake ... real-time,

End-to-End IoT Platform

Capture

High-scale messaging, mediation,

data services

Stream

Transform, cleanse, load, update

Processing & Accessing

Talend ESB

NoSQL

Store & Query

MQTT

Thousand of sources

producing 100s of TB/hr

IoT / Sensors

Real-Time View____________

Precomputed

Views

Incremental Data

All DataHistorical

Data

Real-time

Dashboards

APP

Serving Layer

Sliding WindowAnalytics

MachineLearning

Speed Layer

Data

Batch Layer

Azure

Storage

Hive

Page 8: Powering Smart Cities with IoT, Real-Time and an Agile ...res.cdn.sys-con.com/session/3646/Nick_Piette.pdf•Integrated some 200 + Systems into the newly minted data lake ... real-time,

Key Requirements

1. Must be compatible with Hadoop (Ability to run native Hadoop code)

2. Must be extensible to the Cloud

3. Must be aligned as close as possible to open source technology trends specific to Hadoop/ Big Data

4. Must support our Data Lake data flow architecture

5. Must be able to connect with disparate data sources

6. Must be able to establish a long lasting strategic partnership

7. Must be able to affordably scale to meet anticipated demand

8. Should have an easy to understand user interface

9. Should have minimal proprietary components/ functions

10. Should have no performance degradation compared to direct code run on Hadoop

INGESTION FRAMEWORK SOLUTION for JCI

Page 9: Powering Smart Cities with IoT, Real-Time and an Agile ...res.cdn.sys-con.com/session/3646/Nick_Piette.pdf•Integrated some 200 + Systems into the newly minted data lake ... real-time,

9

SUPPLIERS

CUSTOMERS

CLOUD

SENSORS

PREMISE

From this …

Page 10: Powering Smart Cities with IoT, Real-Time and an Agile ...res.cdn.sys-con.com/session/3646/Nick_Piette.pdf•Integrated some 200 + Systems into the newly minted data lake ... real-time,

• Integrated some 200 + Systems into the newly minted data lake

• Hadoop development became 3 to 10x faster

• 100 developers generating insight for 1000 consumers

To a versatile Platform for JCI

Page 11: Powering Smart Cities with IoT, Real-Time and an Agile ...res.cdn.sys-con.com/session/3646/Nick_Piette.pdf•Integrated some 200 + Systems into the newly minted data lake ... real-time,

Why Talend for JCI?

Platform independence & future proof

Run on Big Data platforms, on prem and in the Cloud

SPARK code generation (Staying Native)

Faster performance, less overhead

Unified

1 unified platform for all integration use cases: batch real-time, on prem, hybrid, Cloud, Big Data, IoT, Machine Learning, self-service, data governance

Page 12: Powering Smart Cities with IoT, Real-Time and an Agile ...res.cdn.sys-con.com/session/3646/Nick_Piette.pdf•Integrated some 200 + Systems into the newly minted data lake ... real-time,

Free Trial: Talend Big Data Sandbox

• A ready-to-run Dockerenvironment leveraging Cloudera

• A step-by-step expert guide

• Real-world scenarios using Spark,Kafka, MapReduce & NoSQL

www.talend.com/BigDataSandbox

Hit the Easy Button for Hadoop, Spark and Machine Learning