16
THE BIG DATA EXPLOSION Are you ready? MANU MARCHAL Managing Director EMEA

The Big Data Explosion - Are You Ready?

Embed Size (px)

Citation preview

Page 1: The Big Data Explosion - Are You Ready?

THE BIG DATA EXPLOSIONAre you ready?

MANU MARCHALManaging Director EMEA

Page 2: The Big Data Explosion - Are You Ready?

AN IoT RICH DATA DAY

Page 3: The Big Data Explosion - Are You Ready?

80 MILLION PEOPLE1300 MESSAGES A SECOND 24 Hours a Day / 365 Days a Year

Information is requested and amended more than 2.6 BILLION times a year

Has enabled over 42 MILLION Summary Care Records to be created and stored

Has transmitted over 1.3 BILLION prescription messages. 1800 messages/s

£21m savings in first year. 700hrs saved every day

NHS Data Spine

Page 4: The Big Data Explosion - Are You Ready?

Smart Thermostat Market is expected to grow from $146.9 million in revenue in 2014 to $2.3 billion by 2023. -Navigant

THE CONNECTED HOME

Store historical date for analytics

Store User Schedules

Sessions Storage for Connected Users

Page 5: The Big Data Explosion - Are You Ready?

1.5 TRILLION RECORDS PER DAY 400% Year Over Year Increase

Ability to Monitor entire IT environment from Single Portal

Array of Real-Time Statistics and Insight

Centralize & Correlate Events, Alerts, and Notifications

Page 6: The Big Data Explosion - Are You Ready?

Cloud-based management tools and data analytics usually only accessible to larger companies. Millions of transactions each day.

POS FOR OVER 20K SMALL BUSINESSES

Quick Service

Retail

Restaurant & Bar

Page 7: The Big Data Explosion - Are You Ready?

20 TERABYTES OF DATA PER DAY BILLIONS OF MOBILE DEVICES

10 BILLION data transactions a day – 150,000 a second – Apple

Forecasting 2.8 BILLION locations around the world

Generates 4GB OF DATA every second

We’re focusing on helping people make better

decisions with the weather.

Page 8: The Big Data Explosion - Are You Ready?

WEATHER FORECAST PREDICTS WALMART’S SALES

Ideal BERRY weather turns out to be low wind with

temperatures below 28C.

People are more likely to eat STEAK when it's warm out with

higher winds but no rain, but not if it gets too hot.

Page 9: The Big Data Explosion - Are You Ready?

WHAT ARE THE IMPLICATIONS?Enterprises must choose: Modernize or Sink!

• Adopt technologies to successfully manage data generated by new data sources and consumed by users accessing complex data types from around the world, 24 hours a day.

• Organizations must make plans to handle data ingestion, data storage, and analytics in order to bring value to the business.

• Increasingly look to distributed systems to help manage the influx of traffic, and ease current operational challenges.

Page 10: The Big Data Explosion - Are You Ready?

DISTRIBUTED WORKLOADS

App App App App

Virtualization

Server

App

Aggregation

Server Server Server Server

Client-Server Era:SMALL APPSBIG SERVERS

ONE LOCATION

Cloud Era:BIG APPS

SMALL SERVERSMANY LOCATIONS

Page 11: The Big Data Explosion - Are You Ready?

Everything works at small scale

What happens when something goes wrong

The customer experience matters

WHY DISTRIBUTED SYSTEMS?

Scale out, up and down predictably and linearly

Survive server, network or data center failures

Data locality enables data operations close to end-users

DISTRIBUTED SYSTEMS

DEVELOPERS OPERATIONS CUSTOMERS SALES

Page 12: The Big Data Explosion - Are You Ready?

The growing hype surrounding data lakes is causing substantial confusion in the information management space

Gartner

Challenge 1 – Isolation of Data

Page 13: The Big Data Explosion - Are You Ready?

Challenge 2 – Consistency of Data

To Be or Not To Be Consistent?

Understand the question…

C A

PX

The CAP TheoremDr Eric Brewer

Describes the trade-offs involved in distributed systems

Page 14: The Big Data Explosion - Are You Ready?

Challenge 3 – Data Gravity

Apps

Services

Lower Latency&

Higher BandwidthGrowth

Over TimeData

Gravity

Gravity

Page 15: The Big Data Explosion - Are You Ready?

“Perhaps the biggest challenge is that the IoT has the

potential to generate orders of magnitude more data

than any other source in existence today. So, in the

world of the IoT we will test the limits of ‘big.’”

Bill Franks, Chief Analytics Officer for Teradata

Putting Challenges In Perspective

Page 16: The Big Data Explosion - Are You Ready?

[email protected]

Get open source riak from