The Real-Time CDO and the Cloud-Forward Path to Predictive Analytics

Preview:

Citation preview

Nikita Shamgunov, CTO and Co-founder of MemSQL

Gartner Data and Analytics Summit, March 2017

The Real-Time Chief Data Officer and theCloud-Forward Path to Predictive Analytics

Today’s TalkThe Real-Time Chief Data Officer

Introduction to MemSQLCustomer Use Cases

Demonstration: Historical, Real-Time, Predictive Analytics

Path to the Cloud

Real-time Chief Data Officer Objectives▪360 view of the Business

• No silos

▪Real-time access to ALL data• Current and historical in one system

▪Flexible and Strategic Deployment Model• Built for the Cloud: Public, Private, As-A-Service

▪Modern Data Architecture• Scalable, Elastic

Introduction to MemSQL

The Real-Time Data WarehouseFor the front lines of your business

Real-Time Scalable Multi-Cloud• Fast Ingest, Low Latency

Queries, High Concurrency• Operational and Ad-Hoc

Analytics• Powerful applications

• Petabyte scale• Elastic• Commodity hardware• Low TCO

• Cloud Managed Service• On-premises• Multi-cloud deployments• Enterprise-grade Security

A Modern Data Warehouse for the Enterprise Frontlines

Real-Time Data

Messaging andTransforms

Historical Data

Bare Metal, Virtual Machines, Containers On-Premises, Cloud, As a Service

Business Intelligence Dashboards

Real-Time ApplicationAnalyticsReal-Time Data

Warehouse

Live DataMemory Optimized

Tables

Historical DataDisk Optimized

Tables

Streaming IngestReal-Time

Data Pipelines

MemSQL Confidential8

Product or Services Scores for Operational Data Warehouse

Critical Capabilities for Data Warehouse and Data Management Solutions for Analytics

Gartner, July 2016

How Did We Get Here

Trying to build scale-out for

a traditional product

Scale-out

▪Every piece of technology is scalable▪Analyzing data from hundreds of thousands of

machines▪Delivering immense value in real-time

• Real-time code deployment• Detecting anomalies• A/B testing results

▪Fundamentally making the business faster by providing data at your fingertips

An Insider’s View at Facebook

Imagine scaling a database on industry standard hardware.

Need 2x the performance? Add 2x the nodes.

Customer Use Cases

Real-time analytics transformed profitability analysis of customer logistics from weekly to daily, and reduced latency from days to minutes

+

17

18

BUSINESS BENEFITS▪New increased profitability customer logistics analysis from weekly to daily▪Reduce Latency from days to minutes

TECHNICAL BENEFITS▪Reduced 22 hour ETL to minutes▪Increased query response time by 80x

THE KELLOGG’S REAL-TIME ARCHITECTURE

19

22 hours to minutes

80x faster

Reducing delay in “freshness of data” from two hours to 10 minutes

+

BUSINESS BENEFITS▪Reach over 1.5 billion users across 100s of thousands of mobile apps▪Real-time optimization of advertising campaigns with improved post-install

engagements▪Net new personalized campaign performance reports for greater visibility

TECHNICAL BENEFITS▪10x faster data refresh, from hours to minutes▪Ad-hoc queries on raw log-level data in seconds▪Real-time deduplication▪1 TB/day ingest

THE MANAGE REAL-TIME ARCHITECTURE

22

REAL-TIMEANALYTICS

Real-Time inputs

http://www.enterprisetech.com/2016/12/09/managing-30b-bid-requests/

DellEMC Adopts MemSQL for Customer Acquisition Lifecycle Management

+

24

BUSINESS BENEFITS• Deliver real-time customer updates to DellEMC Sales Department• Scale customer analytics to increase sales productivity• Execute joins across multiple distributed data set• Drive real-time personalization for operational efficiency

TECHNICAL BENEFITS• Data loading• Concurrency• Sub-second response• Distributed joins

Tables: Customer, Inventory and Contracts

DELLEMC REAL-TIME ARCHITECTURE

REAL-TIMEANALYTICS

SECURE DATA LAKE ARCHITECTURE

26 http://itblog.emc.com/2016/05/03/simplifying-lives-emc-myservice360/

27

The global leader in Content Delivery Network services, has deployed MemSQL to enhance billing speed and efficiency for thousands of customers around the world

+

28

BUSINESS BENEFITS▪Analyze Historical Against Live Data▪30% Increased Forecast Accuracy▪Tighter Financial Reporting to Street

TECHNICAL BENEFITS▪Analyze Millions of rows / second▪Massive Concurrency▪8 Million UPSERTS per second▪Process 1PB Data Per Day

THE AKAMAI REAL-TIME ARCHITECTURE

29

REAL-TIMEANALYTICS

Customer traffic

statistics

Demonstration

The Path to Real-Time Analytics

Real-Time Data Predictive AnalyticsHistorical Data

MemSQL Springs and Golf Resorts

Demo Details1.Showcase fast queries on historical data with Tableau2. Incorporate real-time data with MemSQL Pipelines

and exactly-once ingest from Kafka3.Add predictive analytics with Sentiment Analysis

Historical Data

CREATE PIPELINE

Real-TimeData

Sentiment Analysis

CDO Strategiesfor Hybrid Cloud

Gartner Hybrid DBMS Cloud Scenarios

36

Dev Test

Disasterrecovery

Architecture Spanning Use Case Specific Multicloud

Prod

Source: Gartner (April 2016)

A Comprehensive Hybrid Cloud Approach▪On-Premises deployments

•Any hardware, NUMA optimizations, vectorized processing•Any Linux, VMs, Containers•Robust security including Role-based Access Control (RBAC)•Perfect for retiring legacy appliances

▪Any Cloud•Any cloud service IaaS•Simple `replicate database`•Also available as a MemSQL Managed Service

Strategic Approach to Global Analytics▪ Develop a center of excellence for real-time

infrastructure• Include both real-time AND historical data

▪Identify complements and replacements for traditional technologies

• Data warehouse appliances, rigid systems

▪Choose a straightforward path• Faster historical insights, real-time data, predictive analytics

Please visit at the MemSQL booth

Q&A

www.memsql.com

Thank You

Recommended