25
A NEW PLATFORM FOR A NEW ERA

#GeodeSummit: Architecting Data-Driven, Smarter Cloud Native Apps with Real-Time Decision-Making

Embed Size (px)

Citation preview

Page 1: #GeodeSummit: Architecting Data-Driven, Smarter Cloud Native Apps with Real-Time Decision-Making

A NEW PLATFORM FOR A NEW ERA

Page 2: #GeodeSummit: Architecting Data-Driven, Smarter Cloud Native Apps with Real-Time Decision-Making

© Copyright 2014 Pivotal. All rights reserved.© Copyright 2014 Pivotal. All rights reserved.

Smarter data-driven apps

2

Real-time decision making

Page 3: #GeodeSummit: Architecting Data-Driven, Smarter Cloud Native Apps with Real-Time Decision-Making

© Copyright 2014 Pivotal. All rights reserved.

X

Page 4: #GeodeSummit: Architecting Data-Driven, Smarter Cloud Native Apps with Real-Time Decision-Making

© Copyright 2014 Pivotal. All rights reserved.

Page 5: #GeodeSummit: Architecting Data-Driven, Smarter Cloud Native Apps with Real-Time Decision-Making

© Copyright 2014 Pivotal. All rights reserved.

Transactional Analytical

X

Page 6: #GeodeSummit: Architecting Data-Driven, Smarter Cloud Native Apps with Real-Time Decision-Making

© Copyright 2014 Pivotal. All rights reserved.

Transactional Analytical

User Mgmt

Order Mgmt

Shipping

Inventory

Payment X

Page 7: #GeodeSummit: Architecting Data-Driven, Smarter Cloud Native Apps with Real-Time Decision-Making

© Copyright 2014 Pivotal. All rights reserved.

Transactional

User Mgmt

Order Mgmt

Shipping

Inventory

Payment

Analytical

Page 8: #GeodeSummit: Architecting Data-Driven, Smarter Cloud Native Apps with Real-Time Decision-Making

© Copyright 2014 Pivotal. All rights reserved.

Transactional

User Mgmt

Order Mgmt

Shipping

Inventory

Payment

Analytical

Page 9: #GeodeSummit: Architecting Data-Driven, Smarter Cloud Native Apps with Real-Time Decision-Making

© Copyright 2014 Pivotal. All rights reserved.

Old and coldNew and fresh

Page 10: #GeodeSummit: Architecting Data-Driven, Smarter Cloud Native Apps with Real-Time Decision-Making

© Copyright 2014 Pivotal. All rights reserved.

X

Page 11: #GeodeSummit: Architecting Data-Driven, Smarter Cloud Native Apps with Real-Time Decision-Making

© Copyright 2014 Pivotal. All rights reserved.

X

Hybrid

Page 12: #GeodeSummit: Architecting Data-Driven, Smarter Cloud Native Apps with Real-Time Decision-Making

© Copyright 2014 Pivotal. All rights reserved.

Hybrid

Transactional

Analytical

SQL

API

Page 13: #GeodeSummit: Architecting Data-Driven, Smarter Cloud Native Apps with Real-Time Decision-Making

© Copyright 2014 Pivotal. All rights reserved.

Transactional

Analytical

SQL

API

User Mgmt

Order Mgmt

Shipping

Inventory

Payment

Cloud

Page 14: #GeodeSummit: Architecting Data-Driven, Smarter Cloud Native Apps with Real-Time Decision-Making

© Copyright 2014 Pivotal. All rights reserved.

Transactional

Analytical

SQL

API

User Mgmt

Order Mgmt

Shipping

Inventory

Payment

Order Mgmt

Contract

InventoryContract

PaymentContract

User MgmtContract

RDBMs Polyglot Persistence

Page 15: #GeodeSummit: Architecting Data-Driven, Smarter Cloud Native Apps with Real-Time Decision-Making

© Copyright 2014 Pivotal. All rights reserved.

Transactional

Analytical

SQL

API

User Mgmt

Order Mgmt

Shipping

Inventory

Payment

Order Mgmt

Contract

InventoryContract

PaymentContract

User MgmtContract

RDBMs Polyglot Persistence

Page 16: #GeodeSummit: Architecting Data-Driven, Smarter Cloud Native Apps with Real-Time Decision-Making

© Copyright 2014 Pivotal. All rights reserved.

SQL

Machine Learning

Results

Page 17: #GeodeSummit: Architecting Data-Driven, Smarter Cloud Native Apps with Real-Time Decision-Making

© Copyright 2014 Pivotal. All rights reserved.

Greenplum

Data Temperature

Hot

Warm

ANSI SQL

Parallel Configurable Data Load

GemFire

Rest / HTTP

Push updates

Transactional data write

behind

Analytical data to cache

Data Science, Analytics & ML

PivotalCloud

Fou

ndry

Web Console

PoS EmulatorPoS EmulatorPoS Emulator

Page 18: #GeodeSummit: Architecting Data-Driven, Smarter Cloud Native Apps with Real-Time Decision-Making

© Copyright 2014 Pivotal. All rights reserved.

GemFire

Greenplum

Page 19: #GeodeSummit: Architecting Data-Driven, Smarter Cloud Native Apps with Real-Time Decision-Making

© Copyright 2014 Pivotal. All rights reserved.

Page 20: #GeodeSummit: Architecting Data-Driven, Smarter Cloud Native Apps with Real-Time Decision-Making

© Copyright 2014 Pivotal. All rights reserved.

Page 21: #GeodeSummit: Architecting Data-Driven, Smarter Cloud Native Apps with Real-Time Decision-Making

© Copyright 2014 Pivotal. All rights reserved.

Page 22: #GeodeSummit: Architecting Data-Driven, Smarter Cloud Native Apps with Real-Time Decision-Making

© Copyright 2014 Pivotal. All rights reserved.

Challenge: • Fraudsters use ID theft to file false tax returns, defrauding the

government and costing tax payers significantly • Need to enable complex fraud detection logic to stop billions in

fraud while ingesting large amounts of data over a short time period (1 million tax returns/hour)

• Existing Rules engine architecture used to detect fraud is doesn’t allow for real-time analysis

Solution: • Pivotal Data Engineering re-architected the Rules engine by

leveraging GemFire and Greenplum DB to achieve much faster data processing

• Reduced tax return processing time with real-time technology

Pivotal Solution includes: BDS, Data Labs

U.S. Government Agency Tackles ID Theft in Real-time Speed with In-Memory Technology

Page 23: #GeodeSummit: Architecting Data-Driven, Smarter Cloud Native Apps with Real-Time Decision-Making

© Copyright 2014 Pivotal. All rights reserved.

Telco Network Quality KPIsFast Data Ingest and Real-time Analytics

Challenge:

• Provide network quality KPIs to Brazil's National Telco Agency

• Capture, analyze and guarantee data consistency for millions of data points / sec.

• Enable near real-time analytics over the high volume and fast data being transacted

Solution:

• Pivotal GemFire and Greenplum DB allow combined fast low-latency in-memory transactions and near real-time analytics

• Real-time data insights on cell phone network quality KPIs • Data Science engagement for improving the network

quality

Page 24: #GeodeSummit: Architecting Data-Driven, Smarter Cloud Native Apps with Real-Time Decision-Making

24

Join the Apache Geode Community! • Check out http://geode.incubator.apache.org

• Subscribe: [email protected]

• Download: http://geode.incubator.apache.org/releases/

Page 25: #GeodeSummit: Architecting Data-Driven, Smarter Cloud Native Apps with Real-Time Decision-Making

A NEW PLATFORM FOR A NEW ERA