Watson Foundation IBM Next Generation Analytics … constrained down sampling ... Millions in increased ad revenue thru improved ad inventory ... operating costs

Bruno Marcantonio

Information Management Italy

Watson Foundation IBM Next Generation Analytics Platform fattore abilitante strategico per la trasformazione del business

© 2013 IBM Corporation 2 2

There is a perfect storm where a vast constellation of applications meets a massive, ubiquitous, and

unlimited network of endpoints

Social Mobile Cloud

© 2013 IBM Corporation 4

Data AVAILABLE to an organization

Data an organization can PROCESS

The Big Data Conundrum

• The e o o ies of deletio have ha ged…. – Leading us into new opportunities and challenges

• The percentage of available data an enterprise can analyze is decreasing

proportionately to the available to that enterprise

– Quite simply, this means as enterprises, we are getting

more naive about our business over time

• Just olle ti g a d stori g Big Data does t drive a e t of value to a orga izatio s otto li e

4


IT imperative is to shift the balance of

investments to Innovation

Optimization

• Focus on consolidation, virtualization, cost cutting

Innovation

• Focus on systems of engagement - mobile, intelligent infrastructure, Big Data


Big Data Analytics Iterative & Exploratory Data is the structure

IT Team Delivers Data On Flexible

Platform

Business Users

Explore and Ask Any Question

Analyze ALL Available Information

Whole population analytics connects the dots

Traditional Analytics Structured & Repeatable

Structure built to store data

Business Users

Determine Questions

IT Team Builds System

To Answer Known Questions

6

Available Information

Analyzed Information

Capacity constrained down sampling of available information

Carefully cleanse a small information

before any analysis


Warehouse Modernization Has Two Themes

Analyze information as is & cleanse as needed & existing repeatable



Big Data Analytics Iterative & Exploratory Data is the structure

Traditional Analytics Structured & Repeatable

Structure built to store data

7

Warehouse Modernization Has Two Themes

? Analyzed Information

Question

Data Answer

Hypothesis

Start with hypothesis Test against selected data

Data leads the way Explore all data, identify correlations

Data

Correlation

All Information

Exploration

Actionable Insight

Analyze after landing… Analyze in motion…


The IBM Big Data Platform

IBM Big Data Platform

Systems

Management Application

Development Visualization & Discovery

Accelerators

Information Integration & Governance

Hadoop System

Stream Computing

Data Warehouse

Process any type of data

– Structured, unstructured, in-motion, at-rest

Built-for-purpose engines

– Designed to handle different requirements

Analyze data in motion

Manage and govern data in the ecosystem

Enterprise data integration


Systems Management

Application Development

Visualization & Discovery

Accelerators


Hadoop System

Stream Computing

Data Warehouse

Analytics & Decision Management

Solutions


Metadata and Governance Zone

Master Data Management

•De-duplicated customer information •Reference data & cross-system code

mappings

Master Data Repository

Data Security & Governance

•Data lineage & impact analysis •Data privacy & security

Warehousing

•High-concurrency historical queries

•Limited granularity

•Long-running data processing

EDW

Analytics and Reporting Zone

Data Integration

•Batch (daily) movement

•Only structured data

Batch Reporting

Limited, Disjointed Search & Discovery

Limited Descriptive & Predictive

Models

Metadata Repository

Co

nn

ec

tors

Business Actions

Marts

ODS

•Granular

data •Limited history

Limited Targeting

Mediocre Customer

Experience


Systems Management

IBM provides the complete platform to support this evolution

BI /

Reportin

g

Exp

lora

tion /

Visu

aliza

tion

Functio

nal

App

Industry

App

Pre

dictive

A

nalytics

Conte

nt

Analytics

Ana

lytic Applica

tions

Landing & Analytics Sandbox

Zone

Hadoop System

Ingestion & Real-Time Analytic

Zone

Stream Computing

Sandboxes & Marts

Data Warehouse



http://www-01.ibm.com/software/analytics/business-intelligence/images/dashboarding.jpg


Metadata and Governance Zone

Master Data Management

•De-duplicated customer information •Reference data & cross-system code

mappings

Master Data Repository

Data Security & Governance

•Data lineage & impact analysis •Data privacy & security

Warehousing

•High-concurrency historical queries

•Limited granularity

•Long-running data processing

EDW

Analytics and Reporting Zone

Data Integration

•Batch (daily) movement

•Only structured data

Batch Reporting

Limited, Disjointed Search & Discovery

Limited Descriptive & Predictive

Models

Metadata Repository

Co

nn

ec

tors

Business Actions

Marts

ODS

•Granular

data •Limited history

Limited Targeting

Mediocre Customer

Experience

Ingestion & Real-Time Analytic

Zone

Landing & Analytics Sandbox

Zone

IBM provides the complete platform to support this evolution

Sandboxes & Marts


BI /

Reportin

g

Exp

lora

tion /

Visu

aliza

tion

Functio

nal

App

Industry

App

Pre

dictive

A

nalytics

Conte

nt

Analytics

Ana

lytic Applica

tions

Accelerators



Systems Management

Hadoop System

Stream Computing

Data Warehouse


http://www-01.ibm.com/software/analytics/business-intelligence/images/dashboarding.jpg


Watson Explorer Understand and Navigate Federated Big Data Sources


Watson Explorer

Information Navigation & Discovery Leaves data in place creating a

“virtual” single repository fusing structured, unstructured & federated data, accessible via a single UI for exploration & discovery

Secure & granular access to all applications & data stores so users can only see & navigate info for which they are authorized

Tag, comment, organize & rate content to enhance navigation & discovery

Dynamic clustering, categorization, entity & metadata extraction

Ability to ingest industry and domain-specific taxonomies

Scale to billions of records

Fast Time to Value Rapid deployments from POCs to production

File Systems

Relational Data

Content Management

Email

CRM, ERP, MDM etc.

RSS Feeds

External Sources

Custom Sources

Application/ Users

Social Tools

Commenting

Rating

Shared Folders

Tagging

Streams

Big Insights

Data Warehouse


Janet Robertson Customer search

Transaction

history

Customer s

Products

Customer info

Indexed 3rd party

information related to

customer

Unstructured internal

information related

to customer


Simplify the Existing Environment



Simplify Move analytics into the Data Warehouse

• Integrate the server,

storage and database

into one optimized

package

• Move complex analytics

into the database

• Integrated, high

performance analytics

within the data

warehouse

Server

Storage

Database

Analytics


Inside the IBM PureData System for Analytics N2001

Optimized Hardware +

Software

Hardware accelerated

AMPP

Purpose-built for high

performance analytics

Requires no tuning Snippet Blades ™

Hardware-based query acceleration with FPGAs Blistering fast results Complex analytics executed as the data streams from disk

Disk Enclosures

User data, mirror, swap

partitions

High speed data

streaming

SMP Hosts

SQL Compiler

Query Plan

Optimize

Admin


Netezza Delivers Business Results

450% response rate increase for AMEX with 73% lower CPA

25% conversion rate maintained with 33% lower CPA

300% to 2,000% conversion rate improvements with behavioral targeting…loading clickstream data at 1 terabyte per hour

Millions in increased ad revenue thru improved ad inventory forecasting, ad price optimization, and increased fill rate

20% growth in digital sales

Launched ahead of schedule with a 92 percent reduction in operating costs

Faster processing of behavioral models (reduced from 12 hours to 60 seconds) delivers 25% redemption rates

Over 20% revenue increase due to improved targeting precision and campaign response rates

D I G I T A L M E D I A


Simplified Experience • Designed for easy and quick deployment

• Built-in tools designed for users to derive value quickly

• Easy connectivity to common data warehouse systems

Built-in Expertise • Enables what-if analysis and advanced analytics

• Supports structured, semi-structured, and unstructured data

• Built-in text processing engine and library of annotators to analyze large volumes of text-based information

• Data can be used in its native format eliminating need to pre-define and map structures

Integration by Design

• InfoSphere BigInsights software, cluster management, and IBM System x® servers

• Automatic parallelization and resource optimization to scale economically

• Enterprise-class security and platform management

Introducing pureData for Hadoop – BigInsights Appliance


InfoSphere Data Explorer 9.0 - include tutti i dati nel repository HDFS - fino a 10 GB di contenuti esterni) IBM InfoSphere Streams 3.2 - entitlement di massimo 560 Processor Value Units (PVUs)

(8 core Intel o Power/Linux da 70 PVU) BigSQL e BigSheet IBM Accelerator for Machine Data Analytics IBM Accelerator for Social Data Analytics Cognos Business Intelligence 10.2.1 - 5 utenti autorizzati

Introducing pureData for Hadoop – BigInsights Appliance

BigInsight Enterprise Licence Includes:


System for Analytics System for Hadoop

Immediate storage alternative

of cold data

Cost savings for

cold data

Compliance requirements

Simple analytics

and exploration


Blue Accelleration


DB2 10.5 with BLU Acceleration with Cognos BI

perfor a e is Fast o Fast

Faster cube load

Faster DB Query

Improvement is common*

*Client-reported testing results in DB2 10.5 early release program. Individual results will vary depending on individual workloads, configurations and conditions.

Efficient, affordable, and improved storage savings for Cognos BI customers

Make better and timelier business decisions

DB2 with BLU Acceleration complements and enhances IBM

Cognos BI


BLU Acceleration: Clients Seeing Great Results


Iqbal Goralwalla

Head DB2 Managed Services

Lennart Henäng

IT Architect

Yong Zhou Sr. Manager of Data

Warehouse & BI Dept.

“100x speed up with literally no tuning!

Converting this row uncompressed table to a column organized table in DB2 10.5 delivered a massive 15.4x savings!

With BLU Acceleration, we’ve been able to reduce the time spent on pre-aggregation by 30x—from one hour to two minutes! BLU Acceleration is truly amazing.


I’m an HP/Vertica box and I’m using 96 cores and can heat your house and pool with what I give back to your data center

I’m an Oracle Exadata ¼ Rack and using 60 cores…when you add more storage, you have to buy more of my software

I’m small and mighty! I’m just using 16 of my available 32 cores and BLU Acceleration…my cost is going to surprise you (in a good way)!


Stop, Think and Save up to 50% on applicable IT costs by moving to IBM Software and Systems

• Complimentary Savings Assessment for:

– Oracle database software used with SAP or other applications,

and running on Sun, HP or previous

generation POWER hardware

• Complimentary detailed Migration Plan

• Tailored bottom-line IBM offer includes:

– Migration services

– Training and education

– IBM Systems and maintenance

– IBM Software licenses, subscription & support

1

3

2

• Available IBM financing may eliminate your cash outlay during the

transition IT cost savings reflect potential overall reductions in software and/or hardware maintenance charges and reduced costs of system and workload management that may be achieved over a period of 3-5 years, when consolidating workloads from other systems to IBM. Software migration is from Oracle database and/or application server to comparable IBM DB2 and IBM Web-Sphere products. Actual cost savings and performance characteristics will vary depending on individual client configurations. Complimentary services, training and education will vary by customer and may not be available in every country. Financing terms and availability vary by country. Contact IBM to see what we can do for you.

$0 upfront


Stop, Think and Save: cash-flow illustration

IT cost savings reflect potential overall reductions in software and/or hardware maintenance charges and reduced costs of system and workload management that may be achieved over a period of 3-5 years, when consolidating workloads from other systems to IBM. Software migration is from Oracle database and/or application server to comparable IBM DB2 and IBM Web-Sphere products. Actual cost savings and performance characteristics will vary depending on individual client configurations. Complimentary services, training and education will vary by customer and may not be available in every country. Financing terms and availability vary by country. Contact IBM to see what we can do for you.

Less expensive software

Fewer cores required

Includes migration services, training, as well as

IBM software, systems, and maintenance Oracle software

+

Sun, HP or prior

generation Power

systems

Last Year

IBM software

+

IBM latest

systems

Year+1

Oracle software

+

Sun, HP or prior

generation Power

systems

This Year

IBM software

+

IBM latest

systems

Year+2

IBM software

+

IBM latest

systems

Year+3

IBM software

+

IBM latest

systems

Year+4

Oracle Status Quo on-going costs

IBM Software and Systems Alternative acquisition and on-going costs using IBM financing


business initiative

BUSINESS IMPERATIVE

The number of organizations who see analytics as a competitive advantage is growing.

2010 2011 2012

63%

IQ


IBM delivers a governable, consumable Big Data platform

that’s steeped in analytics for data in-motion and data at-rest.

NO OTHER VENDOR can make this statement


THINK @BigData_paulz

Documents

Watson Foundation IBM Next Generation Analytics … constrained down sampling ... Millions in increased ad revenue thru improved ad inventory ... operating costs