Breaking Down the Last Bastion of IT Cost - IBM's DB2 Cobra Project

B ki D th L t B ti f IT C tBreaking Down the Last Bastion of IT CostIBM’s DB2 Cobra ProjectScott AbbottCertified IT Architect, Data Management Software

Make change work for youIBM Insight Forum 09®

C t tContext

IBM Insight Forum 09®

Make change work for you2IBM Insight Forum 09®

Make change work for you

Inertia

Even in the best of times we struggle to move forwards

Especially if there are those who are afraid of the unknown

“It i t b“It is not becausethings are difficultwe do not dare;

It is because we do not dare that they are difficult”

-Seneca



Seneca

Tough Times R B iRemove Barriers

We the unwilling led by theWe, the unwilling, led by the unknowing, are doing the impossible for the ungrateful. We have done so much, for e a e do e so uc , oso long, with so little, we are now qualified to do anything with nothing.

“The mind opens doors

gMother Teresa

“The mind opens doors the hand cannot reach.”Jon-Henri Damski

So Change is Good



I f ti T h l Ch llInformation Technology Challenges

Lower the cost of managing data

Improve service levels: AvailabilityPerformanceSecurity

Leverage existing investments in skills and codecode



L i IT C tLowering IT Costs





A Diff t O tiA Different Option




Make change work for youIBM Insight Forum 09®

Tough Times R B iRemove Barriers

“Not Business As Usual…”

“GameGame Changing

Technology ”Technology…

So is time to consider DB2?



consider DB2?


C iCompression




Lowering IT Costs – DB2 Compression

Why is it important?Saving Storage

Usually the most expensive component of a database solution

Why is it important?

Usually the most expensive component of a database solutionSaves floor space and personal cost for managing storage Saving storage saves power and cooling!

Improving I/O EfficiencyFewer I/O operations needed to retrieve same amount of data

Quicker Access to Data from DiskAccessing data from disk is the slowest database operation

“DB2 9 compression capabilities are key in helping reduce the size of our databases—in one case by up to 83%.”

Jean Holley CIO Tellabs Inc—Jean Holley, CIO, Tellabs Inc.

“We observed a 70% compression ratio.”—Ellen Reys-Klebaner, Chief Database Architect, Visa




So how does it work?So how does it work?Repeating patterns within the data (and just within each row) is the key to good compression Text data tends to compress wellthe key to good compression. Text data tends to compress wellbecause of reoccurring strings as well as data with lots of repeating characters, leading or trailing blanks




Storing more in lessStoring more in less

Common sequences of consecutive bytes in row

PLANO TX 24355

x’01C’

Uncompressed Row

Compressed Row consecutive bytes in row replaced with 12 bit symbol

x 01CCompressed Row

Data page with compressed rows

Data page with uncompressed rows

x’01C’




How much can I compress?

INDEX M lti l l ith f t ti

How much can I compress?

INDEX - Multiple algorithms for automatic index compression

DATA34%

TEMP33% 34%

INDEX

33%

33%

TEMPORARY TABLES - Automatic compression for temporary tables




Some examples of compression ratesSome examples of compression rates




The Financial impact DB2 9 5(NZ client)

SAP Database Comparison(NZ client)

SAP Database Comparison

The Financial impact – DB2 9.5

SAP Database Comparison3 Year TCO Analysis

SAP Database Comparison3 Year TCO Analysis




The Financial impact DB2 9 7(NZ client)

SAP Database Comparision(NZ client)

SAP Database Comparision

The Financial impact – DB2 9.7

SAP Database Comparision3 Year TCO Analysis

SAP Database Comparision3 Year TCO Analysis




Ad i i t tiAdministration




Lowering IT Costs – Reducing Administration

Autonomic Computing AttributesAutonomic Computing Attributes

Increased ResponsivenessAdapt to dynamically

BusinessResiliency

Discover diagnoseAdapt to dynamically changing environmentse.g. Configuration Advisor,Design Advisor

Discover, diagnose,and act to prevent

disruptionse g Health MonitorDesign Advisor e.g. Health Monitor,

Fault Monitor

Operational Reduced ManualAd i i t tiEfficiency

Tune resources and balance workloads to maximize use of IT

AdministrationAutomatic management of

database objects and resourcese.g. Self-configuring/optimizing utilities, Adaptive utility throttling, STMM!!STMM!!

database objects and administrative tasks

e.g. Automatic storage management



Lowering IT Costs – Reducing AdministrationSelf Configuring Example Configuration Advisor

Automatic environment characteristic detection

Self-Configuring Example ... Configuration Advisor

User description of basic operational questions

Combined with mathematical model of each configuration parameter, based on

Inside DB2

g p

expert heuristics

Autonomically sensed system characteristics

User specification of the database environment

E t

Configuration settings

Configuration model

Expert heuristics



Lowering IT Costs – Reducing AdministrationSelf Configuring Configuration Advisor GUI

Configuration Advisor GUI

Self-Configuring ... Configuration Advisor GUI

Configuration Advisor GUI



Lowering IT Costs – Reducing AdministrationSelf Healing Heath Monitor

Checks healthiness of all active database objects as frequently as deemed necessary

Self-Healing ... Heath Monitor

objects as frequently as deemed necessary

Generates alerts based on a health indicator exceeding a threshold or being in non-normal statestate

Sends notifications to the DB2 Administration Notification Log, and also sends emails and pages to contacts on its notification listpages to contacts on its notification list

Advises on severity of condition, and suggests resolutions

Runs corrective actions (scripts or tasks) defined for health alerts

Easy up-and-running process: provide email orEasy up and running process: provide email or pager address information for notification at install time



Lowering IT Costs – Reducing Administration

Enabled/disabled through database configuration

Self-Managing ... Automatic Object Maintenance

parameter hierarchyAUTO_MAINT

AUTO DB BACKUP *

Auto Backup

_ _

AUTO_TBL_MAINTAUTO_RUNSTATS *

Auto Runstats

Auto ReorgAUTO_REORG *

AUTO_STATS_PROF

AUTO_PROF_UPD

Auto Reorg

Auto Stats Profiling

Hierarchy allows turning all automatic maintenance on or off without affecting the respective activity settings

Customizable

Completely transparent to users

Integrated ith Health MonitoringIntegrated with Health Monitoring



Lowering IT Costs – Reducing AdministrationSelf-Tuning ... Memory Tuning in DB2 - STMM

DB2 9 introduced a revolutionary memory tuning system called the Self-Tuning Memory Manager (STMM)

g y g

g y g ( )Works on main database memory parameters

Buffer pools, sort, locklist, package cache, and total database memory

Hands-off online memory tuning

Requires no DBA interventionRequires no DBA intervention

Senses the underlying workload and tunes the memory based on need

Can adapt quickly to workload shifts that require memory redistribution

Enhanced in DB2 9.5 with greater capability and more automatic configuration settings



Lowering IT Costs – Reducing AdministrationSelf-Tuning ... STMM in action – Dropping a key index

Runtime is reduced by 63% in a few cycles through STMM reacting to i t h

g pp g y

TPCH Query 21 - After drop index - Average times for the 10 streams

7000

avg = 6206

environment changes

5000

6000

Reduce 63%

3000

4000

me

in s

econ

ds avg = 2285

Some

indexes

dropped

2000

3000

Tim

avg = 959

0

1000

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 341 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34

Order of execution



Lowering IT Costs – Reducing AdministrationSelf-Tuning ... STMM in action: Compare to hand-tuned

6379663302

70000

STMM also edgesout benchmark tuned system

g p

50000

60000tuned system

40000

Per

Min

ute

STMM beats default

16713

30000

Tran

sact

ions

configuration by nearly4x

16713

10000

20000

0Default (No tuning) Benchmark Tuned STMM Tuned

Configuration




Hi h A il bilitHigh Availability




Lowering IT Costs – Cost of Providing High AvailabilityDB2 High Availability Data Replication (HADR)g y p ( )

Works over standard t k & h dnetworks & hardware

Free-of-charge withFree of charge with all non-Express

editions



Lowering IT Costs – Cost of Providing High AvailabilityDB2 Maintenance w/ HADR - Rolling Fixpack Exampleg p p

Reduced outagesg



Lowering IT Costs – Cost of Providing High AvailabilityHADR Read Accessible Standby

HADR now supports read-on-standby reportingTurn your HA or DR hardware investment from seldom used servers to

y

a reporting server - giving you more insight and cost effectivenessOffload reporting work from your primary, giving it better performanceDuring failover, DB2 seamlessly turns the read-on-standby into a primary read / write server



G ttiGetting There




Lowering IT Costs – Breaking Down the Oracle BarriersOracle – The Last Bastion of IT Cost

Businesses and developers are locked into OracleComplex databases servers requiring expensive DBA skillsProprietary SQL syntaxProprietary codeProprietary codeRollback segments

Oracle DatabaseDatabase

Y A li ti YYour Applications You Your Databases



Lowering IT Costs – Breaking Down the Oracle BarriersWhy So Afraid of Migrating?

Impedance mismatch between source and target database features

y g g

target database featuresData types, locking model, weak typing, packages, … Oracle

Workarounds Poor performance

THIS IS ALL HISTORY NOW!

LOOK INTO THE FUTURE:Lack of skills in development team DB2 COBRA

ORACLE DB2



Openbravo migration to DB2 p g

DB2 9.5: ~2 YEARS1. Map schema and data types

• Different datatype behavior. Eg: DATE

• Different DDL

2. Move data

3. Translate PL/SQL code (Triggers/Procedures/Functions)

Mi i b ilt i f ti & k• Missing built-in functions & packages

• Missing functionality: REF CURSORs, %TYPE, …

4. Translate SQL in application logic (manual)

• Untyped expressions (thousands of occurences)

5. Debugging• Hard to fix concurrency problems

T t d T i6. Test and Tuning



Lowering IT Costs – Breaking Down the Oracle BarriersA Radically aggressive design goal…y gg g g

Porting?? I meant ENABLING!!!Changes to applications are the exception Not the ruleChanges to applications are the exception. Not the rule.

Oracle SQL

DB2Oracle SQL

PL/SQLConcurrency Control

PackagesPackagesBuilt-in packages

JDBCSQL*Plus Scripts

NO CHANGE

SQL Plus Scripts



Lowering IT Costs – Breaking Down the Oracle BarriersBarrier #1 – PL/SQL only runs on Oracle y

Solution

DB2 Server

A 2nd Compiler for PL/SQL!

SQL PLDB2

CompilerDB2 Engine

Compiler

PL/SQLXPL/SQLPL/SQLCompilerX

DB2 9.7 Compatibility FeaturesR i t i bl DB2 COMPATIBILITY VECTORRegistry variable: DB2_COMPATIBILITY_VECTOROptional: SET SQLCOMPAT PLSQL

Lowering IT Costs – Breaking Down the Oracle BarriersBarrier #2 – Oracle custom data types not supported

Traditionally, DB2 has supported strict typing:In accordance with SQL standard

yp pp

Trend towards weak typing in programming:For PERL, RUBY, PHP, etc.

SolutionFlexible Typing!

DB2 now supports:Automatic casting between data typesGreat performance with or without parameter markers

Easy for your application to use DB2Easy for your developers to use DB2

E.g., no changes for applications with Oracle Database “DATE”



Lowering IT Costs – Breaking Down the Oracle Barriers

Changes to applications are the exception. Not the

C tibilit f t DB2 9 7

rule.

Compatibility features DB2 9.7

Concurrency models Native supportSQL dialects Native supportData types Native supportFunctions Native supportProcedural languages Native supportProcedural languages Native supportPackages Native supportBuilt-in packages Native supportJDBC Native supportOnline schema changes Native supportScripting languages Native supportScripting languages Native support

IBM can rapidly assess your application to confirm level of compatibility



Integrated Data Management Lowering IT Costs – Breaking Down the Oracle Barriers

g gUnified solution across DB2, Informix, and Oracle

Load Oracle catalog

Edit database objects

Design – InfoSphere Data Architect Design logical models, physical models, privilege models, privacy modelsGenerate platform-specific physical objects

catalog

Generate platform-specific physical objectsDevelop – Optim Development Studio

Create, alter, and drop database objectsRun commands via CLPPLUS e.g. START, STOPCopy/paste objects between DB2 and OracleCopy/paste objects between DB2 and Oracle Generate data access layersDevelop SQL, PL/SQL procedures, and functions Capture SQL from executing applicationTrace SQL back to original source

Test - Optim Test Data Manager and Data Privacy Solutions

Invoke Optim TDM from DeveloperUse relationship and privacy definitions from InfoSphere Data ArchitectoSp e e a a c ecCreate right-sized, fictionalized, production-like test databases

Deploy – Optim pureQuery RuntimeReplace SQL without altering application

View SQL and execution results

Take context-sensitive actions

Restrict SQL to eliminate injection risk



Lowering IT Costs – Breaking Down the Oracle BarriersIncrease Collaboration with Integrated Tools

“Our development will operate up to 20% to 50% faster than before.”“Our development will operate up to 20% to 50% faster than before.”

Integrated data management tools

p p p—Janick Bernet, Developer, Swiss ASP

p p p—Janick Bernet, Developer, Swiss ASP

IBM InfoSphere Data Architect, IBM Data Studio, IBM Optim solutions, IBM InfoSphere Mashup Hub

All phases of data lifecycle

DesignDesignAll phases of data lifecycleCollaboration across roles

Business analyst, database architect, DBA, application developer etc

DevelopDevelopOptimizeOptimizeModelsModelsapplication developer, etc.

Support all major database platformsIBM DB2, IBM Informix, Oracle Database, Microsoft SQL Server, etc.

ModelsModelsPoliciesPoliciesMetadataMetadata

DeployDeployOperateOperate



Lowering IT Costs – Breaking Down the Oracle BarriersDoing Oracle better than Oracle

Concurrency Models to Fit Your NeedsYour Needs

Support for multiple “concurrent access” modelsOptimi e thro ghp t for mi ed orkloadsOptimize throughput for mixed workloads

Increased performanceReads don’t block writesWrites don’t block readsWrites don t block readsLog-based control eliminates overheadMuch simpler approach than Oracle Database rollback segmentsg

Easy for developers to work with DB2



Lowering IT Costs – Breaking Down the Oracle BarriersNo more restrictions on toolsets & languages…

DB2: A History of Faster and Easier DevelopmentEasier DevelopmentEasy application development and deployment

Support for all the latest languages and versionsS f ll h l i i l diSupport for all the latest environments, including Visual Studio 2008, Eclipse, and pureQuerySupport for multiple SQL dialects and procedural languagesAccelerate development with custom and built-in packagesAccelerate development with custom and built in packages

Easy Web servicesChoice of query languages and APIs

SQL, XQuery, XPath, CLPPlus, JDBC, SQLJ, ODBC, ADO, , y, , , , , , ,.NET, CLI, OLE-DB, and more

Univar increased developer productivity by 25-50%Univar increased developer productivity by 25 50%...reduced development costs by 35-45%.



Lowering IT Costs – Breaking Down the Oracle BarriersDrag-and-drop migration

Easily Import Oracle D t b S h ithDatabase Schemas with Optim Solutions

Connect to and explore Oracle database objects Move database objects and data b t O l d DB2between Oracle and DB2Edit, deploy, run and debug PL/SQL procedures on Oracle and DB2Build Java applications with pureQuery data access methods on Oracle U d ti it f t fUse productivity features for tracing SQL to source, host spot analysis, and impact analysis for Oracle applications



Moving to DB2 Cobra is Easy

Openbravo migration to DB2 9.7p g

DB2 9.5: ~2 YEARS DB2 9.7: 1 WEEK1. Map schema and data types

• Different datatype behavior. Eg: DATE

• Different DDL

1. Map schema and data types• Native support

• 99% of SQL – no change

2. Move data

3. Translate PL/SQL code (Triggers/Procedures/Functions)

Mi i b ilt i f ti & k

• 156 of 158 procedures- no change

• PL/SQL – no change

2. Move data

3 R th h d d• Missing built-in functions & packages

• Missing functionality: REF CURSORs, %TYPE, …

4. Translate SQL in application logic (manual)

3. Run the shared code• Native support

– NO EMULATION!!

• Minor adjustments (triggers needed tune up)

No porting effort for future releases of the application

• Untyped expressions (thousands of occurences)

5. Debugging• Hard to fix concurrency problems

T t d T i

(triggers needed tune up)

4. Test and Tuning

application6. Test and Tuning



F db kFeedback




What people worldwide are saying about DB2 9 7What people worldwide are saying about DB2 9.7Two years … One week!

"To move our application to DB2 9.5 would have taken an estimated two-year effort. We were thrilled to see it took only one week to move it to DB2 9.7. This represents a terrific opportunity to expand our international community of users, partners and developers, and we’re very excited to partner with IBM to make new deployment options available.”p y pPaolo Juvara, CTO of Openbravo (Spain)

Si ifi tl l ll t

"These features drastically reduce the time required for migration efforts and significantly lower overall costs.“Axel Puerner, Managing consultant, Puerner Unternehmensberatung

Significantly lower overall costs

Axel Puerner, Managing consultant, Puerner Unternehmensberatung

Paradigm shift

"The new IBM DB2 offers true ENABLEMENT and not mere PORTING.This feature is a paradigm shift in the very concept of database migration!"Godson Retna, Senior Architect, Cognizant Technology Solutions



What people worldwide are saying about DB2 9 7What people worldwide are saying about DB2 9.7

“DB2' PL/SQL tibilit i ll t W ’ l ki f d t i t ti th t d l

Amazing!

“DB2's PL/SQL compatibility is excellent. We’re looking forward to integrating the current dual source code base into a single one. This will increase our development and testing productivity. In addition, SQL compatibility is significantly improved. We ran an Oracle Database program as is on DB2, and the test result was more than we expected. The compatibility level that DB2 9 7 achieved is also amazing We can integrate a lot ofThe compatibility level that DB2 9.7 achieved is also amazing. We can integrate a lot of incompatible queries into the same one. Now we can stop our program’s different behaviors, which comes from DBMS’s differences, and this will help us improve the quality of our package.”

Masato Kudo, Developer for Platform Development Group, Works Applications

Porting time 1/6 the original estimate

“As we expand, we consistently see a requirement to support DB2 within large government departments. We specifically chose to take part in the IBM DB2 early access program because of the program's goal to run much of Oracle Database applications without modification. This allows us to reduce the time to port our stored produce persistence layer from Oracle Database to DB2 from 450 days down p p p y yto 75 days. With what we regard as excellent support from the IBM DB2 team, we believe that IBM has achieved these goals.”David Moody - Senior Vice President of Product and Founding Director, Lagan Technologies Ltd.



DB2 9.7 Early Adopter Partner ReferencesDB2 9.7 Early Adopter Partner References



University of Auckland: DB2 Migration – High Level Risk Assessment: - Background

DB2 Cobra ISV Clinics – NZ ISV FeedbackWhereScape is an ISV providing warehouse life cycle

management software They are a fresh new partner asmanagement software. They are a fresh new partner as of mid-late 2008 and have become very involved with the

IM team ever since. They have achieved the "Ready for IBM DB2 data server software" validation and the "Accredited for IBM Information On Demand Specialty" mark They are afor IBM Information On Demand Specialty" mark. They are a

DB2 9.7 beta participant that is extremely active and pleased with the program. They are willing to be a

reference but would also like to be included in our launch activities

“The PL/SQL compatibility in DB2 9.7 is great. WhereScape RED is rapid data warehouse

activities.

Q p y g p pbuilding software, and we like anything that speeds up development. When our customers

use WhereScape RED for converting databases, we can move tables and data very quickly. This new functionality provides a really fast way to move and convert Oracle PL/SQL to

run in DB2 It also allows us to more easily develop new functionality in WhereScape RED asrun in DB2. It also allows us to more easily develop new functionality in WhereScape RED as we can now use more common commands between Oracle and DB2.”

Michael Whitehead, CEO, [email protected], , @ p



DB2 Early Access Program StudyDB2 Early Access Program Study

“The compatibility level that DB2 9.7 achieved is amazing.”—Masato Kudo, Works Applications

Code from 18 EAP Participants analyzed

Range of industries, solutions, countriesRange of sizes: 2,000 –185,000 SQL statementsOver 750 000 lines tested

90-99% of statementsimmediately transferable to IBM DB2

Over 750,000 lines tested90-99% of lines immediately transferable to DB2



Lowering IT Costs – Breaking Down the Oracle BarriersAn Unusual Situation

No-one is questioning IF

Everyone is asking WHAT IT MEANSWHAT IT MEANS

The image cannot be displayed. Your computer may not have enough memory to open the image, or the image may have been corrupted. Restart your computer, and then open the file again. If the red x still appears, you may have to delete the image and then insert it again.The image cannot be displayed. Your computer may not have enough memory to open the image, or the image may have been corrupted. Restart your computer, and then open the file again. If the red x still appears, you may have to delete the image and then insert it again.



P i ItProving It




Conducting a DB2 Cobra Migration BVADB2 Cobra Migration BVA starts with a Discovery Process

What are the customer’s Key Business Requirements?What are customer’s challenges to meeting the Key Business Requirements?What are the consequences of not meeting the Key Business Requirements?The solution is DB2 Cobra with Deep Compression now including indexes andThe solution is DB2 Cobra with Deep Compression now including indexes and temp

Need to reduce IT operating costsKey BusinessRequirement

Oracle ApplicationCosts are too highChallenge

Spending moremaintenance

Spending moreadministration

ConsequencesDB2 Cobra Solutions



BVA Methodologygy

FinancialValue Define To-QualificationDeliver B siness

Document A I Financial

AnalysisAnalysisBe SolutionQualification Business

CaseAs-Is Environment

Account planning session Conduct

discovery using the BVA

S l tiquestionnaire (BVA discovery framework)

Solution Definition mapped to potential benefits

Identify hard and soft b siness Quantify business benefits

Q yBusiness Value in hard dollars using the Alinean Platform

Presentation t Cli tPlatform.

Calculate ROI, NPV, IRR.

Validate with client

to Client Executives / Decision Makers

client



Q ti i P t 1 C t E i tQuestionnaire – Part 1 – Current Environment



Questionnaire – Storage Costs



Q ti i P t 1 Mi ti D t ilQuestionnaire – Part 1 –Migration Details



Q ti i P t 1 G th P j tiQuestionnaire – Part 1 – Growth Projections



Questionnaire – Staff, Hardware and Software Resources



Questionnaire – High Availability and Down Time



Results – Customer Deliverables



TCO A l iTCO Analysis



Investment Summary



Investment Drill Down – DB2 Licenses



Results – ROI Analysis



SSummary




DB2 9 7 Compatibility Features Summary Proven DB2 9.7 Compatibility Features Summary

Differences are the exception, not the rule

Results

Leverage existing skills and code

Applications moved to DB2 run with full native executionrun with full native execution

Deliver high performance

Simple drag and drop of schemas to DB2Achieve high productivity

Integrated, cross-platform tools

IBM idl li tiIBM can rapidly assess your application

DB2 Early Access Program availablehttp://www-01.ibm.com/software/data/db2/technology-sandbox/



“The journey of a thousand miles begins with a step ..”-Lao Tzu



71

Th kThank you

Questions?Questions?


