DB2 – "Data is the reason computers exist."

IBM System i5

© 2006 IBM Corporation

Doug MackWW iSeries [email protected]

DB2 – “Data is the reason computers exist.”

IBM System i5

© 2006 IBM Corporation2

V5R4On Demand Performance Center– DB2 Usability Enhancements: iSeries Navigator

• Index Advisor (real time vs. requiring DB Mon data to be captured)• Real time analysis of SQL Plan Cache

– Improved database monitoring capabilities• Filters to focus on specific user or sql call• Drill through analysis• Before/after comparison (what changed?)

– Autonomic IndexesAdditional Standards Support– SQL and DB2 Family

• E.g., OLAP extensions Many Performance Improvements– SQL Stored Procedures, SQL Query Engine– Data Warehouse EnablementImproved .Net Support– iSeries Access and DB2 Connect for iSeries

0 10 20 30 40 50 60 70 80 90 100

2003 Core Items

DB2 UDB for iSeries

Microsoft SQL Server 2000

Oracle 10g

SQL 2003 Core Standard100% Complete with V5R4!!

IBM System i5


IBM System i5


DB2 “firsts” or “exclusives”DB2 UDB for iSeries Features– Single Level Storage– Automatic Statistics Collection – Parallel I/O– Auto balancing of tables and

indexes– Encoded Vector Indexes– Internodal data partitioning– Conditional Logic within Triggers– Lookahead Predicate Generator– Predictive Query Governor– DRDA Remote Unit of Work– Standard SQL Stored Procedures– Parallel Index Build– ….

IBM System i5


DB2 Modernization Roadmap: SG24-6393Enhance The

End-User Experience

Create A

Modular

Architecture

IntegrateApplications

Integrate BusinessProcesses

Improve

ProductivityTraditional

RPG/COBOL

52505250

RPG/COBOLILE and Java

HTML/JSP

DB2 and SQL

Connectors Process Choreography

DB2 and SQL

RPG/COBOL

XML XML

Portlets

GUI GUI5250GUI

ILE/Java

Java/EJB

ILE

GUI

User Interface

Portlets

HTML/JSP HTML/JSPHTML/JSP

5250 5250

5250

Servlets ServletsServletsServlets

Portlets Portlets

XML XML

DB2 and SQL

Web Services Web Services

ExperienceYour

ProductivityTraditional

RPG/COBOL

52505250

RPG/COBOLILE and Java

HTML/JSP

Connectors Process Choreography

RPG/COBOL

XML XML

Portlets

GUI GUI5250GUI

ILE/Java

Java/EJB

ILE

GUI

User Interface

Portlets

HTML/JSP HTML/JSPHTML/JSP

5250 5250

5250

Servlets ServletsServletsServlets

Portlets Portlets

XML XML

Web Services Web Services

DB2 and SQLDB2 and SQL DB2 and SQL

DDS/RPG to SQL

Use of Advanced DB2 Functions

XML, Unicode, Web Services

Remote DB2 Calls: ODBC, JDBC, .NET

Data Analytics (Bus. Intelligence)

IBM System i5


Building SQL/Query Optimization Skills in 2006Attend the SQL/Query Performance (4 Day) Workshop

– “This is the best IBM class I have ever attended.”

• http://www-03.ibm.com/servers/eserver/iseries/service/igs/db2performance.html

– In some cases, might make sense to bring on-site

DB2 Administration and Monitoring Tooling

– iSeries Navigator

– Centerfield Technologies: http://www.centerfieldtechnology.com/

Enteprise Edition Services Vouchers: DB2 SQL/Query Performance Assessment

– Proactively identify potential problems

– ASSESSMENT only (usually done remotely)

White Papers, COMMON, ITSO, Tech Conferences

– http://www-03.ibm.com/servers/eserver/iseries/db2/

IBM System i5


Data Warehousing and Business Intelligence

*See detailed certified benchmark results at

http://www.sap.com/solutions/benchmark/BW2_results.htm

0

50000

100000

150000

200000

250000

300000

SAP BW 3.5 BenchmarksEnd User Query Performance

DB2 i5/OS 4w iSeriesSQL Srv 16w UnisysDB2 i5/OS 8w iSeriesOracle 10g Fujitsu 8w DB2 i5/OS 8w iSeries

DB2 i5/OS regains leadership on January 23, 2006

43% of LE Customers will implement Business Intelligence or a data warehouse in 2006 (SMB % is even higher) 1

V5R3 and V5R4 are HUGE Releases for DB2 Data Warehousing– #1 in SAP Business Warehouse

Business Drivers– Marketing: Customer Segmentation– Finance: Compliance, budget/planning– C-Level Execs: Dashboarding– Sales and Operations: Sales/Product/Supplier

Analysis

Leverage the Tools Innovation Program– http://www.developer.ibm.com/vic/hardware/port

al/iii_pages/iii_tools_innov_roadmap

1 Source: GMV 1H 2005, Forrester, IDC

IBM System i5


iSeries Tools Innovation – Business Intelligence Vendors

SQL/Query Performance & tuning

On-Line Analytical Processing (OLAP)

Enterprise Reporting

Data Replication

Data Extraction/Transformation/Load

Data Mining/Predictive Analytics

iSeries Tools Innovation Web Portal - http://www-1.ibm.com/servers/enable/tools/innovation/

IBM System i5


DB2 Information Management and the iSeriesDB2 Family Products

–DB2 Connect for iSeries• DB2 family connectivity, .NET developer productivity, and DB2 family

“centers”

–Websphere Information Integrator• Middleware to enable applications access to heterogeneous databases

– Ex: RPG program can access data directly in Oracle or SQLServer• ONLY runs in AIX or IXA/IXS on iSeries

–Content Manager V8.3 Standard• Announced 4Q 2005• Storage and indexing of non traditional forms of data (images)

–QMF, Data Propagator, DB2 Extenders• Query tool, data replication, and XML Programming Enablers

IBM System i5


DB2 UDB for iSeries V5R4 DetailsApplication Flexibility & Portability

Free Format RPG & SQLEnhanced SQL Standards support

–Scalar FullSelect–Standard Flagger

Improved DB2 Family Compatibility–Recursive Expressions–OLAP Support – RowNumber &

Rank –ANS Timestamp Format–TDES Encryption–2 MB SQL Statements & 32K keys

OnDemand & AvailabilityCross-Reference Files Robustness Automatic Journaling EnhancementsSMAPP for EVIsParallel Rollback Unlock

PerformanceSQL Query Engine enhancements

–LIKE & LOB Support–Sensitive Cursors–Autonomic Indexes

Faster SQL Procedural LanguageEnhanced MQT OptimizationFaster XML Extenders

UsabilityiSeries Navigator Enhancements

–DB2 On Demand Performance Center–SQE Plan Cache Analyzer–DB2 Health Center

Resource GovernorGovernor Exit PointDB2 Content Manager

IBM System i5


Application Development – iSeries Access for Windows.NET Provider Enhancements

– LOB column support**– System Naming & Library List support** – MS FW 2.0 Compatibility**– Intellisense support to aid programmers– Multiple active result sets on a connection– Customizable string processing**Available with latest V5R3 Service Pack

JDBC – Version 3 currency & performance

– Optimization Goal connection attribute

IBM EWLM support added to CLI, DRDA, .NET, ODBC, JDBC

Driver support for Windows Vista (depending on availability)

OLE DB Driver– System Naming & Library List support

ODBC Driver

– Optimization Goal connection attribute

IBM System i5


Application Development –DB2 Connect Unlimited Edition for iSeries

New customized package for iSeries developer community –available since 3Q05

Affordable access to:– DB2 Add-Ins for Visual Studio – Federated Data access

• Joining of DB2 tables in different iSeries partitions• Joining of DB2 tables across iSeries & LUW server

– Extend iSeries data to mobile devices: DB2 Mobility on Demand

More details: ibm.com/software/data/db2/db2connect/edition-uei.html

IBM System i5


DB2 add-ins for Visual Studio .NET

Toolbox

DB2 Output Message Pane

IBM Explorer

DB2 Projects

Properties

DB2 Tools Toolbar

Dynamic Help

Intellisense

SQL Editor

IBM System i5


DB2 Development CenterTool for Database Programmers and Application DBAs

Rapid, iterative development of Java and SQL-PL stored procedures, user-defined functions, triggers, types, ... for DB2 for iSeries, DB2 for zSeries and DB2 for Linux, UNIX and Windows

No need to know programming languages (VB, C#, Java etc.)

portable SPs in SQL-PL or Java

Integrated debugger

IBM System i5


Do-It-Yourself Programming LanguagesWhy do you use PHP?

Zend's June 2003 market snapshot of the PHP community. The survey had over 10,000 respondents. http://www.zend.com/zend/php_survey_results.php

IBM System i5


DB2 plug-ins for Zend Studio for PHP

Debugger

DB2 Output Message Pane

Data Perspective

SQL Editor

IBM System i5


Richer Toolbox of SQL FunctionsTriple DES Data Encryption – ENCRYPT_TDES

– Will be available across the DB2 Family– Data Encryption White Paper:

ibm.com/servers/enable/site/education/abstracts/4682_abs.htmlDate/Time Processing

– LAST_DAY, NEXT_DAY, ADD_MONTHS, VARCHAR_FORMATStatistical Processing

– STDDEV_SAMP & VARIANCE_SAMPMiscellaneous

– GENERATE_UNIQUE– RAISE_ERROR

SELECT emp_name,CASE job_typeWHEN 1 THEN ‘Programmer’WHEN 2 THEN ‘Administrator’WHEN 3 THEN ‘Project Manager’WHEN 4 THEN ‘Manager’

ELSE RAISE_ERROR(‘70001’, ‘Invalid JobType’) ENDFROM employee

IBM System i5


INSTEAD OF Triggers (IOTs)New Trigger type can be used to change the semantics of INSERTs, UPDATEs, & DELETE operations against a view

– Certain views contain transformations that make the view read-only, but application really wants to use the View for all I/O operations

– Not part of V5R3 GA, delivered with V5R3 DB Group PTF #4 (ibm.com/iseries/db2/iot.html)

• New trigger type not viewable with iSeries Navigator or DSPFD, etc in V5R3• All view types are NOT supported in V5R3 (eg, views referencing more than one table not

supported until next release )– Example:

CREATE VIEW my_logins(system, login, passwd) AS SELECT system,login,decrypt_char(passwd) FROM regusers WHERE userid=USER

CREATE TRIGGER insert_my_logins INSTEAD OF INSERT ON my_logins REFERENCING NEW AS n FOR EACH ROW MODE DB2SQL

INSERT INTO regusers VALUES (USER,n.system,n.login,Encrypt(n.passwd))

CREATE TRIGGER update_my_logins INSTEAD OF UPDATE ON my_loginsREFERENCING OLD AS o NEW AS n FOR EACH ROW MODE DB2SQL UPDATE reguser SET system=n.system,login=n.login,passwd=Encrypt(n.passwd)

WHERE system=o.system AND login=o.login AND userid=USER

IBM System i5


Performance EnhancementsSQL Query Engine (SQE) Enhancements

– Support for LIKE, LOB columns, SUBSTR, and Sensitive Cursors– Enhanced Partitioned Table optimization– Autonomic Indexes

Faster SQL Procedural language with Expression Evaluator

Faster XML Extenders

Transaction Manager Enhancements– Parallel Rollback Unlock– Soft Commit - Reduce disk forcing with QIBM_TN_COMMIT_DURABLE

environment variable

Accelerator for System i5 boosts performance for SQL-intensive workloads on low-end 520 servers as well as Java & Websphere workloads

IBM System i5


“SQE-only” SQL Following SQL enhancements are only available to programmer if the SQL request is executed by SQE – otherwise SQL0255 returned

– Recursive CTE– RowNumber, Rank, & Dense_Rank– Subquery & Scalar FullSelect– INTERSECT & EXCEPT set operators– MQT Optimizer Awareness– iSeries Navigator SQL Plan Cache Tool

Remaining SQE restrictions• Sort sequences, • UDTFs, UPPER & LOWER functions• Logical File References• Select/Omit Logical Files• Non-SQL interface• Read Triggers

V5R4 includes Statement of Direction for Sort Sequence support of RCTE, RowNumber, Rank, Subquery & Scalar FullSelect in the next release

IBM System i5


Enhanced Performance ToolingPredictive Temporary Storage Governor

– STORAGE_LIMIT QAQQINI option– QRYSTGLMT parameter on CHGQRYA command

Governor exit point for easier administration, QIBM_QQQ_QUERY_GOVR

CURRENT DEGREE special register for controlling DB2 SMP parallelism via SQL

VOLATILE Table SupportCREATE TABLE worktable (id INT, name CHAR(10), current_total DEC(8,2)) VOLATILE

New filters on STRDBMON command– JOB wildcarding (QZDAS*)– RUNTHLD, FTRFILE, FTRUSER, FTRINTNETA

New Redbook on Database Monitor:Diagnosing SQL Performance on DB2 UDB for iSeries (SG24-6654)

IBM System i5


DB2 Family & MQTs Stage 2– V5R4MQT Example:CREATE TABLE Example_MQT AS

(SELECT Geography, Region, Year, Month,

SUM(Revenue) AS Total_Revenue, SUM(Quantity) AS Total_Quantity,

COUNT(*) AS Rows_per_Group

FROM Example_Table

GROUP BY Geography,Region,Year,Month)

DATA INITIALLY IMMEDIATE

REFRESH DEFERRED

ENABLE QUERY OPTIMIZATION

MAINTAINED BY USER

Optimizer could use the MQT instead of fully executing the following query:SELECT Geography, Year,

SUM(Revenue) AS Total_Revenue, SUM(Quantity) AS Total_Quantity,

FROM Example_Table WHERE Year IN (2004, 2005)

GROUP BY Geography, Year;

white paper: ibm.com/servers/enable/site/education/abstracts/438a_abs.html

User responsible for keeping MQT data current and activating optimizer MQT awareness with QAQQINI options

IBM System i5


Enhanced Index Advice

Index Advice, also enhanced (SQE Only)SQE Optimizer will also examine Join, Grouping, Ordering criteria

Available on V5R3 with latest DB Group PTF

System-Wide Index Advisor - Always ActiveAdvice can be viewed at database, schema or table level

IBM System i5


Advanced Database Monitor Filtering

IBM System i5


Database Monitor Analysis SimplifiedMonitor Comparison Utility

IBM System i5


Additional Management EnhancementsDB2 Health Center

– Monitor database metrics – Check which objects are nearing DB2 limits

Index Evaluator (first available on V5R3)

– “Native” last-used date added in V5R4

MQT Evaluator

OnDemand SQL Analysis – enhanced “Show Current SQL”– Statement name– Program or package name– Open Information

IBM System i5


ResourcesDB2 UDB for iSeries Website– http://www.ibm.com/iseries/db2

Sales Contacts– WW: Doug Mack: [email protected]– AG: Jackie Jansen: [email protected]– AP: Pony Ma: [email protected]– EMEA: Petter Sommerfelt: [email protected]

Rochester DB2 Competency Center and ISV Enablement Team– [email protected]

Rochester IBM DB2 Query Optimization Services– IGS: Dan Heithoff – [email protected]– CTC: Mark Even – [email protected]

Documents

DB2 – "Data is the reason computers exist."