Cognitive Systems

Db2 Web Query Demonstration

Doug Mack

Cognitive Systems Lab Services

mackd@us.ibm.com

© 2017 IBM Corporation

Analytics Experiences

• Insurance Industry: Why are our gross profit on policies sold in South America not as

profitable as in North America?

• Manufacturing Industry: What is the amount of money our company spends on

suppliers that are owned by a minority?

• Retailer: How can I ensure I have the right product mix inventory at our store

locations based on how weather impacts purchasing decisions?

• Security Compliance Officer: “I just want to have my cup of coffee in the morning and

see that we are in compliance across 1000+ different security attributes.”

© 2017 IBM Corporation

The Data Challenges

• Not all data is in the same place (or even in the same database)

– Multiple databases, Db2, SQLServer, Excel

• Much of the data is not understandable and may need to be re-structured, cleansed, or

“un-tangled.” Some data you want for analysis might not even exist on your system!

– How many galoshes did I sell on Mondays after a rainy weekend?

• Often processing large amounts of data and summarizing, then drilling deeper

– Analytics workloads are different than transaction processing workloads where the database

I/O and CPU usage is very short and data is at detail level

• Databases supporting analytics workloads require query acceleration techniques

– Buzz Words: “in memory”, “columnar”, “parallelism”, “scalability”

© 2017 IBM Corporation

IBM i, DB2 for i, and Db2 Web Query

Symmetric Multi-Processing

Star Schema Optimization (Look-ahead Predicate Generation)

Encoded Vector Indexing

EVI Index Only Access

Maintained Temp Indexes

Visual ExplainShow Statements Plan Cache

Database Monitors

Db2 Web Query for i

DataMigratorETL

Metadata

Materialized Query Tables

Aggregations in EVIs

SQL Set at a Time

SQL Aggregate Functions SQL OLAP

Extensions

Connections to Watson/IBM Cloud

Data Discovery Data Warehousng

Single Level Store

Large Memory Model

Result Set Caching

Rank, Dense Rank

Grouping Sets, Rollup

SQL Stats Functions

Query Accelerators

DBE Tooling

SQL Language

IBM i Architecture

BI/DW Tooling

Index Advice

Adapter Query Processing

© 2017 IBM Corporation

Db2 Web Query for i – Business Intelligence for IBM iFast, easy access to business information assets for query, reporting and analysis

5

Authoring Tool“Intuitive”

Reports & Graphs“Flexible delivery”

Dashboards“Insightful”

OLAP“Extensible”

Providing Analytics and Query/400 Modernization for the IBM i Client

Low Cost Solution Offering Value Upgrade from Query/400

Leveraging Best Practice Meta Data Layer Approach

Leveraging Db2 for i Advanced Query Optimization Technology

© 2017 IBM Corporation6

Db2 Web Query DataMigrator ETL Extension

▪ Extract, Transformation and Load Functions

‒ Automate consolidation, organization, “untangling” and optionally, the

building of a data warehouse or data mart

‒ Consolidate data from many different data sources

‒ Build transforms through SQL, RPG, use of built in or Db2 functions,

etc.

‒ Can create flat files, relational, incorporate lobs (e.g., XML, JSON)

‒ Run data flows off of IBM i job scheduler

▪ Integrated with IBM i and Db2 for i

‒ All components run in IBM i

‒ CL Commands, PTF Management, Security, Licensing is all IBM i

▪ INTEGRATED with Db2 Web Query Business Intelligence

‒ Can leverage meta data created with Db2 Web Query or vice versa

‒ Shared services and administration

© 2017 IBM Corporation

Prototype Example: Augmenting Operational Data with Weather Data

Db2 for i

Power Systems(IBM i)

Db2 Web Queryfor i

DataMigrator

Db2for i

Datamart

IBM Bluemix

Augment Data with Weather info

Visualize/deploy insights with Db2 Web Query

Order, Product, Inventory and measurements (revenue, COGS) Information

© 2017 IBM Corporation

Db2 Web Query Installation and Setup(in 15 minutes)

With the NEW EZ-Install Package

© 2017 IBM Corporation

What is the EZ-Install Package

– A single downloadable image that you can request that includes:

o Db2 Web Query Version 2.2 at the LATEST PTF Group Level.

o Includes:

– An optional pre-req checker

– Express and Standard Edition

– Data Migrator and Developer Workbench

– Sample “Century Electronics” Database including MetaData over the

database so you can run self guided tutorials out of the box

» Library QWQCENT

o Sample IBM i System Administration Reports

o Db2 Web Query Auditing/Monitoring Reports

o Query/400 Discovery Tool

o All of the Tutorial Reports already completed

– (but this would be cheating if you didn’t do the tutorials yourself)

Request by sending email

to QU2@us.ibm.com

Include: Name, Company

Name, and Serial Number

of system you plan to

install on

© 2017 IBM Corporation

Let’s Take A Look

• And if you’re interested in seeing more detail and how you build metadata, reports,

and visualizations, attend the Workshop this afternoon!

© 2017 IBM Corporation

To SQL or not to SQL

• Your HR department wants to ensure salaries are equitable across the company and

across departments and there aren’t outliers or other discrepancies

– What is the employee’s salary compared to the average WITHIN their department?

– For each employee, compare their salary to the two closest behind this person’s salary,

and the two closest ahead of them in salary

Check out blog post at db2webqueryi.blogspot.com

© 2017 IBM Corporation

Db2 for i OLAP Specifications to the Rescue !

With IBM i 7.3, Db2 for i supports the following additional OLAP specifications for

summarizing and referencing rows within windows of result sets:

▪ Aggregates (SUM, COUNT, etc.)

▪ LAG and LEAD

▪ NTILE

▪ FIRST_VALUE, NTH_VALUE, and LAST_VALUE

▪ RATIO_TO REPORT

▪ CUME_DIST

What is the value of this?

▪ You can address more complex analysis in a much simpler way (than the alternatives)

▪ BI tools like Db2 Web Query can “push the work” to Db2 for better performance

© 2017 IBM Corporation

The Process

• Create a SQL Views (or script) using new 7.3 SQL Extensions

View for Salary compared to AVERAGE View for 2 ahead, 2 behind

© 2017 IBM Corporation

Examples

© 2017 IBM Corporation15

To Learn More

• Db2 Web Query for i Website (Product Info)

– Ibm.biz/db2webqueryi

• Db2 Web Query for i Wiki (Technical Info)

– Ibm.co/db2wqwiki

• Db2 Web Query Getting Started Enablement:

– https://ibm.biz/db2wqconsulting

• Demonstrations:

– V2.2.1 Visualizations: http://ibm.biz/db2wq-221-videos

– End User Demos: https://ibm.biz/db2wqreportingdemos

• EZ-Install

– http://Ibm.biz/db2wqezinstall-info

• Follow Db2 Web Query guy Doug Mack on twitter at

@mckdrmoly or check out his blog at

http://db2webqueryi.blogspot.com/ for the latest info