Business Unit or Product Name

• Presentation subtitle: 20pt Arial Regular, green R204 | G255 | B153 Recommended maximum length: 2 lines

• Confidentiality/date line: 13pt Arial Regular, white Maximum length: 1 line

• Information separated by vertical strokes, with two spaces on either side

Indications in green = Live content

Indications in white = Edit in master

Indications in blue = Locked elements

Indications in black = Optional elements

• Presentation title: 28pt Arial Regular, white Recommended maximum length: 2 lines

• Group name: 17pt Arial Regular, white Maximum length: 1 line

• Copyright: 10pt Arial

Regular, white

DBA’s World Past, Present and Future...

Cüneyt Göksu, IBM Information Champion, IBM DB2 Gold Consultant Cuneyt.Goksu@Gmail.com

2

Who am I ?

BS, Computer Science, YTU, Istanbul, Turkey, 1990

MBA, Marmara University, Istanbul, Turkey, 1992

MS in CS, IIT, Chicago, USA, 1994

20+ years in “Information Management” Technologies

1996, IDUG (International DB2 Users Group)

2004, TDUG (Turkish DB2 Users Group)

2008, 2009 IBM Data Champion

2009, IBM Gold Consultant

3

Today’s reality: Complexity

E01-EDI

Data Warehouse

(Interfaces to and from the Data Warehouse are not

displayed on this diagram)

G02 - General Ledger

A05 - AP

S01 - Sales Corrections

I01 PO Receiving

I03 Return to

Vendor

I06 Warehouse Management

Mainframe PC/NT apps UNIX apps 3rd party interface

S06 - Credit App

P15 EES Employee Change Notice

OTHER APPS - PC

AP - Collections/Credit

TM - Credit Card DB

ACCTS REC APPS - PC

990COR

Bad Debt

Beneficial Fees

Beneficial Reconcile

JEAXF

JEBFA

JEBKA

JEDVA

JESOA

JEVSA

JEVSF

NSF

TeleCredit Fees

INVENTORY CONTROL APPS - PC

Code Alarm

Debit Receivings

Devo Sales

Display Inventory

In Home

Junkouts

Merchandise Withdrawal

Promo Credits

RTV Accrual

Shrink

AP Research - Inv Cntrl

AP Research-Addl Rpts

Book to Perpetual Inventory

Close Out Reporting

Computer Intelligence Data

Count Corrections

Cross Ref for VCB Dnlds

Damage Write Off

Debit Receivings

DFI Vendor Database

Display Inventory Reconcile

Display Inventory Reporting

INVENTORY CONTROL APPS - PC

DPI/CPI

IC Batching

Inventory Adj/Count Correct

Inventory Control Reports

Inventory Levels

Inventory Roll

Merchandise Withdrawal

Open Receivings

PI Count Results

PI Time Results from Inv

Price Protection

Sales Flash Reporting

Shrink Reporting

SKU Gross Margin

SKU Shrink Level Detail

USM

VCB Downloads

Journal Entry Tool Kit

Scorecard - HR

L02-Resource Scheduling (Campbell)

P09 - P17 Cyborg

M02 - Millennium

M03 - Millennium 3.0

Banks - ACH and Pos to

Pay

Cobra

B01 - Stock

Status

S03-Polling

P14 On-line New

Hire Entry

CTS

Plan Administrators (401K, PCS, Life,

Unicare, Solomon Smith Barney)

D01 Post Load Billing

I04 Home Deliveries

I02 - Transfers

Arthur Planning

I07 Purchase

Order

I12 Entertainment Software

I05 Inventory Info

E13 E3 Interface

S04 - Sales Posting

V01-Price Management System

I10 Cycle Physical Inventory

I55 SKU

Information

K02 Customer Repair

Tracking I35 Early Warning

System

B02 Merchandise Analysis

I13- Auto Replenishment

U18 - CTO

Intercept

I09 Cycle Counts

E02-Employee Purchase

Texlon 3.5

ACH

Stock Options

I17 Customer Perceived In-Stock

U16-Texlon

SiteSeer

C02 - Capital Projects

F06 - Fixed Assets

US Bank Recon File

Star Repair

EDI Coordinator

Mesa Data

NEW Soundscan

NPD Group

AIG Warranty Guard

Resumix

Optika

Store Budget Reporting

P16 - Tally Sheet

Cash Receipts/Credit

S05 - House Charges

Ad Expense

L01-Promo

Analysis

V02-Price

Marketing Support

BMP - Bus performance Mngt

Store

Scorecard

I11 Price

Testing

Valley Media

P09 Bonus/HR

I15 Hand Scan Apps

Roadshow

POS

S08 - Vertex Sales

Tax

A04 - Cust Refund Chks

Equifax

ICMS Credit

Cellular Rollover

S09 - Digital Satellite System

NPD, SoundScan

Sterling VAN Mailbox (Value)

I18

SKU Rep

X92-X96

Host to AS400 Communication

S02 - Layaways

Washington, RGIS,

Ntl Bus Systems

V04-Sign System

I14 Count Corrections NARM

P01- Employee Masterfile

I06 - Customer Order

Frick Co

UAR - Universal Account

Reconciliation

Depository Banks

S07 - Cell Phones

S11 - ISP Tracking

AAS

Fringe PO

Cash Over/ Short

L60 MDF

Coop SKU Selection

Tool

SKU Performance

Supplier Compliance

1

I35 - CEI

ASIS

Misc Accounting/Finance Apps - PC/NT COBA (Corp office Budget Assistant)

PCBS(Profit Center Budget System)

Merchandising Budget

AIMS

Merch Mngr Approval Batch Forcasting Ad Measurement

AIMS Admin

AIMS Reporting Ad

Launcher

V03- Mkt Reactions

Spec

Source

CTO2.Bestbuy.

com

Rebate Transfer

Sign

System

CopyWriter's

Workspace

ELT

PowerSuite

Store Monitor

AIS Calendar

Stores & Mrkts

Due Dates

Smart Plus

Insertions Orders

Budget

Analysis Tool

Print Costing Invoice App

AIS Reports

Broadcast Filter

Smart Plus Launcher

General Maintenance

Printer PO

Printer

Maintenance

Vendor Maintenance

Vendor Setup

Connect 3

Connect 3 Reports

Connect 3 PDF Transfe

Spec Source

SKU Tracking

S20-Sales Polling

Prodigy

PSP

In-Home

Repair

Warranty Billing

System

Process Servers

(Imaging)

Prepared by Michelle Mills

An example of a real architecture in an industry

4

The data landscape is complex…

Highly distributed

Multiple applications, databases and platforms • ERP, CRM, Supply Chain, DW, MDM • DB2, Informix, Oracle, SQL Server, TeraData… • NoSQL Databases • Unix/Linux, z-Series, Windows

Complex, poorly understood data relationships • Corporate memory is poor (outsourcing, turnover) • Documentation is poor or nonexistent

6

Time

Gro

wth

of

Com

puti

ng P

ower

Dumb Index in 2012?

New Information

All Digital Data

Sensemaking Algorithms

Growing Amnesia Index?

7

Prospect Database

Employee Database

Human Resources Department

Investigations Database

You are unaware the newly hired employee had previously been arrested for stealing from you!

Marketing Department

Enterprise Amnesia

Corporate Security

Department

8

Prospect Database

Employee Database

Human Resources Department

Corporate Security

Department

Fraud Database

Your marketing department is mailing offers to a person currently in jail for stealing from you!

Marketing Department

Enterprise Amnesia

9

DBA ???

Who is DBA ?

10

DataBase Administrator

Who is DBA ?

* Prevent developers and users from corrupting the company's data.

11

Database Architect

Who is DBA ?

12

DataBase Android*

* An android is a robot designed to look and act human.

Who is DBA ?

13

14

15

DataBase Android* Where is DBA in the hierarchy?

DBA

DBA

16

Edgar F. Codd and 12 Rules

17

Edgar F. Codd and 12 Rules

System R, 1970, IBM

18

Edgar F. Codd and 12 Rules

System R, 1970, IBM

SQL

19

Edgar F. Codd and 12 Rules

System R, 1970, IBM

SQL

XQuery

20

Edgar F. Codd and 12 Rules

System R, 1970, IBM

SQL

XQuery

BIG SQL

21

Platform, CPU, Memory, Storage...

September 1956

IBM 305 RAMAC

First computer with a hard drive.

The 5MB hard drive

weighed one ton, Multi-Million USD

22

Platform, CPU, Memory, Storage...

AMD

Intel

Pentium

PC

Middleware

Mainframe

IFL

zIIP

zAAP

RISC Windows

Minix, Unix, Linux VMS

MVS Central ?

Distributed ?

N-tier

23

Internationalization...

EBCDIC 1950s, 1960s... Mostly Mainframe

ASCII 1960s... PCs and Workstations

Unicode 1987

? ? ?

24

Data Modeling

Very Simple Start May reach to this mess!

25

Data Modeling

Starts from here May reach here...

? ?

?

IBM – Rational Data Architect

CA - Erwin

Oracle Designer

Sybase – Power designer

Microsoft - Visio

Quest – Toad Data Modeller

26

Performance

Pareoto Rule 80 : 20

“fixing the top 20% of the most reported bugs, 80% of the users would not encounter any bugs”

@Microsoft CEO

20% of Database applications cause 80% of your problems

27

Performance

System Application

Hardware, CPU, Storage, Network, Operating System, DBMS, I/O

Algorithm, Technology, Data Model, SQL Design

DBMS SQL

28

Performance

DBMS SQL

DASD Parameter List Memory Budget

More Cache, Less I/O

Optimizer (Rule? Cost?) Index Design Sort ANSI SQL ? DBMS SQL ?

UDF, SP, Trigger

29

End – to – End Transaction Breakdown

Application : Code, App Server such as JVM, External Sources (Flat File..)

Network: Switch, Router, LAN, WAN, etc...

Database Server: OS, Subsystem, SQL, DASD, Tablespace, etc...

30

Data Structure

DDL DCL DML TCL

31

Backup & Recovery

#1 Task of the DBA

Who is going to be affected in case of failure?

1 – Enterprise 2 – Customers, Users, Country and even all Planet!

3 – More Importantly, you, loved ones and family!

Data

32

DBA’s Problem Solving Lifecycle

Collect Performance Data

Analyze

Make sure changes are done

Define the Problem

Performance Reporting

Manual or Tooling

DBMS, SQL, OS, Network, Application vb...

DBA, Non-DBA

33

Disaster Recovery

Local Data

Remote Data

To Sync or Not to Sync !

34

Security

Data

DCL – Grant / Revoke

Information Security Strategy

Production Data Test Data

Encryption

35

Security – How the data is being attacked?

Com

plexity

Probab

ility

DBA & Sysadm & Administrator

App. Developer, valid user for data

Network, LAN Sniffer

SQL Users, App. Users (SQL Injection)

Lost Backups during transit

36

37

DB Tools

• Monitors • Data Dictionary

• Advisers (Index, Tuning, SQL etc...)

• Data Analysis

•Backup & Recovery Automation

•Database Maintenance

A fool with a Tool is still a Fool @ Marco

38

Trouble Shooting

39

Which DBMS ?, Which DBA ?

• DB2, IMS, Informix

• Oracle

• SQL Server

• Adabas, Ingres, MySQL, Postgre SQL etc...

Specialist? Generalist? Criteria

• Price • Support • Documentation • Performance • Tools and Utilities

40

Which Datatype ?

• Char / Numeric

• Char, Varchar / Smallint, Integer, Decimal

• Real, Float

• LOB (BLOB, CLOB)

• XML

• Graphic

• Date, Time

• Row ID

• Distinct Type Freedom

41

Data Replication

DB2 for z/OS

Core Bank

ATM Visa

DB2 for LUW

CRM

Oracle

BI

SQL Server

HR

42

Vendors, 3rd Party, User Groups and Others...

DBMS Provider

Vendors

User Groups

IDUG

OUG

Internet

ITtoolbox

DeveloperWorks Metalink

43

In memory DB

Keep Data in Memory

Extreme Availability

Low Cost

44

Summary

Modelling, Object Management, Etc... xSkills (OS, Network, Application) Security & Standards App. Dev. Interfaces Data Integration

Past Today

45

10 – 15 years ago

• %100 Technical, %100 Specialist • Poor Management Communication

• Programmer DBA • 1 system, 1 DB, maybe 2! • More time for R&D

• DBA ~ Sysprog

46

Today • Technical + Social + Politic!

• e-DBA, Distributed DBA

• x System, y DB, z DBMS

• Less time for different specialities

• Communication Skills

• Certification

• Internal Consultant

• Prod DBA, Test DBA, Q&A DBA, Packaged DBA, Offshore DBA vb...

globalization

Internet

47

Industry Trends

• Performance Management Tools

• Self-Healing, Self-Tuning Systems, Autonomous

• Outsourcing

• Smart Analytics

• Appliance (Netezza...)

48

Rules of the Road for DBAs –

• Write down everything

• Keep Everything

• Automate; Let the machine Dirty Work

• Share your knowledge

• Focus your efforts

49

Rules of the Road for DBAs

• Measure twice, cut once!

• Understand the business

• Don’t be a hermit

• Keep current

• Don’t Panic!

• Be Strategic!

50

$$$ / €€€ / £££

51

Acknowledgements

Jeff Jonas,Distinguished Engineer, IBM Entity Analytics

Seda İşi, IT Specialist, IBM

Maja Markotic, DB2 DBA, Zagrebacka Banka, Croatia

Serpil Yıldız, Tubitak

Florence Dubois, EMEA SWAT Team - DB2 for z/OS, IBM

Craig S. Mullins, Data Management Strategist with NEON

52

Thank you

DBA’s World Past, Present and Future...

Cüneyt Göksu, DB2 SME IBM Information Champion, IBM DB2 Gold Consultant Cuneyt.Goksu@Gmail.com