Performance Testing Progress and Oracle

Performance Testing Progress and Oracle

Environment Variables and Installation

PUG Challenge Americas 2012 Performance Testing Progress

and Oracle

Progress Oracle

DLC /usr/dlc102B ORACLE_HOME /app/oracle/product/11.2.0

ORACLE_BASE /app/oracle

PATH $DLC/bin PATH $ORACLE_HOME/bin

To install

proinst To install runInstaller

Location /etc/oraInst.loc

inventory.xml

Physical Structure (data files)


and Oracle

Database File sports.db Control File(s) control01.ctl

System Area sports.d1 System Tablespace system.dbf

D Files area.d Datafiles tablespace.dbf

Before-Image File + After-Image File

sports.b1 + sports.a1

Undo tablespace +Redo Log

undotbs.dbf + redo01.log

Copy of After-Image File

sports.date_time_etc

Archive Log sports.date_time_etc

Structure file sports.st Backup of control file to trace file

Log File sports.lg Alert Log alert_sports.log

Parameter File sports.pf pfile (or spfile) initsports.ora


and Oracle

sports.dbsports.d1sports.licsports.b1sports.stsports_7.d1sports_8.d1sports_9.d1sports.lgsports.pf

control01.ctlcre_controlfile.sqlredo01.logredo02.logredo03.logsystem01.dbfsysaux01.dbftemp01.dbfundotbs01.dbfusers01.dbf

.srt, .DBI

ORACLE_HOME

Physical Structure

Logical Structure


and Oracle

Area Schema Area Tablespace System Tablespace

Area consists of objects

Objects are Tables or Indexes

Tablespace consists of segments

Segments: Tables, Indexes, Undo, etc

Each Object has one or more Clusters

Clusters size could be 8,64 or 512 blocks

Each Segment has one or more Extents

An extent is a series of blocks that are consecutively numbered within a datafile

Clusters consist of blocks

blocks 1,2,4 or 8K Extents consist of blocks

blocks 2,4,8,16,32 or 64K

Background Processes


and Oracle

Asynchronous Page Writer APW Database Writer DBWn

Before/After Image Writer BIW, AIW Log Writer LGWR

AI Management AIMGT Archive Process ARCn

Watch Dog WDOG Process Monitor PMON

Database Broker _mproserv System Monitor SMON

Checkpoint process CKPT

Many other …. 20 at least

Login Broker _mproserv Listener lsnrctl


and Oracle

Client Server -db db_name -H host -S service

Listener

Shared memory -db /full_path/db-name

N/A

Login Broker lsnrctl [start/stop/status]

Connecting to a database

$ORACLE_HOME/bin


and Oracle

-H host –S service1

-H host –S service2 S

Host:port:SIDSID

ListenerPort 1521

SID2

Connecting to a database

Host:port:SID2

Meta-schema and VST


and Oracle

Progress Table Field Oracle View Column

_Area _Area-name DBA_TABLESPACES TABLESPACE_NAME

_AreaExtent _Extent-Path DBA_DATA_FILES FILE_NAME

_StorageObject _Object-type (1,2 or 3) DBA_OBJECTS object_type (38 types)

_File _File-name DBA_TABLES TABLE_NAME

_Field _Field-name DBA_TAB_COLUMNS

COLUMN_NAME

_Index _Index-name DBA_INDEXES INDEX_NAME

_Sequence _Seq-name DBA_SEQUENCES SEQUENCE_NAME

Progress Meta-schema tables -80 < _file-number < 0

Progress VST _file-number < -16384

Meta-schema and VST


and Oracle

Virtual System Tables V$ (Vee dollar) Views

_Connect v$session, v$process

_DbStatus v$instance, v$sysstat

_Trans v$transaction

_Lock v$lock

_Latch v$latch

_AreaStatus v$tablespace

_Filelist v$datafile

_Startup (some) v$parameter

Data Types


and Oracle

character format "x(100)" varchar2 varchar2(100)

decimal format ">>>>9.99" number number(7,2)

integer format ">>>>9" number number(5)

date format 99/99/9999 date 'MMDDYY HH24:MI:SS'

logical format yes/no N/A N/A

datetime HH:MM:SS.SSS+HH:MM timestamp 'HH24:MI:SS.FF5'

int64 format ">>>>9" number number(38)

rowid rowid

recid N/A N/A

blob, clob,raw blob, clob,raw

10 -5

Create Database


and Oracle


and Oracle


and Oracle

Create Database

• prodb mydb• procopy empty8 mydb

• Min size 5 MB• Min memory 160KB• Time to create 1 second

• A set of .sql scripts • create database mydb;

• Min size 512 MB• Min memory 512MB• Time from 20 min to 1.5 hr


and Oracle

Shutdown

• Unconditional Shutdown• Emergency Shutdown

• Shutdown Normal• Shutdown Transactional• Shutdown Immediate• Shutdown Abort


and Oracle

Progress 10.2B-shutdownTimeout [ immed, 10m, 1h, maximum ]

Startup


and Oracle

Closed ClosedNomount modeMount mode

Open Open

ProrestRestoreinit*.ora

.ctl

Shared MemoryBackground Proc

Backup


and Oracle

Progress backup – simple Oracle RMAN – More complicated

probkup db_name file_name

Progress and Oracle : Online and Offline (Hot and Cold)

Progress and Oracle : Complete and Incremental

Oracle: could be Full and Partial

Compressed Backup


and Oracle

700 GB Progress DB makes about 600 GB probkup

1.4 TB Oracle DB makes either 1.2 TB regular backup or 250 GB RMAN compressed backup (BZIP2 is default).

Dump and Load


and Oracle

Dictionary Dump and Load in ASCII format (.d) or 4GL export/import

SQL select/insert“SQL Loader” or External Tables 10g

Binary Dump (proutil –C dump) Oracle export (exp tables=tbl_name)

Binary Load (proutil –C load) Oracle import (imp file=file_name)

Binary Dump multithreaded V10 Oracle Data Pump Export (expdp) 10g

Oracle Data Pump Import (impdp) 10g

Dump/Load .df Export/Import (exp full=y rows=n)

ATM Database Tests


and Oracle

Hardware: IBM POWER 6 p570, RAM 24GB, 2 CPUs 4704 MHz

Software: AIX 6.1, OpenEdge 11.0, Oracle 11gR2

Database: ATM database = 7GB

Tables # records

Branches 5,000

Tellers 50,000

Accounts 50,000,000

Database Size


and Oracle

Progress DB/area size 7,442,137,088Oracle DB/tablespace size 7,688,953,856

Oracle db appear to be 3% more in bytes

Backup Size and Speed


and Oracle

Progress Oracle Oracle ( compressed )time 94 sec 140 sec 240 secondssize 7GB 7.8GB 735MB

ASCII Dump (in seconds)


and Oracle

# records Progress Oracle10,000 0.31 0.43100,000 1.56 3.321,000,000 15 328,000,000 115 259

for each account where account.id < "condition“ no-lock: export account.

select * from account where account.id < "condition"

ASCII Load (in seconds)


and Oracle

# records Progress Oracle100,000 3.75 0.81,000,000 53 1210,000,000 413 139

repeat: create account. import account.

insert into account select * from stg_account; -- External table

Binary Dump (in seconds)


and Oracle

# records Progress Oracle50,000,000 80.38 55.46

proutil atm -C dump PUB.account /dir -index 0 –RO

expdp user/passwd TABLES=ACCOUNT directory=DATA_DIR dumpfile=expdp.dmp parallel=2 -- Data Pump

Binary Load with integrity


and Oracle


proutil atm -C load account.bd -B 50000 -TB 31 -TM 32 -T /tmp

impdp user/passwd directory=DATA_DIR dumpfile=expdp.dmp -- Data Pump

Binary Load no integrity (-i)


and Oracle


proutil atm -C load account.bd -i -B 50000 -TB 31 -TM 32 -T /tmp

impdp user/passwd directory=DATA_DIR dumpfile=expdp.dmp -- Data Pump

Binary Load


and Oracle

EmptyEmptyEmptyRM BlockFreeRM BlockFullRM Block

HWM

Binary Load


and Oracle

EmptyEmptyEmptyRM BlockFullRM BlockFullRM Block

HWM

Binary Load


and Oracle

EmptyEmptyFullRM BlockFullRM BlockFullRM Block

HWM

Oracle Load


and Oracle

EmptyEmptyEmpty

HWM

Oracle Load


and Oracle

FullFullFull

HWM

Oracle Load


and Oracle

FullFullFull

HWM

Build a brand new index


and Oracle


proutil atm -C idxbuild area "Account Index" -thread 1 -threadnum 2 -TF 80 -TB 64 -TM 32 -B 256 -T /tmp -SG 64

CREATE UNIQUE INDEX account_pk ON account (id);

Rebuild existing index


and Oracle


proutil atm -C idxbuild area "Account Index" -thread 1 -threadnum 2 -TF 80 -TB 64 -TM 32 -B 256 -T /tmp -SG 64

ALTER INDEX account_pk REBUILD PARALLEL 2;

ATM Test


and Oracle

atm1.sql


and Oracle


and Oracle

CL Trans TPS Conc AvgR MinR 50%R 90%R 95%R MaxR Prog

1 329961 1100.0 0.8 0.00 0.0 0.0 0.0 0.0 99.1 atm1.p

5 341090 1137.0 3.9 0.00 0.0 0.0 0.0 0.0 93.0 atm1.p

15 358355 1194.5 13.9 0.00 0.0 0.0 0.0 0.0 95.0 atm1.p

25 360396 1201.3 22.4 0.02 0.0 0.0 0.0 0.0 97.6 atm1.p

50 367093 1223.6 49.8 0.04 0.0 0.0 0.0 0.1 88.4 atm1.p

100 348467 1161.6 99.6 0.09 0.0 0.0 0.0 0.2 88.2 atm1.p

250 341653 1138.8 248.9 0.23 0.0 0.0 0.1 0.6 98.6 atm1.p

500 315142 1050.5 495.6 0.47 0.0 0.0 0.3 1.2 82.8 atm1.p

1000 310793 1036.0 872.2 0.95 0.0 0.0 1.0 2.3 117.6 atm1.p

Progress ATM ResultsAll tests run for 300 seconds


and Oracle

CL Time Trans TPS Conc AvgR Prog

1 300 35589 118.6 1.0 0.01 atm1.sql

5 300 160492 535.0 4.8 0.01 atm1.sql

15 300 480898 1603.0 14.4 0.01 atm1.sql

25 300 803263 2677.5 23.7 0.01 atm1.sql

50 300 953962 3179.9 47.4 0.01 atm1.sql

100 300 1023948 3413.2 69.4 0.01 atm1.sql

250 300 1063454 3544.9 226.4 0.02 atm1.sql

500 300 1092404 3641.4 472.3 0.06 atm1.sql

1000 300 1113454 3711.5 861.3 0.13 atm1.sql

Oracle ATM ResultsAll tests run for 300 seconds


and Oracle


and Oracle

IBM Power 7 Model p75016 3.4 GHz CPUs x 4 SMTsRAM 124 GBSAN V7000

Big box Test


and Oracle


and Oracle

Type: DBS and CC Only DBSAny -pf file anywhere init*ora In $ORACLE_HOME/dbsPromon R&D / 1 / 12 or _Startup select * from V$PARAMETER

Startup parameters


and Oracle


and Oracle

OEM parameters


and Oracle

-db db_name-B memory_target-bibufs log_buffer-n processes-spin spin_count-L dml_locks-Ma 1 Dedicated connections-Ma 2 or more Shared connections-cp* (I18N) NLS* National Language Support

Startup parameters


and Oracle

Questions

Web page www.proora.comEmail [email protected]

Documents

Performance Testing Progress and Oracle