02_oracle10g_newfeatures

1Dr. Norbert LeiendeckerLeitender SystemberaterServer Technologies Competence Center

Oracle Deutschland GmbH, Geschftsstelle Hamburg

[email protected]

Oracle 10g New Features

2Oracle 10g

g = grid

3Grid the idea

y Partitioning of one large servery Built with high quality,

high cost parts y Complete, integrated softwarey High quality of service at

high cost

y Coordinated use of many small servers

y Built with low cost, standard, modular parts Blades

y Open, Complete, integrated software

y High quality of service at low cost

Mainframe Model Grid Computing Model

4Making of...

y 25 % of development effort was codingy 2 years planningy 700 developers, 150 testers, 80 product managersy 3.000h testing each night on 1.000-plus computer gridy 100.000 automated tests (9i: 30.000)y Source control system running on 9i RACy 24h Worldwide development (USA, Canada, India,

China, U.K., Australia)

5Oracle10G Manageability Features

y Infrastructure Easy OracleJVM Monitoring SYSAUX Tablespace Enhanced Wait Model Database Features Usage

Tracking Enhanced Database Time

Model Top Consumers Performance

Monitoring & Diagnostic JDBC: End-to-end

Java/J2EE Tracing SQLJ: End-to-end Java/J2EE

Tracing Automated Routine

Administration Tasks Proactive Server-based

Alerts and Notifications Database Statistics and

Workload Respository Threshold-Based Alerts

y Server Configuration Automated Storage

Management Configuration

Automated RAC Services Configuration

Simplified Upgrade for RAC and OPS Databases

Automated Enterprise Manager Configuration

Automated Portable Clusterware Installation

Automated Configuration of Recovery Area

Out-of-the-box LDAP Configuration

Simplified Initialization Parameters

Easy Upgrade Upgrade Information Tool Simplified Database Install User Default Tablespace

y Instance Tuning User-Initiated Buffer Cache

Flushing Database Resource Manager

- Adaptive Consumer Group Mapping

Database Resource Manager - Fixed CPU Quota

New Performance Overview Charts in Oracle Enterprise Manager

Improved SQL Reporting Using Oracle Enterprise Manager

Integration of Resource Manager and Profiles

Automated Checkpoint Tuning

Transaction Rollback & Recovery Monitoring

Database Performance Analyzer

Redo Logfile Sizing Advisor Automated SGA Memory

Tuning

y Application Tuning SQLAccess Advisor Materialized View Tuning

API SQL Tuning Advisor Enhanced SQLAccess

Advisor Automatic Optimizer

Statistics Collectiony Backup and Recovery

Enhanced RMAN Reporting Backup Compression Bounded Backup Window Manage RMAN Scripts Recovery Area Full Alert

y Storage Management Multiple Default Temporary

Tablespace Support for SQL Operations

Automated Storage Management

Rename Tablespace

6Oracle10G Manageability Features(continued)

y Network Management Back Up Directory Naming

Entries to Local Naming File Dynamic Connection

Manager Configuration Easy Connect Naming

Method Easy OCI/JDBC Install Improved Network Outage

Detection Automated LDAP Discovery

for Clients Improved Connection

Manager Access Rules Automated Shared Server

Configuration Simplified Shared Server

Configuration Parameters

y Space, Object, Transaction Mgmt

Automatic Undo Retention Tuning

Segment Shrink Advisor Segment Size Estimation Online Segment Shrink Proactive Tablespace

Management Undo Advisor

y Database Utilities SQL*Plus - SPOOL

CREATE, REPLACE, and APPEND Options

SQL*Plus - Show Recycle Bin

SQL*Plus -DBMS_OUTPUT After SELECT

SQL*Plus - SET SQLPROMPT Runtime Variable Substitution

SQL*Plus -COMPATIBILITY Command Line Option

SQL*Plus - Run glogin.sql and login.sql After Each CONNECT

iSQL*Plus Input Prompting

y Scheduler Core Scheduler Features Usability and

Manageability Monitoring Recovery Support for Jobs in a

Clustered Environment Job Processing ILMS Support Increased Throughput Redo Minimization Dynamic Slave Pool

7Database Management Challenges

Applicationand SQL

ManagementStorage

Management

Backup andRecovery

Management

SystemResource

Management

SpaceManagement

?

?

??

?

8Solution: Self-Managing Database

Applicationand SQL

Management

StorageManagement

Backup andRecovery

Management

SystemResource

Management

SpaceManagement

Fix Advise

AlertMonitor

CommonManageabilityInfrastructure

AutomaticManagement

Enterprise ManagerDatabaseConsole

9Common Manageability Infrastructure: Automatic Workload Repository (AWR)

AutomaticWorkload

Repository (AWR)

ServerAlerts

AutomatedTasks

AdvisoryFramework

Data Warehouseof the Database Automatic collection of important statistics

Direct memoryaccess

Automatic Proactive

Efficient

10

MMONAutomatic Workload Repository

SGA

In-memorystatistics

AWRStatistics ASH

SYSAUX

7:00 a.m.7:30 a.m.8:00 a.m.

WR Schema

Snapshot 1

Snapshot 2

Snapshot 3

Snapshot 4

8:30 a.m.

8:30am

ADDM finds top problems

BG

BG

FG

FG

DBA

Sevendays

without SQL

11

Statistics Level

STATISTICS_LEVEL

BASIC TYPICAL ALL

Recommendeddefault value

Additional statistics for manual SQL diagnostics

Turn offall self-tuning capabilities

12

Database Feature Usage Metric Collection

MMONDB Feature UsageStatistics DB High-Water Mark

StatisticsAdvanced Replication, Oracle Streams, AQ,Virtual Private Database,Audit options,

size of largest segment,maximum number of sessions,maximum number of tables,maximum size of the database,maximum number of data files,

DBA_FEATURE_USAGE_STATISTICS DBA_HIGH_WATER_MARK_STATISTICS

OracleDatabase

10g

AWR

HOST CONFIGURATION INFO

EM Repository: ECM

EM Console

Once a week

13

Common Manageability Infrastructure:Server Alerts

AutomaticWorkload

Repository

ServerAlerts

AutomatedTasks

AdvisoryFramework

Enabled by defaultTimely generation

Push model

Automatic Proactive

Efficient

14

Server Alerts

Oracle Server(SGA)

ServerAlertsQueue

EnterpriseManager

Server monitorsitself

MMON

AWR

AutomaticNotification

GuidedResolution

15

Alert

Server-Generated Alert Types

MMON

85% Warning

97% CriticalAlert Cleared

ClearedThreshold

Alerts

Non-Threshold

Alerts

Metric-Based

Event-BasedAlert Alert Alert

SnapshotToo Old

ResumableSession

Suspended

Recovery Area Low On

Free Space

16

Out-of-the-box Alerts

ResumableSession

Suspended

SnapshotToo Old

Recovery Area Low On

Free Space

Tablespace

85% Warning97% Critical

TablespaceSpace Usage

LocallyManaged

17

EM Interface to Alerts

18

Setting Alert Thresholds

19

Common Manageability Infrastructure:Automated Tasks

AutomaticWorkload

Repository

ServerAlerts

AutomatedTasks

AdvisoryFramework

Pre-packaged routinemaintenance tasks Resource usage controlled

Statistics collection task scheduledout-of-the-box

Automatic Proactive

Efficient

20

Automatic Optimizer Statistics Collection

Automatic statistics collection

DBA tracks and gathers statistics

Resolvestwo issues

Targetsright objects

Determinesright samples

21

Gather Statistics Job

AUTO_TASKS_JOB_CLASS

AUTO_TASKS_CONSUMER_GROUP

gather_stats_job

WEEKNIGHT_WINDOW

10pm6am Mon to Fri

MAINTENANCE_WINDOW_GROUP

WEEKEND_WINDOW

12am Sat to 12am Mon

New PL/SQL-Package:DBMS_SCHEDULER

22

Common Manageability Infrastructure:Advisory Framework

AutomaticWorkload

Repository

ServerAlerts

AutomatedTasks

AdvisoryFramework

Uniform interface Fully integrated

Automatic Proactive

Efficient

23

Advisory Framework:Automatic Database Diagnostic Monitor

ADDM

SQL Tuning

Access

Memory

Space

PGA

SGA

Segment Advisor

Undo

Buffer Cache

Shared Pool

SeamlessintegrationAWR

Commondata source

24

Performance DiagnosticsADDM

25

Guided Tuning Session

Create an advisor task

Adjust task parameters

Acceptresults?

Implementrecommendations

YesNo

Perform analysis

EnterpriseManager DatabaseConsole

26

Advisor Central

27

Solution: Self-Managing Database

Applicationand SQL

Management

StorageManagement

Backup andRecovery

Management

SystemResource

Management

SpaceManagement

Fix Advise

AlertMonitor

CommonInfrastructure

AutomaticManagement


28

Performance Monitoring Solutions

Snapshots

ADDM ADDMResults

MMON

Alerts

In-memorystatistics

AWR

SGA

ReactiveMonitoring

Proactive Monitoring within

Oracle ServerDBA

29

ADDM Performance Monitoring

Snapshots

ADDM

MMONIn-memorystatistics

AWR

SGA

ADDMResults

EM

30 minutes

ADDMResults

30

Accessing ADDM Advice

31

ADDM Recommendations

32

Performance Management Approach

CPU/Waits

SQL Sessions

Host

Oracle

CPU Bottlenecks Memory Bottlenecks

Uses ASH and AWR

D E M O N S T R A T I O N

AWR-Snapshots(swrfrpt.sql)

34

Applicationand SQL

Management

StorageManagement

Backup andRecovery

Management

SystemResource

Management

SpaceManagement

Fix Advise

AlertMonitor


AutomaticManagement



35

Automate the SQL Tuning Process

DBA

ADDM

SQL Tuning Advisor

High-loadSQL

SQL Workload

I can doit for you!

36

SQL Tuning Advisor Overview

Add MissingIndex Run

Access Advisor

RestructureSQL

Plan Tuning(SQL Profile)

AutomaticTuning Optimizer

SQL AnalysisOptimization

Mode

Access Analysis Optimization

Mode

Plan Tuning Optimization

Mode

Statistics CheckOptimization

Mode

DetectStale or Missing

Statistics

ComprehensiveSQL Tuning

SQL Tuning Advisor

37

Plan Tuning Flow

Optimizer(Tuning Mode)

createsubmit

output

SQL Profile

DatabaseUsers

Well-TunedPlan

SQL TuningAdvisor

use

No application code

change Optimizer(Normal Mode)

slow

fast

38

SQL Tuning Advisor Usage Model

SQLTuning Advisor

ADDM High-load SQL

Cursor CacheSQL Tuning Set

STS

Custom

Filter/Rank

SourcesManualSelection

Automatic Selection

AWR

DBA

AWR

39

Applicationand SQL

Management

StorageManagement

Backup andRecovery

Management

SpaceManagement

Fix Advise

AlertMonitor


AutomaticManagement

Enterprise ManagerDatabaseConsole System

ResourceManagement


40

Selftuning PGAPGA_AGGREGATE_TARGETSQL Cache

sort

Online Users

Large Pool

Buffer Cache

Java Pool

PGA Pool

SGA Pool

LargeBatchJobs

sort

PGA Pool

SQL Cache

Large Pool

Buffer Cache

Java Pool

SGA Pool

Automatic Shared Memory Tuning

41

SQL Cache

Large Pool

Buffer Cache

Java Pool

SGA Pool

Java Pool

SQL Cache

Large Pool

Buffer Cache

SGA Pool

sort

PGA Pool

sort

PGA Pool

LargeBatchJobs

Online Users

Selftuning PGAPGA_AGGREGATE_TARGET

Selftuning SGASGA_TARGET

Automatic Shared Memory Tuning

42

Automatic Shared Memory ManagementBenefits

DB_CACHE_SIZESHARED_POOL_SIZELARGE_POOL_SIZEJAVA_POOL_SIZE

Enable Automatic Shared Memory Management

SGA_TARGET

43

Automatic Shared Memory Tuning:sga_target - Parameter

Automatically managed components: db_cache_size shared_pool_size large_pool_size java_pool_size

Manually managed components: keep/recycle buffer (db_keep_cache_size, db_recycle_cache_size) buffer caches non-standard block size (db_k_cache_size) streams_pool_size

if 0 min-value

44

Applicationand SQL

Management

StorageManagement

Backup andRecovery

Management

SystemResource

Management

Fix Advise

AlertMonitor


AutomaticManagement


SpaceManagement


45

y Table, IOT, Index, Partition, Subpartition, LOB segment, MAV, MAV Log

y Segments in Tablespaces with automatic segment management

y Row movement must be enabledy Oracle compacts the segment, adjusts high water mark,

releases the recuperated space immediatlyy Not for:

Cluster, clustered table, objects with LONG column Master table of ON COMMIT MAV ROWID MAVs must be rebuild after shrink operation

sql> ALTER TABLE SHRINK SPACE [COMPACT] [CASCADE];

46

Segment Shrink Overview

Data

HWM

HWM

ShrinkOperation

Data UnusedSpaceUnusedSpace

Reclaimed Space

Online and in-place

Data

47

PAUSE

48

Applicationand SQL

Management

Backup andRecovery

Management

SystemResource

Management

SpaceManagement

Fix Advise

AlertMonitor


AutomaticManagement


StorageManagement


49

What Is Automatic Storage Management ?

Database

Tablespace

Segment

Extent

ASM managesOracle files.

ASM solvesmanagement problems

of Oracle databases.

ASM does notreplace existing

concepts.

50

Hierarchy

Tablespace

Segment

Extent

Oracleblock

Data file

Physicalblock

ASMdisk group

ASM disk

ASM file

Allocation unitFile system

file orraw device

Database

Or

Database Instance ASM Instance

51

ASM Instance

INSTANCE_TYPE = OSMLOCK_NAME_SPACE = +OSM1OSM_POWER_LIMIT = 11OSM_DISKSTRING = '/dev/rdsk/*s2', '/dev/rdsk/c1*'OSM_DISKGROUPS = dgroupA, dgroupBLARGE_POOL_SIZE = 8MB

Lightweight instance- Few processes- No database to mount, metadata tripled mirrored in ASM

diskgroup

Initialization Parameters

52

ASM Files

Database file

ASM file automatically spread inside disk group dgroupA(Default stripe size = 1 MB)

CREATE TABLESPACE sample DATAFILE '+dgroupA';

1234

1 2 3 4

Automatic ASM filecreation

Not visible from OS,but to Oracle-Tools like RMAN

53

SQL Statements Issued to ASM Instances

ASM Instance

CREATE DISKGROUP

ALTER DISKGROUP DROP DISKGROUP

ALTER SYSTEMRESTRICTED SESSION

54

ASM

The Operational Stack

Disks

Logical Vols

File System

0010 0010 0010 0010 00100010 0010 0010 0010 0010Files

Tablespace

Tables

Disk Group

Logical Vols

File System

Files Tablespace

Tables

TODAY ASM

The best way to lower mgmt costs is to remove complexity

55

Mirroring with ASM: Failure Groups

Disk Group 1

y Storage resources organized intoDisk Groups and Failure Groups

y A Disk Group is a collection of disks managed as a logical unit in which ASM files are stored

y Disk Groups assigned by DBAsy A Failure Group is a set of disks sharing a

common resource whose failure needs to be tolerated

Redundant copies of an extent are stored in separate Failure Groups

y Failure Groups assigned by DBAs or automatically by ASMFailure Group 1 Failure Group 2

Controller 1 Controller 2

56

Mirroring with ASM

y 3 choices for disk group redundancy External: defers to hardware mirroring Normal: 2-way mirroring High: 3-way mirroring

57

Create or Delete Disk GroupsCREATE DISKGROUP dgroup1 DISK /dev/raw/raw*

DROP DISKGROUP dgroupA INCLUDING CONTENTS;

CREATE DISKGROUP dgroupA NORMAL REDUNDANCY FAILGROUP controller1 DISK

'/devices/diskA1' NAME diskA1 SIZE 120G,'/devices/diskA2','/devices/diskA3'

FAILGROUP controller2 DISK'/devices/diskB1','/devices/diskB2','/devices/diskB3';

58

Traditional vs ASMRemove Disk

1. List all data that is on disk

2. Choose existing filesystem to hold data from dropped disk

3. Move data to new files4. Rename files in

database5. Remove disk from OS6. Re-tune I/O

1. Issue drop disk command2. Remove the disk from OS

when Oracle says it is done

59

Removing Disks from Disk Groups

ALTER DISKGROUP dgroupA DROP DISK Group2_0003;

Disk Group Rebalancing

ALTER DISKGROUP dgroupA REBALANCE POWER 5;Optional: Adjustment of power during rebalance

60

Traditional vs ASMTune I/O

1. Daily monitor I/O performance

2. Discover hot spots3. Figure out how to remove

hot spots4. Move data to new files5. Rename files in database6. Verify that hot spot is gone

This space intentionally left blank

61

Migration of File System Tablespace to ASM

RMAN> BACKUP AS COPY TABLESPACE USERS FORMAT +DGROUPA;

RMAN> SWITCH TABLESPACE USERS TO COPY;

62

ASM Summaryy NO Volume-Managery NO replacement for a filesystemy NO combination of VM and FSy Management component that manages storage and Tablespaces

of an Oracle systemy Eliminates physical layout issues y Eliminates I/O tuning issuesy Eliminates down-time issues to add/delete storagey No additional storage management tool is required to manage an

Oracle system

63

ASM Internet Seminar

64

Applicationand SQL

Management

StorageManagement

SystemResource

Management

SpaceManagement

Fix Advise

AlertMonitor


AutomaticManagement


Backup andRecovery

Management


65

Automatic Backup (DBCA Setup)

66

Defining Flash Recovery Area

67

Flash Recovery Area Space Management

Disk limit is reached and a new file needs to be written into the Recovery Area.

12

Backup filesto be deleted

Database filebackup

1234

Warning is issued to user.

Recovery Area

Space pressure occurs.

RMAN updateslist of files thatmay be deleted.

Oracle deletes files that are nolonger requiredon disk.

68

Suggested Strategy

69

Odds and endsy ALTER TABLESPACE ... RENAME TO ...;y DROP DATABASE;y LOBS: Size = (4GB 1Byte) x db_block_sizey Datatypes: BINARY FLOAT, BINARY DOUBLEy CREATE BIGFILE TABLESPACE...y DROP TABLE ... PURGE;y Regular expressionsy Data Pumpy Transportable Tablespaces cross platform !y FLASHBACK DATABASE;y FLASHBACK TABLE employees TO BEFORE DROP RENAME TO

employees_old;y Native PL/SQL

70

y Tablespace and all its datafiles must be onliney COMPATIBLE 10.0.0y No renaming of SYSTEM or SYSAUX tablespacey UNDO-Tablespace automatically renamed in SPFILEy Helpful for transportable Tablespaces!y Does NOT change the name of the datafile(s)

sql> ALTER TABLESPACE RENAMETO ;

71

y Database must be mounted (closed) in exclusive and restricted mode

y Deletes all datafiles, controlfiles listed in the controlfiley Deletes SPFILE if used

sql> DROP DATABASE;

72

y Contains one datafile or tempfiley Up to 232 blocks 232 x 32K = 128 TBy Locally managed, automatic segment space-

management

sql> CREATE BIGFILE TABLESPACE ...

73

Regular expressions

sql> SELECT first_name, last_name FROM employees WHERE REGEXP_LIKE (first_name, '^Ste(v|ph)en$');

FIRST_NAME LAST_NAME -------------------- -------------------------Steven King Steven Markle Stephen Stiles

- IEEE Posix standard- Unicode Regular Expression Guidelines of the Unicode Consortium


Analyze any logfile with regexp_like

75

Oracle10g Data Pump

y High performance import and export 60% faster than 9i export (single thread) 15x-20x faster than 9i import (single thread)

y Replacement for original Export and Importy Data Pump/Export Dumpfiles not compatible y Scales with parallel threadsy Network transfer data between databases with

no intermediate representation

76

Oracle10g Data PumpExample

sql> create directory dpump_dir as d:\oracle\dpump;sql> create directory dpump_dir2 as d:\oracle\dpump2;sql> create directory dpump_log as d:\oracle\dpump;sql> grant read,write on directory dpump_dir to hr;sql> grant read,write on directory dpump_dir2 to hr;sql> grant read,write on directory dpump_log to hr;$ expdp hr/hr dumpfile=dpump_dir:hr_1.dmp,dpump_dir2:hr_2.dmp logfile=dpump_log:hr.log parallel=2

77

Cross Platform Transportable Tablespace

Solaris (SPARC)

Open VMS (Intel IA64)

Windows (Intel IA32/64)

Linux (Intel IA32/64)

AIX (PowerPC)

HP-UX (PA-RISC)

Tru64 UNIX (Alpha)

HP-UX (Intel IA64)

Small Endian Platforms Big Endian Platforms

Simple File Copy Within These Simple File Copy Within These

High SpeedFile Convert

RMAN

78

y How Do I Determine Endianness?

y How Do I Perform the Conversion?

y Conversion on source or destination platform

SELECT endian_formatFROM v$transportable_platform tp, v$database dWHERE tp.platform_name = d.platform_name;

sql> alter tablespace example read only;$ exp sys/sys transport_tablespace=y tablespace=example$ rman target=sys/sys catalog=rman/rman@orclRMAN> CONVERT TABLESPACE EXAMPLE'

TO PLATFORM = "AIX-Based Systems (64-bit)"FORMAT=D:\temp\transport_aix\example.dbf;

Cross Platform Transportable Tablespaces Usage

79

Flashback error correction

Flashback Database (instead of PITR)y Restore database to timey Uses flashback logs

Flashback Dropy Restore dropped tabley Uses recycle bin

Flashback Tabley Restore all rows in table to timey Uses UNDO in database

Flashback Transaction Queryy Query a committed Txn

Flashback Versions Queryy Query changes to rows over time

Order

Order Line

DatabaseCustomer

79

Flashback error correction

Flashback Database (instead of PITR)y Restore database to timey Uses flashback logs

Flashback Dropy Restore dropped tabley Uses recycle bin

Flashback Tabley Restore all rows in table to timey Uses UNDO in database

Flashback Transaction Queryy Query a committed Txn

Flashback Versions Queryy Query changes to rows over time

Order

Order Line

DatabaseCustomer DB_RECOVERY_FILE_DEST

DB_RECOVERY_FILE_DEST_SIZEALTER DATABASE FLASHBACK ON;

FLASHBACK ANY TABLE PrivilegeALTER TABLE ENABLE ROW MOVEMENT;

FLASHBACK ANY TABLE PrivilegeALTER TABLE ENABLE ROW MOVEMENT;

80

PL/SQL interpreted nativeComparison

y Calculation of Fibonacci-Numbers

Environment Time (s)

9i R2 interpreted 11.5

9i R2 native compiled 5.2

10g R1 interpreted 3.4

10g R1 native compiled 1.2

Environment Time (s)

9i R2 interpreted 11.5

9i R2 native compiled 5.2

10g R1 interpreted 3.4

10g R1 native compiled 1.2


Fibonacci

82

Upgrading to 10g

83

Installation

y DELL Latitude C640: Pentium 42 GHz 1GB RAMy Installation von Festplattey Binaries 10 miny Starter-Datenbank 7 miny Lauffhiges System in 17 min!

84

Upgrade-Pfade und -Versionen

Oracle 7.3.4

Oracle 8.0.6

Oracle 8.1.7

Oracle 9i

Oracle 7.3

Oracle 7.2

Oracle ...

Oracle 8.0.5

Oracle 8.0.4

Oracle 8.0.3

Oracle 8.1.6

Oracle 8.1.5

85

Database Upgrade Assistant Automates the upgrade process by performing all the tasks

you normally accomplish manuallyy Shows upgrade progressy Writes detailed trace and logging files RAC-DBUA facilitates upgrade of 8.1.7, 9.0.1, 9.2 to

10.1.0 All database and configuration files are upgraded on all the

nodes in the cluster.

Customizable Restartable Silent mode for single command upgrade Calls Post Upgrade Status Utility

86

Summaryy Oracle Database 10gs self-management

capabilities work out-of-the-box.y Customization of Oracle Database 10gs self-

management capabilities can be done through Enterprise Manager.y Oracle Database 10g is a self-managing database

which reduces administration overhead and enables DBAs to become proactive strategists.

86

Summaryy Oracle Database 10gs self-management

capabilities work out-of-the-box.y Customization of Oracle Database 10gs self-

management capabilities can be done through Enterprise Manager.y Oracle Database 10g is a self-managing database

which reduces administration overhead and enables DBAs to become proactive strategists.

Themen fr weitere Regiotreffen gesichert !

87

Data Dictionary 10gKostenlos bei Opitz Consulting

mailto:[email protected]

Q U E S T I O N SQ U E S T I O N SA N S W E R SA N S W E R S

Documents

02_oracle10g_newfeatures