Oracle Database 11g Release 2 · • Oracle RAC 11g Release 2 – Server pools ... –Shared Clusterware files (OCR/Vote Disk) ... OCR & Voting Files Binaries File em System Siebel

Oracle Database 11g Release 2

<Insert Picture Here>

Agenda

• Oracle Clusterware

– Automatic Cluster Time Synchronization

– Clusterized (Cluster Aware) Commands

• Oracle RAC 11g Release 2

– Server pools

– RAC ONE

• ASM

– ASM Cluster File System

– Managing Oracle Clusterware Files with ASM

– Managing Oracle Database Files with ASM

• Time synchronization between

cluster nodes is crucial

• Typically, a central time server, accessed

by NTP, should be used to synchronize the

time in the data center

• Oracle provides the Oracle CTSS as an

alternative for cluster time synchronization

• CTSS runs in 2 ways:

• Observer mode: whenever NTP is installed

on the system, CTSS only observes

• Active mode: time in cluster is synchronized

against the CTSS master (node)

Automatic Cluster Time SynchronizationOracle Cluster Time Syncronization Service (CTSS)

Ora

cle

Clu

ste

rware

Still 2 tools: CRSCTL & SRVCTL

1) CRSCTL manages all cluster(ware) related operations

Usage: crsctl <command> <object> [<options>] command:

enable|disable|config|start|stop|relocate|replace|stat|add|delete|modify

|getperm|setperm|check|set|get|unset|debug|lsmodules|query|pin|unpin

2) SRVCTL manages all Oracle resources related operations

Usage: … objects:

database|instance|service|nodeapps|vip|asm|diskgroup|listener|srvpool|se

rver|scan|scan_listener|oc4j|home|filesystem|gns

Clusterized (Cluster Aware) Commands

[GRID]> crsctl check crs

• Works on the local node only (pre 11.2 compatibility)

• New in 11.2 are clusterized commands. For example:

[stbpo56]> crsctl check cluster –n stbpo57

**************************************************************

stbpo57:

CRS-4537: Cluster Ready Services is online

CRS-4529: Cluster Synchronization Services is online

CRS-4533: Event Manager is online

**************************************************************

• Alternatively: [GRID]> crsctl check cluster -all

DO NOT USE: any crs_* Commands

• CRS_* commands will still be shipped for backward compatibility

• DO NOT CALL these commands directly.

• They are deprecated in Oracle Clusterware 11g Release 2

• CRSCTL commands have replaced the crs_* functionality:

• crs_start / crs_stop crsctl start / stop …

• crs_relocate crsctl relocate …

• crs_profile + crs_register crsctl add resource

• crs_stat (-t) has also been deprecated and replaced by

crsctl status resource (–t)or short: crsctl stat res (–t)


Agenda





– Server pools

– RAC ONE

• ASM




Fro

nt

Off

ice

DW

Back

Off

ice

Fre

eApp

Servers

Oracle Database 11g Release 2Dynamic Cluster Partitioning via Server Pools

• Server Pools

– Dynamically assigns the server

resources required to run specific

workloads

• Both Application and Database

Pools

• Policy Managed

– Min and Max Servers

– Relative Importance

• Unassigned Servers go to Free

Pool

© 2009 Oracle Corporation – Proprietary and Confidential

RAC One

Server Pool

• Managed by crsctl (applications), srvctl

(Oracle)

• Defined by 3 attributes (min, max, importance)

or a defined list of nodes

– Min- minimum number of servers (default 0)

– Max – maximum number of servers (default 0)

– Importance – 0 (least important) to 1000

For Oracle RAC start with: min 0, max=cardinality

Fro

nt

Off

ice

DW

Back

Off

ice

Fre

eApp

Servers

Oracle Database 11g Release 2Example: Server Pool


RAC One

Server Pool Min Max Imp

App Servers 6 12 3

Front Office 6 6 3

Back Office 6 6 2

DW 8 8 1

Free 4 0

Fro

nt

Off

ice

DW

Back

Off

ice

Fre

eApp

Servers

Oracle Database 11g Release 2Dynamic Cluster Reconfiguration for High Availability

• If a server pool falls below its

minimum the cluster reconfigures

• Moves a server from

– A server pool that is less important

– A server from pool with the same

importance with more servers than its

min

• Oracle Clusterware will only move

servers if you have non-default

values for min, importance


RAC One

Fro

nt

Off

ice

DW

Back

Off

ice

Fre

eApp

Servers

Oracle Database 11g Release 2Better Virtualization for Databases

• RAC One extends benefits of

server virtualization to single-

instance databases on physical

hardware– Consolidation

– Live Migration

– Rolling Patches

– Server failover

– Standardized DB environment

• Online upgradeable to full RAC


RAC One

Oracle Database 11g Release 2RAC ONE – A grid of virtualized single instance databases


• Automated Failover within Grid







• Live migration across Grid









• Rolling Patches





• Rolling Patches





• Rolling Patches





• Rolling Patches





• Rolling Patches





• Rolling Patches

• Online Upgrade to multi-node RAC instances




• Live migration of across Grid

• Rolling Patches

• Online Upgrade to multi-node RAC instances




Agenda





– Server pools

– RAC ONE

• ASM





Extending ASM to Support ALL Files

ASM

Disk

GroupASM Files (for Database)

VolumeManager

General PurposeFile System

Snapshots

3rd Party FS support

Manage all Oracle Databaseand Clusterware files

A

S

M

Oracle Database 11g Release 2ASM Supports All File Types

• ASM now supports all types

of files

– Database files

– Shared Clusterware files

(OCR/Vote Disk)

– File system files


(ACFS)

– 3rd-party file systems


DB Datafiles

OCR &Voting Files

Binaries

FileSystem

AS

M C

lus

ter

File

Sys

tem

Siebel

Web

PSFT

DWODS

SOAIMDBOC4J

APACHE

EBS

RAC One

Oracle Database 11g Release 2ASM Cluster File System (ACFS)


Siebel

Web

PSFT

DWODS

SOAIMDBOC4J

APACHE

EBS

DB Datafiles

OCR &Voting Files

Binaries

FileSystem

AS

M C

lus

ter

File

Sys

tem

RAC One

• General purpose clustered or local file system

• Data stored in ASM

• Inherits all ASM manageability benefits

– Optimized disk layout

– Online disk add/drop/rebalance

– Integrated mirroring

• Read-Only Snapshots– up to 64 point-in-time space

efficient copies of file system


Creating an ACFS File System

$ mkfs -t acfs -b 4k /dev/asm/volume1-62 ; Create fs

on ASM volume

$ su - root

# mount -t acfs /dev/asm/volume1-62

/u01/app/oracle/acfsdata/images

# su – oracle_usr

$ acfsutil registry -a /dev/asm/volume1-62

/u01/app/oracle/acfsdata/images

$ mount –t acfs –o all none none ; Mount everything

in the registry

$ cd /u01/app/oracle/acfsdata/images

$ cp /home/my_images .


Managing the ACFS File System is Simple

1. Native Linux, UNIX, and Windows OS file system

commands and extensions

2. acfsutil platform independent commands

3. ASM Configuration Assistant (ASMCA)

4. Enterprise Manager


Linux-Unix Extensions

• Extensions for ACFS

– Create an ACFS file system

mkfs [-vf] -t acfs [-b blksz] [-n name ] device [blocks]

Example: % mkfs -t acfs /dev/asm/diskgroup/vol1

– Mount an ACFS file system

mount [-v] -t acfs [-o options] device dirExample: % mount -t acfs /dev/asm/diskgroup/vol1 /oracle/cluster1/myacfs

– Unmount an ACFS file system

umount [-v] device|dir

– Check and repair an ACFS file system

fsck [-avnf] -t acfs [info] deviceExample: % fsck -t acfs /dev/asm/diskgroup/vol1


Windows Extensions

• Supports all Windows FS commands (dir, pwd, etc)

• Creates an ACFS file system

acfsformat [/vf] [/b blksz] [/n name] device [blocks]

Example: % acfsformat diskgroup1_vol1

• Mount/dismount an ACFS file system

acfsmountvol [/all] [/v]

acfsdismount [/v] [/p] [/P] path

Example: % acfsmountvol O:diskgroup1_vol1

• Check and repair an ACFS file system

acfschkdsk [/a] [/v] [/n] [/f] [info] device

• acfsutil detach

Example: % acfsutil detach


Command Function

acfsutil info Display new ACFS file and file system features (ACFS,

snapshots, registry, size) and information

acfsutil snapshot Create and display ACFS snapshots

acfsutil registry Register an ACFS file system with the ACFS mount

registry (i.e. cluster-wide fstab)

acfsutil rmfs Remove an ACFS file system

acfsutil size Resize an ACFS file system

acfsutil tune View or modify ACFS tune-ables

ACFS Platform Independent Commands

New ACFS commands for Linux/Unix and Windows (not natively supported)


OCR/Vote in ASM

• OCR and Voting Disks can now be stored in ASM

• Grid Infrastructure Install will create the diskgroup

• Best Practice is to use the same diskgroup as

Database

– COMPATIBLE.ASM must be 11.2.0.0

• Cannot stop ASM (unless stop the cluster) if

OCR/Vote in ASM

– Stopping ASM will cause the database instance to get

restarted, ASM will not stop


Oracle Cluster Registry in ASM

• OCR stored similar to any database file

• Redundancy defined by the diskgroup (same

as database files)

– Normal – 2 copies

– High – 3 copies

• Only 1 OCR in a diskgroup

– If you try to add an OCR to a diskgroup that

contains an OCR, the command will fail


Voting Disks in ASM

• Voting Disks are created on specific disks and CSS knows their

location

• Number of voting disks depends on the redundancy chosen for

the diskgroup

– External: one (1) Voting Disk

– Normal: three (3) Voting Disks

– High: five (5) Voting Disks

– By default each disk in a diskgroup is in its own failure group

– Diskgroup must contain enough failure groups (disks) to create each

voting disk in a separate failure group

• The ‘simple majority rule’ remains:

– Each node needs to see (v/2)+1 (with v= #Voting Files)

Voting Disks in order not to be rebooted (Check: every second)


Backup of Clusterware FilesFully Automatic Backups

• The Voting Disks are backed up into the OCR

• Any configuration change in the cluster (e.g. node addition) triggers a new backup of the Voting Files.

• A single, failed Voting Disks is restored by ASM automatically within a Disk Group – no action required

• Note: Do not use DD to back up the Voting Disks anymore!

• The OCR is backed up automatically every 4 hours

• Manual Backups can be taken as required

• ONLY IF all Voting Disks are corrupted or failed AND (all copies of) the OCR are also corrupted or unavailable THEN manual intervention would be required


ASM 11g Release 2 New Features for

Oracle Database Files

• Improved Management

– Full Featured ASMCMD

– ASM File Access Control

– ASM Disk Group Rename

– Datafile to Disk Mapping

– ASM Configuration Assistant (ASMCA)

• Tunable Performance

– Intelligent Data Placement (IDP)


Intelligent Data Placement (IDP)

• Policy-based file placement for hot files on high performance regions of disk

• Leverage disk performance regions on disk drives

– 50% performance difference from outer to inner tracks

• Classify or Mark an ASM file to be HOT/COLD

– Alter diskgroup dgname modify file ‘xxx’ attributes HOT/COLD or based on a template at creation time

– Rebalance to migrate the ‘file’ to HOT/COLD IDP region

• IDP regions are dynamic

• New V$ASMFILE recording IO stats

• The IDP feature better leveraged when ASM disks are whole disks

Disk Platter

Hot Files

Cold Files


Complete ASMCMD FunctionalityA complete API for the system admin

• Extending ASMCMD to manage:– ASM instance (startup/shutdown, init.ora, .)

– Disk group, disk and failure group (create, mount, add, drop, …)

– Attribute (list, set)

– User/Group (add user, change password, …)

– Template (list, add, alter drop)

– Iostat and df

– lsof: list files that are open by ASM lsod: list disks that are open by ASM

– Dynamic Volume


ASM File Access Control

• Introducing 3 classes of permissions:

–owner, group, and other

• 3 levels of permissions per class:

–none, read-only, read-write

• User name/passwd authentication via ASM passwd

file

• ACL commands apply to OS User names

–Database users inherit this ACL


ASM Disk Group Rename

• renamedg tool may be used to rename a disk group

• renamedg disk_string is used to discover disks to be renamed

in a disk group

• Renaming a disk group is a 2 stage process (for safety)

1. Generates a config file (each line contains description of change to

be made to one disk)

2. uses conf file to perform change

$ renamedg -dgname MYOLDDG -newdgname MYNEWDG

$ renamedg -phase one -dgname MYOLDDG -newdgname

MYNEWDG -config /tmp/myrendg.conf

$ renamedg -phase two -config /tmp/myrendg.conf


ASM Configuration Assistant (ASMCA)

Oracle Database 11g Release 2Schedule

• Aug 2009 - Linux GA

• Oct 2009 - Major announcement at Oracle World

• Nov 2009 - HP, Solaris and AIX GA

• Dec 2009 - Windows 32

• Mar 2010 - Windows 64 GA

• 2010 - Other Ports


For More Information

http://search.oracle.com

or

www.oracle.com/database

oracle database 11g


Documents

Oracle Database 11g Release 2 · • Oracle RAC 11g Release 2 – Server pools ... –Shared Clusterware files (OCR/Vote Disk) ... OCR & Voting Files Binaries File em System Siebel