Dell | Oracle Rapid Deployment Techniques on Linux Ravi Kumar Dell Inc

Dell | Oracle Rapid Deployment Techniques on Linux

Ravi KumarDell Inc.

|

Agenda

• Oracle Rapid Deployment Techniques

– Pre OS tasks

– OS installation – Red Hat Linux

– Pre Oracle tasks

– Oracle installation

– Post Oracle tasks

• Dell Deployment Kit

– Deliverables

– Testing

– Drill down

Oracle Rapid Deployment Techniques

SKIP

|

Pre OS - Tasks

• You are deploying an integrated system…

• Read the Oracle documentation

– Make deployment choices:

• Oracle 9i RAC DB: raw partitions or OCFS for shared storage?

• Oracle Collaboration Suite: Storage: infrastructure, storage: use existing OID, DB, etc, or deploy new servers.

• Select and implement a hardware topology… Ex: RAC…

• Gather system components

– Supported Oracle software, patches, etc.

– OS software, errata updates, etc.

– Hardware components: servers, switches, HBAs, disks, cables, etc.

• Check Oracle minimum/recommended hardware requirements

• Ensure latest supported BIOS, firmware, drivers.

Pre OS OS Install Pre Oracle Oracle Post OracleTechniques Kit

|

Example: RAC HW Topology: Direct Attach - SCSI

Server Server

NIC

NIC

X-over Cable

PE

RC

PE

RC

SCSIEnclosure

SCSI Cable

1 Gbps

160 Mbps


|

Example: RAC HW Topology: Direct Attach – Fiber Channel

Server Server

NIC

NIC

HB

A HB

A

SAN

FC Cable

1 Gbps

2 Gbps

X-over Cable


|

Example: RAC HW Topology: SAN (Basic)

Server ServerEthernet

Switch

NIC

NIC

GigE Cable

HB

A HB

A

FC SWITCH

SAN

FC Cable

1 Gbps

2 Gbps


|

Example: RAC HW Topology: SAN (Redundant)

Server Server

EthernetSwitchN

ICs N

ICs

GigE Cable

HB

As H

BA

s

FC SWITCH

SAN

FC Cables

1 Gbps

2 GbpsFC SWITCH

EthernetSwitch


|

OS Installation - Tasks

OS installation must:

• Follow IT environment guidelines for deploying Linux hosts

• Update kernel and other OS errata, both for Oracle functionality and OS robustness, for example:

– binutils, pdksh – 9iAS

– e25 kernel, pdksh – 9i RAC

• Update hardware drivers, for example:

– megaraid, qla2300_6x, bcm5700, e1000

• Partition boot drive (Oracle product specific), for example:

– swap, /, /usr, /var, /tmp, /home, /opt, etc.


|

OS Installation – CD-ROM

OS installation can be achieved via:

• OS CD-ROM based installOS CD-ROM based install

• PXE based network install

• Redeployment partition

/ (sda1)

/usr

/var

/home

/opt/oracle

/tmp

swap

CD-ROM based install

Familiar process Slow / manual

Some ks.cfg automation

Post-OS manual (errata packages, drivers)

Install time flexibility

Inconsistency between servers


|

OS Installation – Network


• OS CD-ROM based install

• PXE based network installPXE based network install

• Redeployment partition

/ (sda1)

/usr

/var

/home

/opt/oracle

/tmp

swap

Network install

Rapid deployment

Network issues

ks.cfg automates Post-OS

Infrastructure setup

Reusable

PX

E / D

HC

P S

erver


|

OS Installation - RP


• OS CD-ROM based install

• PXE based network install

• Redeployment partitionRedeployment partition

RP based install

Reusable partition

Uses up local disk space

ks.cfg automates Post-OS

More work to setup

Rapid redeployment

PX

E / D

HC

P S

erver

/

/usr

/var

/home

/opt/oracle

/tmp

swap

RP (sda1)


|

OS Installation – RP Details

• Dell recommends the use of a redeployment partition

– The RP can be created via CD-ROM, network, or imaging

• RP enables rapid redeployment

• RP ensures consistent install on all servers (IT compliance, RAC)

• Enables scale out (grid) computing from the OS layer

• Key difference w/ Network-based is self-reliance

/ (sda1)

/usr

/var

/home

/opt/oracle

/tmp

swap

Traditional Partitioning

/

/usr

/var

/home

/opt/oracle

/tmp

swap

+RP Partitioning

RP (sda1)


|

OS Installation – RP Contents 1

• RP must be the first partition on bootable drive i.e., /dev/sda1 or /dev/hda1

• Use standard DOS style MBR and mark RP partition active

• RP directories:

/boot Contains grub / lilo boot loader

/linux Contains kernel (vmlinuz) and ramdisk (initrd)

/ks.cfg RH Kickstart configuration file, contains RH install information such as partitioning, network setup,

X-windows setup, etc.

/Oracle Contains Oracle Product Disks

/RedHat Contains RedHat OS Disks


|

OS Installation – RP Contents 2

• RP directories cont’d:

/custom/scripts Scripts that can be called from ks.cfg (%post)

/custom/rpms RPMS for errata, drivers etc, installed from a script in ../scripts

/custom/files Files (.tar, .gz, .txt etc), needed during installation

ks.cfg %post /custom/scripts contents:

mkdir –p /mnt/RPmount /dev/sda1 /mnt/RPcd /mnt/RP/custom/scriptsfor SCRIPT in `ls *`; do

./${SCRIPT}done

10-switch-active.sh

20-install-rpms.sh

30-apply-patches.sh

40-configure-network.sh …


|

Pre Oracle - Tasks

Pre Oracle must:

• Configure network:

– Configure NICs in server for interaction with Network environment.

• Update kernel parameters in /etc/sysctl, for example:

– shmmax, shmmin, files-max, etc.

• Create Oracle user, group, Oracle directories and permissions. For example:

– Users: ias, oracle

– Groups: oinstall, dba, ias_admin

– Homes: /opt/oracle/home, /home/ias, /u01/oracle

• Set parameters in root/oracle user profiles, for example:

– ORACLE_HOME, TMP, TMPDIR

• Tweak linux configuration, for example:

– Remove ldap and ldaps from /etc/services for 9i AS


|

Pre Oracle - Manual

Pre Oracle tasks can be:

• ManualManual

• Script-based

• Script-based kicked off during OS install ks.cfg %post

Flexible Slow

Interactive Inconsistency between servers


|

Pre Oracle – Script-based


• Manual

• Script-basedScript-based


Automated Less flexible

Non-interactive

Output to Log

Non-interactive

Consistent install for multiple servers

Scripts have to be delivered to server

Enables Grid Scripts must be developed / tested


|

Pre Oracle – Script-based+


• Manual

• Script-based

• Script-based kicked off during OS Script-based kicked off during OS install ks.cfg %postinstall ks.cfg %post

Automated Least flexible

Non-interactive

Output to log

Non-interactive

Hook into RP or network-based install

Scripts must be developed / tested


|

Oracle Installation - Tasks

Oracle Installation must:

• Install any pre-Oracle product services:

– Oracm, gsd (RAC)

• Install Oracle:

– RAC, SN DB, 9i AS, Collaboration Suite (Infrastructure, Storage, and Middle tier), 11i, etc.

• Apply any patch sets:

– Update OUI (if necessary)

– Apply patch set(s)

• Apply other hot fixes

• Validate ORACLE_HOME and other environment variables in Oracle user profile


|

Oracle Install - Manual

Oracle installation tasks can be:

• ManualManual

• Script-based



Flexible Slow

Interactive Inconsistency between servers

|

Oracle Install – Script-based


• Manual

• Script-basedScript-based



Automated Less flexible

Non-interactive

Output to Log

Non-interactive

Consistent install for multiple servers

Scripts have to be delivered to server

Enables Grid Scripts must be developed / tested

|

Oracle Install – Script-based+


• Manual

• Script-based

• Script-based kicked off during OS Script-based kicked off during OS install ks.cfg %postinstall ks.cfg %post


Automated Least flexible

Non-interactive

Output to log

Non-interactive

Hook into RP or network-based install

Scripts must be developed / tested

|

Post Oracle - Tasks

Post Oracle tasks:

• Configure Oracle services:

– Create a new database (RAC, DB)

– Load servlets, jsps, html, etc. (9iAS)

• Configure Linux boot behavior:

– Configure Oracle services to startup at boot

• Create other users

– Collaboration suite users, DB users, etc.

• Test Oracle services functionality

• Tune Oracle services for performance


Automate some tasks:

• Scripts

• OUI response files

Automate some tasks:

• Scripts

• OUI response files

|

Oracle Deployment Techniques Summary


Pre OS Network

Manual

RP

Post OracleOS install Pre Oracle Oracle Install

Script

Manual

Script+

Script

Manual

Script+

Script

Manual

Dell Deployment Kit

SKIP

|

Dell Test Methodology:Solution Components

Storage

Switch

HBA / RAID

Servers

OS/OCFS versions

DatabaseOracle Oracle

DatabaseDatabase

PERC 3/DCPERC 4/DC

PE2650, 4600, 6600, 6650PE2650, 4600, 6600, 6650, 8450

QLA2342

DASW3800SW3200

CX200FC4700-2 CX600CX400

QLA2340

QLA2310

Red Hat AS Updates/Major Release N and/or OCFS N

Red Hat AS Updates/Major Releases N-1 and/or OCFS N-1

PV220SU320

PV220SU160

Oracle Test Focus

EMC Test Focus

Test Deliverables DrilldownTechniques Kit

|

Dell Test Methodology

• Dell performs comprehensive tests on 9i RAC [Clusters of 2-8 nodes] and 9i DB [Single Node] products

• Level 1 Testing [Functionality Testing]:

– Integration Testing [Ex: Oracle + OCFS + Power Path]

– Functional Testing [Ex: Install Wizard and Configuration Wizard]

– Bounds / Coverage testing

– Documentation testing

• Level 2 Testing [Integration Testing]:

– Performance / stress testing

– Multiple Configurations [Ex: 2x2650, 4x6650, 8x8450, CX200, CX400, CX600 etc.,]

– Destructive testing while running stress [Ex: Power Path, Private interconnect]

– Documentation testing


|

Deployment Kit drilldown:What does it do for the User?

• Provides a Dell certified and tested software stack for a tested hardware stack. Customers know that this exact software combination that has been tested in combination with the hardware.

• This CD Kit Performs a turnkey installation (eliminates need for manual OS, and Oracle install).

• Creates a redeployment partition which installs the system quickly and reduces redeployment time and complexity.

• Installs/configures/updates the OS – Red Hat Linux.

• Installs/configures/updates Oracle – 9i R2 Database (RAC and SN).

• Provides configuration wizards for Oracle configuration.

Pre OS

OS Install, Pre Oracle, Oracle

Post Oracle


|

Deployment Kit drilldown:Install Wizard Operation 1

F2 setupDell PowerEdge 2650

DELL


|


Installation and Deployment Media Build 23006

Initializing Installation . . .Please wait. . .

1 : Dell Certified Config 2.3 for Oracle 9i Release 2 – Single Node Only2 : Dell Certified Config 2.3 for Oracle 9i Release 2 – With Cluster Option3 : Abort Installation4 : Command Prompt (rescue mode)

Enter the number of the solution that you would like to install:

•Server has blank drives•Server is running OS from CD•Embedded Environment

RP partition/dev/sda1 is created


|



Insert Advanced Server CD 1 got cd…..Insert Advanced Server CD 2 got cd……Insert Advanced Server CD 3 got cd…….

•Red Hat Linux CDs are inserted

The Red Hat CDs are copied to the RedeploymentPartition (RP).


|



Insert Oracle CD 1 got cd…..Insert Oracle CD 2 got cd……Insert Oracle CD 3 got cd…….

•The Oracle CDs set are inserted.

The Oracle CDs are copied as ISOs into the RedeploymentPartition (RP).


|


Dell PowerEdge 2650

DELL

• System Reboots.• Begins reading dynamicallygenerated Red Hat kickstart file.

Language = fr_FR, de_DE

Hard Drive Partitions

/ = growable

/tmp

/var

/home

PACKAGES

%post

/updates/kickstart2.sh

DELLRedhat Install 1/2


|


• System Reboots.• Begins reading dynamicallygenerated Red Hat kickstart file.

runInstaller

DELLRedhat Install 1/2

9.2.0.2

9.2.0.1


|

Deployment Kit drilldown:Post Install Operation

• Before the reboot, the Post-Install executes a number of scripted tasks•Install of Kernel•Drivers•Install of Oracle•Modifications to the system•Etc.

9.2.0.2


|

Deployment Kit drilldown:Configuration

• After reboot, system is ready to be configured (Post Oracle)• Configuration Wizard for raw partitions• Scripts / instructions for OCFS

9.2.0.2


|

Dell Deployment Kit Summary

Pre OS Network

Manual

RP

Post OracleOS install Pre Oracle Oracle Install

Script

Manual

Script+

Script

Manual

Script+

Script

Manual


Q & AThank You

Documents

Dell | Oracle Rapid Deployment Techniques on Linux Ravi Kumar Dell Inc