22
HOUG 2013 IWIW – Oracle Database Appliance Migration Stahl István 2013.04.10

A Complete, Engineered High Availability Databasekonferenciak.advalorem.hu/uploads/files/IWIW – Oracle Database...HOUG 2013 The two server node IWIW – Oracle Database Appliance

Embed Size (px)

Citation preview

HOUG 2013

IWIW – Oracle Database Appliance Migration

Stahl István

2013.04.10

The appliance simplifies storage management by automatically detectingissues and performing corrective actionsshould a storage device indicate it is beginning to fail or isoffline the disk and rebuild the redundancy.feature will generate support requestsetc. if they fail.

When a problem occurs, the Oraclelogs to rapidly service the supportmanually search for and compile all the logs and system history Appliance Manager automatically collects andbe processed, analyzed and fixed

A Complete, Engineered High Availability Database

The Oracle Database Appliance Xoffers many advantages over “build

Hardware

Servers

The Oracle Database Appliance X3rack unit (RU) system that consists of twoservers and one storage shelf. Each contains two 8-core Intel Xeon pE5-2690, providing up to sixteenon-demand processor cores and 256memory per server for a total of 32 processorcores and 512 GB of memory per appliance

Networking

The two server nodes are connected via a Each server also provides 10-GbE be compatible with any data center

Storage

The Oracle Database Appliance X3configuration shares twenty 900 GB SAS Hard Disk Drives in a single storage shelf the two servers, however, the appliance also supports optional storage expansion with an additional storage shelf that doubles the storage capacity of the system. With the storage expansion shelf, the appliance contains 36 TB of raw storage that i

Oracle Database Appliance X3

Figure 1: Oracle Database Appliance X3-2 with Optional Storage Expansion Shelf

The appliance simplifies storage management by automatically detecting performance and availability and performing corrective actions. Disks can be replaced without administrative tasks, and

it is beginning to fail or is impacting performance, the appliance redundancy. In addition, the Auto Service Request (phone home)

requests for replacement components such as disks, power supplies, fans

Oracle Database Appliance X3-2 gathers and packages all the rsupport request. Rather than requiring the DBA or System Admin

manually search for and compile all the logs and system history when issuing a support request, the automatically collects and compiles the relevant logs and history, allowing

analyzed and fixed much more quickly.

, Engineered High Availability Database Solution

X3-2 is an integrated hardware and software database solution“build-your-own” implementations.

X3-2 is a 4 that consists of two

Each server core Intel Xeon processors

providing up to sixteen enabled-demand processor cores and 256 GB of

for a total of 32 processor and 512 GB of memory per appliance.

s are connected via a redundant 10-GbE interconnect for cluster communication. GbE Base-T external networking connectivity ensuring the appliance

data center.

X3-2 base GB SAS Hard

in a single storage shelf between , however, the appliance also

supports optional storage expansion with an additional storage shelf that doubles the storage capacity of the system. With the storage expansion

tains 36 TB of raw storage that is double-mirrored or triple-mirrored, offering

“The Oracle Database Appliance X3-2 provides additional flexibility

to easily expand the shared storage architecture.

storage expansion doubles the storage capacity while maintaining

the simplicity of the appliance. Customers just connect the

additional storage shelf and the appliance takes care of the rest.”

Alex Gorbachev, CTO- Pythian, Oracle ACE Director

Oracle Database Appliance X3-2

3

2 with

rmance and availability administrative tasks, and

impacting performance, the appliance will (phone home)

, power supplies, fans,

gathers and packages all the relevant Administrator to

equest, the , allowing issues to

olution

solution that

communication. ensuring the appliance will

additional storage shelf that doubles the storage capacity of the system. With the storage expansion mirrored, offering

2 provides additional flexibility

The optional

storage expansion doubles the storage capacity while maintaining

Customers just connect the

ance takes care of the rest.”

Pythian, Oracle ACE Director

ORACLE DATA SHEET

ORACLE DATABASE APPLIANCE FEATURES • Fully integrated database appliance

in a single box • Simple one-button installation,

patching, and diagnostics • Oracle Database, Enterprise Edition

11g • Oracle Real Application Clusters or

Oracle Real Application Clusters One Node

• Oracle Automatic Storage Management • Oracle Enterprise Manager • Oracle Linux • Two database servers • 24 processor cores • 192 GB of memory • 12 TB SAS disk storage • External NFS storage support

BENEFITS • World’s #1 database • High availability for wide range of

application databases • Reduced planned and unplanned

downtime • Consolidation of databases onto

common platform • Ease of deployment and management • Single-vendor support • Pay-as-you-grow licensing

The Oracle Database Appliance saves time and money by simplifying deployment, maintenance, and support of high-availability database solutions. Built with the latest generation of the world’s most popular database—Oracle Database 11g—it offers customers a fully integrated system of software, servers, storage, and networking in a single box that delivers high-availability database services for a wide range of homegrown and packaged online transaction processing (OLTP) and data warehousing applications. All hardware and software components are supported by a single vendor—Oracle—and offers customers unique pay-as-you-grow software licensing to quickly scale from 2 processor cores to 24 processor cores without incurring the costs and downtime usually associated with hardware upgrades.

Fully Redundant Integrated System

Providing access to information 24/7 and protecting databases from unforeseen as well as planned downtime can be a challenge for many organizations. Indeed, manually building redundancy into database systems can be risky and error-prone if the right skills and resources aren’t in-house. The Oracle Database Appliance is designed for simplicity and reduces that element of risk and uncertainty to help customers deliver higher availability for their application databases.

The Oracle Database Appliance hardware is a single 4U rack-mountable chassis containing two Oracle Linux server nodes, each with two 6-core Intel Xeon processors X5675 and 96 GB of memory. The two server nodes are connected via an internal redundant gigabit Ethernet (GbE) interconnect for cluster communication, and each provides both 1 GbE and 10 GbE external networking connectivity. The appliance contains 12 TB of raw storage that’s triple-mirrored, offering 4 TB of resilient usable database storage. There are also four 73 GB solid-state disks for database redo logs to boost performance. To expand storage outside of the appliance, external NFS storage is supported for online backups, data staging, or additional database files. The appliance is designed with mission-critical requirements in mind, with hot-swappable and redundant components.

The Oracle Database Appliance runs Oracle Database 11g, Enterprise Edition, and customers have the choice of running Oracle Real Application Clusters (Oracle RAC) or Oracle RAC One Node for “active-active” or “active-passive” database server failover.

Ease of Deployment, Management, and Support To help customers easily deploy and manage their databases, the Oracle Database Appliance

Who I am

•  Started with Oracle & Linux in 1999

•  Red Hat Certified Engineer - 2007

•  Oracle Certified Master 10g - 2010

•  Oracle Certified Master 11g – 2013

•  http://istvanstahl.wordpress.com - not up-to-date L

•  Worked for: •  Manufacturers: Rába, Pepsi •  Consulting: TCS/Genworth Financials, EDS •  Social Networking: Virgo Systems/iWiW •  Software development: MSCI

Agenda

•  Why ODA? - The perfect timing

•  The Migration – how we did it

•  The Migration - how you should do it

•  Lessons learnt

•  Problems after the upgrade

•  Latest ODA updates (X3-2 – Solution-in-a-box)

Why ODA? – The perfect timing

In 2011 Origo started looking for new options in order to replace the actual Oracle infrastructure.

Principles:

•  Cost cut – reduce the number of CPU licenses

•  The warranty of the current hardware expired

•  More and more hardware failures

•  Oracle database upgrade (10gR2)

21 September 2011 - Oracle Announces the Immediate Availability of the Oracle Database Appliance

Why ODA? – The past and the future

Why ODA? – comparison

Main differences

2 racks 4U

7 nodes 2 nodes

56 core (56 licensed) – PM: 3.651 24 core (8 licensed) – PM: 14.603

External storage - 112 SAS disks 20 SAS disks (12TB)

- 4 SSD disks (4 x 72GB)

External Ethernet interconnect Built in Fibre interconnect

10gR2 11gR2

Energy consumption !!!

High Availability

RAC

Why ODA? – Pros and cons. Our questions: •  How to add more memory (192GB), more disk (12TB), more nodes (2)? •  Can we use hugepages? •  Does it have a raid controller? How much cache? •  SSD for redo logs??? •  Why does it have 2.6.18 kernel instead of UEK (2.6.32)? •  How to install 10gR2 software on it? The answers: •  Cannot be easily expanded (dNFS) •  No hugepages, •  No raid controller •  What do you think? •  No answer •  You will not install 10gR2 on it!

Oracle Database Appliance is an engineered system!

The Migration - Planning

Aims:

1.  Minimal downtime (max. few hours)

2.  Database migration along with upgrade from 10gR2 to 11gR2

The plan:

1.  Pre-create the IWIW Database (save the metadata)

2.  Install 10gR2 database software on the Appliance

3.  Setup Data Guard Physical standby

4.  Switch over to the ODA

5.  Upgrade the Database

6.  GO LIVE

Hint: Oracle White Paper June 2012 Oracle Database Appliance: Migration Strategies

The Migration – Step 1.

Hint: Oracle Database Appliance Manager Configurator

The Migration – Step 2.

The Migration – Step 3.

The Migration – Step 3. continued

1.  Move the ASM spfile from +DATA to +RECO 2.  OCR

The Migration – Step 3. continued

3. Voting Disk 4. Optional /cloudfs - is stored in +RECO (not dependent on +DATA)

The Migration – Step 3. continued

Recreating the +DATA diskgroup Setasmgidwrap

The Migration – Steps 3-6.

From this point everything is simple: 3. Create the standby database (merge the two init.ora) 4. Switch over

1.  Stop IWIW 2.  Dataguard switchover

5. Upgrade the single instance database 6. GO LIVE

1.  Revert back all changes (ASM spfile, OCR, Voting disk) 2.  Advance compatible.rdbms to 11.2.0.2 3.  Move the redo logs to the +REDO diskgroup 4.  Startup both instances 5.  Take a full backup 6.  Create the required services 7.  Start IWIW

2 hours downtime

The Migration – how you should do it

Frequently Asked Questions about Restoring Or Duplicating Between Different Versions And Platforms [ID 369644.1]

•  Revised Steps: 1.  Use the spfile of the pre-created database instance on the Appliance

(compatible parameter should be large enough to keep the database in ASM)

2.  Restore the standby controlfile of the source database 10gR2 using the 11gR2 binaries

3.  Restore the 10gR2 database using the 11gR2 binaries 4.  Keep it in with applying archivelogs 5.  Activate the standby database 6.  SQL> startup upgrade; 7.  Do manual upgrade to 11gR2

Lessons Learnt

•  The real advantage of an engineered system is that even a SYSADMIN – without any Oracle DBA knowledge - can setup a RAC properly

•  Although it is engineered, it still contains standard components.

•  Like in a case of any new product: •  Documentations has gaps

•  Best practices are documented much later

•  There are always surprises

Problems after the upgrade – disk replacement

Problems after the upgrade – disk replacement

ODA (Oracle Database Appliance): The Steps to replace failing disks [ID 1496114.1]

•  oakcli show disk

•  oakcli locate disk pd_xx

•  Pull-out the bad disk

•  Push-in the new disk

•  oakcli reinit pd_xx (optional)

•  SQL> select * from gv$asm_operation;

Latest news

Nov 2012 •  ODA 2.4 Patch provides ASM Normal redundancy (4 vs. 6 TB net storage) Apr 2013 - Oracle Database Appliance X3-2 •  Announced 06 Mar 2013 on https://blogs.oracle.com/ODA •  Virtualization: Application and Database on the same box •  2x8 cores E5-2690 per server (32 core) •  256GB memory per server (512GB) •  18TB raw storage (additional storage shelf +18TB) •  Grow/shrink with capacity-on-demand licensing •  List Price: $60.000 + $40.000 the additional storage shelf •  The older model continues to be available until 31st May 2013

The appliance simplifies storage management by automatically detectingissues and performing corrective actionsshould a storage device indicate it is beginning to fail or isoffline the disk and rebuild the redundancy.feature will generate support requestsetc. if they fail.

When a problem occurs, the Oraclelogs to rapidly service the supportmanually search for and compile all the logs and system history Appliance Manager automatically collects andbe processed, analyzed and fixed

A Complete, Engineered High Availability Database

The Oracle Database Appliance Xoffers many advantages over “build

Hardware

Servers

The Oracle Database Appliance X3rack unit (RU) system that consists of twoservers and one storage shelf. Each contains two 8-core Intel Xeon pE5-2690, providing up to sixteenon-demand processor cores and 256memory per server for a total of 32 processorcores and 512 GB of memory per appliance

Networking

The two server nodes are connected via a Each server also provides 10-GbE be compatible with any data center

Storage

The Oracle Database Appliance X3configuration shares twenty 900 GB SAS Hard Disk Drives in a single storage shelf the two servers, however, the appliance also supports optional storage expansion with an additional storage shelf that doubles the storage capacity of the system. With the storage expansion shelf, the appliance contains 36 TB of raw storage that i

Oracle Database Appliance X3

Figure 1: Oracle Database Appliance X3-2 with Optional Storage Expansion Shelf

The appliance simplifies storage management by automatically detecting performance and availability and performing corrective actions. Disks can be replaced without administrative tasks, and

it is beginning to fail or is impacting performance, the appliance redundancy. In addition, the Auto Service Request (phone home)

requests for replacement components such as disks, power supplies, fans

Oracle Database Appliance X3-2 gathers and packages all the rsupport request. Rather than requiring the DBA or System Admin

manually search for and compile all the logs and system history when issuing a support request, the automatically collects and compiles the relevant logs and history, allowing

analyzed and fixed much more quickly.

, Engineered High Availability Database Solution

X3-2 is an integrated hardware and software database solution“build-your-own” implementations.

X3-2 is a 4 that consists of two

Each server core Intel Xeon processors

providing up to sixteen enabled-demand processor cores and 256 GB of

for a total of 32 processor and 512 GB of memory per appliance.

s are connected via a redundant 10-GbE interconnect for cluster communication. GbE Base-T external networking connectivity ensuring the appliance

data center.

X3-2 base GB SAS Hard

in a single storage shelf between , however, the appliance also

supports optional storage expansion with an additional storage shelf that doubles the storage capacity of the system. With the storage expansion

tains 36 TB of raw storage that is double-mirrored or triple-mirrored, offering

“The Oracle Database Appliance X3-2 provides additional flexibility

to easily expand the shared storage architecture.

storage expansion doubles the storage capacity while maintaining

the simplicity of the appliance. Customers just connect the

additional storage shelf and the appliance takes care of the rest.”

Alex Gorbachev, CTO- Pythian, Oracle ACE Director

Oracle Database Appliance X3-2

3

2 with

rmance and availability administrative tasks, and

impacting performance, the appliance will (phone home)

, power supplies, fans,

gathers and packages all the relevant Administrator to

equest, the , allowing issues to

olution

solution that

communication. ensuring the appliance will

additional storage shelf that doubles the storage capacity of the system. With the storage expansion mirrored, offering

2 provides additional flexibility

The optional

storage expansion doubles the storage capacity while maintaining

Customers just connect the

ance takes care of the rest.”

Pythian, Oracle ACE Director

Latest news – X3-2 Product Launch webcast

IWIW – Oracle Database Appliance Migration

Q / A

Contact: [email protected]