Upload
doankhue
View
256
Download
0
Embed Size (px)
Citation preview
<Insert Picture Here>
S317130: Oracle E-Business Suite on Oracle Exadata:
Deployment Best Practices, and Sogeti Live!
Oracle Development, Applications MAA/Exadata:
Richard Exley, Ray Dutcher, Lyn Pratt
Sogeti:
Jack Kemp
2
<Insert Picture Here>
E-Business Suite on Exadata
Introduction: MAA and Exadata
E-Business Suite on Exadata
Migrating to Exadata
Customer Story: Sogeti Live!
4
IntroductionMAA/Exadata Team
Committed to delivering a complete hardware and
software solution for deploying Oracle applications on
Exadata
High Performance
Scalability
High Availability
Disaster Recovery
Current focus:
E-Business Suite
PeopleSoft
Siebel
Primary Site Secondary Site
Oracle Data Guard
Application Tier
Exadata
DB Servers
Exadata Storage
Servers
MAA Integration
High Availability
Scalability
Oracle
V2 Exadata Database
Machine
MAA Integration
High Availability
Scalability
Oracle
V2 Exadata Database
Machine
5
Exadata Hardware Architecture
Database Grid Intelligent Storage Grid
InfiniBand Network
• Redundant 40Gb/s switches
• Unified server & storage network
• 14 High-performance low-cost
storage servers• 8 Dual-processor x64 database servers
OR
• 2 Eight-processor x64 database servers
Scalable Grid of industry standard servers for Compute and Storage
• Eliminates long-standing tradeoff between Scalability, Availability, Cost
•100 TB High Speed disk, or336 TB High Capacity disk
•5.3 TB PCI Flash
•Data mirrored across storage servers
Copyright © 2010, Oracle Corporation and/or its affiliates
6
Keys to Speed and Cost Advantage
© 2010 Oracle Corporation
Exadata Hybrid Columnar
Compression
Exadata Intelligent Storage
Grid
Exadata Smart Flash Cache
7
Exadata is Smart Storage
Storage Server is smart storage, not a DB node
Storage remains an independent tier
Database Servers
Perform complex database processing such as
joins, aggregation, etc.
Exadata Storage Servers
Search tables and indexes filtering out data that is
not relevant to a query
Cells serve data to multiple databases enabling
OLTP and consolidation
Simplicity, and robustness of storage appliance
© 2010 Oracle Corporation
Compute and Memory Intensive Processing
Data IntensiveProcessing
8© 2010 Oracle Corporation
Exadata Hybrid Columnar CompressionHighest Capacity, Lowest Cost
Data is organized and compressed by column
Dramatically better compression
Speed Optimized Query Mode for Data Warehousing
10X compression typical
Runs faster because of Exadata offload!
Space Optimized Archival Mode for infrequently accessed data
15X to 50X compression typical
Qu
ery
Faster and Simpler
Backup, DR, Caching, Reorg, Clone
Benefits Multiply
9
© 2010 Oracle Corporation 9
Exadata Smart Flash CacheExtreme Performance OLTP
5X More I/Os than
1000 Disk Enterprise
Storage Array
• Exadata has 5 TB of flash
• 56 Flash PCI cards avoid disk
controller bottlenecks
• Intelligently manages flash
• Smart Flash Cache holds hot data
• Gives speed of flash, cost of disk
• Exadata flash cache achieves:
• Over 1 million IO/sec from SQL (8K)
• Sub-millisecond response times
• 50 GB/sec query throughput
10
Failure Protection
Redundant Hardware
Servers, Storage, Network
Database Level HA
Tolerate failures and changes
Documented and validated
Exadata MAA best practices
to achieve the highest
availability
© 2010 Oracle Corporation 10
Data GuardRAC
ASM
Flashback
Secure
Backup
Online
Redefinition
ERP
CRM
Warehouse
Data Mart
HR
12
E-Business SuiteMAA on Exadata
Primary Site Secondary Site
Oracle Data Guard
Application Tier
Exadata
DB Servers
Exadata Storage
Servers
MAA Integration
High Availability
Scalability
Oracle
V2 Exadata Database
Machine
MAA Integration
High Availability
Scalability
Oracle
V2 Exadata Database
Machine
13
E-Business Suite on ExadataDatabase MAA Features
Primary Site Disaster Recovery Site
Real Application Clusters
& ClusterwareFault Tolerant
Server Scale-Out
Data GuardFully Active
Failover Replica
FlashbackCorrect Errors by
Moving Back in Time
Automatic Storage
ManagementFault Tolerant
Storage Scale-Out
Recovery Manager &
Oracle Secure BackupLow Cost High Performance
Data Protection and Archival
Database Servers Database Servers
Storage Storage
15
E-Business Suite on ExadataOngoing Testing
Testing to develop and validate our Exadata and MAA
best practices is ongoing
So far we have tested three scenarios on E-Business
Suite release 12.1.2:
Order to Cash
Payroll
Online Users
16
E-Business Suite on ExadataFindings – Overall
This is still E-Business Suite running on Oracle
Database
As you may expect, nothing much changes in the application
Everything you already know still applies
We don’t lose anything with Exadata, but there is lots
to be gained…
17
E-Business Suite on ExadataFindings – High CPU Utilization
All workloads are characterized by high DB CPU
utilization
Benefit greatly from the fast Exadata processors
Will likely have spare capacity to facilitate growth or
consolidation
18
E-Business Suite on ExadataFindings – High Memory Utilization
Workloads benefit from large SGA and PGA made
possible by large Exadata memory capacity
Allow larger PGA for high concurrency online workloads
Configure hugepages for the SGA
More efficient memory usage, especially with large SGA or
high number of concurrent DB connections
Configured in Linux kernel
Can only be used for SGA, and the entire SGA must fit
See Support Note 744769.1 - How to Configure
HugePages for Oracle Database on 64-bit Linux Platforms
No need to allow for large Linux file system cache with ASM
19
E-Business Suite on ExadataFindings – Exadata Smart Flash Cache
Exadata Smart Flash Cache hit rates are high
Average IO latency reduced by 58 percent when flash cache
is enabled
Automatic – no special tuning required
20
E-Business Suite on ExadataFindings – Disk IO Capacity
Data intensive batch work benefits from the high IO
request rates and throughput
High IO capacity also benefits other activities:
Backups – up to 20TB per hour in tests – incremental
backups are faster still
Flashback database
21
E-Business Suite on ExadataReferences
See MAA OTN Site for EBS MAA best practices
See Note 1110648.1 - Oracle E-Business Suite
Release 12.1 with Oracle Database 11g Advanced
Compression
23
E-Business SuiteFresh Install
Prerequisites
Sun Oracle Database Machine Health Check (1070954.1)
Temporary local file system
Prepare target 11.2 database ORACLE_HOME
“Standard Installation” with Rapid Install
Upgrade the database to 11.2.0.1
Convert database to RAC and move the database
files to ASM using rconfig
Paper available soon
24
E-Business SuiteMigration
Migrating an Oracle E-Business Suite Database to Sun Oracle
Database Machine [Support Note ID 1133355.1]
Sun Oracle Database Machine Platform
Linux x86 64-bit (little endian format)
Database 11.2
Supported Oracle E-Business Suite (EBS) releases
11.5.10.2 (11i), 12.0.4, 12.1
Source platform factors
Operating System
Endian format (byte ordering)SELECT ENDIAN_FORMAT
FROM V$TRANSPORTABLE_PLATFORM VTP, V$DATABASE VDB
where vtp.platform_id=vdb.platform_id;
Database release
Oracle E-Business Suite release
25
E-Business SuitePhysical Migration Options
Data Guard Physical Standby
11.1 (see Note 1055938.1 Case #2) or 11.2 Database
32-bit or 64-bit Windows, 32-bit or 64-bit Linux, Solaris x86-64
Transportable Database
same endian format
same Oracle software version and patches installed
Oracle E-Business Suite Rapid Clone
Cloning Oracle Applications Release 12 with Rapid Clone [ID
406982.1]
26
E-Business SuiteData Pump Migration Option
Any platform
Minimum Database release of 10gR2
Flexibility to implement best practices on target
Longest downtime
MAA paper
Migrating Oracle E-Business Suite to Sun Oracle
Database Machine Using Oracle Data Pump
http://www.oracle.com/technetwork/database/features/availability/maa-ebs-dbm-datapump-
167285.pdf
Used by Sogeti to migrate from Sun Solaris to
Exadata
27
E-Business SuiteData Pump Migration Steps
1. Prepare the Source System
2. Prepare the Target Database System
MAA database best practices
RAC and ASM
Remove uniform extents and use AUTOALLOCATE
ORACLE_HOME dedicated to a single EBS environment
3. Data Pump Export
Use NFS for export dump files
4. Data Pump Import
No NETWORK_LINK option (LONG and evolved types)
5. Updating the New Database
6. Set up Load Balancing
Local Touch – Global Reach
www.us.sogeti.com
Deploying Oracle E-Business Suite
on Oracle Exadata: Tips/Best
Practices
September 21, 2010
30www.us.sogeti.com
Local Touch – Global Reach
Topics
• The Background
• The Situation
• The Considerations
• The Decision
• The Plan
• The Unexpected
• The Results
• Questions
31www.us.sogeti.com
Local Touch – Global Reach
The Background
Consumer Products,
Retail & Distribution
Four Capgemini Divisions Across 6 Sectors
Consulting Services (Capgemini Consulting):
helping our clients identify, structure and execute transformation projects that will have lasting effects on their growth and competitiveness.
Technology Services (TS):
designing, developing and implementing packaged-based ERP solutions such as SAP and Oracle for systems integration and global IT roll outs.
Outsourcing Services (OS):
Assisting our clients in the total or partial outsourcing of their IT systems.
Local Professional Services (Sogeti):
Supplying IT projected-based services that are suited to local needs (Microsoft, IBM, Oracle Technologies, business intelligence, testing, application development) while also leveraging Global Delivery.
Sogeti is one of four professional disciplines
of expertise. These services range from
strategy development to IT systems
maintenance. By combining its skills, The
Group’s four main professional disciplines
offer Capgemini’s clients integrated
transformation services.
The Group also combines its areas of
expertise to offer specific solutions across six
sectors.
Manufacturing
Telecom, Media & Entertainment
Financial Services
Public Sector
Energy, Utilities & Chemicals
Lo
cal P
rofe
ss
ion
al S
erv
ices
Ou
tso
urc
ing
Se
rvic
es
Tech
no
log
y S
erv
ices
Co
ns
ult
ing
Se
rvic
es
32www.us.sogeti.com
Local Touch – Global Reach
The Situation
Sogeti uses Oracle e-Business Suite to support its end-to-end business processes, including financials, human resources, project resource management, and project accounting.
Key statistics:
• Existing Application: EBS 11.5.10.2• Existing Database: 10gR2, Solaris 10 SPARC• Number of users: 3000• Modules Implemented:
• Financials (Accounts Payable, Accounts Receivable, General Ledger, Purchasing)
• Human Resources
• Project Accounting (Project Resource Management, iExpenses, Time & Labor)
• Fixed Assets
• Other Applications (outside of EBS): Several legacy applications, CRM, and Payroll
Challenge:
• A small IT team trying to meet the fast growing need of data
• A significant amount of time spent fighting fires, running ad-hoc queries against large data sets and optimize queries which have short shelf life
• Time lost due to performance issues with ad-hoc queries & reports
33www.us.sogeti.com
Local Touch – Global Reach
The Considerations
The key considerations in the decision
making process included:
• Time spent by IT team in developing and
supporting custom code needed to support
growing data needs of business users &
multiple database instances (estimated effort
reduction of 2 full time equivalents)
• Time spent by end users during the period of
system unavailability (estimated savings of 1
full time equivalent)
• Infrastructure cost avoided by consolidating
multiple database instances
• Time spent by end users while dealing with
performance challenges (estimated savings of
½ full time equivalent)
(Compared NPV of investments and cost savings,
assuming 5 Year Life for hardware and 10 year life for
software with no inflation and 11% weighted average
cost of capital)
5 Year expected ROI(NPV with 11% WACC)
Note: Does not account for fringe benefits resulting from improved and real-time visibility into KPIs/ financial
data, reduced lead times (resulting in faster cash collection)
34www.us.sogeti.com
Local Touch – Global Reach
The Decision
Based on anticipated savings and additional benefits, we decided to migrate our EBS 11.5.10.2
environment to Oracle Database Machine. Oracle Exadata will help:
Improve Consolidation
• Reduce number of instances by aggregating all Oracle database instances into a single instance
• Reduce effort needed to administer & optimize databases
• Reduce weekly tape backup from 4 hours to daily 4 minutes
Reduce Overall Costs/ Increase Productivity
• Reduce number of servers and simplify software licensing resulting in meaningful cost savings
• Reduce dependence on IT staff
• Increase availability resulting in significant productivity enhancements
• Enhance performance resulting in additional productivity
Enhance Reporting
• Eliminate batch processing for 20-25 nightly and weekly custom reports/ batch jobs
• Provide real-time reporting for critical key performance indicators
• Create a high-performing platform for subsequent BI/ DW implementation
35www.us.sogeti.com
Local Touch – Global Reach
The Plan
May 2010 June 2010 July 2010 August 2010
Perform Technical Testing
Go-Live
Perform UAT Testing
Conduct Initial Migration to Linux ASM/single instance
Conduct Final Migration to Linux ASM/RAC
Kickoff and Information Gathering/Analysis
Perform Technical Testing
36www.us.sogeti.com
Local Touch – Global Reach
The Unexpected
Issues Resolution
Failed flash drive • Service request filed; Sun engineer arrived onsite and replaced it within a day
Two cluster crashes • Applied latest patches to avoid bugs that were fixed in the most recent patch
set available at the time
Patch conflict between Oracle
Exadata BP3 and Oracle e-
Business Suite
• The conflicting EBS patches were incorporated into the subsequent Exadata
patch bundles
OEM DB Console did not work after
migration
• Created work around with few parameter changes
• Abandoned OEM DB Console in favor of OEM Grid Control
EM crashed when changing
resource plan
• Known issue that will be resolved in soon to be released BP6
Error in PO approval process in
Workflow
• Resolved with a Profile Option change
Failover not happening for
concurrent manager services when
Node 1 of RAC is down
• Created a work around by restarting concurrent manager when a DB instance
fails
Issues with NTP server
synchronization
• Resolved by reconfiguring NTP to use a relay server. Root cause has something to
do with using a Windows NTP server and Linux ntpd not able to sync with it.
37www.us.sogeti.com
Local Touch – Global Reach
The Results
Go-live was successful on Saturday, August 15,
2010. Approximate timeline was:
• Took production down on Friday at 7:00 PM
(approximately 6 hours)
• Completed backup by midnight
• Exported data by 9:00 AM (approximately 7
hours)
• Performed FTP to Oracle Database Machine;
completed import by 3:00 PM (approximately 6
hours)
• Completed post-import configuration on Saturday
by 6:00 PM (approximately 3 hours)