Embed Size (px)
Citation preview
Oracle GoldenGateFrank Bommarito
RMOUG Training DaysFebruary 11-13, 2013
© DBAK 2013 2
About DBAKOracle Database, Technology and E-Business Suite applicationsCo-founded in 2005Colorado owned and operatedAverage 15 Years of Oracle Expertise Awards• “Top 250 Private Companies, 2011 and 2012” ” – CoBIZ Magazine • “Fastest-Growing Private Companies” – 2012 Finalist, Denver Business Journal• “Colorado Companies to Watch” – 2012 Finalist, Colorado Office of Economic
Development and International Trade• “Emerging Business of the Year, 2008” – South Metro Denver Chamber of Commerce
100+ Clients200+ Implementations, Upgrades, Conversions, Support ProjectsOracle Gold Partner• Oracle Accelerate Solution – Hosted Financials• “Specialized”
- Oracle Database- Oracle Enterprise Manager
© DBAK 2013 3
Agenda
TopologyHigh Level OverviewGoldenGate updatesMisc StuffQuestions and Wrap up
© DBAK 2013
Who am I?
Frank Bommarito, DBAKCo-founder and Chief Technology Officer of DBAK, Frank is an expert in designing, delivering, tuning, and troubleshooting advanced technology, large-scale, highly complex systems using Oracle technology. With more than 20 years of Oracle-based experience, including Oracle Database, Oracle Applications, Oracle Application Server, and Oracle's development tools, Frank has participated in implementing, training, and documenting solutions that include high availability, disaster recovery, data warehousing, online transaction processing, and process automation. Frank is a frequent speaker at industry conferences including OAUG and Oracle OpenWorld.
4
© DBAK 2013
How It Works: Modular Architecture
SourceDatabase(s)
TargetDatabase(s)
LAN / WAN / Internet(TCP/IP)
Route: Data is compressed, encrypted for routing to targets.
Capture: Committed changes are captured (and can be filtered) as they occur by reading the transaction logs.
Capture
Trail files: Stages and queues data for routing.
Source Trail
Delivery: Applies data with transaction integrity, transforming the data as required.
Target TrailDelivery
Bi-directional
Source TrailTarget TrailDelivery Capture
Pump
Pump
Pump: Distribute data for routing to multiple targets.
5
© DBAK 2013
Heterogeneous Platforms
Databases O/S and Platforms
Capture: Oracle DB2 Microsoft SQL Server Sybase ASE Teradata Enscribe SQL/MP SQL/MX
Delivery: All listed above, plus: HP Neoview, Netezza, Greenplum, and any ODBC compatible databases ETL products JMS message queues MySQLTimesTen
Windows 2000, 2003, XPLinuxSun SolarisHP NonStopHP-UXHP TRU64HP OpenVMSIBM AIXIBM z/OS
6
© DBAK 2013
Why GoldenGate?
FastEfficientEasy to troubleshootEasy to implementReality Check – it is software
7
© DBAK 2013
Common Issues
Long Running JobsNetwork outagesNew tablesValidation of data DDLLogging
8
© DBAK 2013
Simple SetupInstall Software (download and unzip – done!)Configure in the database – user to read/write dataFew system settings – no downtime – typically
– alter database archivelog;– alter database force logging;– alter system set recyclebin=off scope=both;– alter database add supplemental log data;
Create managerConfigure Extract/ReplicatDone!
9
© DBAK 2013
How to start?
RMAN Backup/RestoreInitial Load (GG Process)Export/ImportCTAS
10
© DBAK 2013
What do I get?
Setup TNS to take advantage in case of failureOS Upgrade – no problemDB Upgrade – no problemPlatform switch – no problemAuditing of data – no problemDDL (Create table) – no problemTroubleshooting – very clearLearning to ride a bike took some time with years of pleasure – why not take the bridge!
11
© DBAK 2013
What GoldenGate is not…
A database backup (physical versus logical) (Veridata)Tied to OracleTied to a specific OSIn need of extensive maintenanceHard to operationally controlHard to master
12
© DBAK 2013
Can I?
Use one database with many destinations?Have one destination with from many sources?Use one source for many purposes (i.e. Failover/HA/Auditing)Use a source differently than the target?Eliminate other tools (ETL – data guard – backups)?
13
© DBAK 2013
What about the others?
GoldenGate versus StreamsGoldenGate versus Data GuardGoldenGate versus SharePlex
Summary – it is a single tool that does all of these things and does not have the negative view that some of these have.
14
© DBAK 2013
Where to use?
Low RTO/RPOWant to maximize usage of D/RNeed to offload without complexityHave a need for the MAAWant to try new performance techniques without a solid commitmentWant to try upgrades to see what occurs
15
© DBAK 2013
What is so different?
Relatively Non-intrusiveLow impactSub-second latencyOpen/HeterogeneousModular accessMaintains transactional integrityNot HA – not DR – not CA – it is all three
16
© DBAK 2013
Am I on an Island?
Often used with StandbyOften used with Other ETL toolsOften used with RMAN/Tape backupsOften used with storage solutionsThe nice kid that places well with othersCopies the tables – create the views local
17
© DBAK 2013
Miscellaneous Stuff
9.2 and greater for OracleMost data types – but – a few exceptions256 bit encryption of all data – Blowfish is usedInitial load can use a where clause (SQLPREDICATE)Active/Active must EXCLUDE the GG_MANAGER userOracle Product – but – no need for Oracle
18
© DBAK 2013
Any GUI? – GG Management Pack
Define, configure, manage, and report on Oracle GoldenGate processes deployed across your businessUtilizes Oracle GoldenGate Management Services architectureSuffers from a few “issues” – getting better every week.Key features:• Centralized management of any number of Oracle GoldenGate
processes• Rich-client and Web-based interfaces for increased visibility• Alert notifications, integration with 3rd-party monitoring
products• Real-time feedback on Oracle GoldenGate processes• Zero-impact implementation without affecting performance
19
© DBAK 2013
Veridata – warm and fuzzyHigh-speed data comparison solution• Audits, identifies, and reports data discrepancies between in-use
databases
Benefits:• Reduce risk exposure and act on data discrepancies sooner• Simplify comparison• No disruption to business systems• Easy to install – not really as fast as one would hope.
Key features:• Support for large data volumes• Comparisons ran while data sources are kept online• Unparalleled speed and efficiency• Selective comparison options• Unattended execution• Flexible reporting
20
© DBAK 2013
Reality CheckProblem
Tables GGS_MARKER and GGS_DDL_HIST grow – forever – when DDL support is enabled
SolutionAdd this to the manager and restartPURGEMARKERHISTORY MINKEEPDAYS 3, MAXKEEPDAYS 5, FREQUENCYMINUTES 30
This example keeps all rows that have not been modified in the past three days and deletes them when they have not been modified for at least five days. The purge frequency is 30 minutes.
See note 1272645.1 for more details
21
© DBAK 2013
Reality CheckProblem
Initial loads of large tables from Oracle to Oracle take a long time if the fetch size is larger than the table – generally 400k rows or more
SOURCEISTABLE is documented as being “best”
SolutionAvoid sourceistable for Oracle to Oracle.CTAS across a database link of a 40M row table took < 5 minutesSame table with sourceistable took many days
22
© DBAK 2013
Reality CheckProblem
Data replication stops and logs indicates that a KEY is NULL. Log showsWhere PK_ID =
SolutionTrandata was removed from the table. Must re-enable and manually fix the missing rows.select * from DBA_LOG_GROUP_COLUMNS where table_name = '<TN here>’Note the best way to restart is to skip the bad SCN (also reported in the LOG) – see the next section for the syntax.start replicat rep_la, aftercsn 6589933710857
23
© DBAK 2013
Reality Check
Doc states• recycle bin off• Force Logging
But – I only want a few tables – now what?
24
Questions?
25© DBAK 2013
