Understanding Oracle GoldenGate - ll1.workcast.netll1.workcast.net/10068/4214601045897321/Documents/Avnet-GoldenG… · Accelerating Your SuccessTM Understanding Oracle GoldenGate

Accelerating Your SuccessTM

Understanding Oracle GoldenGate

Ron Caffrey [email protected]

Oracle Product Specialist

Avnet Technology Solutions

07711-302797


A G E N D A

Background & context

The essence of GoldenGate

fundamental functionality

solution models exploiting GoldenGate

key facts

Latest enhancements in G/G 11gR2

Commercial considerations

Summary of opportunity

http://www.ts.avnet.com/uk/vendors/oracle/


GoldenGate evolution

GoldenGate Software established in 1995.

Chief Technology Officer recruited from Oracle Server Technology labs

Oracle acquired GoldenGate in Oct 2009.

As in many of Oracle’s acquisitions, heterogeneity was a key factor

Under GoldenGate ownership, the main client base was typically large Finance

organisations with (too) many mainframe, Unix and Windows systems,

and considerable pains. Most engagements were consultancy-led and substantial.

Under Oracle ownership, the product has to stand as a piece of technology for all.

Major complex migration/upgrade projects around mission-critical components will still

demand considerable know-how and project control.



Oracle Data Integration Solutions

Specialized team formed in 2010

Focus is real time movement, manipulation and management of data

Products satisfy diverse customer requirements

Oracle

GoldenGate

Heterogeneous real-

time change data

capture for

Continuous

Availability, Disaster

Tolerance and real-

time Data Integration

Heterogeneous

data integration

services for Data

Warehousing and

SOA, including

Data Quality and

Profiling options

Oracle Data

Integrator EE



Data Integration : the challenges

Not to be confused with application integration (SOA, BPEL, AIA etc)

The dream is “One Version of the Truth”

i.e. each business entity (customer, product etc) is represented only once in an organisation

The reality…

Buying a new packaged application usually means another database

Mergers and acquisitions create more system overlaps

Consolidation often thwarted by disparate versions – application lifecycle is king

Data explosion continues (90% of data created in last 2 years : 50x growth by 2020?)

Meanwhile business continues (i.e. transactions happen)

Timescales and costs often prevent idealised re-alignment of systems



Data Integration : the needs

Duplication (whether permanent or transient) typically cannot be eradicated

Transaction-driven data changes need to distributed and replayed

Upgrades/migrations for critical systems demand near zero downtime

Database-level

Application-level

Business Intelligence also generally needs data duplication

Keeping heavy I/O and cpu loads away from OLTP

Reflecting need for restructured data to aid analysis

Increasingly near real-time







Database-level

Application-level











Database-level

Application-level





NB many customers who buy GoldenGate continue to

find new reasons to use it


A G E N D A





key facts





What is GoldenGate?

Core product is simple to describe

– it captures transactional data changes and propagates them to other locations,

in a heterogeneous world

Oracle, Teradata, DB2, SQL Server, MySQL, NonStop etc etc

Unidirectional or bi-directional



Low-Impact, Real-Time Data Integration

& Transactional Replication for many benefits


Additional comments

Business Continuity (HA and DR).

This is a solution that can be applied to Oracle DB SE as well EE.

And, since it is possible for replication to be bi-directional, for the first time Oracle now has

a solution for the Active/Active requirement over major distances.

(with Data Guard one side would always be passive and not accept changes.

Advanced Replication was too big a hit on performance).

NB bi-directional implementation does not increase licence costs.

Offloading reporting workloads to relieve OLTP system : scope of data can be filtered

so reporting system has only relevant tables.

Oracle has built integration between GoldenGate and Data Integrator to enable a real-time

data warehousing delivery system.


Things to understand about GoldenGate

Every database in the GoldenGate world is AUTONOMOUS

(not a slave clone as with Data Guard etc)

Your choices in the Configuration Files decide how the databases will interact

and the overall business goals to be achieved

Transfer is always ASYNCHRONOUS

(but if you provide an external means of mirroring the source database log files,

Goldengate can use them to complete all transactions)

Conflict resolution mechanisms are supported for multi-master systems

It captures and distributes canonical forms of data items, so it is prudent to double-check the

documentation to see that relevant application schemas do not have any issues


Oracle Streams positioning

From the GoldenGate Statement of Direction…

Oracle Streams continues to be supported but will not be enhanced to support

any new database features in future releases. This means that Streams will continue to

support exactly what it supports today (11.2) in future releases. It also means that any

new database features, data types, or capabilities will not be supported by Streams.

Customers who want to take advantage of the new data types and features will need to

license Oracle GoldenGate.

In a soak-test, after stopping transaction arrival, Streams continued for 45 mins.

GoldenGate completed distribution almost immediately.

Streams is of course bundled with DB EE, but it would be unwise to commence

new projects now.



Integration of GoldenGate output

as a source for Data Integrator EE

Oracle BI Tools

Oracle GoldenGate

Capture/migrate from heterogeneous

sources

Reduce or remove reliance on batch feeds by using continuous real-time

data capture and delivery

Oracle Data Integrator

Optional DQ/DP

Batch feeds for data migration or integration


Data conversion / mapping

GoldenGate provides abilities to re-codify data and make minor adjustments

For wholesale re-mapping of data structures Data Integrator is the correct tool.

E.g. conversion of Third Normal Form transactional data models into Star Schemas

for Analysis.


Oracle Veridata

Sold independently of GoldenGate

Effective for comparing schemas regardless of the replication technology used

Heterogeneous support

Licensing is in respect of the Veridata environment, not the databases being compared


A G E N D A





key facts






GoldenGate 11gR2 Enhancements

In case of Oracle databases, choice of new Integrated Capture architecture is more tightly-

coupled with the database.

Greater scalability

Ability to capture changes from Compressed Data

(all types including the full Exadata HCC ones)

Better support for global deployments through support for UNICODE and multi-byte

character-sets.

Enhanced security of transmission with FIPS or Blowfish encryption algorithms

Simpler, enhanced conflict resolution

Enhanced feature support for other databases. DB2 for iSeries now added.

Application adapters output JMS messages or flat-file batches rather than targeting a

database.


A G E N D A





key facts






GoldenGate commercials

Be aware that Oracle has created two separate products:-

“Oracle GoldenGate” (this is for an Oracle source or target)

“Oracle GoldenGate for Non Oracle Database” (everything else)

(There are also specials for Mainframe and Teradata Replication Services)

So in a heterogeneous deployment makes sure you sell the correct products

and quantities for each source and target. Oracle doesn’t do refunds!

Currently there is no distinction in licensing rules or price between the main two.

Bi-directional replication does not influence the price.

Do not be fooled by the fact that the Processor and NUP prices appear identical

to those for Database Standard Edition. The GoldenGate variants are priced by the

calculation of cores * multi-core factor for the chip-type, and so core architecture will

influence price.

.



GoldenGate commercials

GoldenGate products have the same NUP minimum of 25 per Processor as the DB EE

GoldenGate pricing is not explicitly linked to database pricing, but since it has to be

installed adjacent to the database engine the licensed environment will be identical, as well

as considerations of whether NUPs are permissible.

(Note Oracle GoldenGate for Teradata Replication Services is unique in being deployed

separate from the source, but still the database environment dictates licensing).

Processors or users are counted as those using the database, not some notional subset or

group of administrators. This applies to all source and target types.

The new (11gR2) GoldenGate Application Adapters for JMS and FlatFile are licensed only

by Processor, and in respect of the source database(s).



GoldenGate commercials : Active Data Guard bundled

The Oracle GoldenGate product includes licence cover for Active Data Guard.

This is a little strange and needs an explanation.

Remember that Data Guard (at least the Physical Standby variant) maintains a clone of

the database by pasting changed bytes into correct file addresses. It cannot be used

actively, apart from read-only access through Active Data Guard Option, or temporarily

when converted to a Logical Standby and then subjected to Flashback Database command.

Conversely with GoldenGate all databases are always autonomous.

Therefore no DR database could be maintained by Data Guard AND GoldenGate.

The free licence is simply to avoid a turf war between Oracle’s Server Technology and

Middleware groups.

The ADG licence cover CAN be beneficial if you had Data Guard and G/G deployed

to separate copies. The source must have ADG licences so this is covered.


Disaster Recovery for SE v EE : price comparison

Assuming Production & DR (or Active-Active) have 2 sockets each quad-core Intel chips

With SE have to check datatype support and cope with physical DDL issues, but still

superior to Hot Standby in most respects

Still lacking all other EE benefits

Licences List Prices

DB EE 8 £254,712

DB SE 4 £46,920

GoldenGate 8 £93,840

£140,760


A G E N D A





key facts






Look for the causes : new business systems, mergers &

acquisitions, geographic separation, real-time BI



Collateral

http://www.oracle.com/us/products/middleware/dataintegration/overview/index.html

http://www.oracle.com/us/products/middleware/data-integration/resources/index.html

http://www.oracle.com/technetwork/middleware/goldengate/documentation/index.html

http://www.oracle.com/us/products/middleware/dataintegration/overview/index.html

http://www.oracle.com/us/products/middleware/data-integration/resources/index.html

http://www.oracle.com/technetwork/middleware/goldengate/documentation/index.html


Understanding Oracle GoldenGate

Ron Caffrey [email protected]

Oracle Product Specialist

Avnet Technology Services

07711-302797