45
Informatica PowerExchange Update Q2 2010 Tim Wong Alliances Sales Consultant Director

Informatica PowerExchange

Embed Size (px)

DESCRIPTION

informatica power excehnage doc

Citation preview

Page 1: Informatica PowerExchange

1

Informatica PowerExchange Update

Q2 2010

Tim Wong

Alliances Sales Consultant Director

Page 2: Informatica PowerExchange

2

Agenda

• Informatica V9 Architecture Review

• PowerExchange Mainframe Update

• Why PowerExchange?

• Architecture Overview

• Interfacing With PowerCenter

• Relational Database Management Systems: Real Time and Application Connectors

• PWX Roadmap

• Customer Examples

• Q & A Session

Page 3: Informatica PowerExchange

3

The Informatica v9 Platform ArchitectureComprehensive, Unified, Open, Economical

Supporting the complete data

integration lifecycle

Enabling any data integration project

Delivering at any latency

Accessing data from any source

Mitigating risk by working with what you have now and

in the future

Open Economical

Maximizing productivity with

Role based collaboration,

Shared services

Consistent interfaces

Low Total Cost of Ownership (TCO)

Fast Return on Investment (ROI)

UnifiedComprehensive

Page 4: Informatica PowerExchange

4

PowerExchange Mainframe Update

Q2 2010

Scott Hagan

Senior Product Manager

Diane Ditrick

Technical Manager

Page 5: Informatica PowerExchange

5

Myths/Lies and Realities

• The Mainframe is dead (1980’s and 1990’s)

• The Mainframe will be gone by Y2K

• We are migrating to Oracle

• We are migrating to DB2

• We are migrating to SQL Server

• We have SAP, PeopleSoft, and 12 other packages

• Today, we have a real mess on our hands….

Page 6: Informatica PowerExchange

6

Analyst Comments

• Over 80% of the world’s corporate and government data resides on mainframes.

• According to IBM, $5 trillion worth of business assets are housed on IBM mainframes.

• Nearly 95% of Fortune 1000 companies use IBM’s Information Management System (IMS) for their critical data management needs.

• More than 50 billion transactions are running through IMS databases on a daily basis.

Page 7: Informatica PowerExchange

7

Analyst Comments

• Unix and Windows are losing ground, albeit for different reasons. (Forrester)

• Linux is the big winner.

• IBM's System z platform is growing, not declining. (Gartner)

• IBM has generated mainframe revenue growth in five out of the past seven quarters and million instructions per second (MIPs) growth in eight out of the past 10 quarters.

• Specialty engines that attract new application workloads

• A strong and growing community of independent software vendors (ISVs).

• Strategy to attract new skills to the mainframe platform, including University programs.

• Significantly increased systems capacity

• A major increase in performance thanks to new architectural features. (Forrester)

• IBM has launched an enormous campaign to incent SUN & HP Server customers to migrate back to the Mainframe (z/Linux) (IBM)

Page 8: Informatica PowerExchange

8

Why the Mainframe Today?

Page 9: Informatica PowerExchange

9

The Informatica PlatformComprehensive To Automate The Entire Data Integration Lifecycle

Informatica On Demand

Improve Decisions &RegulatoryCompliance

ModernizeBusiness & Reduce IT

Costs

FacilitateMergers &

Acquisitions

Improve Customer Service &

Operational Efficiency

OutsourceNon-coreFunctions

IncreasePartner network

Efficiency

Cloud Data Integration B2B Data Exchange

Data Quality Across the Whole Enterprise

Enterprise Data Integration

Application ILM

Page 10: Informatica PowerExchange

10

The Informatica PlatformComprehensive To Automate The Entire Data Integration Lifecycle

Informatica On Demand

Improve Decisions &RegulatoryCompliance

ModernizeBusiness & Reduce IT

Costs

FacilitateMergers &

Acquisitions

Improve Customer Service &

Operational Efficiency

OutsourceNon-coreFunctions

IncreasePartner network

Efficiency

Cloud Data Integration B2B Data Exchange

Data Quality Across the Whole Enterprise

Enterprise Data Integration

Application ILM

Without Access what is going to work?

Page 11: Informatica PowerExchange

11

Why PowerExchange?

Page 12: Informatica PowerExchange

12

Change Capture Approaches to Date

• Add timestamps through reverse engineering

• User exits that interrupt transaction streams

• Add triggers that impact application performance

• Full file compares to determine deltas

• Home grown solutions technically challenging

All disruptive, all programming centric!

Page 13: Informatica PowerExchange

13

Traditional Methods

• Innovation restricted by cost, complexity and time

• Not a repeatable, scalable solution

• Requires specialist skills to complete the task

• Potential failure points at every step along the way

Extract Translate Move Load

Program Extractfrom one or more sources

Filter, ASCIIEBCDIC

conversion

Transportdata acrossplatforms

Load datato target

Database

SourceData

TargetDatabase

Page 14: Informatica PowerExchange

14

PowerExchange Approach

Data is extracted using SQL, converted (EBCDIC/ASCII), filtered and available to the target database in memory, without any

program code or FTP.

NO PROGAMMING,NO INTERMEDIATE FILES

SourceData

TargetDatabase

Page 15: Informatica PowerExchange

15

Informatica PowerExchange

• Patented change data capture

• Complex Source Access

• Codeless, Visual SQL Driven

• Enterprise Scalability

• Data and System Security

• Delivers data in “right-time”

• Extends value of existing investments

• Accelerates development and reduces maintenance

Unlock Complex Data. On Demand.

Key Technology Business Value

Page 16: Informatica PowerExchange

16

Architecture Overview

Page 17: Informatica PowerExchange

17

Remote Data

Standards andMessaging

Relational andFlat Files

PackagedApplications

Mainframe andMid-Range

Introducing PowerExchangeUnlock Complex Data. On Demand.

Real-time

Batch

Page 18: Informatica PowerExchange

18

Create Datamap

Data Maps for Non-Relational Access

Listener

PowerExchange – Design TimeMetadata driven approach

Remote Data

Standards andMessaging

Relational andFlat Files

PackagedApplications

Mainframe andMid-Range

Informatica PowerExchangeUser Applications

Operating Environment

Metadata Sources

Copybooks

Adabas Definitions

Schemas

DatabaseDefinitions

Hand Key

<<<< MM >>>>

PowerExchange Navigator

1. Import “metadata” from

source

Source Metadata

3. Export datamap to source systems for data extraction

process

Datamaps

2. Create the datamap, based

on metadata

Page 19: Informatica PowerExchange

19

Tools

(ETL, EAI, BI)

Data Maps for Non-Relational Access

InformaticaPowerCenter

DataRecordsListener

PowerExchange Run-TimeBatch Data Movement or CDC Base Materialization

SQL

Informatica PowerExchangeUser Applications

Operating Environment

Target

Remote Data

Standards andMessaging

Relational andFlat Files

PackagedApplications

Mainframe andMid-Range

<<<< MM >>>>

Native DB Request

Native DB Response

1. PowerCenter issues standard

SQL request2. PowerExchange

converts SQL request to native

DB call

3. Source DB responds in

native format

4. PowerExchange sends translated data records to PowerCenter

Page 20: Informatica PowerExchange

20

Capture RegistrationProcess

Data Maps for Non-Relational Access

PowerExchangeNavigator

Listener

Defining the Changes to be Extracted

Informatica PowerExchange

Operating Environment

Extract definitions are based on capture registrations

Extraction Definitions

Capture Registrations

<<<< MM >>>>

Metadata for Relational Access

Metadata

First, we import Metadata from which to define registrations

Next, we define registrations based on metadata presented in

NavigatorRegistrations

Lastly, registrations are exported to the source platforms for

capture process

Page 21: Informatica PowerExchange

21

Tools

(ETL, EAI, BI)

Informatica PowerExchange

Capture and Then Consume(Capture-Once Deliver-Many)

Change Stream

InformaticaPowerCenter

DataRecordsC

ollector

Listener SQLPublishedInterfaces

MainframeADABAS

DATACOMDB2IDMSIMS

VSAM

Mid-RangeDB2/400Oracle

SQL Server

Informatica PowerExchange

DataRecordsListener SQL

PublishedInterfaces

Database vendor - journal, archive, redo logs

Physical VSAM Linear Datasets

Collector

Virtual Change Stream

<<<< MM >>>>

1.PowerExchange collects changes

2. Changed data persists in

PowerExchange change stream

4. PowerCenter issues standard

SQL request

5. PowerExchange sends changed data records to PowerCenter

3.DB Log Mechanism

collects & persists changes

Page 22: Informatica PowerExchange

22

Tools

(ETL, EAI, BI)

PowerExchangeChange Capture Architecture

Registration & ExtractionData Maps

Change Stream - or -

Virtual Change Stream

InformaticaPowerCenter

Collector

Listener

MainframeADABAS

DATACOMDB2IDMSIMS

VSAM

Mid-RangeDB2/400Oracle

SQL Server

Operating Environment

<<<< MM >>>>

Informatica PowerExchange

PublishedInterfaces

1.PowerExchange collects changes

via published interfaces

2. Changed data persisted in change stream

SQLRequest

3. PowerCenter issues standard

SQL request

Data Records

4. PowerExchange sends changed data records to PowerCenter

Page 23: Informatica PowerExchange

31

Informatica PowerExchange

Operating Environment

User Application

Tools

(ETL, EAI, BI)

RegistrationData Maps

Oracle

InformaticaPowerCenter

DataRecordsListener

SQL

Midrange PowerExchange CDC:Oracle Example

OracleLogs

Collector

Virtual Change Stream

<<<< MM >>>>

1. Oracle collects and

persists changes in Redo Logs

3. PowerExchange issues LogMiner request

2. PowerCenter issues standard SQL request

4. PowerExchange sends changed data records to

PowerCenter

LogMiner

Page 24: Informatica PowerExchange

32

Operating Environment

Informatica PowerExchangeUser Application

Tools

(ETL, EAI, BI)

RegistrationData Maps

SQL Server

InformaticaPowerCenter

DataRecordsListener SQL

PowerExchange Change Capture Architecture for MS SQL

SQLPublication

SQL ServerDistribution

DB

Collector

Virtual Change Stream

Page 25: Informatica PowerExchange

33

Interfacing With PowerCenter

Page 26: Informatica PowerExchange

34

How does PowerExchange interface with PowerCenter?

• PowerExchange Client

• Designer menus

• Sources

• Targets

Page 27: Informatica PowerExchange

35

PowerExchange client dialog

• Location• NODE= values from client

dbmover.cfg

• User name / Password• SECURITY=(1,N) or (2,N) in

listener dbmover.cfg(zOS and AS/400 only)

• Multi-Record Datamaps

• Allows group source

• CDC Datamaps

• Extract maps

Page 28: Informatica PowerExchange

36

PowerExchange client dialog – Source Type

• Source Type ADABAS

• DATACOM DB2390 – Subsystem Id DB2400 – Database Name

• DB2MAP DB2UDB – Database Name

• DB2UNLD

• IDMS

• IMS

• MSSQL – Server & Database Names

• ORACLE – TNS Name SEQ VSAM

also target

Page 29: Informatica PowerExchange

37

PowerExchange client dialog – Retrieve Datamaps

• Specify identifier

• Specify metadata filter

• ‘*’ used to match zero or more characters

• Connect

• Select data map

Page 30: Informatica PowerExchange

38

Relational Database Management Systems: Real Time and Application Connectors

Page 31: Informatica PowerExchange

39

The Informatica PlatformEnables Key Business Imperatives from fragmented data

Improve Decisions

ModernizeBusiness

Improve Efficiency & Reduce

Costs

Acquire & Retain

Customers

OutsourceNon-coreFunctions

GovernanceRisk

Compliance

MergersAcquisitions

& Divestitures

IncreasePartnerNetwork

Efficiency

Increase Business

Agility

Application Partner Data

SWIFT NACHA HIPAA …

Cloud Computing UnstructuredDatabase

Page 32: Informatica PowerExchange

40

PWX Roadmap

Page 33: Informatica PowerExchange

41

Safe Harbor Statement

Product roadmap is subject to change. The development, release and timing of any Informatica product features described herein are subject to certain assumptions made around available resources, changes in product direction and information available to date.

Page 34: Informatica PowerExchange

42

Informatica PowerExchange Release TimelineContinued Innovation with Progression to INFA Platform Integration

PWX 8.6.x2008

PWX 9.0.2 Q1 2011

PWX 9.22011

Deeper Integration into Mercury Platform, Broader HA/Failover support, Multi-rectype write back to System z VSAM & FF

Major Performance Enhancements (Offloading, Threading & Stability)

PWX 9.0Q4 2009

Continued Performance Enhancements, Array support for iSeries, Basic HA support, Partitioning for VSAM & FF on System z

Integration of Navigator (Client) into Mercury Platform, Completed migration of all sources and

CDC supportPWX 9.01 Q2 2010

Configuration & Control integration into PowerCenter Admin Console,Mercury Platform Support for DB2, IMS & VSAM

PWX 9.5+Beyond

TBD – New Sources, Tighter integration, performance, etc.

Page 35: Informatica PowerExchange

43

• RRN Support for iSeries

• Enhanced high availability support for PowerExchange form mainframe

• TCP/IP heartbeat for listener

• Stored Procedure Support DB2 (z/OS)

• Performance enhancements• Array support for iSeries

• Partitioning support for PWX VSAM/flat file

• Integration of PowerExchange configuration parameters w/ Informatica Administration Console

• New Control Functions Added for Logger/Compress

Informatica PowerExchange for Mainframe 9.0Release Summary (Q4 2009)

Page 36: Informatica PowerExchange

44

• Threading for VSAM/flat file

• Utility Updates

• PowerExchange for iSeries High Availability support

• IPv6 Support

• Support for Oracle data encryption

• Manage PowerExchange as a service from Informatica Administration Console

• New eField Support for Navigator (file list & GDG)

• Certify z/OS 1.11, DB2 9.7, IMS 11, ADABAS 8.2.2 (?)

Informatica PowerExchange 9.0.1 and BeyondSummary

Page 37: Informatica PowerExchange

45

• LogBased Oracle CDC Product

• Deeper levels of Mainframe Security Controls

• IMS Enhancements• DLI/ODBA Group Sourcing

• DBRC API

• Enhanced PWX Installation

• Metadata Support for VSAM & IMS

• Extend DxT connectivity to • ADABAS

• VSAM

• IMS

• SSL Performance Enhancements

Informatica PowerExchange 9.0.1 and BeyondSummary

Page 38: Informatica PowerExchange

46

Customer Examples

Page 39: Informatica PowerExchange

47

• Native access to Adabas DB on mainframe

• High data throughput and scalability

• Powerful data cleansing• Advanced metadata

management capabilities

Improve Decisions & Regulatory Compliance

KEY BUSINESS IMPERATIVE

INFORMATICA ADVANTAGE RESULTS/BENEFITS

• Increase effectiveness and ROI of sales and CRM marketing campaigns

• Create a single, 360-degree view of customer data• Improve quality of customer data

THE CHALLENGE

IT INITIATIVE

Business Intelligence

Brazil’s Oi quadruples sales campaign ROI with single view of customer

• Massive data volumes in many disparate systems, including mainframes

• Inconsistent data across systems

• Increased sales campaign effectiveness from 1% to 4% ROI

• Reduced mainframe extraction time from 50 hours to 2 hours

• Processed 10 TB of data each day

DATA INTEGRATION PROJECT

Data Warehousing

ref123

Page 40: Informatica PowerExchange

48

• Mapping Architect for Visio tool ensured consistent methodology and structure to data integration projects

• Offered access to any data―relational databases, applications, and flat files to standards-based data

• IPS ‘ranked above almost every previous vendor services team’

Multiline Healthcare Insurance Business Required State-by-State Picture for Fast, Accurate Decision-making

KEY BUSINESS IMPERATIVE

INFORMATICA ADVANTAGE RESULTS/BENEFITS

• Reduce support/ maintenance costs; increase efficiency• Bridge the gap to real-time business decision making• Comply with Federal healthcare mandates

THE CHALLENGE

IT INITIATIVE

Business Intelligence

• Fragmented, state-by-state data made rolled-up reporting slow & unreliable

• Reporting data derived from scores of mutually exclusive source systems

• Data needed for reports extracted manually

• Reported data sometimes months out of date

• Consistent, state-by-state view of insurance situation

• Enabled firm to respond quickly to auditing requirements

• Reduced maintenance and support costs by 50%

• Saved more than 40 hours of development per mapping implementation

Data Integration Project

Data Warehouse

ref123

Centene Puts Informatica at Heart of Healthcare Insurance Decision-making and Cuts Operational Costs by 50%

Page 41: Informatica PowerExchange

49

Modernize Railroad Business & Reduce IT Costs

KEY BUSINESS IMPERATIVE

INFORMATICA ADVANTAGE RESULTS/BENEFITS

• Reduce integration expenditure and deliver data driven services enhancing customer satisfaction

• Provide a platform for integrating real-time data• Replace custom-coded interfaces to access source

databases

THE CHALLENGE

IT INITIATIVE

Operational Integration

BNSF Railway Gets on the Right Track with Informatica Data Integration Platform

DATA INTEGRATION PROJECT

Data Synchronization

ref123

• Inability to synchronize customer information to web in real time

• Reliance on expensive-to-maintain custom-coded interfaces to mainframe

• Lack of scalable framework for leveraging data

• Non-invasive mainframe access, including changed data capture, without coding

• Scalability to handle both current and future data volumes

• Decreased latency between update and data store, capturing 50 million data changes daily

• Reduced mainframe CPU costs and improved performance

Page 42: Informatica PowerExchange

50

• Enabled real-time data integration based on an agile, flexible infrastructure

• Ensured on-demand access to heterogeneous systems, without manually coding

• Simplified complex data integration

Improve Speed of Decision Making and Help Brazilian Central Bank Meet Regulatory Compliance Needs

KEY BUSINESS IMPERATIVE

INFORMATICA ADVANTAGE RESULTS/BENEFITS

• Modernize, streamline, and refine management processes

• Obtain more detailed financial information from banking system clients

THE CHALLENGE

IT INITIATIVE

BI/Compliance

• Slow response times owing to complex, labor intensive data transfers

• Pressure to manage growing data volumes

• Lack of modern management processes and detailed client information

• Increased speed of integration by 30%

• Reduced time to document integration processes by 50%

• Streamlined creation/launch of new financial solutions

• Increased operational security

Data Integration Project

Data Warehousing

ref123

Central Bank of Brazil Brings Decision-making Forward by 30% with Informatica

Page 43: Informatica PowerExchange

51

• Native access to VSAM and Adabas data

• Long-term ROI through standardization and extensibility

Improve Decisions & Regulatory Compliance

KEY BUSINESS IMPERATIVE

INFORMATICA ADVANTAGE RESULTS/BENEFITS

• Integrate complex VSAM and Adabas data into warehouses to enable better reporting and analysis for highway safety improvements

THE CHALLENGE

IT INITIATIVE

Business Intelligence

Washington improves access to fragmented legacy data for operational analysis of hwy infrastructure

• Complex hierarchical legacy data based on VSAM mainframes and Adabas DB

• Need to non-invasive data access to core VSAM systems

• Reduced development time by 50%

• Gave 300 analysts data access to improve highway safety

• Redeployed six mainframe resources to more strategic roles

DATA INTEGRATION PROJECT

Data Warehousing

ref123

Page 44: Informatica PowerExchange

52

Why is Informatica’s PowerExchange Solution Unique?

• Single Vendor, Single Methodology across databases

• No Coding, No Triggers

• Ease of Installation and Maintenance

• Don’t need to be a database expert to get to the data quickly, securely, efficiently

• User can consume changed data either• immediately (Real-Time)

• periodically in bulk (Change)

• Changes can be captured once and used multiple times

• Faster Implementation – Time to Market

Page 45: Informatica PowerExchange

53

Thanks for your time!

For More Information Contact:

Scott Hagan --- [email protected] 573-964-6225Or

Diane Ditrick --- [email protected] 702-765-0025