Text of Training | CIF CONSULT | Redouane BELBAHRI Informatica PowerExchange 9.X
Training | CIF CONSULT | Redouane BELBAHRI Informatica PowerExchange 9.X
Agenda Objectives What is PowerExchange How Does the Team typically use PWX Power Exchange Batch Architecture Real Examples
Agenda 1 Objectives
Agenda This course explains what PowerExchange is and how it is used. We will learn the Architetue (batch) of PowerEXchange, and the key components Undestand the PowerExchange Architecture Describe How PWX Datamaps are used and where they are stored Create a basic Datamap in the PWX Navigator GUI
Agenda 2 What is PowerExchange
Agenda Power Exchange (PWX) is a tool we use to parse complex files and pull them into Designer. Power Exchange (PWX) is comprised of 3 main components Change Data Capture Allows you to monitor and retrieve changes that have occurred to data in which you have expressed an interest. Data Maps Used to access data sources like IMS databases, VSAM files and flat files. Personal Metadata - Allows you to browse meta data from remote databases. Remark: Change Data Capture (CDC) and Personal Metadata are out of scope in this presentation
PowerExchange Batch Platforms
PowerExchange Change Capture (CDC)
Agenda 3 How Does the Team typically use PWX
Complex Flat File Parsing Complex copybooks with multiple record types Creating multiple records out of occurs depending on or blowing them out to the full range of the occurs Verifying that the layout is correct with a row test Data from the row test can be copied into a text file and then imported into Excel as a comma delimited file. Making sure that the input data can be seen correctly by PWX Interaction with Power Center Pulling Sources and Targets set up with PWX into Informatica Designer
When to Use PowerCenter PowerCenter supports only fixed width files,Informatica VSAM reader does not support variable length file. This file is read using a PowerCenter Normalizer transformation. PowerCenter does not support the Occurs Depending On clause. PowerCenter supports comp, comp-3, comp-6 and comp-x fields. When to use PWX When to Use PowerExchange However, PowerExchange has a capability of reading the variable length VSAM file. In PowerExchange create a data map for the VSAM file by importing the COBOL copybook.
Agenda 4 Power Exchange Batch Architecture How Does PWX work?
Where PWX is installed ?
Informatica PowerExchange Design Time - Batch Architecture
PowerExchange CDC Architecture For Oracle (option available at AXA) PowerExchange Change Data Capture (CDC) works in conjunction with PowerCenter to capture changes to data in source tables and replicate those changes to target tables and files.
Traditional Methods for Moving Data Multiple manual steps for each source database!
PowerExchange Approach No Programming, No Intermediate Files Data extracted with SQL, converted and filtered Loaded to target in memory Restart and Recovery integration with PowerCenter
A Datamap defines metadata For non-relational databases, need to define metadata Contains all information regarding the underlying dataset Created from existing information VSAM copybooks IMS DBDs, then overlay segment copybooks ADABAS FDT IDMS schemas Flattens out hierarchical or multi-record type data Stored on the same platform as the data Not needed for relational sources Provides the information to convert an SQL statement to actual data base requests What is a Datamap ?
Where is the Datamap stored? Source version of datamap is stored on windows machine where created Datamaps folder, (dmp file on windows) Run time version is stored with the PWX software on the source data machine Datamaps folder, (dmp file type on windows) Install.lib.DATAMAPS sequential file on MVS Stdatamaps lib on AS400 Run time version can be imported into any windows session of PWX Navigator to pull in most recent copy Refer to the Navigator User Guide for more information
Different types of data and where they are stored The 'compiled' version of the data map, in this case test.EBCDIC.dmx' is stored in the 'datamaps' folder directly under the product install directory on the system where it will be used by the product to access the data. It is sent when you see a message in Navigator that says that information must be sent to the 'remote system' in order to retrieve data. There is also a lock file for the customer data map. It is 'customer.lck' and is also stored in the Shared folder. It is used to serialize access to the data map source.
Configuration File Sets many defaults parameters for PowerExchange Provide security settings Communication Settings Config File Communication Params: LISTENER Node Name TCPIP (standard parm) Port Number NODE Node name TCPIP (standard parm Host Name or IP address Port Number Sample dbmover.cfg file
What is a Listener? A PowerExchange task that accept requests for data Uses an IP address and Port Number Can listen on multiple Port numbers at the same time Can have multiple listeners running (on unique IP and Ports) Only needed on remote platforms for access to batch data Also used for connecting to remote PowerExchange Nodes for creating datamaps and Capture Registrations
Listener = Phone line Easy way to remember The Listener is the equivalent of the phone number that defines a number, whitch is the IP address and Port, once turned on can be called from other places.
Node = Address Book Numbers Easy way to remember Node statement gives all the available numbers we can call from this location
Listener and Node Example
Agenda 5 Real Examples
Examples 1. Fixed Length File 2. Variable Length File 3. Variable Length File with multiple record types
Connection to PWX Navigator From the Taskbar Desktop icon 1 1 Connection to PowerExchange client tool Note: No need to use a Login and password to access 2 Acces Homepage Demonstration Of PWX OR
Example 1 Fixed length VSAM file Create Data Map that convert an EBCDIC file to ASCII file format: Add a Data Map Fill in the Schema name and the Data Map Name Insert the Input File name and its location on the server, Select the fixed option, & change the default line to EBCDIC & IBM-1047 Enter the name of the source file copybook Demonstration Of PWX
Prepare the Cobol file structure 1.The Cobol file structure you are being to use should not contains the header informations, if not later you will have this error Remove this section Demonstration Of PWX
Add a data map Right click on the data map folder to add a data map. Demonstration Of PWX
Fill in the Schema Name and the Data Map Name 1.Fill in the Schema Name and the Data Map Name 2.Access Method: SEQ (for Flat file) 3.Click next Demonstration Of PWX
Data Map Properties Location and type of copybook that you want to import. 1.Insert the file name (data file) that the map will need to read in Informatica (this file will be on the server). 1.Select fixed or variable depending on the type of file. 2.In the Size box, enter the record length ( if not known give 1 as size, will correct later ). 3.The screen print above is for a fixed file only. 4.Click Finish Demonstration Of PWX
1.Enter information about the location and type of metadata that you want to import. 2.Click Next Import Copybook Source Details Column Range: Enter the start and end column range for the copybook: Source: Local. The copybook is located on the PowerExchange Navigator system. Remote. The copybook is located on a remote system. Demonstration Of PWX
1.Tell PowerExchange where you have your copybook located on your PC 2.Click next. Import Copybook Local Cobol Details Demonstration Of PWX
1.Click Finish Import Copybook Configuration Details Demonstration Of PWX
Import Copybook Information 1.Click OK Demonstration Of PWX
Record Definition 1.Click OK Demonstration Of PWX
Add a data map Physical definition mapped to the relational definition Record Table 1.Click OK Demonstration Of PWX
Add a data map (EBCDIC) 1.Click Close 2.Make a note of the file actual length 3.Click yes Demonstration Of PWX
Add a data map (EBCDIC) 1.Right click on Test.EBCDIC in the resource explorer (Data Map) and select properties. 2.Select the SEQ Access Method Tab and change the length to 350. Demonstration Of PWX