Power Center 8 6 Update UG 4 Nov 2008

Embed Size (px)

Citation preview

  • 8/8/2019 Power Center 8 6 Update UG 4 Nov 2008

    1/39

    1

    Data Quality 8.6

    Identity Resolution

    Informatica PowerCenter 8.6

    Update Session4 november 2008

    Arjan Hijstek Senior Sales Consultant

    Alex Bruschke Sales Consultant

  • 8/8/2019 Power Center 8 6 Update UG 4 Nov 2008

    2/39

    2

    Informatica- upgrades/updates vs. support

    PowerCenter 8.6- new architecture

    - new features* CacheCalc* Parameters* GRID/High Availability* Data Masking

    - RTM Reference Table Manager

    - Mapping Analyst for Excel

  • 8/8/2019 Power Center 8 6 Update UG 4 Nov 2008

    3/39

    3

    Informatica- upgrades/updates vs. support

    PowerCenter 8.6- new architecture

    - new features* CacheCalc* Parameters* GRID/High Availability* Data Masking

    - RTM Reference Table Manager

    - Mapping Analyst for Excel

  • 8/8/2019 Power Center 8 6 Update UG 4 Nov 2008

    4/39

    4

    PowerCenter 6 and 7 Architecture

    Standards,Messaging,Web Services

    PackagedApplications

    Relational/FlatFiles

    Mainframe/Midrange

    Standards,Messaging,Web Services

    PackagedApplications

    Relational/FlatFiles

    Mainframe/Midrange

    Sources Targets

    PowerCenterConnects

    PowerExchange

    Data Servers (pmserver)

    RepositoryServer

    Client Tools

    Rep. Manager

    WF MonitorWF Manager

    Designer

    RepositoryDatabaseWeb ServicesHub

  • 8/8/2019 Power Center 8 6 Update UG 4 Nov 2008

    5/39

    5

    Node & Domain

    PowerCenter 8 Architecture

    PowerCenterConnects

    Core Services

    Client Tools

    RepositoryDatabase

    PowerExchange

    Repository Manager

    Designer

    Workflow Manger

    Workflow MonitorAdministration Console

    Application Services

    Integration Service

    Web Services Hub

    Repository Service

    SAP BW Service

    Log ServiceRepository ServiceDomain/Gateway Services

    Administration & Authorization Configuration Domain Licensing

    *

  • 8/8/2019 Power Center 8 6 Update UG 4 Nov 2008

    6/39

    6

    Domain Overview Dashboard

  • 8/8/2019 Power Center 8 6 Update UG 4 Nov 2008

    7/39

    7

  • 8/8/2019 Power Center 8 6 Update UG 4 Nov 2008

    8/39

    8

    Informatica- upgrades/updates vs. support

    PowerCenter 8.6- new architecture

    - new features* CacheCalc

    * Parameters* GRID/High Availability* Data Masking

    - RTM Reference Table Manager

    - Mapping Analyst for Excel

  • 8/8/2019 Power Center 8 6 Update UG 4 Nov 2008

    9/39

  • 8/8/2019 Power Center 8 6 Update UG 4 Nov 2008

    10/39

    10

    Informatica- upgrades/updates vs. support

    PowerCenter 8.6- new architecture

    - new features* CacheCalc

    * Parameters* GRID/High Availability* Data Masking

    - RTM Reference Table Manager

    - Mapping Analyst for Excel

  • 8/8/2019 Power Center 8 6 Update UG 4 Nov 2008

    11/39

    11

    Additional levels of specification

    (in parameter files)

    GLOBAL

    SERVICE

    SERVICE PROCESS

    WORKFLOW

    SESSION

    SCOP

    E

    PRECE

    DENCE

    high

    low

    low

    high

  • 8/8/2019 Power Center 8 6 Update UG 4 Nov 2008

    12/39

    12

    Example parameter file

    Global level

    Service level

    Service process

    level

    Workflow leveltakes precedence

    over higher order levelssuch as Global / Service

    / Service Process.

  • 8/8/2019 Power Center 8 6 Update UG 4 Nov 2008

    13/39

    13

    Expanded areas of parametrization Pre-defined server variables can be overridden in parameter file now

    Use of workflow variables in any task in the workflow as a parameter

    Owner name of relational source

    Table name prefix of relational target

    E-mail address in e-mail tasks and pre/post session e-mails

    File name parameterization

    Workflow and session log file names FTP remote file name

    Persistent cache file name

    Use of workflow/session/mapping variables and parameters in E-mail subject/ body

    Pre/post SQL for source & target Environment SQL

    Transaction SQL

    Pre/post session commands

    Call text of stored procedures

  • 8/8/2019 Power Center 8 6 Update UG 4 Nov 2008

    14/39

    14

    Informatica- upgrades/updates vs. support

    PowerCenter 8.6- new architecture

    - new features* CacheCalc

    * Parameters* GRID/High Availability* Data Masking

    - RTM Reference Table Manager

    - Mapping Analyst for Excel

  • 8/8/2019 Power Center 8 6 Update UG 4 Nov 2008

    15/39

    15

    Node & Domain

    PowerCenter 8 Architecture

    PowerCenterConnects

    Core Services

    Client Tools

    RepositoryDatabase

    PowerExchange

    Repository Manager

    Designer

    Workflow Manger

    Workflow Monitor

    Administration Console

    Application Services

    Integration Service

    Web Services Hub

    Repository Service

    SAP BW Service

    Log ServiceRepository ServiceDomain/Gateway Services

    Administration & Authorization Configuration Domain Licensing

    *

  • 8/8/2019 Power Center 8 6 Update UG 4 Nov 2008

    16/39

    16

    Domain Overview Dashboard

  • 8/8/2019 Power Center 8 6 Update UG 4 Nov 2008

    17/39

    17

    High Availability in PowerCenter V8

    Failover

    Restart for data integration, repository and other services

    Primary and backup servers

    Recovery

    Workflow and sessions will be recovered on running servers on

    the grid during server failure Checkpoint recovery

    Repository recovery

    Resilience PowerCenter jobs will sustain transient failure

    Network errors

    DB connection failures

  • 8/8/2019 Power Center 8 6 Update UG 4 Nov 2008

    18/39

    18

    Simple High Availability/Failover Scenario

    Simple environment with 2nodes for services and 1

    server for repository.

    Repository database is on CA

    B C

    PrimaryBackupRepository

    Service

    BackupPrimaryIntegration

    Service

    Node BNode A

  • 8/8/2019 Power Center 8 6 Update UG 4 Nov 2008

    19/39

    19

    Simple High/Failover Availability Scenario

    Node A goes down

    Integration Service fails over toNode B A

    B C

    PrimaryUnavailableRepository

    Service

    BackupUnavailableIntegration

    Service

    Node BNode A

  • 8/8/2019 Power Center 8 6 Update UG 4 Nov 2008

    20/39

    20

    Informatica- upgrades/updates vs. support

    PowerCenter 8.6- new architecture

    - new features* CacheCalc

    * Parameters* GRID/High Availability* Data Masking

    - RTM Reference Table Manager

    - Mapping Analyst for Excel

  • 8/8/2019 Power Center 8 6 Update UG 4 Nov 2008

    21/39

    21

    Protecting Sensitive DataRestrict Access, Mask Private Data

    Development and Testing

    Training

    Support

    Data Analysis

    Outsourcing and Offshoring

    Glen Carter900-45-2643

    4563-XXXX-XXXX-6342342 54th StreetNew York

    John Smith654-65-89454563-3456-9876-6342100 Cardinal wayRedwood city

  • 8/8/2019 Power Center 8 6 Update UG 4 Nov 2008

    22/39

    22

    What is Data Masking?

    Transformation of sensitive information intode-identified, realistic-looking data

    while retaining original data properties

    Data remains relevant and meaningful

    Preserves the shape and form of individual fields

    Preserves intra-record relationships

    Preserves join / foreign key relationships

    John Smith654-65-8945

    4739-1146-8075-5716100 Cardinal wayRedwood City

    Glen Carter900-45-2643

    4739-1102-3517-8842342 54th StreetNew York

  • 8/8/2019 Power Center 8 6 Update UG 4 Nov 2008

    23/39

    23

    Masking Production Data for Test Environment

    Production Environment Test Environment

    PowerCenter +

    Data Masking Option

    Remote Data

    Standards andMessaging

    Relational andFlat Files

    Packaged

    Applications

    Mainframe andMid-Range

    Remote Data

    Standards andMessaging

    Relational andFlat Files

    Packaged

    Applications

    Mainframe andMid-Range

  • 8/8/2019 Power Center 8 6 Update UG 4 Nov 2008

    24/39

    24

    CUSTOMER_ACCOUNTS_TEST

    CUSTOMERS_TEST

    CUSTOMER_ACCOUNTS_PROD

    CUSTOMERS_PROD

    PowerCenter +

    Data Masking Option

  • 8/8/2019 Power Center 8 6 Update UG 4 Nov 2008

    25/39

    25

  • 8/8/2019 Power Center 8 6 Update UG 4 Nov 2008

    26/39

    26

    Informatica- upgrades/updates vs. support

    PowerCenter 8.6- new architecture

    - new features* CacheCalc

    * Parameters* GRID/High Availability* Data Masking

    - RTM Reference Table Manager

    - Mapping Analyst for Excel

  • 8/8/2019 Power Center 8 6 Update UG 4 Nov 2008

    27/39

    27

    Reference Table Manager (RTM) Overview

    An easy-to-use interface for business analysts/SMEs to: Create, edit and delete reference tables

    Manually edit reference data, such as valid values and cross-references,

    individually or en masse Designate default values

    Import and export reference tables as .csv or .xls

    View an audit trail documenting the changes to the reference tables

  • 8/8/2019 Power Center 8 6 Update UG 4 Nov 2008

    28/39

    28

    Typical Use Cases

    Data Migrations

    Define default values for an application (e.g. the default value to

    load into a field when there is no corresponding data from thesource system)

    Define valid values for an application (e.g. the list of acceptablegeography codes for an ERP application)

    Cross-reference data values from one application to another(e.g. how the accounting codes from a legacy financial systemmap to the codes in the new finance application)

    Data Warehousing/Other Data Integration

    Manage lookups for data warehousing operations

  • 8/8/2019 Power Center 8 6 Update UG 4 Nov 2008

    29/39

    29

    RTM empowers the business SME to create, edit andmanage reference tables directly

    Benefit: Tighten business-IT collaboration;accelerate project delivery

  • 8/8/2019 Power Center 8 6 Update UG 4 Nov 2008

    30/39

    30

    RTM maintains an audit trail on changes to thereference data

    Benefit: Ensure compliance

  • 8/8/2019 Power Center 8 6 Update UG 4 Nov 2008

    31/39

    31

    RTM is integrated with PowerCenter Admin Console

    Benefit: Enterprise-grade security;lower administrative overhead

  • 8/8/2019 Power Center 8 6 Update UG 4 Nov 2008

    32/39

    32

  • 8/8/2019 Power Center 8 6 Update UG 4 Nov 2008

    33/39

    33

    Informatica- upgrades/updates vs. support

    PowerCenter 8.6- new architecture

    - new features* CacheCalc

    * Parameters* GRID/High Availability* Data Masking

    - RTM Reference Table Manager

    - Mapping Analyst for Excel

  • 8/8/2019 Power Center 8 6 Update UG 4 Nov 2008

    34/39

    34

    Mapping Analyst for ExcelCurrent Approach

    Business Analyst1. Gathers requirements fromthe business2. Documents businessinformation and business rules

    DI Developer1. Translate mapping specifications into

    PowerCenter Mappings

    Data Analyst1. Create source to target mappingspecifications with transformation rules

    MappingSpecificationEnglish/Pseudo Codeon a spreadsheet

  • 8/8/2019 Power Center 8 6 Update UG 4 Nov 2008

    35/39

    35

    Mapping Analyst for ExcelMapping Specification: Issues with Current Practice

    No easy way to collaborate.Passing spreadsheets & documents back and forth.

    Specification becomes out-dated quickly.

    Rules are free-

    form andunstructured

    Finding the right

    sources for businessinformation takes a

    long time

    Each analyst has hisown Excel format

  • 8/8/2019 Power Center 8 6 Update UG 4 Nov 2008

    36/39

    36

    Mapping Analyst for ExcelThe Informatica Solution

    Business Analyst1. Gathers requirements fromthe business2. Documents businessinformation and business rules

    DI Developer1. Augment & Tune Generated

    PowerCenter Mappings2. Re-use mappings for other projects

    Data Analyst1. Create source to target mappingspecifications with transformation rules

    2. Auto-generate PowerCenterMapping

    Mapping SpecificationEnglish/Pseudo Code on aspreadsheet

  • 8/8/2019 Power Center 8 6 Update UG 4 Nov 2008

    37/39

    37

    Auto-generate specification from modified mappings

    Auto-generate PowerCenter mappings

    Mapping Analyst for Excel PowerCenter

    Benefit: Improve documentation andauditability

    Mapping Analyst for ExcelKeep Specifications Updated

    Define business terms Specify associated sources, target Define transformation rules

    Standardize Excel format

    Jumpstart mappings from specification Modify and optimize mappings

    Synchronize mappings w/ spec.Analyst Developer

  • 8/8/2019 Power Center 8 6 Update UG 4 Nov 2008

    38/39

    38

    Mapping Specification Lifecycle

  • 8/8/2019 Power Center 8 6 Update UG 4 Nov 2008

    39/39

    39