49
© COPYRIGHT TRANSFER SOLUTIONS B.V. 1 Oracle Data Integrator 2006 2014

Oracle Data Integrator - Transfer Solutions · Oracle Data Integrator 2006 2014 © COPYRIGHT TRANSFER SOLUTIONS B.V. 2 Oracle Data Integrator © COPYRIGHT TRANSFER SOLUTIONS B.V

  • Upload
    buidien

  • View
    244

  • Download
    9

Embed Size (px)

Citation preview

Page 1: Oracle Data Integrator - Transfer Solutions · Oracle Data Integrator 2006 2014 © COPYRIGHT TRANSFER SOLUTIONS B.V. 2 Oracle Data Integrator © COPYRIGHT TRANSFER SOLUTIONS B.V

© COPYRIGHT TRANSFER SOLUTIONS B.V. 1

Oracle Data Integrator

2006

2014

Page 2: Oracle Data Integrator - Transfer Solutions · Oracle Data Integrator 2006 2014 © COPYRIGHT TRANSFER SOLUTIONS B.V. 2 Oracle Data Integrator © COPYRIGHT TRANSFER SOLUTIONS B.V

© COPYRIGHT TRANSFER SOLUTIONS B.V. 2

Oracle Data Integrator

Page 3: Oracle Data Integrator - Transfer Solutions · Oracle Data Integrator 2006 2014 © COPYRIGHT TRANSFER SOLUTIONS B.V. 2 Oracle Data Integrator © COPYRIGHT TRANSFER SOLUTIONS B.V

© COPYRIGHT TRANSFER SOLUTIONS B.V. 3

Mapping

Topology In Topology Uit

Knowlegde Module

Package

Loadplan

Page 4: Oracle Data Integrator - Transfer Solutions · Oracle Data Integrator 2006 2014 © COPYRIGHT TRANSFER SOLUTIONS B.V. 2 Oracle Data Integrator © COPYRIGHT TRANSFER SOLUTIONS B.V

© COPYRIGHT TRANSFER SOLUTIONS B.V. 4

ODI Onderwerpen

Topologie

Mappings

Knowlegde Modules

Flow Controls

Package en Loadplans

Case

Page 5: Oracle Data Integrator - Transfer Solutions · Oracle Data Integrator 2006 2014 © COPYRIGHT TRANSFER SOLUTIONS B.V. 2 Oracle Data Integrator © COPYRIGHT TRANSFER SOLUTIONS B.V

© COPYRIGHT TRANSFER SOLUTIONS B.V. 5

Model Topologie

Mapping

Data

Server

Logical

Schema

Physical

Schema

Context Data

Store

Model

Folder

Data

Model

Page 6: Oracle Data Integrator - Transfer Solutions · Oracle Data Integrator 2006 2014 © COPYRIGHT TRANSFER SOLUTIONS B.V. 2 Oracle Data Integrator © COPYRIGHT TRANSFER SOLUTIONS B.V

© COPYRIGHT TRANSFER SOLUTIONS B.V. 6

Physical Architecture

Dataserver Definition

Page 7: Oracle Data Integrator - Transfer Solutions · Oracle Data Integrator 2006 2014 © COPYRIGHT TRANSFER SOLUTIONS B.V. 2 Oracle Data Integrator © COPYRIGHT TRANSFER SOLUTIONS B.V

© COPYRIGHT TRANSFER SOLUTIONS B.V. 7

Physical Architecture

JDBC

Page 8: Oracle Data Integrator - Transfer Solutions · Oracle Data Integrator 2006 2014 © COPYRIGHT TRANSFER SOLUTIONS B.V. 2 Oracle Data Integrator © COPYRIGHT TRANSFER SOLUTIONS B.V

© COPYRIGHT TRANSFER SOLUTIONS B.V. 8

Physical Architecture

ONTW

server/un/

pw

TEST

server/un/

pw

PROD

server/un/

pw

Connectie info in OTAP

ODI ONTW

ONTW

datasource

weblogic

ODI TEST

TEST

datasource

weblogic

ODI PROD

PROD

datasource

weblogic

Page 9: Oracle Data Integrator - Transfer Solutions · Oracle Data Integrator 2006 2014 © COPYRIGHT TRANSFER SOLUTIONS B.V. 2 Oracle Data Integrator © COPYRIGHT TRANSFER SOLUTIONS B.V

© COPYRIGHT TRANSFER SOLUTIONS B.V. 9

Physical Architecture

Datasource

Page 10: Oracle Data Integrator - Transfer Solutions · Oracle Data Integrator 2006 2014 © COPYRIGHT TRANSFER SOLUTIONS B.V. 2 Oracle Data Integrator © COPYRIGHT TRANSFER SOLUTIONS B.V

© COPYRIGHT TRANSFER SOLUTIONS B.V. 10

Physical Architecture

Datasource in weblogic

Page 11: Oracle Data Integrator - Transfer Solutions · Oracle Data Integrator 2006 2014 © COPYRIGHT TRANSFER SOLUTIONS B.V. 2 Oracle Data Integrator © COPYRIGHT TRANSFER SOLUTIONS B.V

© COPYRIGHT TRANSFER SOLUTIONS B.V. 11

Logical Architecture

Koppelen aan Physical Schema via Context

Wordt gebruikt in datamodel en mappings

Context vastleggen in mappings, loadplan of

runtime kiezen Bijvoorbeeld OTAP of Landen

Page 12: Oracle Data Integrator - Transfer Solutions · Oracle Data Integrator 2006 2014 © COPYRIGHT TRANSFER SOLUTIONS B.V. 2 Oracle Data Integrator © COPYRIGHT TRANSFER SOLUTIONS B.V

© COPYRIGHT TRANSFER SOLUTIONS B.V. 12

Model Topologie

Mapping

Data

Server

Logical

Schema

Physical

Schema

Context Data

Store

Model

Folder

Data

Model

Page 13: Oracle Data Integrator - Transfer Solutions · Oracle Data Integrator 2006 2014 © COPYRIGHT TRANSFER SOLUTIONS B.V. 2 Oracle Data Integrator © COPYRIGHT TRANSFER SOLUTIONS B.V

© COPYRIGHT TRANSFER SOLUTIONS B.V. 13

Data Model

Page 14: Oracle Data Integrator - Transfer Solutions · Oracle Data Integrator 2006 2014 © COPYRIGHT TRANSFER SOLUTIONS B.V. 2 Oracle Data Integrator © COPYRIGHT TRANSFER SOLUTIONS B.V

© COPYRIGHT TRANSFER SOLUTIONS B.V. 14

Data Stores

Page 15: Oracle Data Integrator - Transfer Solutions · Oracle Data Integrator 2006 2014 © COPYRIGHT TRANSFER SOLUTIONS B.V. 2 Oracle Data Integrator © COPYRIGHT TRANSFER SOLUTIONS B.V

© COPYRIGHT TRANSFER SOLUTIONS B.V. 15

Data Stores CDC

Page 16: Oracle Data Integrator - Transfer Solutions · Oracle Data Integrator 2006 2014 © COPYRIGHT TRANSFER SOLUTIONS B.V. 2 Oracle Data Integrator © COPYRIGHT TRANSFER SOLUTIONS B.V

© COPYRIGHT TRANSFER SOLUTIONS B.V. 16

Data Stores CDC

Page 17: Oracle Data Integrator - Transfer Solutions · Oracle Data Integrator 2006 2014 © COPYRIGHT TRANSFER SOLUTIONS B.V. 2 Oracle Data Integrator © COPYRIGHT TRANSFER SOLUTIONS B.V

© COPYRIGHT TRANSFER SOLUTIONS B.V. 17

Mapping

Logical

Page 18: Oracle Data Integrator - Transfer Solutions · Oracle Data Integrator 2006 2014 © COPYRIGHT TRANSFER SOLUTIONS B.V. 2 Oracle Data Integrator © COPYRIGHT TRANSFER SOLUTIONS B.V

© COPYRIGHT TRANSFER SOLUTIONS B.V. 18

Mapping

Physical

Page 19: Oracle Data Integrator - Transfer Solutions · Oracle Data Integrator 2006 2014 © COPYRIGHT TRANSFER SOLUTIONS B.V. 2 Oracle Data Integrator © COPYRIGHT TRANSFER SOLUTIONS B.V

© COPYRIGHT TRANSFER SOLUTIONS B.V. 19

Mapping Uitvoeren

Page 20: Oracle Data Integrator - Transfer Solutions · Oracle Data Integrator 2006 2014 © COPYRIGHT TRANSFER SOLUTIONS B.V. 2 Oracle Data Integrator © COPYRIGHT TRANSFER SOLUTIONS B.V

© COPYRIGHT TRANSFER SOLUTIONS B.V. 20

Mapping Uitvoeren

Page 21: Oracle Data Integrator - Transfer Solutions · Oracle Data Integrator 2006 2014 © COPYRIGHT TRANSFER SOLUTIONS B.V. 2 Oracle Data Integrator © COPYRIGHT TRANSFER SOLUTIONS B.V

© COPYRIGHT TRANSFER SOLUTIONS B.V. 21

Mapping Uitvoeren

Page 22: Oracle Data Integrator - Transfer Solutions · Oracle Data Integrator 2006 2014 © COPYRIGHT TRANSFER SOLUTIONS B.V. 2 Oracle Data Integrator © COPYRIGHT TRANSFER SOLUTIONS B.V

© COPYRIGHT TRANSFER SOLUTIONS B.V. 22

Knowledge Module

Vertaalt de logische declaratie naar fysieke code

Één logische mapping op verschillende manieren

(technisch) uitvoeren

Component versus template

Aanpasbaar

Page 23: Oracle Data Integrator - Transfer Solutions · Oracle Data Integrator 2006 2014 © COPYRIGHT TRANSFER SOLUTIONS B.V. 2 Oracle Data Integrator © COPYRIGHT TRANSFER SOLUTIONS B.V

© COPYRIGHT TRANSFER SOLUTIONS B.V. 23

Knowledge Module

Page 24: Oracle Data Integrator - Transfer Solutions · Oracle Data Integrator 2006 2014 © COPYRIGHT TRANSFER SOLUTIONS B.V. 2 Oracle Data Integrator © COPYRIGHT TRANSFER SOLUTIONS B.V

© COPYRIGHT TRANSFER SOLUTIONS B.V. 24

Knowledge Module

Page 25: Oracle Data Integrator - Transfer Solutions · Oracle Data Integrator 2006 2014 © COPYRIGHT TRANSFER SOLUTIONS B.V. 2 Oracle Data Integrator © COPYRIGHT TRANSFER SOLUTIONS B.V

© COPYRIGHT TRANSFER SOLUTIONS B.V. 25

Knowledge Module

Page 26: Oracle Data Integrator - Transfer Solutions · Oracle Data Integrator 2006 2014 © COPYRIGHT TRANSFER SOLUTIONS B.V. 2 Oracle Data Integrator © COPYRIGHT TRANSFER SOLUTIONS B.V

© COPYRIGHT TRANSFER SOLUTIONS B.V. 26

Knowledge Module

Insert flow into $I table

Page 27: Oracle Data Integrator - Transfer Solutions · Oracle Data Integrator 2006 2014 © COPYRIGHT TRANSFER SOLUTIONS B.V. 2 Oracle Data Integrator © COPYRIGHT TRANSFER SOLUTIONS B.V

© COPYRIGHT TRANSFER SOLUTIONS B.V. 27

Knowledge Module

Kies KM bij Mapping

Page 28: Oracle Data Integrator - Transfer Solutions · Oracle Data Integrator 2006 2014 © COPYRIGHT TRANSFER SOLUTIONS B.V. 2 Oracle Data Integrator © COPYRIGHT TRANSFER SOLUTIONS B.V

© COPYRIGHT TRANSFER SOLUTIONS B.V. 28

Knowledge Module

Page 29: Oracle Data Integrator - Transfer Solutions · Oracle Data Integrator 2006 2014 © COPYRIGHT TRANSFER SOLUTIONS B.V. 2 Oracle Data Integrator © COPYRIGHT TRANSFER SOLUTIONS B.V

© COPYRIGHT TRANSFER SOLUTIONS B.V. 29

Flow Control

Page 30: Oracle Data Integrator - Transfer Solutions · Oracle Data Integrator 2006 2014 © COPYRIGHT TRANSFER SOLUTIONS B.V. 2 Oracle Data Integrator © COPYRIGHT TRANSFER SOLUTIONS B.V

© COPYRIGHT TRANSFER SOLUTIONS B.V. 30

Flow Control

Page 31: Oracle Data Integrator - Transfer Solutions · Oracle Data Integrator 2006 2014 © COPYRIGHT TRANSFER SOLUTIONS B.V. 2 Oracle Data Integrator © COPYRIGHT TRANSFER SOLUTIONS B.V

© COPYRIGHT TRANSFER SOLUTIONS B.V. 31

Flow Control

Page 32: Oracle Data Integrator - Transfer Solutions · Oracle Data Integrator 2006 2014 © COPYRIGHT TRANSFER SOLUTIONS B.V. 2 Oracle Data Integrator © COPYRIGHT TRANSFER SOLUTIONS B.V

© COPYRIGHT TRANSFER SOLUTIONS B.V. 32

Flow Control

Error tabel E$_STG_EMP

Page 33: Oracle Data Integrator - Transfer Solutions · Oracle Data Integrator 2006 2014 © COPYRIGHT TRANSFER SOLUTIONS B.V. 2 Oracle Data Integrator © COPYRIGHT TRANSFER SOLUTIONS B.V

© COPYRIGHT TRANSFER SOLUTIONS B.V.

Mapping Procedure

ODI SDK

Variabele Sequence

Package

Scenario

Loadplan Step 1

Step 2

DataStore

Generate

Schedule

Page 34: Oracle Data Integrator - Transfer Solutions · Oracle Data Integrator 2006 2014 © COPYRIGHT TRANSFER SOLUTIONS B.V. 2 Oracle Data Integrator © COPYRIGHT TRANSFER SOLUTIONS B.V

© COPYRIGHT TRANSFER SOLUTIONS B.V. 34

Packages en Loadplans

Proces Flow

Loadplans : Parallel uitvoeren mogelijk

Herstartmogelijkheden per stap

ODI-toolkit

Page 35: Oracle Data Integrator - Transfer Solutions · Oracle Data Integrator 2006 2014 © COPYRIGHT TRANSFER SOLUTIONS B.V. 2 Oracle Data Integrator © COPYRIGHT TRANSFER SOLUTIONS B.V

© COPYRIGHT TRANSFER SOLUTIONS B.V. 35

Packages

Page 36: Oracle Data Integrator - Transfer Solutions · Oracle Data Integrator 2006 2014 © COPYRIGHT TRANSFER SOLUTIONS B.V. 2 Oracle Data Integrator © COPYRIGHT TRANSFER SOLUTIONS B.V

© COPYRIGHT TRANSFER SOLUTIONS B.V. 36

Loadplans

Page 37: Oracle Data Integrator - Transfer Solutions · Oracle Data Integrator 2006 2014 © COPYRIGHT TRANSFER SOLUTIONS B.V. 2 Oracle Data Integrator © COPYRIGHT TRANSFER SOLUTIONS B.V

© COPYRIGHT TRANSFER SOLUTIONS B.V. 37

CASE : Brandstof file interface 15 landen

Page 38: Oracle Data Integrator - Transfer Solutions · Oracle Data Integrator 2006 2014 © COPYRIGHT TRANSFER SOLUTIONS B.V. 2 Oracle Data Integrator © COPYRIGHT TRANSFER SOLUTIONS B.V

© COPYRIGHT TRANSFER SOLUTIONS B.V. 38

Complex Files

Page 39: Oracle Data Integrator - Transfer Solutions · Oracle Data Integrator 2006 2014 © COPYRIGHT TRANSFER SOLUTIONS B.V. 2 Oracle Data Integrator © COPYRIGHT TRANSFER SOLUTIONS B.V

© COPYRIGHT TRANSFER SOLUTIONS B.V. 39

Complex/XML Files

File

HSQL :Internal

Memory

NXSD

Staging

Table

JDBC

ORACLE :

TEMP TABLES

Staging

Table

PRC :

SYNC

HRO

NIZE

Dp_land.p

roperties PRC :

SYNC

HRO

NIZE

MAP : Oracle -

Oracle

MAP : HSQL -

Oracle

Page 40: Oracle Data Integrator - Transfer Solutions · Oracle Data Integrator 2006 2014 © COPYRIGHT TRANSFER SOLUTIONS B.V. 2 Oracle Data Integrator © COPYRIGHT TRANSFER SOLUTIONS B.V

© COPYRIGHT TRANSFER SOLUTIONS B.V. 40

Topologie Variabel maken

Page 41: Oracle Data Integrator - Transfer Solutions · Oracle Data Integrator 2006 2014 © COPYRIGHT TRANSFER SOLUTIONS B.V. 2 Oracle Data Integrator © COPYRIGHT TRANSFER SOLUTIONS B.V

© COPYRIGHT TRANSFER SOLUTIONS B.V. 41

Flexibele Flowcontroles

Contraints op staging tabel

Dynamisch land, procedure, leverancier Tabel

Db package

Page 42: Oracle Data Integrator - Transfer Solutions · Oracle Data Integrator 2006 2014 © COPYRIGHT TRANSFER SOLUTIONS B.V. 2 Oracle Data Integrator © COPYRIGHT TRANSFER SOLUTIONS B.V

© COPYRIGHT TRANSFER SOLUTIONS B.V. 42

Flexibele Flowcontroles

Page 43: Oracle Data Integrator - Transfer Solutions · Oracle Data Integrator 2006 2014 © COPYRIGHT TRANSFER SOLUTIONS B.V. 2 Oracle Data Integrator © COPYRIGHT TRANSFER SOLUTIONS B.V

© COPYRIGHT TRANSFER SOLUTIONS B.V. 43

Flexibele Flowcontroles

Database Tabel

Database Package

Page 44: Oracle Data Integrator - Transfer Solutions · Oracle Data Integrator 2006 2014 © COPYRIGHT TRANSFER SOLUTIONS B.V. 2 Oracle Data Integrator © COPYRIGHT TRANSFER SOLUTIONS B.V

© COPYRIGHT TRANSFER SOLUTIONS B.V. 44

Package Proces Files

Page 45: Oracle Data Integrator - Transfer Solutions · Oracle Data Integrator 2006 2014 © COPYRIGHT TRANSFER SOLUTIONS B.V. 2 Oracle Data Integrator © COPYRIGHT TRANSFER SOLUTIONS B.V

© COPYRIGHT TRANSFER SOLUTIONS B.V. 45

Package Proces File

Page 46: Oracle Data Integrator - Transfer Solutions · Oracle Data Integrator 2006 2014 © COPYRIGHT TRANSFER SOLUTIONS B.V. 2 Oracle Data Integrator © COPYRIGHT TRANSFER SOLUTIONS B.V

© COPYRIGHT TRANSFER SOLUTIONS B.V. 46

Procedure Aanroep pl/sql

Page 47: Oracle Data Integrator - Transfer Solutions · Oracle Data Integrator 2006 2014 © COPYRIGHT TRANSFER SOLUTIONS B.V. 2 Oracle Data Integrator © COPYRIGHT TRANSFER SOLUTIONS B.V

© COPYRIGHT TRANSFER SOLUTIONS B.V. 47

Package ReadMail

Page 48: Oracle Data Integrator - Transfer Solutions · Oracle Data Integrator 2006 2014 © COPYRIGHT TRANSFER SOLUTIONS B.V. 2 Oracle Data Integrator © COPYRIGHT TRANSFER SOLUTIONS B.V

© COPYRIGHT TRANSFER SOLUTIONS B.V. 48

Webservices

Page 49: Oracle Data Integrator - Transfer Solutions · Oracle Data Integrator 2006 2014 © COPYRIGHT TRANSFER SOLUTIONS B.V. 2 Oracle Data Integrator © COPYRIGHT TRANSFER SOLUTIONS B.V

© COPYRIGHT TRANSFER SOLUTIONS B.V. 49

Webservices