7
Designing the data warehouse / data marts Part 2

Designing the data warehouse / data marts Part 2

  • View
    214

  • Download
    2

Embed Size (px)

Citation preview

Page 1: Designing the data warehouse / data marts Part 2

Designing the data warehouse/ data marts

Part 2

Page 2: Designing the data warehouse / data marts Part 2

Creating the Physical ModelPhase 4: Creating the Physical Model

Translate the dimensional design to a physical model

for implementationDefine storage strategy for tables and

indexesPerform database sizing Define initial indexing strategyDefine partitioning strategy

Page 3: Designing the data warehouse / data marts Part 2

Physical Model Design Tasks

• Define naming and database standards

• Perform database sizing

• Design tablespaces

• Develop initial indexing strategy

• Develop data partition strategy

• Define storage parameters

Page 4: Designing the data warehouse / data marts Part 2

Data Staging Area• The construction site for the warehouse• Required by most implementations• Composed of ODS, flat files, or relational

server tables• Frequently configured as multitier staging

ExtractExtract

TransformTransform

Operationalsystem TransportTransport

(Load)(Load)

Warehouse

Datastaging

area

Page 5: Designing the data warehouse / data marts Part 2

Remote Staging ModelData staging area within the warehouse environment

Extract,Extract,transform,transform,transporttransport

TransformTransform

Operationalsystem TransportTransport

(Load)(Load)

Datastaging

areaWarehouse

Warehouse environmentWarehouse environmentOper. envt.Oper. envt.

Data staging area in its own environment, avoiding negative impact on the warehouse environment

Extract,Extract,transform,transform,transporttransport

TransformTransform

Operationalsystem TransportTransport

(Load)(Load)

Datastaging

areaWarehouse

Staging envt.Staging envt.Oper. envt.Oper. envt. Warehouse envt.Warehouse envt.

Page 6: Designing the data warehouse / data marts Part 2

Onsite Staging Model

ExtractExtract

TransformTransform

Operationalsystem TransportTransport

(Load)(Load)

Datastaging

area Warehouse

Operational environmentOperational environment WH envt.WH envt.

Data staging area within the operational environment,

possibly affecting the operational system

Page 7: Designing the data warehouse / data marts Part 2

Extracting Data

• Routines developed to select fields from source

• Various data formats• Rules, audit trails, error correction

facilities

Transform

OperationalOperationaldatabasesdatabases

Data Data stagingstagingareaarea

WarehouseWarehousedatabasedatabase

Browser:http://HollywoodHollywood XX ++

Customers:

a re

coro

f

a

s

XX ++

Customers:

Browser:http://HollywoodHollywood

Browser:http://HollywoodHollywood

XX ++

Data mapping