14
LEARN WELL CLASSES ETL/Data-warehousing Testing ETL Testing VS Manual Testing o Similarities and Differences o Advantages of ETL testing o Requirement of ETL tester o Responsibility of ETL tester o ETL testing methodology in Industry Datawarehousing and ETL in Testing perspective o Datawarehousing concepts o ETL(Informatica) concepts o Datawarehousing testing o ETL testing SQL in ETL Testing perspective o SQL concepts o Special SQL commands for ETL testing o Special SQL queries for ETL testing o SQL query tuning

Learn Well Professional Classes - ETL Testing

Embed Size (px)

Citation preview

Page 1: Learn Well Professional Classes - ETL Testing

LEARN WELL CLASSES

ETL/Data-warehousing Testing

ETL Testing VS Manual Testing

o Similarities and Differences

o Advantages of ETL testing

o Requirement of ETL tester

o Responsibility of ETL tester

o ETL testing methodology in Industry

Datawarehousing and ETL in Testing perspective

o Datawarehousing concepts

o ETL(Informatica) concepts

o Datawarehousing testing

o ETL testing

SQL in ETL Testing perspective

o SQL concepts

o Special SQL commands for ETL testing

o Special SQL queries for ETL testing

o SQL query tuning

Page 2: Learn Well Professional Classes - ETL Testing

Unix in ETL Testing perspective

o Unix concepts

o Unix commands for ETL testing

o Using Unix for ETL testing

Documentation

o BR document

o SR document

o DA specification document

o Test plan preparation

o Test Bed preparation

o Test summary and Status Report

ETL testing specifications

o Test data creation strategy

o Test case Design

1. Column Level

2. Scenario Based

3. Code Integration related test cases

4. Functionality based test cases

5. Extract based test cases

o Extract Testing

o Load testing

o RTM creation

Page 3: Learn Well Professional Classes - ETL Testing

INFORMATICA/DATAWAREHOUSING Syllabus

Administrator Guide:

Understanding Domains

o Nodes

o Application Services

Using Administration Console

Managing the Domain

o Managing Folders

o Managing Permissions

Managing Users and Groups

Managing Privileges and Roles

Creating and Configuring the Repository Services

Managing the Repository

Creating and Configuring Integration Services

o Enabling and Disabling the Integration Services

Integration Services Architecture

Managing License

Page 4: Learn Well Professional Classes - ETL Testing

Advanced Workflow Guide:

Stopping and Aborting

o Error Handling

o Stopping and Aborting Workflows

Concurrent Workflows

Workflow Variables

o Predefined Workflow Variables

o User- Defined Workflow Variables

o Using Worklet Variables

o Assigning Variable Values in a Worklet

Parameter and variables in Sessions

o Working with Session Parameters

o Assigning Parameter and Variables in a Session

Parameter File

Session Caches

Incremental Aggregation

Session Log Interface

Page 5: Learn Well Professional Classes - ETL Testing

Command Reference:

Using Command Line Programs

o Infacmd

o Infasetup

o Pmcmd

o pmrep

Designer Guide:

Using the Designer

o Configuring Designer Options

o Using Toolbars

o Navigating the Workspace

Working with Sources

o Working with Relational Sources

Working with Flat Files

o Importing Flat Files

o Formatting Flat Files Column

Working with Targets

o Importing Target Definition

o Creating Target Definition from Source Definition

o Creating Target Definition from Transformations

o Creating Target tables

Page 6: Learn Well Professional Classes - ETL Testing

Mappings

o Working with Mappings

o Connecting Mapping Objects

o Linking Ports

o Propagating Port Attributes

o Working with Targets in a Mapping

o Working with Relational Targets in a Mapping

o Validating a Mapping

o Using Workflow Generation Wizard

Mapping Parameters and Variables

Working with User-Defined Functions

Using Mapping Wizard

Naming Conventions

Performance Tuning Guide:

Performance Tuning Overview

Bottlenecks

o Using Thread Statistics

o Target Bottlenecks

o Source Bottlenecks

o Mapping Bottlenecks

o Session Bottlenecks

o System Bottlenecks

Page 7: Learn Well Professional Classes - ETL Testing

Optimizing the Targets

Optimizing the Source

Optimizing the Mapping

Optimizing the Transformations

Optimizing the Sessions

Optimizing the Power Center Components

Optimizing the System

Using Pipeline Partitions

Performance Counters

Repository Guide:

Understanding the Repository

Using Repository Manager

Folders

Managing Object Permissions

Working with Versioned Objects

Exporting and Importing Objects

Copying Objects

Page 8: Learn Well Professional Classes - ETL Testing

Transformation Guide:

Working with Transformations

o Configuring Transformations

o Working with Ports

o Working with Expressions

o Reusable Transformations

Aggregator Transformation

Custom Transformation

Expression Transformation

External Transformation

Filter Transformation

Joiner Transformation

Java Transformation

Lookup Transformation

Lookup Caches

Normalizer Transformation

Rank Transformation

Router Transformation

Sequence Generator Transformation

Sorter Transformation

Source Qualifier Transformation

SQL Transformation

Page 9: Learn Well Professional Classes - ETL Testing

Stored Procedure Transformation

Transaction Control Transformation

Union Transformation

Update Strategy Transformation

Transformation Language Reference:

The Transformation Language

Constants

Operators

Variables

Dates

Functions

Creating Custom Function

Workflow Basics Guide:

Workflow Manager

o Workflow Manager Options

o Navigating the Workspace

o Working with Repository Objects

o Copying Repository Objects

o Comparing Repository Objects

Page 10: Learn Well Professional Classes - ETL Testing

Workflow and Worklets

o Creating a Workflow

o Using Workflow Wizard

o Assigning an Integration Service

o Working with Worklets

o Working with Links

Sessions

o Creating a Session Task

o Editing a Session

o Pre- and Post- Session Commands

Session Configuration Objects

Tasks

o Creating a Task

o Working with Command Task

o Working with Decision Task

o Working with Event Task

o Working Timer Task

o Working with Assignment Task

Sources

o Configuring Sources in a Session

o Working with Relational Sources

o Working with Flat Sources

Page 11: Learn Well Professional Classes - ETL Testing

Targets

o Configuring Targets in a Session

o Working with Relational Targets

o Working with File Targets

o Reject Files

Validation

o Validating Tasks

o Validating Worklets

o Validating Session

o Validating Workflows

Sending Email

o Working with Email Tasks

o Working with Post-Session Email

Workflow Monitor

o Using Workflow Monitor

o Customizing Workflow Monitor Options

o Working with Tasks and Workflows

o Using Gantt Chart View and Task View

Workflow Monitor Details

o Integration Services Properties

o Workflow Run Properties

o Worklet Run Properties

Page 12: Learn Well Professional Classes - ETL Testing

o Session Task Run Properties

o Performance Details

Session and Workflow Logs

o Log Events

o Log Events Window

o Working with Log Files

o Workflow Logs

Note: Lab sessions for all the points mentioned above will be taken.

Page 13: Learn Well Professional Classes - ETL Testing

Data warehousing Syllabus

Evolution of Datawarehousing - History

The need of Datawarehousing

Why Datawarehousing

What is Datawarehousing – The Definition

o Subject -Oriented

o Integrated

o Non – Volatile

o Time Varying

Datawarehousing Architecture

o Data Source Layer

o Data Extraction Layer

o Staging Layer

o ETL Layer

o Data Storage Layer

o Data Logic Layer

o Data Presentation Layer

o Metadata Layer

o System Operation Layer

Dimension table

Fact table

o Additive Facts

Page 14: Learn Well Professional Classes - ETL Testing

o Semi Additive Facts

o Non – Additive Fact

o Cumulative

o Snapshot

Attribute

Hierarchy

Types of Schema

o Star Schema

o Snow Flake Schema

o Fact Constellation Schema

Slow Changing Dimension

o SCD1 – Advantages/ Disadvantages

o SCD2 – Advantages/ Disadvantages

o SCD3 – Advantages/ Disadvantages

OLAP and OLTP

- Difference between OLAP and OLTP

- Types Of OLAP

o Multi-Dimensional (MOLAP)

o Relational(ROLAP)

o Hybrid(HOLAP)