Download ppt - Free One Day Business Intelligence Workshop

Free One Day Business Intelligence Workshop for IT Professionals(Together we can fight recession by helping each other in the community)

May 09 2009 (9.30 AM – 3.30 PM)

Welcome

Agenda

1. Welcome and Introductions (9.30 - 9.45 AM)

2. Information Age Demo – (9.45 - 10.00 AM)

3. Introduction Data/Information Lifecycle Management & Business Intelligence Concepts – Praveen Moturu (10.00 – 10.30 AM)

4. Introduction to Data Warehouse Lifecycle and Concepts - Sri Tripurani (10.30 - 11.00 AM)

5. Business Intelligence - ETL and BO Technical Overview and Case Study Demo - Sashi - (11.00 - 12.30 PM)

6. 12.30 - 1.30 PM - Lunch

7. Business Intelligence - Reporting - Cognos Technical Overview and Case Study Demo - Srikanth (1.30 - 3.00 PM)

8. Job Counseling and Expert Advise - 3.00 to 4.00 PM (Shree, Raj Kavuru, Subba Rao Inampudi, Srikanth & Sashi)

Welcome and Introductions

SME Contacts

Sri Tripurani (Data Warehousing, ETL, ODS)

Wachovia Securities

Brokerage Data Management - ODS Team

Office - 312.574.5933

Cell - 630.803.4231

Email - [email protected]

Pager- [email protected]

Srikanth Danda (Cognos 8.x)

Cognos BI Consultant

Blue Cross Blue Shield

Chicago, IL

Desk: 312-653-6591

Mobile: 405-473-1544

[email protected]

Gayatri Kalluri (Data Warehousing/BI)630.205.3069

Sashi Palavalla (Business Objects & Informatica)Cell: (924) 635 [email protected]

mailto:[email protected]

mailto:[email protected]

Chicago Telugu Association (CTA)

About Chicago Telugu Association (CTA)• A non-profit organization primarily focused to provide community service for Telugu Community in

and around Chicago Land.

Some of the programs and services CTA plans to organize and promote include:• Skills Development & Training, Leadership Development Sessions, Immigration Help• Health Awareness including Yoga Sessions & Physical Education, Spirituality Activities • Medical Camps, Medical Camps and Screening • Employment Help, Student Support Services, Job Counseling, Support Services for Students• Urgent Need - Provide possible help during special situations by bringing community together in

responding to the needs of people.• Helpline Services -Toll Free Number • Telugu Festival objective is to bring telugu people in and around Chicago

Telugu Festival – July 2nd Evening (keeravani Musical Night) and July 3rd Day and EveningPrograms (Local Talent followed by Tollywood Star Show Night)

The main objective of this conference is to bring the telugu community in and around Chicago together

for fun and entertainment and raise funds for CTA to provide services to the Telugu Community in and

around Chicago

Information Age Demo

Role of Information – Future State

Introduction

Data/Information Lifecycle Management &

Business Intelligence Concepts

Praveen Moturu (10.00 – 10.30 AM)

Information/Data

Data: Recording of events, actions, facts in Numbers and Letters.

Raw facts, stored out of context and without semantic meaning. Bits and BytesRepresentation in terms of IT

Data are often viewed as a lowest level of abstraction from which information andKnowledge are derived.

Information: Processed Data used to provide Context

Data in context – meaning, format, timeframe, relevanceEx: Customer Address

Data/Information Format

Structured Content: ex: Data adhering to a well defined schema/modelSemi Structured Content: ex: MS Word, PDF, HTML, XML Un Structured Content: ex: TIFF, GIF, IMG, etc

http://en.wikipedia.org/wiki/Information

http://en.wikipedia.org/wiki/Knowledge

Information/Data Management – Big Picture

.)

External Information**

External Information

Internal Reporting

External Reporting

Metrics

MD

M

Governance/Stewardship

Data Access

EDW

DM

ETL

MetaData

ODS

ECM OM

Applications

BusinessPurpose

BusinessPurpose

SourceSystems

External Information**

Definitions

• Data Warehouse (DW): An integrated, centralized, historical, relational database and the related software used to collect, cleanse, transform and load data from a variety of operational sources for reporting and analysis by business professionals.

• Data Mart: A database of aggregated and summarized historical data typically focused on a specialized subject area for reporting and analysis by business professionals. A data mart may be may be independent, or part of a larger data warehousing environment and fed from a data warehouse (dependent).

• Business Intelligence (BI): Knowledge workers (executives, managers, staff) using information to answer the questions that inform business decisions (formerly known as decision support).

• Business Intelligence Environment: The information, support, tools and technology that enables knowledge workers to find the answers they need.

• Business Intelligence Management: Providing the information, technologies & support knowledge workers need to find the answers that inform business decisions.

Data Management Lifecycle Activities

Data Analysis &

Minning

Data Profiling

Data Quality

Data Auditing

Data Metrics

Data Extraction, Transformation, Loading

CREATE, READ, UPDATE, DELETE (CRUD)

Data Backup, Retention, Purge,

Data Modeling(Relational/Dimensional Models)

(Conceptual, Logical & Physical Models)

What is Business Intelligence

• Business Intelligence (BI) is about getting the right information, to the right decision makers, at the right time.

• BI is an enterprise-wide platform that supports reporting, analysis and decision making.

• BI leads to:– fact-based decision making– “single version of the truth”

• BI includes reporting and analytics.

• What happened?

• What is happening?

• Why did it happen?

• What will happen?

• What do I want to happen?

PAST – CURRENT- FUTURE

Business Intelligence Applications

• Ad Hoc Query & Reporting• Enterprise Reporting• OLAP – Online Analytical Processing

– Desktop Cubes– MOLAP– ROLAP

• Statistical Analysis• Data Mining (pattern identification, predictive analysis)• “What If” Modeling & Forecasting• Analytical Applications (e.g., budgeting, sales force

analysis)• Dashboards and Scorecards• Business Performance Management• Executive Information Systems

BI Concepts

• BI Types– Scheduled & Adhoc Reports based on users– Dashboards, Scorecards, Alerts, Query, & Analysis with drilldown Capability, lineage derivation capabilities

Information/Data Big Picture

ETL

ETL

ETL

Information/Data Lifecycle End to End

Introduction

Data Warehouse Lifecycle & Concepts

Sri Tripurani(10.30 – 11.00 AM)

Data Warehouse Life Cycle

• In early 1990s Data Warehousing practice been based on assumption that,

– From a design perspective, once in production data warehouses and data marts were essentially static.

– Data warehouse change management practices were fundamentally no different than those of other kinds of production systems.

Data Warehouse Life cycle

According to W.H. Inmon

–The classical system development life cycle (SDLC) does not work in the world of the DSS analyst.

–The SDLC assumes that requirements are known at the start of the design (or at least can be discovered).

–However, in the world of the DSS Analyst, requirements are usually the last thing to be discovered in the DSS development life cycle


Dimensional schema design methodology

•One of the earliest – and to this day the most effective

•Interacts with the business users at business process level to design star schemas

•The population of those star schema was then largely a technical matter of matching available data elements in transactional source systems to the designed schema, creating or synthesizing data elements when they were not available natively in the systems of record.


Design

Deploy

Enhance

Operate

Prototype

Although specific vocabularies vary from organization to organization, the datawarehousing industry is in agreement that the data warehouse lifecycle model is fundamentally as described in the diagram below.


Although specific vocabularies vary from organization to organization, the datawarehousing industry is in agreement that the data warehouse lifecycle model is fundamentally as described in the diagram below.


Design phase • The development, from both available data inventories and business

analyst requirements and analytical needs, of presentation layer views or robust star-schema-based dimensional data models

Key activities • End-user interview cycles.• Source system cataloguing, definition of key performance indicators

and other critical business metrics.• Mapping of decision-making processes to the underlying information

needs.• Logical and physical schema design tasks, which feed the

prototyping phase of the lifecycle model quite directly.


Prototype phase • The deployment, for a select group of opinion-makers and leading

practitioners in the end-user analytical communities, of a populated, working model of a data warehouse or data mart design, suitable for actual use.

Key activities • Prototyping shifts might occur, as the design team moves back and

forth between design and prototype.• As the gap between stated needs and actual needs closes over the

course of 2 or more design-prototype iterations, the purpose of the prototype shifts toward diplomacy – gaining commitment to the project at hand from opinion leaders.


Deploy phase • The formalization of a user-approved prototype for actual production

use, including the development of documentation, training, operations and management processes and the host of activities traditionally associated with enterprise IT system deployment.

Key activities • Typically involves at least two environments.• Deployment into Non-Production environment (Test)• Deployment into Production environment• Production support and End user documentation is completed.• End-user training


Operation phase • The day-to-day maintenance of the data warehouse or data mart,

the data delivery services and client tools that provide business analysts with their access to data warehouse and data mart data

Key activities • Management of ETL process.• From batch processing to real-time data processing• Keep Data Warehouse current with respect to source system


Enhancement phase • The modification of logical schema designs in response to changing

business requirements, operations and management processes (ETL and Scheduling), and physical technological components.

Key activities • External business conditions change discontinuously, or

organizations themselves undergo discontinuous changes (as in the case of asset sales, mergers and acquisitions)

• Enhancement moves seamlessly back into fundamental design.


Data Life Cycle

•Data becomes active as soon as it is of interest to an organization.

•Data life cycle begins with a business need for acquiring

data. •Active data are referenced on a regular basis during day-to-day business operations. •Over time, this data loses its importance and is accessed less often, gradually losing its business value, and ending with its archival or disposal.



Active Data•Active data is of business use to an organization.

•The ease of access for business users to active data is an absolute necessity in order to run an efficient business.

•The simple, but critical principle, that all data moves through life-cycle stages is key to improving data management.


Active Data•By understanding how data is used and how long it must be retained, companies can develop a strategy to map usage patterns to the optimal storage media, thereby minimizing the total cost of storing data over its life cycle.

•The ideal solution is to manage data stored in relational databases as part of an overall enterprise data

management solution.


Inactive Data

•Data are put out to pasture once they are no longer active. i.e. there are no longer needed for critical business tasks or analysis.

•Prior to the mid-nineties, most enterprises achieved data in Microfilms and tape back-ups.

•There are now technologies for data archival such as Storage Area Networks (SAN), Network Attached Storage (NAS) and Hierarchical Storage Management

Business Intelligence

ETL and Business Objects Technical Overview and Case Study

Sashi Palavalla(11.00 - 12.30 PM)

What is Business Intelligence?

• Business intelligence is a way of exploring data to improve business performance, whether to drive profitability or to manage costs.

• Business intelligence often aims to support better business decision-making, so BI system can be called as Decision Support System (DSS)

What is Data Warehouse

• Data warehouse is a repository of an organization's electronically stored data.

• Data warehouses are designed to facilitate reporting and analysis

• Data warehouse was the biggest enabler for successful BI implementation

• Data warehouse extracts information from the transactional/ERP systems and aggregates it to allow for fast analysis of vast amounts of data

Difference b/w transaction & DW

ERP/Transaction System Data Warehouse / Data Mart

Goal to process the day to day transactional data

Goal is to provide access to information

Current Information with very little history

Larger amount of history allow multiyear trend analysis

Normalized tables in thousands (3NF)

Denormalized star and snowflake schemas with fewer tables

Fast inputs, but slow queries Read only; tuned for fast queries

Informatica Power Center

Data Integration/ETL Tool

Informatica Power Center

Power Center is an ETL/Data Integration tool

‘E’ Extraction

‘T’ Transformation

‘L’ Load

Power Center utilizes mappings to perform ETL

Power Center Sources

PowerCenter accesses the following sources: Relational: Oracle, Sybase ASE, Informix, IBM DB2, Microsoft SQL

Server, and Teradata File: Fixed and delimited flat file, COBOL file, XML file, and web log Application: Hyperion Essbase, WebSphere MQ, IBM DB2 OLAP

Server, JMS, Microsoft Message Queue, PeopleSoft, SAP NetWeaver, SAS, Siebel, TIBCO, and webMethods

Mainframe: Mainframe databases such as Adabas, Datacom, IBM DB2

OS/390, IBM DB2 OS/400, IDMS, IDMS‑X, IMS, and VSAM. Other: Microsoft Excel, Microsoft Access, and external web services.

Power Center TargetsPowerCenter can load data into the following targets: Relational: Oracle, Sybase ASE, Sybase IQ, Informix, IBM DB2,

Microsoft SQL Server, and Teradata. File: Fixed and delimited flat file and XML. Application: You can purchase additional PowerExchange products to

load data into business sources such as Hyperion Essbase, WebSphere MQ, IBM DB2 OLAP Server, JMS, Microsoft Message Queue, mySAP, PeopleSoft EPM, SAP BW, SAS, Siebel, TIBCO, and webMethods.

Mainframe: You can purchase PowerExchange to load data into

mainframe databases such as IBM DB2 for z/OS, IMS, and VSAM. Other: Microsoft Access and external web services.

Transformations in Informatica

Source qualifier

Aggregate

Sequence generator

Sorter

Router

Filter

Expression

Stored Procedure

Lookup

Update strategy

Joiner

Normalizer

HTTP Transformation

XML Parser

XML Generator

Java Transformation

SAP Business objects

Business Intelligence Reporting Tool

What is Business Objects ?

• BO is an integrated query, reporting and analysis solution

• Allows you to access the data in your corporate data bases

• Present and analyze this information in a BUSINESS OBJECTS reports

Why Business Objects popular?

• 16 years ago Business Objects came up with a simple but profound idea: “semantic layer” or “Universe”

BO Universe

• Universe is a business representation of your data warehouse or transaction database

• It shields users from the underlying complexities of the database schema

• It is the single greatest component which will make your implementation succeed or fail.

• To build a successful universe, keep it simple

Universe Components

• Parameters that define database connectivity and SQL options

• Classes and objects that users see when building queries and reports

• Tables that are pointers to the physical tables in the database

• Joins that define the relationships between the tables

Classes and Objects

• A class is a logical grouping of objects within a universe.

• An object is a named component that maps to data or a derivation of data in the database.

• There are 3 types of objects in BO

Types of Objects

• Dimension: Parameters for analysis Dimensions typically relate to a hierarchy such as geography, product, or time. For example: Last Name and City_Id

• Description: Provide a description of a dimension example: Month name

• Measure: Convey numeric information which is used to quantify a dimension object. For example, Sales Revenue

Important Modules in Business objects

• Designer• Info view• Webi• Deski• Central Management Console

Designer

• Tool to create and manage Universes

• This tool is for Universe developers

Info view

• It is portal in BO.

• Information consumers who want to view and refresh standard reports but who don’t need to build their own.

• Reports can include those built in Crystal Reports, Web Intelligence, Desktop Intelligence

Web Intelligence (webi)

• This is thin client to create and manage reports

• Can create reports only from Universes

• Business authors uses this tool to design shared reports or ad hoc queries and analyses

Desktop Intelligence (Deski)

• This is thick client installed on desktop

• Can create reports from universe, free hand sql, stored procedure, personal files

• Power users who want to design more complex reports for disconnected access

Central management console

• For creating users , user groups and privileges

Some other BI Tools

• Cognos

• MicroStrategy

• Oracle Business Intelligence

• Hyperion

Required skills to BO Developer

• Business Objects, Crystal Reports

• Oracle or DB2

• SQL, PL/SQL, SQL query tunning

• Knowledge of 3NF, Dimensional Modeling (Star schema and Snowflake schema)

• Knowledge of Data warehousing

Lunch

12.30 – 1.30 PM

Business Intelligence & Reporting

Cognos Technical Overview and

Case Study

Srikanth Danda (1.30 - 3.00 PM)

IntroductionCognos 8 is a solution designed to address the challenges of enterprise-scale reporting, analysis, scorecarding, and event notification.

The Web-based Cognos 8 architecture was designed for scalability, availability, and openness. It uses platform independent, industry proven technology, such as Extensible Markup Language (XML), Simple Object Access Protocol (SOAP), and Web Services Definition Language (WSDL). For this reason, Cognos 8 can integrate with and leverage your existing technology infrastructure on multiple platforms.

The Cognos 8 architecture features a consistent, zero footprint, Web-based user interface for viewing, creating, and administering reports, analyses, scorecards, and events. It has a common dispatcher and supports leading relational databases as well as OLAP (Online Analytical Processing) and dimensionally modeled relational cubes. It ensures dynamic load balancing and provides failover recovery for 24 x 7 operation. It also provides a single point of administration, as well as Web-based delegated administration. Cognos 8 is fully open to third-party products and custom development. It also integrates with Web farms and supports multilingual reporting and scorecarding.

Cognos Architecture

OLTP ODSODS ODS

Packages, cubes and Reports

Frame Work Manager, Power Play Transformer, Metrics Manager

Report Studio, Query Studio, Analysis Studio

ETL

Cognos Development Work Flow

Cognos Security

Cognos Connection Home Page

Frame Work Manager

Query Studio

Query Studio

Query Studio

Query Studio

Report Studio

Report Studio

Report Studio

Report Studio

Report Studio

Report Studio

Analysis Studio

Report Studio

Report Studio

Report Studio

Report Studio

Report Studio

Report Studio

Report Studio

Report Studio

Report Studio

Report Studio

Job Counseling and Expert Advise - 3.00 to 4.00 PM

(Shree, Raj Kavuru, Subba Rao Inampudi, Srikanth Danda &

Sashi Palavalla)

Useful Tips for Interviews

Job Finding Tips• Build network using LinkedIn, Facebook, etc..• Prepare to extend your boundaries and explore for all possible opportunities. (No opportunity is

small)• Communicate and keep in touch with your friends and never burn relationships/bridges with

current company when you leave a job.

Resume Tips• Create your resume to be not more than 3 pages.• First page is very important and remember your resume says a lot about you and will help you to

be shortlisted.• Prepare to talk on all content on your resume.

Interview Tips• Make sure to carry copies of your resume to the interview.• Never go too early, if you arrive early do not rush to the interviewer rather wait for your time and

then contact them at the mentioned time.• Dressing is key and dress well.• Remember that the current interview is not your last interview in life so be patient and settled

rather than getting tensed.• Answer all questions with honesty and give examples related to your experience as required.• Also follow up after your interview with an email and thank the interviewer for the opportunity and

time.

Thank You Please send your feedback & questions to

[email protected]

Please visit our web site for more info on all future events and volunteer opportunities

www.chicagoteluguassociation.org