UGF9944_Rittman

T : +44 (0) 1273 911 268 (UK) or (888) 631-1410 (USA) or +61 3 9596 7186 (Australia & New Zealand) or +91 997 256 7970 (India)

E : [email protected] : www.rittmanmead.com

UGF9944 Overview of Oracle BI Apps 11.1.1.7.1Mark Rittman, CTO, Rittman MeadOracle Openworld 2013, San Francisco, September 2013

Saturday, 28 September 13



About the Speaker

•Mark Rittman, Co-Founder of Rittman Mead•Oracle ACE Director, specialising in Oracle BI&DW•14 Years Experience with Oracle Technology•Regular columnist for Oracle Magazine•Author of two Oracle Press Oracle BI books•Oracle Business Intelligence Developers Guide•Oracle Exalytics Revealed•Writer for Rittman Mead Blog :http://www.rittmanmead.com/blog

•Email : [email protected]•Twitter : @markrittman


http://www.rittmanmead.com/blog

http://www.rittmanmead.com/blog

mailto:[email protected]




About Rittman Mead

•Oracle BI and DW Gold partner•World leading specialist partner for technical excellence, solutions delivery and innovation in Oracle BI

•Approximately 80 consultants worldwide•All expert in Oracle BI and DW•Offices in US (Atlanta), Europe, Australia and India•Skills in broad range of supporting Oracle tools:‣OBIEE, OBIA‣ODIEE‣Essbase, Oracle OLAP‣GoldenGate‣Endeca





What are the Oracle BI Applications?

•Pre-built and pre-integrated horizontal and industry-specific applications built around OBIEE•Provides pre-built ETL, conformed dimensional data warehouse, RPD and Catalog•Covers Oracle EBS, Peoplesoft, Siebel, SAP and Fusion Applications

IntegratedAnalytic Apps

•  Financials •  HR •  Procure & Spend •  Projects •  Supply Chain •  Order Management

•  Sales •  Marketing •  Service •  Contact Center •  Price •  Loyalty •  Hyperion Planning

•  Hyperion Close •  Budgeting & Forecasting •  Profitability Management

•  Communications •  Healthcare •  Retail •  Financial Services

Run 5-10X Faster Leverage Built-In

Best Practices




Oracle BI Applications Packaging

•BI Apps is sold as a series of analytic applications - Financial Analytics, HR Analytics etc•Vertical apps for pharma, banking etc also available•OBIEE, Oracle Database and ETL tool have to be licensed separately •Customers typically license 3-4 applications, then build out from there




Role-Based, “Best Practice” Dashboards and Reports

•BI Apps delivers an integrated RPD that maps DW structures into 3-layer OBIEE model•Can be customized or extended by the customer - design patterns and quick-start elements•Suite of “best practice” reports and dashboards, based around BI Apps analytic apps•Built on OBIEE 11g (since BI Apps 7.9.6.3), can also make use of BI Mobile, Scorecard, Essbase etc




Pre-Defined ETL Routines from EBS, PSFT, Siebel, JDE, SAP

• Integrated, conformed dimensional data warehouse•Deployable on Oracle, MS SQL, IBM DB/2 and Teradata•Uses embedded ETL tool (historically Informatica) to load data from sources to DW•Staging tables and presentation tables•Allows modular deployment•Lowest grain of information•Prebuilt aggregates •History tracking•Indexing




Oracle BI Apps 7.9.x and Earlier

•Historically, BI Apps has used Informatica PowerCenter as the embedded ETL tools‣Controlled and orchestrated by DAC (Data Warehouse Administration Console)

•“Loosely-coupled” integration that can be complex to set up, but otherwise works well•BI Apps ships with pre-defined INFA mappings, which are then called as tasks within execution plans

•This option will continue - but now there is also the option to use ODI 11g




Introducing Oracle BI Applications 11.1.1.7.1 and ODI 11g

•All-new, 11g release of the BI Applications•New content, applications, uptakes OBIEE 11g visuals etc•Simplified topology - now uses ODI 11g for the ETL‣Informatica support coming soon

•No DAC - uses web-based configuration tools, and ODI, to control and orchestrate the ETL

•Lower TCO, faster ETL, simpler architecture•So how does it all work...?




New Content in BI Apps 11.1.1.7.1

•Two new analytic applications:‣Student Information Analytics‣Indirect Spend Analytics

•New content for existing applications‣Financial Analytics‣HR Analytics‣Project Analytics etc

•Dashboards and analyses updated for 11g‣Performance tiles‣Trellis charts‣Hierarchical columns etc




BI Apps 11.1.1.7.1 Source System Support

* As of Jan 2013, from Oracle Product Roadmap presentation. Subject to change.




Migrating and Upgrading to BI Apps 11g

•BI Apps 11.1.1.7.1 is ODI-only, and for Apps Unlimited customers (i.e. EBS, PSFT, Siebel - not Fusion Apps)

•Future patch release will support Fusion Apps sources•Plan is to also offer BI Apps 11g with INFA•Going forward, ODI releases will first, INFAwill be a port of ODI mappings‣But INFA will still be supported going forward

•No upgrade to BI Apps 11.1.1.7.1, so ideally for:‣New implementations (e.g. “green field”)‣Re-implementations

* As of Jan 2013, from Oracle Product Roadmap presentation. Subject to change.




7.9.6.4 vs. 11.1.1.7.1 (and 11.1.1.7 ...)




7.9.6.4 vs. 11.1.1.7.1 (and 11.1.1.7 ...)

•So how does one choose between 7.9.6.x and 11.1.1.7.x for new implementations?




7.9.6.4 vs. 11.1.1.7.1 (and 11.1.1.7 ...)

•So how does one choose between 7.9.6.x and 11.1.1.7.x for new implementations?•At the moment, choice is driven by ETL tool preference‣If you want Informatica - go with 7.9.6.x‣If you want ODI - go with 11.1.1.7.x‣(and if you want to load from Fusion Apps - go with 11.1.1.7)




7.9.6.4 vs. 11.1.1.7.1 (and 11.1.1.7 ...)


•From 11.1.1.7.x PS2 onwards, Informatica should also be available




7.9.6.4 vs. 11.1.1.7.1 (and 11.1.1.7 ...)


•From 11.1.1.7.x PS2 onwards, Informatica should also be available•So then more down to known-and-tested vs. new-and-more-features




7.9.6.4 vs. 11.1.1.7.1 (and 11.1.1.7 ...)


•From 11.1.1.7.x PS2 onwards, Informatica should also be available•So then more down to known-and-tested vs. new-and-more-features•Going forward, 11g should support all sources, and both ETL tools‣So more down to ETL tool preference - though no easy way to switch later on‣And ODI will be Oracle development focus - Informatica mappings will be ports




Oracle BI Applications 11.1.1.7.1 Product Architecture

•All server-side BI Apps components now run withinWebLogic Server Domain

•Web-based apps for configuring and controlling the ETL process

•ODI agent runs within WebLogic domain, uses WLS security etc

•ODI Console embedded in web apps, used for web-based monitoring of loads

•ODI Studio available for developer tasks•No DAC - functionality now handled by ODI,Configuration Manager and FSM

•GoldenGate for trickle-feed loadinginto staging area / ODS




Taking a Closer Look...

1.Installation process2.New Administration Tools3.Post-Install Configuration4.How ODI11g replaces Informatica, and the Informatica Repository5.Creating and Executing Data Loads




As Detailed in Our OTN BI Apps “Cookbook”

• “Getting you started” article for BI Apps 11.1.1.7.1 on Windows x64•Cookbook style - step-by-step, minimal steps to get a working system•Written by Mark Rittman and Kevin McGinley•Available on OTN, at http://www.oracle.com/technetwork/articles/bi/mcginley-bi-apps-1993643.html


http://www.oracle.com/technetwork/articles/bi/mcginley-bi-apps-1993643.html






Installation Steps

1. Use RCU to create OBIEE repository tables2. Install OBIEE 11.1.1.7 using Enterprise Install type3. Run OBIA RCU to create DW schema, BIA schema,

ODI repository etc4. Install OBIA 11.1.1.7.1 incl. ODI into

OBIEE middleware home5. Apply OBIA patches6. Use Configuration Utility to extend WLS domain

to include OBIA applications7. Upgrade WLS to 10.3.68. Run post-install config scripts9. Configure ODI Studio to use WLS security




Configuration Manager, and Functional Setup Manager

•Functionality of the DAC has been passed to three products‣ODI - for details on mappings, dependencies etc‣Configuration Manager - for system-wide configuration‣Functional Setup Manager - for app-specific configuration

•Deep integration between the tools•Faster deployment and configuration




Use of ODI 11g as the Embedded ETL Engine

•ODI, rather than Informatica, is used as the embedded ETL engine•Individual mappings are grouped into scenarios, equivalent of workflows in Informatica

•Scenarios are then orchestrated into load plans, the equivalent to execution plans in the DAC

•ODI uses the target DW (Oracle initially) for ETL‣Actually “ELT”, for extract-load-transform

•ODI agent controls the process - equivalent to DAC server

•Configuration metadata is held in the ODI repository, and in repository tables used by CM and FSM




Leveraging Core ODI Functionality

•Oracle Data Integrator 11g is used as the embedded data loading tool for the BI Apps•Uses core ODI functionality - interfaces, scenarios, load plans, topologies, agents etc•ODI Studio can be used to view ETL internals, or just manage through web-based tools•Uses ODI versioning for customization, ODI release mgmt etc




Inside the ODI BI Apps Repository

•BI Apps “Adapters” become Projects withinthe ODI work repository

• INFA workflows / DAC tasks becomescenarios, mapping to one or more interfaces

•Data source connections stored in ODI masterrepository, viewed in Topology navigator

•Execution plans become load plans•ODI versioning used when customizations are made, instead of creating new adapters

•Groupings of facts and dimensions are definedin Configuration Manager, which has its ownrepository tables (BIACM)




Initial Configuration, Data Sources and Domain Value Load

•Several steps need to be performed before a full data load can take place1.Select products to enable2.Define source systems (EBS etc)3.Create data source connections4.Load domain values (account codes etc) from source into DW

•Performed using Config. Manager and FSM•All settings automatically pushed-through to ODI repository‣JDBC connection details to ODI repository‣File locations, etc.




Fact Groups - Equivalent to DAC Subject Areas

•BI Apps 7.9.x had the concept of subject areas and execution plans, within the DAC•Allowed groups of facts + dimensions to be selected, and then loaded in the correct sequence

•Handled dependencies, running steps in parallel, restarting etc

• In BI Apps 11.1.1.7.1, this is now handled through fact groups, and load plans

•A set of fact tables for a particular subject area•Link to their dimensions using FKs•Load plans are generated on-demand (equivalent to execution plan build step), and sequence ODI scenarios that are linked to the fact tables in the ODI metadata




The Load Plan Generator

•Load Plan Generator (LPG) is a JEE library installed into the WebLogic Domain alongside OBIEE, CM etc

•Automatically generate the optimal load plan for a set of fact groups•Called from the Configuration Manager web interface, or by developers as a plug-in to ODI Studio

•Uses fact > dimension FK relationships, and then links back to staging tables and temp tables, to create the required load plan




Automatic Population of Domain Values

•Uses special type of load plan called a “Domain-Only Extract and Load (SDE and SIL)”•Retrieves flexfield and other values from EBS, PSFT etc and automatically populates BIA metadata tables - no need to manually complete CSV files

12

3




Initiating, and Viewing the Status of, Load Plans

•BI Apps load plans are generated, and then initiated, from Configuration Manager•Once initiated, status can be monitored either in CM, or in ODI Studio•View ETL failure reasons, see error codes, restart from point of error

1

2

3




Performing a Full Data Load Step 1 : Create Load Plan

•Similar to creating a domain values load plan - select fact groups, generate new load plan•Relies on “offerings” (applications) being enabled at an earlier stage•First stage is to generate this load plan, like the “build” phase for DAC execution phases•But no need to get involved with parameters etc - all handled behind the scenes




Performing a Full Data Load Step 2 : Execute Plan

•New load plan executed through Configuration Manager (or to a schedule)•Creates new instance of the load plan within ODI repository•View progress of load plan in CM, in ODI Console, or ODI Studio




Performing a Full Data Load Part 3 : Deal with any ETL Issues

•Data loads can fail for a number of reasons‣New data that causes key constraints, data out of range, duplicates‣Out of tablespace datafile etc

•ODI load plans are restartable, can raise exceptions, showdebug information from within ODI Studio Operator‣Less log files to look through‣Obvious to ODI developers what the issue is‣Straightforward way to write exception handling code,to for example extend datafiles, raise alerts etc

•Once issue addressed, just restart load plan‣Automatically resumes from failed step




BI Apps 11.1.1.7.1 and GoldenGate

•Oracle’s cross-platform data replication (CDC) solution•Creates new data layer called “Source-Dependent Staging”‣Replica of source tables, held locally to BI Apps and with GG/ODI journaling

•Near-zero impact of ongoing data extraction‣No ETL batch load windows required‣Full reload without touching source

•Consistent CDC approach regardless of source•Potentially reduced ETL runtimes‣Transforms and loads all performed locally‣Near real-time ETL possible, & 24x7 deployments‣Great enabler for cloud deployments

•Trickle-feed of data updates over WAN




Thank You for Attending!

•Thank you for attending this presentation, and more information can be found at http://www.rittmanmead.com

•Contact us at [email protected] or [email protected]•Look out for our book, “Oracle Business Intelligence Developers Guide” out now!•Follow-us on Twitter (@rittmanmead) or Facebook (facebook.com/rittmanmead)


http://www.rittmanmead.com










UGF9944 Overview of Oracle BI Apps 11.1.1.7.1Mark Rittman, CTO, Rittman MeadOracle Openworld 2013, San Francisco, September 2013


Documents

UGF9944_Rittman