1214 deploying rational insight in a heterogenous environment

IBM Innovate 2012Deploying Rational Insight in a Heterogeneous Environment

Marc J. Nehme, Rational Reporting EngineerPaulo Cezar Lacerda Neto, Rational IT SpecialistSession# 1214

© 2012 IBM Corporation2

The Premier Event for Software and Systems Innovation

Agenda

� Key Takeaways

� Challenges in Enterprise Reporting

� Rational Insight

� Topology & Integrations

� Demo

� Business Intelligence

� Best Practices & Lessons Learned

� Q & A



Key Takeaways

� Rational Insight’s ability to be deployed in a heterogeneous environment through wide-range compatibility with various third-party vendors

�Rational Insight’s ability to provide industry-leading business intelligence with timely and accurate metrics, via reports and dashboards, from a collection of Rational and third-party solutions

�Rational Insight Best Practices and Lessons Learned with Rational Insight including performance enhancements, time savings, suggestions, and helpful tips



Organizational Reporting Challenges

� Organizational process� Different departments, different processes, not unified� Roll-up of data doesn't compare well� Lack of visibility into organization metrics

� Various disparate data sources

� Individual product reporting� Lack of functionality/customization

� Training & Resources� $$$

� Manual process

� High Level of effort / Time consuming� $$$

� Inaccurate / unreliable data

� Outdated metrics



Rational Insight

� IBM Rational’s Performance Measurement Offering

� An Enterprise Reporting solution that gets consistent metrics from across an organization to objectively measure status and progress

� Measure program, project, and team-level progress against pre-defined business objectives through multiple views

�Identify high-priority items and Become notified of high-severity items

�Report & Dashboard elements viewable via� Web browser� iPads� Mobile phones� MS Office, PDF� Any tool that is JSR168 compliant



Key Benefits

� Automation � Increased Reliability

� Versatile Integration support

� Cross-product reporting� Traceability

� Trending & historical data (DW model)� Real-time data (Live model)

� Web-based tool

� Custom/Interactive dashboards (Business Insight)

� OOTB Collateral� XML data mappings� ETL fact builds, dimension builds, jobs � Framework Manager projects� Data Warehouse structure� Reports and Dashboards



Architecture

� Based on Cognos 10 BI platform, industry proven technology

� Leverages web architecture

�Integration Options� REST service (adapter)� REST service (native)� Direct DB access� ODBC access� Generic XML

� Very open architecture and wide-range compatibility



Deployment Topology

InsightReport Server

RHEL 5.4 x64

InsightETL ServerRHEL 5.4 x64

Insight Developer 1Windows 7 x64

Insight Dev ToolsOracle 11G client

Insight Developer 2Windows 7 x64

Insight Dev ToolsOracle 11G client

OracleContent Store

Data WarehouseETL Catalog

Database Server

CLM 3.0.1.1Windows 08 x64

DB2

Development

CLM 3.0.1.2RHEL 5.8 x64

DB2

SubversionSCM data

Windows 08 x64

ExcelResource DataSpreadsheet



Rational Insight Integration



Insight integration with IBM CLM – JTS #1

� Leverages CLM’s native REST service� Key benefit: OSLC compliant

� Insight communicates directly with the CLM point product APIs to extract data � Key benefit: Any CLM database changes are transparent to Insight’s configured ETL jobs

https://qvmw174.ratl.swg.usma.ibm.com:9443/qm/secure/service/com.ibm.rqm.integration.service.IIntegrationService/resourc

es/JKE+Banking+%28Quality+Management%29

Project Name




� XML Mapping from CLM (e.g. RQM) to Insight




� From CLM, a User exports pre-configured XML mappings, ETL jobs, Framework model and report designs and imports them into Insight

� Key benefit: Allows users to get deployed and realize value quickly (plug & play)




� Insight configured to JTS authentication� Key benefit: No need to manage additional authentication mechanism� Users will only see the data in Insight that they have access to in CLM

�Single Sign-On Support� Key benefit: One login to CLM will be inherited to Insight and vice-versa




� Leverages REST service integration � Key benefit: OSLC compliant

� Insight communicates directly with the CLM point product APIs to extract data� Key benefit: Any database changes are transparent to Insight’s configured ETL jobs

� From CLM, a User imports pre-configured XML mappings, ETL jobs, Framework model and report designs into Insight

� Key benefit: Allows users to get deployed and realize value quickly

� Note: Integrating with multiple JTSs changes the way you setup authentication� Note: The importing of multiple JTS/CLM deployment artifacts scenario varies

depending on what versions of CLM you are running



Insight integration with Subversion

� SVN log extracts repository data to XML file� Use shell script to automate the extraction from SVN to XML file




�Insight integrates directly with the XML file using XML ODBC Driver� Key benefit: Same tool, same process using XDC as CLM




� Extracting SVN data and loading into Insight (ETL)� Key benefit: Reuse existing ETL, Data warehouse, Framework collateral OOTB



Insight integration with Excel

� Leverages ODBC Connectivity via MS Excel Driver

� Simplistic setup

� Use the “Define Name” function to simulate database tables



What does all this data mean?

How can I make intelligent decisions based on this data?

Have I realized Business Intelligence?





Enterprise ReportingIn

Rational Insight



The Power of Enterprise Reporting in Insight

Executive Dashboard Views




Traceability




Trending




Drill-throughs for Lower Level Detail Visual Alerts




Versatile & Customizable Solution

Custom Attributes & Categories

� Customize Insight to report on your custom fields� Operational data� Data Marts (trending)



Best Practices&

Lessons Learned



Best Practices & Lessons Learned

Environmental Limitations

� Insight Developer tools require a Windows machine

� Installing Insight on Linux requires an installation of a unixODBC driver (using 32-bit libraries) to support the RQM Live reporting functionality

� Cognos Data Manager Network Service is not supported under 64-bit architecture� All other Data Manager components can run using 32-bit engine

� Oracle client must be 32-bit architecture – installed using “Administrator install”option




Using Oracle as DBMS for Insight

� Confirm 32-bit library installation

� Confirm System environment variables are set correctly

� Confirm Websphere Application Server environment entries are set correctly

� Oracle & Redhat library dependencies




Data Warehouse Query Optimization in Oracle

� Problem: As a data warehouse increases in size, one may face some performance problems with querying

� Solution: Create a bitmap index

� Result: The majority of the star queries running in the data warehouse will use a query execution strategy known as the star transformation. The star transformation provides very efficient query performance for star queries.

CREATE BITMAP INDEX F_TXTF_CHGMET_BIXON RIDW.F_TEXT_FILE_INCIDENTE_METRICS(PROJECT_ID)LOCAL NOLOGGING COMPUTE STATISTICS;




Insight / JTS Security Mechanism

� Insight can be configured with multiple namespaces, however only one Jazz namespace, one JTS (currently)

� Solution: Configure Insight’s security mechanism directly to the organization’s company-wide authentication system (e.g. LDAP)

� Drawback: You will lose the single sign-on capability between Insight & CLM tools

� Drawback: You must account for the security check difference

� With JTS authentication, Insight uses ‘Email’ against REFERENCE_ID

� With LDAP authentication, Insight uses ‘Full_Name’

� Potential Solutions:

� Modify the VW_PROJECT_RESOURCE_LOOKUP (view in database)

� Modify the ‘Contributor’ CLM ETL fact to load the ‘Full_Name’ into the ‘Reference_ID’




Managing Multi-JTS Insight collateral (with differe nt versions)

� XDC, ETL, FM

� Import both 3.0.1.1 & 3.0.1.2 collateral

� Drawback: Some manual manipulation

� Drawback: Two sets of collateral to maintain

� Positive: Multi-JTS is still achievable




Adding RICALM Schema to Insight Data Warehouse

� You need to point CLM to RIDW database

� Comment: We should provide an alternative method (e.g. script) that does this as a manual option




Avoiding Duplicate Entries for Dimension data in Di fferent Sources

e.g. Project Name




Avoiding Duplicate Entries for Dimension data in Di fferent Sources

� Leverage the mapping tables in Data Manager




Excel

� If the number of rows or columns increase, that data will be excluded from extract

� Solution: Increase the span of the table in Excel to include these new rows

� Drawback: A very manual process




CLM Data Dictionary

� Use this to understand how the CLM data maps to the Insight data model




Resource Allocation

� Identify a minimum of two people to own/manage the deployment

� Developer – Back end work: product integration, data extraction, data transformation, Data Warehouse loading, Data modeling

� This person could also play the role of Administrator

� Report Author – Front end work: Dashboard/report designs, everything the end user will see



www.ibm.com/software/rational



Daily iPod Touch giveaway

� Complete your session surveys online each day at a conference kiosk or on your Innovate 2012 Portal!

� Each day that you complete all of that day’s session surveys, your name will be entered to win the daily IPOD touch!

� On Wednesday be sure to complete your full conference evaluation to receive your free conference t-shirt!



© Copyright IBM Corporation 2012. All rights reserv ed. The information contained in these materials is provided for informational purposes only, and is provided AS IS without warranty of any kind, express or implied. IBM shall not be responsible for any damages arising out of the use of, or otherwise related to, these materials. Nothing contained in these materials is intended to, nor shall have the effect of, creating any warranties or representations from IBM or its suppliers or licensors, or altering the terms and conditions of the applicable license agreement governing the use of IBM software. References in these materials to IBM products, programs, or services do not imply that they will be available in all countries in which IBM operates. Product release dates and/or capabilities referenced in these materials may change at any time at IBM’s sole discretion based on market opportunities or other factors, and are not intended to be a commitment to future product or feature availability in any way. IBM, the IBM logo, Rational, the Rational logo, Telelogic, the Telelogic logo, and other IBM products and services are trademarks of the International Business Machines Corporation, in the United States, other countries or both. Other company, product, or service names may be trademarks or service marks of others.

www.ibm.com/software/rational



Acknowledgements and disclaimers

© Copyright IBM Corporation 2012. All rights reserve d.

– U.S. Government Users Restricted Rights - Use, dupli cation or disclosure restricted by GSA ADP Schedule Contract with IBM Corp.

IBM, the IBM logo, ibm.com, Rational, the Rational logo, Telelogic, the Telelogic logo, Green Hat, the Green Hat logo, and other IBM products and services are trademarks or registered trademarks of International Business Machines Corporation in the United States, other countries, or both. If these and other IBM trademarked terms are marked on their first occurrence in this information with a trademark symbol (® or ™), these symbols indicate U.S. registered or common law trademarks owned by IBM at the time this information was published. Such trademarks may also be registered or common law trademarks in other countries. A current list of IBM trademarks is available on the Web at “Copyright and trademark information” at www.ibm.com/legal/copytrade.shtml

If you have mentioned trademarks that are not from IBM, please update and add the following lines:

[Insert any special third-party trademark names/attributions here]

Other company, product, or service names may be trademarks or service marks of others.

Availability : References in this presentation to IBM products, programs, or services do not imply that they will be available in all countries in which IBM operates.

The workshops, sessions and materials have been prepared by IBM or the session speakers and reflect their own views. They are provided for informational purposes only, and are neither intended to, nor shall have the effect of being, legal or other guidance or advice to any participant. While efforts were made to verify the completeness and accuracy of the information contained in this presentation, it is provided AS-IS without warranty of any kind, express or implied. IBM shall not be responsible for any damages arising out of the use of, or otherwise related to, this presentation or any other materials. Nothing contained in this presentation is intended to, nor shall have the effect of, creating any warranties or representations from IBM or its suppliers or licensors, or altering the terms and conditions of the applicable license agreement governing the use of IBM software.

All customer examples described are presented as illustrations of how those customers have used IBM products and the results they may have achieved. Actual environmental costs and performance characteristics may vary by customer. Nothing contained in these materials is intended to, nor shall have the effect of, stating or implying that any activities undertaken by you will result in any specific sales, revenue growth or other results.

Technology

1214 deploying rational insight in a heterogenous environment