How to work with BI Monitoring - SAP · How to work with BI Monitoring ... Central monitoring of Business Objects ... BO server types and SAP BO metric

How to work with BI Monitoring

© 2011 SAP AG. All rights reserved. 2

Disclaimer

This presentation outlines our general product direction and should not be relied on in making a purchase decision. This presentation is not subject to your license agreement or any other agreement with SAP. SAP has no obligation to pursue any course of business outlined in this presentation or to develop or release any functionality mentioned in this presentation. This presentation and SAP's strategy and possible future developments are subject to change and may be changed by SAP at any time for any reason without notice. This document is provided without a warranty of any kind, either express or implied, including but not limited to, the implied warranties of merchantability, fitness for a particular purpose, or non-infringement. SAP assumes no responsibility for errors or omissions in this document, except if such damages were caused by SAP intentionally or grossly negligent.


Agenda

This demo introduces the BI Monitoring application and shows how to work with the below mentioned BI Monitoring applications.

oIntroduction

oBI Overview Monitor

oSystem Monitoro BO WebApp Systemso BO Server Systemso BW ABAP/Java Systems

oBI Detail Monitorso BO Job Monitoro BW Process Chain Monitoro BW Report Monitor


Introduction - Monitoring for Business Intelligence

SAP Solution Manager

BI Overview Monitor

System Monitor

Central system status overview for all technical components involved in SAP Business Intelligence SolutionCapability to monitor cross-systemSAP BW process chains and single process chain steps

Integration of Business Intelligence specific alerts in Alert Inbox including Notification Management, Incident Management, Task Assignment and forwarding to 3rd party

Central monitoring of Business Objects specific jobs and correlation to system specific metrics

Central monitoring of SAP BW queries and templates

BI Detail Monitors


Introduction – Monitored BI scenario and objects

Backend Systems/ Data Sourcese.g. SAP ERPSAP BI Platform Systems

(BusinessObjects Enterprise)

BO Jobs

Reports

SAP DataWarehouse Systems(SAP BW)

Process Chains

Queries / Templates

Infoobjects

BO Web ApplicationServer Systems

BOE Web

Application

BI monitoring scenarioMonitored systems in BI scenario – grouped by BI component type (BW systems, BO server systems, BO web app server systems).

Monitored BI objects (process chains, queries and templates in SAP BW system; jobs in BO system)

End user

This picture shows a typical BI scenario (between backend systems and end user). Two monitoring levels are provided:

• System level monitoring for the involved technical systems

• Monitoring of important BI objects (process chains, queries, templates, BO jobs)


SAP BusinessObjects Business Intelligence 4.0 Architectural Overview (simplified)

BO WebApp.

Layer

SAP BusinessObjects Enterprise XI Web Application Java

PioneerViewer

CrystalViewer

WEBIViewer

Platform SDKs

WebServices

BOServer Layer

CrystalServices

Multidim. Analy. Serv.

WebIServices CMSOthers

…..

DataSources

SAPBW

FrontendsCRYSTAL

XCelsius

Live OfficeWEBI

HTTP

CORBA

ODBO, MDX, RFC, ……..

http://www.discoveractenergy.com/images/ie-icon.gif


Agenda

oIntroduction





BI Overview Monitor – How to Start…


BI Overview Monitor – How to Start…

1. Select a scenario...1. Select a scenario...

2. Start the BI Overview monitor by choosing „Start Embedded“ or

„Start in New Window“

2. Start the BI Overview monitor by choosing „Start Embedded“ or

„Start in New Window“


BI Overview Monitor – Initial View

The overview is grouped by the BI component types in your scenarioThe overview is grouped by the BI component types in your scenario

Total number of alerts for the specific BI component type

Total number of alerts for the specific BI component type

System Monitoring status (availability, performance and exceptions)System Monitoring status (availability, performance and exceptions)

Status of the monitored BI applications (BO jobs, BW process chains and queries and templates)

Status of the monitored BI applications (BO jobs, BW process chains and queries and templates)


BI Overview Monitor

The BI Overview Monitor shows at a glance the summary of the current status and the open alerts of all BI components that are included in your technical scenario.

Summary of alerts and status worst case of all systems in the same BI component type(web app, BO, BW)

Alert (summary)

Technical instances status (worst case)

BI monitored objects status(summary)

System + host level status(worst case)


BI Overview Monitor – Detail View (BO Web App)

Clicking on a component type in the BI overview monitor expands the underlying single systems and technical instances with their separate alert and status aggregation per system resp. technical instance

Tomcat example


BI Overview Monitor – Detail View (BO System)

Tomcat example

Technical instancesof a BO systemTechnical instancesof a BO system

Two BO systemsTwo BO systemsTwo BO systemsTwo BO systems


BI Overview Monitor – Tabular View

Switch between Graphical and Tabular View

Switch between Graphical and Tabular View

Allows comprehensive overview for large number of instances

Allows comprehensive overview for large number of instances


Agenda

oIntroduction





System Monitoring for systems in BI monitoring scenario

System type BOBJ

SAP BI Platform Systems (BusinessObjects Enterprise)

System type ABAP

or JAVA (SAP J2EE)

SAP DataWarehouse Systems(SAP BW)

System typeATC

(Tomcat)


This picture shows a typical BI monitoring scenario and the monitored technical objects:

• The involved technical systems in a full scope BI monitoring scenario include

• BO Web Application Systems (with SP1 only Tomcat is supported for system monitoring). For SP2 SAP J2EEand WebSphere are planned to follow

• BOBJ server systems.

•SAP BW systems. Technically the SAP BW systems may consist of a ABAP type system and a SAP J2EE type system

• The system monitoring for each involved system has to be setup separately via the system monitoring setup

• System monitoring for each system can be viewed via the system monitoring UI or as jump in from the BI monitoring UI

With enhancements forBO web application

Completely BO specific „classical“ ABAP / SAP J2EEsystem monitoring (no BW specifics)


Agenda

oIntroduction





Example: BO Web Application Systems Monitor

The BO Web Applications System Monitor shows the single BO Web components that are part of your technical scenario.

Each single instance of a BO Web component is shown including details like number of alerts, availability status, performance status and exception status. A direct start of the system monitoring application for each BO Web instance is provided.

Drill down to the system monitoring application system hierarchy by clicking on the icon of a System Monitoring category you are interested in

Drill down to the system monitoring application system hierarchy by clicking on the icon of a System Monitoring category you are interested in



Select a System Monitoring category you are interested in, for example “Performance”

Select a System Monitoring category you are interested in, for example “Performance”



The performance category and its subcategories are shown

The performance category and its subcategories are shown

In the details section you can investigate now the single performance-relevant metrics

In the details section you can investigate now the single performance-relevant metrics



… and examine the metric details…… and examine the metric details…

By changing the view category you can directly switch between the single categories to Performance…

By changing the view category you can directly switch between the single categories to Performance…


BI System Monitor – BO Web Application metrics

Availability of BOE InfoView web application(HTTP ping from SMD agent)

Avg. Response time ofopen session action

Exceptions in BI launchpat = InfoViewapplication or in Query As a Web Service QaaWS calls

Introscope metric tree

(Log file scanning via SMD agent)


System Monitoring for BO Web Application System

•The system monitoring for the BO Web Application System provides all general system monitoring capabilities for the underlying web application system plus specific monitoring for BO web application metrics

• Currently the following BO web application specific metrics are provided

• Category Availability: regular http ping check for the BO InfoView web application (web UI for BOE). The URL is defined during managed system setup and stored in the Solution Manager URL framework.

• Category Performance: average response time of BO web application frontend calls (Introscope metric)

• Category Exceptions: any message of type ERROR in the BO web application log of the InfoView webapp.More specific ERROR patterns can be customized by the customer based on customer need / experience.


Asbjj ddsds dd

BOE Web

Application

Solution ManagerIntroscope EM

Asbjj ddsds dd

PerformanceMetrics

SMD Agent

Host Agent

SMD Agent

URL ping

Availability

Performance

Exceptions


Agenda

oIntroduction





B

BOE Server Intelligence Agent

BOE Server Process

BOE Service

BOE Service

BOE Server Process

BOE Service

BOE Service

BOE node

BO Enterprise System Model

BOE Server Intelligence Agent

BOE Server Process

BOE Service

BOE Service

BOE Server Process

BOE Service

BOE Service

BOE node

BOE Cluster

Softwarecomponent

Monitoring templates persoftware component definedon technical instance level(corresponds to BO server types)

Technical system

Currently no metricson BO system level

Technical instances

Many types of BO serverprocesses exit. Differenttypes correspond to differentBO product instances

BOE nodes are notmodelled but each serverprocess name has thenode name as prefix

A complete list of BOE 4.0 servicesand their mapping toBO server types and SAP BO metrictemplates can be found here:

BOE 4.0 Services


Example: BO Server Systems Monitor

Technical BO instances = BO serversTechnical BO instances = BO servers

BO system wide job metrics / alertsBO system wide job metrics / alerts

For scrolling through all BO instances page by pageFor scrolling through all BO instances page by page


Example: BO Server Systems Monitor

For BO systems each BO server represents a technical instance.

Each technical instance provides its own metrics and alerts.

For BO systems each BO server represents a technical instance.

Each technical instance provides its own metrics and alerts.

Choose the category that you are interested in – like Availability - …Choose the category that you are interested in – like Availability - …


BI System Monitor – BO Server Systems metricsServer Intelligence Agent (SIA)

No BO specific metrics forperformance or availability(SIA is the BO watchdog andnot monitored itself) only receiving from Host level

Exception for unexpected BOserver restarts reported in SIA log

For all other BO servers an inactivemetric defintion exists that can beadapted by customers


BI System Monitor – BO Server Systems metricsCentral Management Server

Avg. Response time ofCMS queries and Logons


BI System Monitor – BO Server Systems metricsFile Repository Server

Avg. Read and Writeresponse times


BI System Monitor – BO Server Systems metricsWeb Intelligence Processing Server

WebI server memory usage


System Monitoring for BO Server System

•The system monitoring for the BO ServerSystem provides all general system monitoring capabilities for the underlying operating system plus specific monitoring for BO metrics

• Currently the following BO Server specific metrics are provided

• Category Availability: BOE Server availability metric from Introscope (collected by BO monitoring service andoffered via JMX)

• Category Performance: average response time of BO Server Introscope metric

• Category Exceptions: unexpected server stops logged in the SIA (Server Intelligence Agent) log (BO watchdog server)More specific ERROR patterns can be customized by the customer based on customer need / experience. An inactive metric entry is available for BO server type in the SAP template

Asbjj ddsds dd

BO Server Systems

Asbjj ddsds dd

Solution ManagerIntroscope EM

Asbjj ddsds dd

Performance+ Availability Metrics

SMD Agent

Host Agent

SMD Agent

Availability

Performance

Exceptions

BO ServerBO Server

BO Monitoring Server

JMX


Agenda

oIntroduction





Agenda

This demo shows how to work with the following BI Monitoring applications:

oIntroduction





BO Job Monitor - Starting

… and click then on the traffic light section jobs

… and click then on the traffic light section jobs

In the BI Overview Monitor choose the BO Server Systems box…

In the BI Overview Monitor choose the BO Server Systems box…


BO Job Monitor

The BO Job Monitor opens in a separate tab The BO Job Monitor opens in a separate tab

For each job you can see the status of each monitored metric:

- Not Started on Time- Out of Time Window- Duration- Status


- Not Started on Time- Out of Time Window- Duration- Status

Monitored jobs are grouped by the BO system they belong to

Monitored jobs are grouped by the BO system they belong to


BO Job Monitor – metrics details

Status of thelast finished jobrun (= job instance)

Green if successful

Red if failed

Duration of lastfinished or currentlyrunning job run inminutes

Delay in minutes of the lastfinished or currently running job runto the specified threshold timestamp(today if the timestamp is already reached or yesterday otherwise)

Maximum distance in minutes of the last finished or currently running job run to the specified threshold time window on the day where the window start timestamp has the closest distance to the job start time. 0 if the job start time is > window start time and job end resp. current time for running job is < window end time. See details on next slide.


BO Job Monitor – out of time window calculation examples

time

yesterday tomorrowtoday

now

J1

W1 W2 W3

J2

J3

J4

J5

0

Daily time window

Job runs

Closest window

Reported metric value

J6


BO Job Monitor – Checking Configured Thresholds

How to check the thresholds of your technical scenario? Go to the SAP Solution Manager Configuration - BI Monitoring. Choose your technical scenario and go to the step Configure BO Job Monitor

How to check the thresholds of your technical scenario? Go to the SAP Solution Manager Configuration - BI Monitoring. Choose your technical scenario and go to the step Configure BO Job Monitor

Choose the job that you are interested in and check the thresholds…

Choose the job that you are interested in and check the thresholds…


BO Job Monitor – check job details in BO system

Select Navigate to and then Central Management Console (CMC)For detailed analyis of a job in the BOE system

Select Navigate to and then Central Management Console (CMC)For detailed analyis of a job in the BOE system

… and log on… and log on



Start the Instance Manager…Start the Instance Manager…

Enter the selection criteria for your job of interest and click the Find button

Enter the selection criteria for your job of interest and click the Find button



Right click the job you are interested in and select “Instance Details” to see more details of this instance.

Right click the job you are interested in and select “Instance Details” to see more details of this instance.



Check the corresponding detail information for the alert you are investigating. In our case: check the error message to find the reason for the failed status.

Check the corresponding detail information for the alert you are investigating. In our case: check the error message to find the reason for the failed status.


BI Monitoring for BO Jobs

•The BI Monitoring for BO Jobs provides the following metrics for the execution of process chains in the Business Objects system:

•Performance:•Duration

•Not Started on Time

•Availability:•Out of Time Window

•Exceptions:•Status

BO Server system Solution Manager (ABAP stack)

Extractor

Name = „DPC PUSH CORE“

SystemID=<SOLMAN-SID>

Extended Content=<BO server host name> Script ‚List Jobs‘

„bobjnormal.jar“

SMD Agent

BO Server

Solution Manager (JAVA stack)

Web-Service„BOBJMonService”

External Name= „BOBJMonServiceVi_

Document“ Type= „Consumer

Proxy“

Agelet „e2emai.bobj“

Agelet „remoteos“


Agenda

oIntroduction





BW Process Chain Monitor - Starting

… and click then on the traffic light in the section Process Chains

… and click then on the traffic light in the section Process Chains

In the BI Overview Monitor choose the BW Server Systems box…



BW Process Chain Monitor

Monitored process chains/steps are grouped by the BW system they belong to

Monitored process chains/steps are grouped by the BW system they belong to

Monitoring of complete process chains as well as single process chain steps is supported.





- Not Started on Time- Out of Time Window- Duration- Status- Records Processed- Data Packages Processed


- Not Started on Time- Out of Time Window- Duration- Status- Records Processed- Data Packages Processed

As of Solman 7.1 SP1 metrics are calculatedfrom all process chain / step runs within thelast 24h worst case values are reported.As of SP3 each single run may raise an alert.


BW Process Chain Monitor – Starting the Analysis Transaction

2. Start the BW Analysis Transaction by choosing Navigate to -> Analysis Transaction


1. Mark the BW process chain you want to investigate…

1. Mark the BW process chain you want to investigate…


BW Process Chain Monitor – Analysis with Transaction RSPC

The analysis transaction RSPC is started by default showing the previously chosen process chain...

The analysis transaction RSPC is started by default showing the previously chosen process chain...


BW Process Chain Monitor – Analysis with Service Tool ST13

You can use the SAP WebGUI session also for calling other analysis tools like ST13 (BW-TOOLS)…

You can use the SAP WebGUI session also for calling other analysis tools like ST13 (BW-TOOLS)…

Enter transaction here…Enter transaction here…


BW Process Chain Monitor – Analysis with Workload Monitor ST03N

… or ST03N… or ST03N


BW Process Chain Monitor – Starting the Alert Inbox

Open the alert inbox by clicking on the number of alerts or the traffic light of the BW process chain that you are interested in

Open the alert inbox by clicking on the number of alerts or the traffic light of the BW process chain that you are interested in


BW Process Chain Monitor – Alert Inbox for BI

2. Select the alert group that you want to investigate in greater detail

2. Select the alert group that you want to investigate in greater detail

1. Select the alert that you are interested in - for example BW Process Chain Records/Data Packages

1. Select the alert that you are interested in - for example BW Process Chain Records/Data Packages

3. Choose the Show Details button3. Choose the Show Details button


BW Process Chain Monitor – Alert Inbox for BI

Check the details of the specific alert - like minimum, maximum and last measured value of the metric

Check the details of the specific alert - like minimum, maximum and last measured value of the metric


BI Monitoring for BW Process Chains

•The BI Monitoring for Process Chains provides the following metrics for the execution of process chains in the BW system:

•Performance:•Duration

•Not Started on Time

•Availability:•Out of Time Window

•Exceptions:•Status

•Records Processed

•Data Packages Processed

BW system (ABAP stack)

ST-PI:/SDF/E2E_BW_PROCESSCHAINS

Solution Manager (ABAP stack)

Extractor

Name = „DPC PULL CORE“

SystemID = <BW-SID>

Extended Content = „ST_PI“ST-A/PI:BCC_BW_PC_MONITORING

RFC

BW


Agenda

oIntroduction





BW Reporting Monitor - Starting

… and click then on the traffic light in the section Reporting

… and click then on the traffic light in the section Reporting




BW Reporting Monitor

For each BW Query or Template you can see Average ResponseTime in seconds and the alerts

For each BW Query or Template you can see Average ResponseTime in seconds and the alerts

Monitored queries / templates are grouped by the BW system they belong to

Monitored queries / templates are grouped by the BW system they belong to


BW Reporting Monitor – Analysis with Workload Monitor ST03N



1. Mark the BW Query or Template you want to investigate…

1. Mark the BW Query or Template you want to investigate…


BW Reporting Monitor – Analysis with Workload Monitor ST03N

3. Check the details of the query you want to investigate

3. Check the details of the query you want to investigate

1. Transaction ST03N opens in a SAPGui for HTML session

1. Transaction ST03N opens in a SAPGui for HTML session

2. Choose section Queries: Bex Web (ABAP)

2. Choose section Queries: Bex Web (ABAP)


BI Monitoring for BW Queries & Templates

•The BI Monitoring for Queries & Templates provides the following metrics for the execution of queries and templates in the BW system:

•Performance:•Average response time of queries

•Average response time of templates

BW system (ABAP stack)

ST-PI:/SDF/E2E_BW_QUERY_TEMPLATES

Solution Manager (ABAP stack)

ST-A/PI:BCC_BW_QT_MONITORING

RFC

BW

Extractor

Name = „DPC PULL CORE“

SystemID = <BW-SID>

Extended Content = „ST_PI“


No part of this publication may be reproduced or transmitted in any form or for any purpose without the express permission of SAP AG. The information contained herein may be changed without pr ior notice.

Some software products marketed by SAP AG and its distributors contain proprietary software c omponents of ot her software vendors.

Microsoft, Windows, Excel, Outlook, and PowerPoint are registered trademarks of Microsoft Corporation. IBM, DB2, DB2 Universal Database, System i, System i5, System p, System p5, System x, System z, System z10, System z9, z10, z9, iSeries, pSeries, xSeries, zSeries, eServer, z/VM, z/OS, i5/OS, S/390, OS/390, OS/400, AS/400, S/390 Parallel Enterprise Server, PowerVM, Power Architecture, POWER6+, POWER6, POWER5+, POWER5, POWER, OpenPower, PowerPC, BatchPipes, BladeCenter, System Storage, GPFS, HACMP, RETAIN, DB2 Connect, RACF, Redbooks, OS/2, Parallel Sysplex, MVS/ESA, AIX, Intelligent Miner, WebSphere, Netfinity, Tivoli and Informix ar e trademarks or r egistered trademarks of IBM Corporation.

Linux is the registered trademark of Linus T orvalds in the U.S. and other countries.

Adobe, the Adobe logo, Acrobat, PostScript, and Reader are ei ther trademarks or registered trademarks of Adobe Systems Incorporated in the United States and/or other countries.Oracle is a registered trademark of O racle Corporation.

UNIX, X/Open, OSF/1, and Motif are registered trademarks of the Open Group.

Citrix, ICA, Program Neighborhood, MetaFrame, WinFrame, VideoFrame, and MultiWin are trademarks or r egistered trademarks of C itrix Systems, Inc.HTML, XML, XHTML and W3C are trademarks or registered trademarks of W 3C®, World Wide Web Consortium, Massachusetts Institute of Technology.

Java is a registered trademark of Oracle Corporation.

JavaScript is a registered trademark of Oracle Corporation, used under license for technology invented and implemented by Netscape. SAP, R/3, SAP NetWeaver, Duet, PartnerEdge, ByDesign, SAP BusinessObjects Explorer, StreamWork, and other SAP products and services mentioned herein as well as their respective logos are t rademarks or registered trademarks of SAP AG in Germany and other countries.

© 2011 SAP AG. All rights reserved

Business Objects and the Business Objects logo, BusinessObjects, Crystal Reports, Crystal Decisions, Web Intelligence, Xcelsius, and other Business Objects products and services mentioned herein as well as their respective logos are trademarks or r egistered trademarks of Business Objects Software Ltd. Business Objects is an SAP company.

Sybase and Adaptive Server, iAnywhere, Sybase 365, SQL Anywhere, and other Sybase products and services mentioned herein as well as their respective logos are trademarks or registered trademarks of Sybase, Inc. Sybase is an SAP company.

All other product and service names mentioned are the t rademarks of their respective companies. Data contained in this document serves informational purposes only. National product specifications may var y.The information in this document is proprietary to SAP. No part of this document may be reproduced, copied, or transmitted in any form or for any purpose without the express prior written permission of SAP AG.

This document is a preliminary version and not subject to your license agreement or any other agreement with SAP. This document contains only intended strategies, developments, and functionalities of the SAP® product and is not intended to be binding upon SAP to any particular course of business, product strategy, and/or development. Please note that this document is subject to change and may be changed by SAP at any time without notice.

SAP assumes no responsibility for errors or omissions in this document. SAP does not warrant the ac curacy or c ompleteness of the information, text, graphics, links, or ot her items contained within this material. This document is provided without a warranty of any kind, either express or implied, including but not limited to the implied warranties of merchantability, fitness for a particular purpose, or non-infringement.SAP shall have no liability for damages of any kind including without limitation direct, special, indirect, or consequential damages that may result from the use of t hese materials. This limitation shall not apply in cases of intent or gross negligence.

The statutory liability for personal injury and defective products is not affected. SAP has no control over the information that you may access through the use of h ot links contained in these materials and does not endorse your use of third-party Web pages nor provide any warranty whatsoever relating to third-party Web pages.

Documents

How to work with BI Monitoring - SAP · How to work with BI Monitoring ... Central monitoring of Business Objects ... BO server types and SAP BO metric