CA Performance Management 2.6 Deep Dive

Pre-Con Education: CA Performance Management 2.6 Deep Dive

Jeff Morris

DevOps: Agile Ops

CA Technologies

Principal Engineering Services Architect

DO5X82E

@TwitterHandle

#CAWorld

2 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD

© 2015 CA. All rights reserved. All trademarks referenced herein belong to their respective companies.

The content provided in this CA World 2015 presentation is intended for informational purposes only and does not form any type of

warranty. The information provided by a CA partner and/or CA customer has not been reviewed for accuracy by CA.

For Informational Purposes Only

Terms of this Presentation


AbstractCA Performance Management 2.6 is a next-generation tool for monitoring mega-sized networks. This session, led by CA network monitoring experts, is designed to help new and existing users expand their knowledge of key capabilities and maximize the value of their performance data. The session will focus on foundational features, including understanding the architecture (data collectors, data repository/database, data aggregator, user interface and integration with CA Mediation Manager), leveraging the predefined dashboards and reports, understanding metric families and vendor-specific device certification, creating and deploying discovery and monitoring profiles and eventing. You'll also learn about advanced features, such as customizing dashboards and reports, automating custom groups creation and device population, using the application program interface (API) to integrate CA Performance Management with basic service set (BSS)/configuration management systems and create a zero-touch, automated process flow to on-board monitoring and self-certification procedures for device monitoring.

Jeff Morris

CA Technologies Principal Engineering Services Architect


Agenda

FOUNDATIONAL FEATURES

ARCHITECTURE

PERCENTILES

DASH BOARDS

REPORTS

DATA AND ANALYTICS

1

2

3

4

5

6


CAPC Single Pane View Reporting

Participating data sources that synchronize device related items and elements information to Performance Center CA Data Aggregator (DA)

CA Network Flow Analysis (NFA)

CA Application Deliver Analysis (ADA)

CA Unified Communications Monitor (UCM)

CA Service Operations Insight (SOI)

CA eHealth views and reporting (eHealth)

CA Spectrum event processing only…

Note: eHealth is not a Report Information Base (RIB) as the approach leverages a integration SOAP API.

Multi-Domain Dashboard and On-Demand Reporting


CAPC – Reporting Architecture

RIB Components

• Web services and XML documents that access data collected from various sources

• RIB Engine• Application-facing web service accepts

queries, distributes across RIB sources, and combines results

RIB Documents

• XML document describes & defines valid ways of querying a particular RIB source


Dashboard Types

Inventory pages High-level information to identify managed items and groups of items

Groups and Sites, Devices and Servers, Interfaces, Device Components, Elements

Summary pages• High-level information, such as averages from groups of managed items.

Often provide a drill-down path to more detailed, related pages from a selected item context.

Context pages• Provide specific, focused performance or status data from a narrow context,

such as a single router or server. These pages are available as drill-down links or tabs from Summary dashboards.

Categories of dashboards are available by default or through customization


Dashboard/View Visualization TypesAvailable views to be customized to met customer needs

Table for grid aggregate data

Calendar heat chart

Pie chart

Gauge for threshold dissemination

Gauge/Table

Trend/Table

Trend/Stacked chart

Horizontal/Side by Side bar chart

Multi-view

Multi-trend

Scorecard severity Health Table and Trend Grids

Dynamic Trend Chart

On-Demand for the ability to generate live reports


On-Demand Reporting Visualization TypesMultiple visualization & aggregation options

Chart with multiple metrics

Chart per metric

Chart per Item with multiple metrics

Chart per metric with multiple items

Table with multiple metrics

Table per item with multiple metrics

Summary table/Chart by metrics

Summary table/Chart by items


Metric Filtering in Custom and Dynamic ViewsSimplify the selection of which metrics are available for a selected context

Metrics filtering support with Custom and Dynamic views based on item.


Scorecard Views

Types:– Table grid for multiple metrics with health status indicator

– Trend grid for single metric for time sensitive health status threshold

– IM Custom view group scorecard (trend type for single metric)

Value:– Show aggregated values for current report period and up to 8 prior periods

of the same size to be used in calculations

– Threshold symbols indicate aggregate “health” status via green/yellow/red icons.

– Aggregation levels are at Group, Device, & Device Component (i.e. Interface)


Analytics

Analytics is the discovery and communication of meaningful patterns in data. Especially valuable in areas rich with recorded information, analytics relies on the simultaneous application of statistics, computer programming and operations research to quantify performance.

CAPM Context driven analytics


Types of Analytics


Types of Analytics


Analytics in Context – Smart and AccessibleCAPM makes analytics easy and accessible

Accessible– Easy to interpret

– Easy to configure

– Analytics available in many views and reports

Smart– Individual metric-level configuration

– Multiple percentiles and projections per metric

– Multiple visualization types

– Many metrics already turned on Out-of-Box


Percentiles and ProjectionsCore analytics for deep insights and accurate capacity projections

A percentile is a measure used in statistics indicating the value below which a given percentage of observations in a group of observations fall

A Projection is a forecast about what will happen in the future, based on historical data


Understanding Percentiles – Bandwidth ExampleCommon use case in measuring bandwidth utilized – remove peaks

The 95th percentile says that 95 percent of the time, the bandwidth usage is below this amount. The remaining 5 percent of the time, the bandwidth usage is above that amount. – Uses: Capacity Planning, Billing, SLA Compliance

95th

Percentile

Count of Samples


Understanding Percentiles – Illustration


Percentile CalculationCAPM uses the industry standard or ‘Excel method’

Sorted List IF Util%

1 30

2 30

3 30

4 30

5 35

6 40 95/100 N-1 .95*11 +17 45 0.95 11 10.45 11.45

8 50

9 60

10 65 11th value 70

11 70 "0.45*(85-70)" 6.75

12 85 95th Percentlie 76.75


CAPM – Configure Percentiles

Pre-2.5 : 95th Percentile ONLY available per metric

2.5 and above: Two user configurable percentiles were added per metric


Easy Configuration


Available Where You Want It


Understanding Projections

A Projection is a forecast about what will happen in the future, based on historical data.⁻ Calculated using “least-squares” linear

regression line from historical data

⁻ Estimates future values from regression line

⁻ Consistently use the same methodology for all visualizations


Projections in CAPM

Intuition: find the projection line that minimizes the overall sum of difference between predicted and actual historical values

Projections Calculated by Linear “Least-Squares” Regression

Sum of the Residuals

Time

Polled MetricValues

Projection Line


Metric Projection - How it Works

Configuration requires user to specify– Projection intervals (days into future)– Percentile Used for Projections

(typically set to 95th)

Calculate and store daily percentile of polled data

Daily percentile values become basis for calculation of projection line

X Daily

Percentile

Metric Value

TimeMon, 3/9 Tues,

3/10Wed, 3/11

Thurs, 3/12

Y Daily

Percentile

Z Daily

Percentile

Regressio

n P

eriod

(up

to

90

days)

Prediction Daily Percentile Storage

Mon 3/9, Daily Percentile = X

Tues 3/10, Daily Percentile = Y

Wed 3/11, Daily Percentile = Z


Metric Projection - How it Works


3 Major Ways to Utilize Projections in CAPM

Trend line view w/Projection

Scorecard view w/Projection values

Custom table view w/Projection values

B

C

A


Trend Line with Projection


Scorecard View with Projection Values

Approximation– Uses the average from each time frame in the view to calculate the

projection values with least squares regression

– Precision can be considered by Central Limit Theorem (that is average of an average normalizes with sample size)

Detailed Data Uses the polled data for the entire time frame of the view to calculates

a least squares regression across entire set of data points

This calculation is statistically more accurate and provides extra columns in the view


Scorecard projections – Dynamic Configuration

Up to 3 Columns of Projections


Custom Table View w/ Projection Values


Projection Comparison - Overview


Recommended Sessions

SESSION # TITLE DATE/TIME

DO5X213LIncrease Your Speed to Manage with CA Performance

Management Self Certification 11/19/2015 at 4:30 pm

DO5T17S

University of Chicago Achieves High Availability through

a Centralized and Service Centric Approach to IT

Monitoring

11/19/2015 at 4:30 pm

DO5X221L

Hands-On Lab: Experience How to Leverage CA

Spectrum® 10.1 Support for Wireless LAN Controller and

Access Point Management

11/19/2015 at 4:30 pm


Must-See Demos

Demo Name

CA Performance Management

Theater 5

Demo Name

Service Operations Insight

Theater 5

Demo Name

CA Unified Infrastructure Management

Theater 5

Demo Name

CA Virtual Network Assurance

Theater 5


Follow ON Conversations At…

Smart Bar

Service Operations Insight

Theater 5

Tech Talks

Capacity Manager

Theater 5


Q & A


For More Information

To learn more, please visit:

http://cainc.to/Nv2VOe

CA World ’15

http://cainc.to/Nv2VOe

http://bit.ly/1wbjjqX

Technology

CA Performance Management 2.6 Deep Dive