Download pdf - Webinar - Is your Web Application Performance Doomed?

Is your Web Application Performance Doomed?

Imad Mouline - Compuware CTO, APM Solutions

Jean-Pierre Garbani - VP, Principal Analyst, Forrester Research

How issues with browsers, cloud services, third-party providers, the Internet, and your

data center can impact your performance – and what you can do about it

Agenda

Complexities of today’s application deliver and the impact on IT and business

Evolution of APM and limitations of today’s APM tools

Best practices for unifying your APM strategy

© 2010 Forrester Research, Inc. Reproduction Prohibited3 © 2009 Forrester Research, Inc. Reproduction Prohibited

Jean-Pierre Garbani, Vice President, Principal Analyst

© 2010 Forrester Research, Inc. Reproduction Prohibited4

Controlling complexity is a

major IT issue . . .


IT and the enterprise

Application performance is key to enterprise productivity and

business success.

– Transactional applications and business services based on aggregates of

these applications are the business visible component of IT.

– Performances are critical for the overall productivity of the enterprise.

– IT operation must deliver performances are in line with business expectations.

The current economic conditions favor short-term returns on

investments.

– IT organizations tend to favor tactical over strategic initiatives.

– In light of the poor economic situation, reducing costs tops business goals.

– There's increasing pressure to prove business benefits of any IT spending.


Complexity example: web based business service

MajorISP

Local ISP

Mobile Carrier

Internet

Content DeliveryNetworks

3rd Party/Cloud Services

Browsers and

devices Users

Storage

Web Servers

App Servers

DB Servers

Mainframe

Load Balancers

Mobile Components

Network

Zone of customer expectation

Virtual or Real Data Center


Productivity equals application performance

The key to productivity in interactive applications is

response time:

.1 second is instantaneous.

1 second is when a response time is perceived.

10 seconds is when users lose focus on the interaction.

Basic rules

Simple and frequent tasks: 1 second or less

Common tasks: 2 to 4 seconds

Complex tasks: 8 to 12 seconds


But can IT organizations deliver?


Complexity management issue

IT complexityBusiness

integration

Manual ability

Time

IT management

gap

Saturation

point


Technology

innovation

Business

service

demand

Cost/value

ratio

$

R&D

Exponential

growth

Things will not improve with time

IT is an autocatalytic process

© 2010 Forrester Research, Inc. Reproduction Prohibited11Source: October 29, 2008, “Talking To Your CFO About Cloud Computing” Forrester report

Cloud-based services are on the horizon


What will be naturally in the cloud in 2015?

Standardized business logic

Horizontal business applications

Multitenant business process platforms

Simple, standardized infrastructure services (IaaS) like storage and

compute power

What will remain on-premise?

• Most custom-build applications

• Application implementing customer’s intellectual property relevant

and competitive business logic

How will we manage complex hybrid applications?


Management tools evolve with application complexity

System

management

Application

network monitoring

End user experience

monitoring

Java EE and

.NET

management

Database

performance

management

Messaging, Web

services, and SOA

monitoring

Business

transaction

management

Future integration

with business

processes

Analytics and event

processing

One and two

tier applications

Browser-based

applications

N-tier composite

applications

Highly integrated

business services


The application performance management concept

Java EE and .NET are at the application core.

– Java EE applications servers seen as the critical technology

– Number of entrants in the monitoring of these applications, closely followed by

an interest in .NET

– Acquired by larger IT management vendors

BSM and application mapping

– But the granularity of dependency mapping at the application level isn't

sufficient to be a template for transaction performance management

APM evolved into a broader monitoring solution.

– Complex applications, using Web services, SOA, and multitier aggregation

– Problems can now come from a number of directions .

– APM started to include other forms of monitoring, such as end user experience,

infrastructure, and database to complement the Java EE and .NET monitoring.


The business transaction monitoring concept

Applications are really seen through business transactions.

– Performances are perceived at the transaction level.

– Transactions are not created equal.

Global monitoring is not sufficient to debug transaction performance

issues.

Business transaction monitoring, with the possibility to map in real time at

the individual transaction level, appears alongside APM solutions.

Business transaction monitoring solutions provide transaction visibility and

problem identification but not the monitoring depth of APM.

Is the ideal solution an APM-BTM convergence?


The Forrester APM Reference Model

MajorISP

Internet

Storage

Web Servers

App Servers

DB Servers

Mainframe

Load Balancers

Mobile Components

Network

Collect transaction response time

Inside Outside

Zone of customer expectationMap the transaction componentsZone of customer expectationMonitor the transaction components



Collect response times by transaction, and determine the first level-

alerting criterion.

Understand and map all the components of the transaction.

Monitor applications themselves. This includes all types of applications.

Monitor performance of the database(s).

Monitor the physical and virtual components of the infrastructure.

Combine all these parameters.

Provide all this information on a “single-pane-of-glass” dashboard.


End user experience monitoring

Database monitoring

Application monitoring

Infrastructure monitoring

Role-oriented,real-time

dashboard

Combined analytics

Transactionmapping

Real user performance monitoring

Synthetic user record playback

Java EE and .NET monitoring

Messaging monitoring

Portal and Web server monitoring

Packaged application monitoring

Databaseperformance analytics

Database performance monitoring

Mainframe performance connector

Network and server monitoring

Virtual world monitoring

Custom application monitoring

CMDB connector



Conclusion

An application performance management solution:

Understands the infrastructure supporting the transaction

Collects data and events from all transaction components, including

virtualization and cloud

Integrates all events and data on a single pane of glass for proactive

analysis

Guide IT operations in identifying the component at fault

Determine transaction criticality

Allows deep dive on component (of all nature) at fault


Recommendations

Understand the complexity level of your business services. This should be

assessed in a business dimension and in an IT operation dimension but with an eye

to what’s coming down the pike.

Inventory the monitoring products installed in your operation. Conduct a

thorough assessment of the value and potential for integration of each of these

products, sorting what should be replaced and what should be kept.

Conduct an analysis of the solutions available on the market. Create a gap

analysis between installed solutions versus a comprehensive performance

management solution using the Forrester reference model.

Conduct an economic analysis. This analysis should take into consideration the

efficiency of the end result. For example, how many brownouts and downtimes

could have been avoided with the right solution, and privilege these long-term

benefits over short-term savings in license costs.

© 2009 Forrester Research, Inc. Reproduction Prohibited

Thank you

JP Garbani

+1 239.352.0129

[email protected]

www.forrester.com


Examples and Recommendations based on JP’s Conclusions



Collects data and events from all transaction components, including virtualization and cloud

Integrates all events and data on a single pane of glass for proactive analysis




The Browser Is Becoming THE Integration Platform

8.87

By The Numbers

Number of hosts accessed directly by the browser, per user transaction, averaged across 3,000 companies

Measurementcity

Number of hosts per user transaction

Hong Kong 6.82

Beijing 8.87

London 7.95

New York 9.82

Frankfurt 8.71

Paris 10.12

Stockholm 10.48

Helsinki 12.71

Amazon EC2 Region Percentage

EC2 Asia Pacific - Singapore 0.151

EC2 EU - Ireland 1.578

EC2 US West - Northern California 2.066

EC2 US East - Northern Virginia 24.144

TOTAL 27.938

Enterprises ARE Adopting Cloud Computing

Percentage of web app transactions that include at least one object hosted on Amazon EC2

Amazon EC2 Region Percentage

EC2 Asia Pacific - Singapore 0.151

EC2 EU - Ireland 1.578

EC2 US West - Northern California 2.066

EC2 US East - Northern Virginia 24.144

TOTAL 27.938

The Web Application Delivery Chain

The Challenge of Delivering Web Applications

Systems management

tools: “OK”

…user is NOT happy

MajorISP

Local ISP

Mobile Carrier

Internet



Browsers and devices UsersUsers

Storage

Web Servers

App Servers

DB Servers

Mainframe

Load Balancers

Mobile Components

Network

Traditional zone of control


Conclusion






analysis





The Challenge of Delivering Web Applications

Systems management

tools: “OK”


MajorISP

Local ISP

Mobile Carrier

Internet




Storage

Web Servers

App Servers

DB Servers

Mainframe

Load Balancers

Mobile Components

Network

Traditional zone of control

MajorISP

Local ISP

Mobile Carrier

Internet




Storage

Web Servers

App Servers

DB Servers

Mainframe

Load Balancers

Mobile Components

Network


• Network peering problems

• Outages

• Inconsistent geo performance• Bad performance under load• Blocking content delivery• Incorrect geo-targeted content

• Configuration issues• Oversubscribed POP• Poor routing optimization• Low cache hit rate

• Network peering problems

• Bandwidth throttling

• Inconsistent connectivity• Configuration

errors• Application

design issues• Code defects• Insufficient

infrastructure

• Poorly performing JavaScript

• Browser/device incompatibility

• Page size too big

• Too many objects

• Low cache hit rate

• Network resource shortage

• Faulty content transcoding

• SMS routing / latency issues

The Challenge of Ensuring Quality Web Experiences

Zone of customer expectationZone of customer expectation

Systems management

tools: “OK”


Zone of customer expectationZone of customer expectationTraditional zone of controlTraditional zone

of control

MajorISP

Local ISP

Mobile Carrier

Internet




Storage

Web Servers

App Servers

DB Servers

Mainframe

Load Balancers

Mobile Components

Network

Pinpointing Problems and Optimizing Performance


Is it my data

center?

Is it anISP or the Internet?

Is it a 3rd party

provider?

Is it a browser or

device?

Is it my datacenter, the Internet, my vendor or a browser/device issue?

Focus on the most critical business issuesQuick identification of root cause


Conclusion






analysis




Is it my datacenter, the Internet, my vendor or a browser/device issue?

Focus on the most critical business issuesQuick identification of root cause

“Single Pane of Glass” requires unifying monitoring approaches

Internet

Web Servers

Load Balancers

AppServers

Data base

Users

Synthetic Tests

Gomez Backbone

Agents

Real User Traffic

RUM metrics Active monitoring metrics

Business impact prioritizationRapid root cause isolationRapid time-to-value

Gomez SaaS Platform

GomezFirst Mile appliance

Use Case Scenarios

Scenario #1: Problem inside data center

Scenario #2: Problem with third party

MajorISP

Local ISP

Mobile Carrier

Internet




Storage

Web Servers

App Servers

DB Servers

Mainframe

Load Balancers

Mobile Components

Network

• Scenario 1 • Scenario 2

Data Center Problem: IdentificationIs it my datacenter, the Internet, my vendor or a client issue?

Focus on the most critical business issuesNew operations Dashboard organized by alert severity

Shopping Cart Transaction: Severe alert with a response time over 9 seconds

Root Cause Indicators instantly highlight an issue in the data center


Conclusion






analysis




Data Center Problem: IdentificationIs it my datacenter, the Internet, my vendor or a client issue?

Focus on the most critical business issuesNew operations Dashboard organized by alert severity

Shopping Cart Transaction: Severe alert with a response time over 9 seconds

Root Cause Indicators instantly highlight an issue in the data center

Data Center Problem: QuantificationHow many users are impacted by poor performance?

Drill into details of shopping cart transaction

Further drill into trends over time

Problem is with the “Cart” page specifically and is impacting 26% of 3,235 Users



Conclusion






analysis




Data Center Problem: QuantificationHow many users are impacted by poor performance?

Drill into details of shopping cart transaction

Further drill into trends over time



Data Center Problem: ResolutionWhere is the problem in my infrastructure?

Is my load balancer “balancing” properly?Do I have a problem with a specific web server?

Web Server 3Specific issue with Web Server creating response time degradation


Conclusion






analysis




Data Center Problem: ResolutionWhere is the problem in my infrastructure?

Is my load balancer “balancing” properly?Do I have a problem with a specific web server?

Web Server 3Specific issue with Web Server creating response time degradation

Third Party Problem: IdentificationIs it my datacenter, the Internet, my vendor or a client issue?

Identify third party issues immediatelyEasily drill into third party

Product Search shows a severe alert with a response time over 3 seconds

Root Cause Indicators highlight a third party issue

Drill into third party contributors

Third Party Problem: Historical AnalysisTrend Third Party Performance over time

Ad Vendor shows marked degradation of performance

Chart shows third party trending over time

Data Center n-Tier Deep-Dive

Gomez First Mile One ChartBusiness and User Impact“Outside In” Response TimeData Center Response TimeWeb Server Infrastructure

Vantage Multi-tier ReportMulti-tier analysis (Web, App, DB)Response Time at each TierTransaction analysis

Java / .NET Method Analysis… In Context with Gomez Alert

1 2

Summary

“At a Glance” status of business critical transaction Identify “alerting”

transactions Immediate fault domain

isolation

Transaction detail drill down View transaction level

performance details and trends

View business impact

Fault domain drill down Isolate problem root cause

Q&A


Jean-Pierre Garbani - VP, Principal Analyst, Forrester Research