Performance Testing Solutionssolutions.pyramidci.com/wp-content/uploads/2015/07/Pyramid... · Overview Performance testing ... Performance Testing Solutions help identify bottlenecks

Performance Testing Solutions

We get you past the bottlenecks!TM

QA CENTER OFEXCELLENCE SOA SERVICESFDA VALIDATIONFUNCTIONAL

PERFORMANCE AGILEBIG DATASECURITY

AUTOMATION LEGACYCLOUDMOBILE

FUNCTIONAL




FUNCTIONAL

solutions.pyramidci.com 2

Overview

Performance testing is a critical part of application

testing as it affects business revenue, credibility of the

organization, and customer satisfaction. Pyramid’s

Performance Testing Solutions help identify bottlenecks in

a system, establish a baseline for future testing, support

a performance tuning effort, determine compliance with

performance goals and requirements, and/or collect other

performance-related data to help stakeholders make

informed decisions related to the overall quality of the

application being tested.

Performance Testing Challenges

Today’s applications are built on advanced platforms

using technologies such as HTML 5, Web 2.0, CMS,

and Cloud. To ensure application speed, stability,

and scalability, it is critical to address the following

performance testing challenges:

• Inadequate non-functional requirements for performance testing

• Selecting the right tool and inability to customize the tool

output to develop load generation scripts

• Test data collection and analysis of huge data

• Scaled down performance test environment

due to budgetary constraints

• Exhaustive performance testing before go-live

and limited time for testing

• Testing unique application protocols that are

not supported by standard tools

• Testing from multiple geographical locations

• Wide range of user operating environments, e.g.

Windows, Linux, Mobile

Applications

Pyramid’s centralized performance testing center of excellence

integrates web, mobile, cloud, and legacy applications testing.

Tools Expertise

At Pyramid we employ the most widely used performance testing tools

for measuring web application performance and load stress capacity.

Skilled in both open source and licensed performance testing tools,

our performance QA designers will evaluate application under test,

then explore and choose the best suited tools for the applications.

Types of Performance Testing

It is important to understand different performance test types to

reduce risks, minimize cost, and know when to apply the appropriate

test over the course of a given performance testing project. Our

performance test designers have strong experience in resourcing,

estimating, and projecting potential returns on testing efforts.

Performance Test

A performance test is any test that measures stability, performance,

scalability and/or throughput of an application.

> Apache JMeter> LoadRunner> WebLOAD> NeoLoad> LoadUI> Loadster> LoadImpact> Rational Performance Tester> Testing Anywhere> Loadstorm

> Performance Testing> Load Testing> Stress Testing> Soak Testing> Spike Testing> Configuration Testing

> Web Performance> Cloud Performance> Mobile Performance> Legacy Performance

APPLICATION TESTING TYPES

PYRAMID PERFORMANCE TESTING SOLUTIONS

TOOLS

Performance Testing Solution




FUNCTIONAL




FUNCTIONAL

PERFORMANCE TESTING SOLUTIONS


THE BEST WAY TO ENSURE

ACCURATE RESULTS IS

TO FOLLOW A PROVEN

PERFORMANCE TESTING

METHODOLOGY. THE DIAGRAM

BELOW SHOWS PYRAMID’S

PERFORMANCE TESTING

METHODOLOGY.





FUNCTIONAL




FUNCTIONAL

Load Testing

A load test is usually conducted to understand the behavior of

the system under a specific expected load. This load can be

the expected concurrent number of users on the application

performing a specific number of transactions within a set duration.

This test will provide the response times of all of the important

business critical transactions. If the database, application server,

etc. are also monitored, then this simple test can point toward

bottlenecks in the application software.

Stress Testing

Stress testing is normally used to understand the upper limits

of capacity within a system. This test is done to determine the

system’s robustness under extreme load and it helps application

administrators determine if the system will perform sufficiently

when loads go well above the expected maximum.

Soak Testing

Soak testing, also known as endurance testing, is usually done

to determine if the system can sustain the continuous expected

load. During soak tests, memory utilization is monitored to detect

potential leaks.

Spike Testing

Spike testing is done by suddenly increasing the load generated

by a very large number of users, and observing the behavior of the

system. The goal is to determine if performance will suffer, if the

system will fail, or if it will be able to handle dramatic changes in

load.

Configuration Testing

Rather than testing for performance from a load perspective,

tests are created to determine how changes in the configuration

of the system’s components affect the system’s performance

and behavior. A common example would be experimenting with

different methods of load-balancing.

Pyramid Performance Testing Methodology

The best way to ensure accurate results is to follow a proven

performance testing methodology. The diagram on the right

shows Pyramid’s Performance Testing Methodology.

PYRAMID PERFORMANCE METHODOLOGY

IDENTIFY TEST ENVIRONMENT

IDENTIFY PERFORMANCE ACCEPTANCE CRITERIA

PLAN & DESIGN

TESTS

CONFIGURE TEST ENVIRONMENT

EXECUTE TESTS

ANALYZE & REPORT


Identify Test Environment

Identify the load generation environment, system under test, and the

tools and resources available.

Identify Performance Acceptance Criteria

Identify the response time, throughput, and resource utilization

goals and constraints. In general, response time is a user concern,

throughput is a business concern, and resource utilization is a system

concern.

Plan and Design Tests

Identify key business processes and load scenarios, determine the

volume of data required, and establish metrics to be collected.

Configure Test Environment

Prepare the test environment, tools, and resources necessary to

execute each strategy as features and components become available

for testing.

Execute Tests

Run and monitor tests. Validate the tests, test data, and results

collected against the test design. Execute validated tests for analysis

while monitoring the test and the test environment.

Analyze and Report

Analyze the data both individually and as a cross-functional team.

The Executive Summary and Performance Goals sections explicitly

summarize the areas that need troubleshooting in an easy-to-read

checklist. All data is charted for additional analysis.

Pyramid Performance Testing Solution Advantages

We run applications through a complete performance evaluation, then

advise the exact number of users a website can support. We pinpoint

potential problem areas and provide a full report detailing what

needs to be fixed. Our performance QA designers (PQAD) work with

your schedule, running tests and performing the analysis. Pyramid’s

Performance Testing Solutions advantages include:

• We centralize performance testing into a single function.

• Our centralized function increases productivity and decreases costs,

preserving investment in performance solutions.

• We increase quality and reduce or eliminate performance defects

prior to production.

• Pyramid’s performance testing and analysis help estimate the

hardware configuration required to support the application(s) at “go

live” to production operation.

• Our Industry-best performance test designers are knowledgeable in

both licensed and open source tools.

• Our performance QA designers have tuned thousands of systems

and know just where to look, saving time to market and money with

our proven testing methodology.

• We provide clear, detailed reports.





FUNCTIONAL




FUNCTIONAL

PERFORMANCE TESTING IS A CRITICAL PART OF

APPLICATION TESTING AS IT AFFECTS BUSINESS

REVENUE, CREDIBILITY OF THE ORGANIZATION, AND

CUSTOMER SATISFACTION.

Pyramid Consulting Inc. - World Headquarters

11100 Atlantis Place, Alpharetta, GA 30022

Phone: 678.514.3500, Toll Free: 877.248.0024

[email protected]

Documents

Performance Testing Solutionssolutions.pyramidci.com/wp-content/uploads/2015/07/Pyramid... · Overview Performance testing ... Performance Testing Solutions help identify bottlenecks