36
Ready, Set, Shop! The Pressure is on For Your Applications to Perform Flawlessly before the Holiday Rush Jeff Hughes DevOps: Continuous Delivery CA Technologies Application Delivery D03T37T @yourtechtrends #CAWorld

Ready, Set, Shop! The Pressure is on For Your Applications to Perform Flawlessly before the Holiday Rush

Embed Size (px)

Citation preview

Ready, Set, Shop!

The Pressure is on For Your Applications to Perform Flawlessly before the Holiday Rush

Jeff Hughes

DevOps: Continuous Delivery

CA Technologies

Application Delivery

D03T37T

@yourtechtrends

#CAWorld

2 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD

For Informational Purposes Only

© 2015 CA. All rights reserved. All trademarks referenced herein belong to their respective companies.

The content provided in this CA World 2015 presentation is intended for informational purposes only and does not form any type of warranty. The information provided by a CA partner and/or CA customer has not been reviewed for accuracy by CA.

Terms of this Presentation

3 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD

Abstract

CA Technologies Performance Testing-in-a-Box allows

companies to test applications more quickly by eliminating test

resource constraints, provisioning quality reusable data and

scaling tests to millions of users . Learn from this presentation

how to virtualize production systems, generate quality test data

and stress test with millions of virtual users to significantly

improve application quality and stability.

Jeff Hughes

CA Technologies

Product Marketing Manager

4 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD

Agenda

APPLICATION TRENDS & TESTING CHALLENGES

CA’S VISION OF THE APPLICATION ECONOMY

THE SOLUTION

ENVIRONMENTAL CONSTRAINTS

WRONG TEST DATA

LACK OF SCALE TESTING

1

2

3

4

5

6

5 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD

Are Your Applications Ready for Prime Time?

51% of online shoppers in the US say that site slowness is the top reason they’d abandon a purchase.*

* Akami Interview: http://www.neotys.com/blog/load-testing-with-a-cdn/

6 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD

The Performance Testing Challenge

Testing Remains Ad Hoc and Incomplete

Testing Relies on Accessing Production Systems that are often Unavailable

Test Data is Incomplete and Difficult to Create

Testers Need to Stress Test with Thousands (or Millions) of Users

7 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD

DESIGN RELEASE

CA’s Vision for the Application Economy…Quicker Time-to-market with Better Collaboration, Quality, with Security

OPERATIONS

MONITORINGCOLLABORATIVE

PORTFOLIO PLANNING

CONTINUOUS FEEDBACK

DEVELOP

MODELTEST

CONTINUOUS PLANNING CONTINUOUS INTEGRATION & DELIVERY CONTINUOUS OPERATONS

API MANAGEMENT

RELEASE AUTOMATION

SERVICE VIRTUALIZATION

TEST DATA MANAGEMENT

AGILE PLANNINGPERFORMANCE &

CAPACITY MGMT

App Governance DevOps Enterprise Reliability

SECURE

MOBILE END-USER

APPLICATION ANALYTICS

& DIAGNOSTICS

CLOUD TESTING

8 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD

Key Performance Testing Challenges

ENVIRONMENTAL

Pre-production environment

is not representative of

production

Application components

delivered on different

timelines

DATA – NOT FIT FOR PURPOSE

Insufficient

Not representative of production

In ability to quickly reset to the baseline

TRANSACTION LOAD GENERATION

Appropriate transaction mix to represent production

How to address injection points that are representative of production

Monitoring of results – real time

9 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD

Solving for the – Performance Testing Pitfalls

ENVIRONMENTAL

Pre-production environment

is not representative of

production

Application components

delivered on different

timelines

DATA – NOT FIT FOR PURPOSE

Insufficient

Not representative of production

In ability to quickly reset to the baseline

TRANSACTION LOAD GENERATION

Appropriate transaction mix to represent production

How to address injection points that are representative of production

Monitoring of results – real time

10 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD

Service Virtualization: Why It’s Needed

“I can’t do anything until I have everything

…and I never have

everything!”

Data Constraints

System Constraints

CostConstraints

Parallel DevConstraints

Bottlenecks Everywhere

11 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD

Service Virtualization Eliminates Dev/Test Constraints

“I have everything

I need, when I need it!"

SV … like Wind Tunnel for Fight Simulation

MainframeSystem of

RecordERP SaaS/API

Availability Sync Capacity Cost

System Under Test

12 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD

“I have everything

I need, when I need it!"

Service Virtualization Eliminates Dev/Test Constraints

SV … like Wind Tunnel for Fight Simulation

MainframeSystem of

RecordERP SaaS/API

Availability Sync Capacity Cost

CA ServiceVirtualization

System Under Test

13 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD

“I have everything

I need, when I need it!"

Service Virtualization Eliminates Dev/Test Constraints

SV … like Wind Tunnel for Fight Simulation

MainframeSystem of

RecordERP SaaS/API

Availability Sync Capacity Cost

CA ServiceVirtualization

System Under Test

CA Cloud Test

14 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD

Solving for the – Performance Testing Pitfalls

ENVIRONMENTAL

Pre-production environment

is not representative of

production

Application components

delivered on different

timelines

DATA – NOT FIT FOR PURPOSE

Insufficient

Not representative of production

In ability to quickly reset to the baseline

TRANSACTION LOAD GENERATION

Appropriate transaction mix to represent production

How to address injection points that are representative of production

Monitoring of results – real time

15 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD

Can’t I Just Copy Production Data?

16 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD

Can’t I Just Copy Production Data?

17 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD

Can’t I Just Copy Production Data?

MORE COVERAGE WITH BETTER DATA

18 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD

CA Test Data ManagerProvide High Quality “fit-for-purpose” Data to Dev/Test

Data Profiling

Data Subsetting / Slicing

Data Obfuscation

Virtual Services

Synthetic Data

Subset

Masked

Created

Test Matching

Coverage Metrics

Data Design

Test DesignCA Dev Test

Develo

pm

en

t / TestProduction

Data Objectives

Test Data Warehouse

Version Control

Data Inheritance

19 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD

Solving for the – Performance Testing Pitfalls

ENVIRONMENTAL

Pre-production environment

is not representative of

production

Application components

delivered on different

timelines

DATA – NOT FIT FOR PURPOSE

Insufficient

Not representative of production

In ability to quickly reset to the baseline

TRANSACTION LOAD GENERATION

Appropriate transaction mix to represent production

How to address injection points that are representative of production

Monitoring of results – real time

20 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD

Many Companies Don’t Test in Production

21 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD

Automated Grid Provisioning

22 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD

You Need a Kill Switch – No Fear Factor!

23 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD

Real-time Performance Analysis

24 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD

Detailed Error Analysis

25 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD

Multi-Test-Run Comparison

COMPARE RESULTS OF A LIVE TEST WITH PREVIOUS TEST EXECUTIONS

26 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD

Detailed Transaction, Page, and URL Analysis

• Detailed Transaction and Page Analysis of Web and Mobile Load Tests

Detailed URL Analysis of Web and Mobile Load Tests

27 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD

Run Globally Distributed Load Tests

28 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD

Detailed Page Component Breakdown

29 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD

• Eliminates resource constraints across your backend systems

• Generates test data quickly that is fit-for-purpose, reusable and reliable

• Scales tests up to millions of users across global locations

CA Performance Testing-in-a-BoxA Solution utilizing: CA Service Virtualization, CA Test Data Manager and CA Cloud Test

Eliminates resource constraints across your backend systems

Generates test data quickly that is fit-for-purpose, reusable and reliable

Scales tests up to millions of users across global locations

30 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD

Achieve cost savings via infrastructure optimization and testing resources of

Reduce test data set up effort by

Avoids investing testing costs of

Increase testing platform availability by

90%

Increase application deployment time by

75%

75%

40%http://bit.ly/15bY6Tc

http://bit.ly/184km3C

http://bit.ly/1iNXkCL

http://bit.ly/1Cf80AN

http://slidesha.re/1JajBDp

Here is What’s Possible…

$300,000

31 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD

Q & A

32 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD

Recommended Sessions

SESSION # TITLE DATE/TIME

DO3X113SCase Study: DBS Shares Its Continuous Delivery Journey

as a Global Financial Institution11/19/2015 at 3:00 pm

DO3X114S

Technology Primer: Freeing the World from Slow: How

Service Virtualization and the Concept of S.P.E.E.D. Will

Steer You Away from Committing Continuous Delivery

Suicide

11/19/2015 at 3:45 pm

D03T22SBusiness Transformation: DevOps for a 10-Year Old

(Codebase)11/19/2015 at 4:45 pm

33 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD

Must See Demos

Test Data Management

Embrace Test Data Management

Theater 4

Service Virtualizationon Demand

Service Virtualization on Demand

Theater 3

Service Virtualization

Deliver Better Apps Faster with Service Virtualization

Theater 4

DevOps Sim Experience

DevOps Simulation Experience

Theater 3

34 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD

Follow On Conversations At…

Smart Bar

Theaters 3 & 4

Tech Talks

Theaters 3 & 4

35 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD

Q & A

36 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD

For More Information

To learn more, please visit:

http://cainc.to/Nv2VOe

CA World ’15