Agile, Cloud Computing, Open Source and what's in between

175 Varick Street NY, NY 10013|1.855.445.2285|info@blazemeter.com @alongir

Performance Testing in the

Agile Age

Alon Girmonsky About The Speaker

•  Hands-On Developer for the Past 20 Years •  Expertise

– Large-Scale Web and Mobile Applications –  IP & Internet

•  Founder & CEO of BlazeMeter – A Load Testing Platform as a Service – 100% Compatible with Apache JMeter

20,000

500,000

The Agile Enterprise

•  All organizational divisions - not just R&D •  It’s about survival in a highly competitive

business environment •  Innovate in short Iterations – a MUST! •  New DNA •  New IT Infrastructure (a.k.a Devop)

Agility Enablers

Open Source

Cloud Compu/ng

E.G E.G

Performance Testing

Waterfall Agile

Front-‐end

Back-‐end

Func/onal

Load E.G API

E.G Java Script

In The Agile Age

2005 2010 2014

Agile? What it Means?

"We'd like to squeeze in a load test for XXXX’s biggest event of the year, Fantasy Football season. Our best opportunity to execute this is tonight 3-7am EST. We'd like to generate a constant 40,000 hits/sec for about 1 hour. .."

Traditionally this would have taken weeks and cost $$$

An Example from a Large Media Company

Agile? What it Means?

Traditionally this would have taken weeks and cost $$$

Network Bottleneck Identified

For Both Mobile and Web

Massive Global Simulation of Users, Devices and Mobile Networks

Agile Performance Testing

480 CPU Cores and

1.8 TB of Memory

What Beast Has .. ?

480 CPU cores and 1.8 TB of Memory A Typical Test

EC2 Large 2 cores, 7.5GB

EC2 XL 4 cores, 15GB

Mobile Application Simulation A Common Use-Case

Using Agile Performance Testing

•  You can create such test in a matter of minutes •  You can run dozens of times per day on demand •  You can enjoy an interactive reporting that provides an

immediate intelligence

Actions Sign-up Sign-in Purchase Browse

Comprehensive scripting at your fingertips

Any Script, Any Scenario

•  HTTP / HTTPS •  Login / Signup •  Form POSTing / Credit card transactions •  Web services •  Parameters extraction •  Mobile •  Mongo, MSSQL, Oracle SQL, MySQL •  Multiple user profiles

» Any script » Any scenario » Any protocol

Agile Summary

1 to 300,000 Concurrency

Open-Source Compatible

Self-Served

TTS < 10m

Any Protocol

Any Scenario

Multi Locations

On-Demand

Comprehensive

The Load Sensitivity Point What to look for?

Load Performance Types

Perfect Time

Sensitive

Perfect

The Perfect Load

Sensitive

Sensitive to Load

Bad Performance

Perfect

Here They Are Again

Sensitive

175 Varick Street NY, NY 10013|1.855.445.2285|info@blazemeter.com

What Can Be Achieved By Using Agile Performance

Testing

Apache JMeter + AWS or Commercial Vendors

Use Case Examples

What to Look Out For? GEO Sensitive Testing

•  Realistic Vs Unrealistic Simulation •  Single Location Vs Geo Distributed Load •  Small Subset of Target Servers •  Unrealistic Connectivity

Testing AKAMAI CDN GEO Sensitive Testing

Testing AKAMAI CDN (ALL) GEO Sensitive Testing

Testing AKAMAI CDN (VA Only) GEO Sensitive Testing

In Real-time Pinpoint Accuracy

In Real Time Pinpoint Accuracy

50%-50%

60%-40%

In Real Time Pinpoint Accuracy

100 hits/s

1,000 hits/s

Benefits Distributed Load

•  More realistic •  More load •  Evenly distributed •  More IPs (For a more even load balancing) •  More locations (For GEO sensitive systems)

Conclusions Agile Performance Testing

•  Cloud Computing + Open Source = Agile •  Any Protocol, Any Scenario, Any Scale •  Self-Served, On-Demand, TTS < 10m •  For Dev, Devop, Performance Engineer and Ops •  Test Driven Development •  Better Quality + Faster = Competitive !

Thank you for your time!

Jolt Awards 2013: The Best Testing Tools

Agile, Cloud Computing, Open Source and what's in between

Technology

AGILE, CLOUD COMPUTING, OPEN SOURCE AND WHAT’S IN …€¦ · Agile Performance Testing Cloud Computing + Open Source = Agile Any Protocol, Any Scenario, Any Scale Self-Service,

What's New in CA Agile Requirements Designer?

What's Agile ? Introduction to Agile methods

Design Thinking in an Agile process: why, how, what's the impact on business

Cloud Computing Contracts and Services: What's Really Happening Out There? Toulouse

Agile and what's next

Cloud Computing: What's in It for Me?

What's Agile?

Handout: 'Agile Methodology: What's the Big Deal?

What's the difference between Cloud Computing and ASP?(HBEP#13)

PRINCE2 Agile - What's in it, and what's in it for me?

Cloud Computing: What's the Cloud All About

Cloud Computing - What's all the hype?

Agile Scrum Sprint Length: What's Right for You - Cognizant

Cloud Computing for Agile Software Development and ... · Budapest 21.05.2015 Cloud Computing for Agile Software Development and Resources Management Optimization Grzegorz Kołaczek,

Cloud computing training what's right for me

LCNUG 2015 - what's new for agile teams in TFS 2015

Agile marcoms oct 13 an agile students vision on what's next in marcom - bart versteegen

Agile estimating - what's the point(s)?

Agile Android - index-of.co.ukindex-of.co.uk/Agile/Agile Android by Godfrey Nolan.pdf · Agile Android Nolan Godfrey Nolan Agile Android Shelve in: Mobile Computing User level: Intermediate–Advanced