Performance Testing its not that Scary!

Stephen Mounsey

Performance is Scary

Real World Performance Examples

• Obama Care 4.7 million people in 24 hours

• M&S re-launch 8.1%

• ACCORDING TO GOOGLE, AN EXTRA 500MS OF LATENCY COSTS THEM 20% OF THEIR SEARCH TRAFFIC.

Performance is important

• Google rankings

• Mobile – more sensitive

• User experience

• Conversion rates

• Money

• Marissa Mayer (Google) Users really respond to speed – Maps shrunk from 100k to 70k in three weeks traffic was up 25%

• Walmart increased conversions by 2% for every second of load time improvement

• Amazon report a 1% increase in revenue for Every 100ms of Improvement

Performance Testing

Performance Testing

Stress

Scalability

LoadSoak

FailoverCapacity

Resilience

SpikePerformance Regression

Ramp

EnduranceVolume

Speed

Stability

Load

Stress

Agile, Dev Ops, Continuous Delivery and Performance Testing

• Mentality Change

• Ability to ruin a project days from the deadline

• Early & Often

• Continuous Performance Testing– We need to do more

Early and Often

• How can we do it earlier, smaller units, complete system earlier can you stub or virtualize

• Title: Performance Testing its not that scary

• We all need to do it – Everyone is responsible for Quality

Get Performance Noticed

Principles

• Repeatability - Trends

• Realistic – TVM, Concurrency

• Change One Thing - Scientific

• Understand – Monitor, Measure

Performance Tools

• Loadrunner Performance Center

• Jmeter• Grinder• Smart Bear• Gatling• MS Load Test• Neo-load• WebLoad• Rational

Tool Selection

• Skills• Products • Technology culture• Support vs

Business Critical• Cost• Wider dev

integration

Recruitment

• It’s tough

• PT: It’s not that scary

• Make your own

What do we do?

Monitoring vs Testing

• What if we didn’t performance test?

• Pre production is it the same as production?

• Performance panic

Testing in Production

• Do you test in production?

• Are you outsourcing your perf testing to users

• Performance Testing its not that scary!

A Little about me:

• Stephen Mounsey: @stephenmounsey

• Principal Performance Test Lead

Person of Interest: Scott Barber