Mobile App Performance Testing with Open Source Tools

BlazeMeter.com | 175 Varick Street NY, NY | 1-855-455-2285 | [email protected]

Performance Testing for Mobile Apps & Sites

(using open source tools)

mailto:[email protected]



BlazeMeterOphir Prusak VP Customer Success & Product Evangelist




Today’s Agenda

• Current Mobile Trend

• Challenges and Importance of a Fast Mobile Experience

• Mobile Performance Testing Solution Walkthrough

• Q&A




Current State of Affairs




Current State of Affairs

Internet Searches

mobile applicationdevelopment

mobile application testing

mobile performance testing

mobile application performance testing


Mobile Challenges

Desktop Mobile

Client “Standard” Browser Multitude of clients

Technology HTML HTML / Native

Bandwidth Fast (1-20 Mb/s) Slow (0.1 Mb/s and up)

Latency Small (less than 100ms) Large (100-1000ms)

Visual Feedback Immediate After data has loaded*




Network Challenges

Latency effect on page load times

Source: http://www.igvita.com/2012/07/19/latency-the-new-web-performance-bottleneck/



http://www.igvita.com/2012/07/19/latency-the-new-web-performance-bottleneck/

http://www.igvita.com/2012/07/19/latency-the-new-web-performance-bottleneck/


Development Life Cycle (old)




Development Life Cycle (new)




Performance Testing Solution Walkthrough

Load Testing Steps• Record the mobile user scenario• Configure test parameters• Run load test• Analyze the results




Recording a Mobile User

Simulation Techniques• Browser Spoofing- Over-ride user-agent string- Only applicable for mobile websites- Does not simulate mobile hardware or functionality

• Proxy Recording- Works with almost all mobile apps - Requires setting up mobile device to use a proxy




Setup the Proxy




Get Your Local IP

Local IP address on a Mac




Point Device to the Proxy

Defining proxy settings on an iPhone




Run the App

Real usage of a mobile app (CNN iPhone app)




View Requests in JMeterAll of the requests made by the app.

Request Headers




Full Recording of All Data

DifferentUser Agent




Load Testing Steps

• Record the mobile user scenario• Configure the test parameters• Run test load test• Analyze the results




Define Test Parameters

- Number of Users - Number of Servers- Test Duration- Ramp Up Time- Load Server Geo Location(s)




Mobile Network Emulation

Define bandwidth and latency for each simulated user




Developer Integrations- Plug-ins for integration into agile / continuous integration tools- Full REST API for custom integration- APM integration for detailed application monitoring- Detailed error reporting- Fully automated spin up / down of dedicated servers- 100% compatible with open source scripting (JMeter)




Load Testing Steps





Load Testing Steps





Detailed Reporting- Performance Testing KPIs- Error Report- Waterfall Report with Detailed Timings- Load Server Monitoring- Application Performance Monitoring- JMeter Logs




Detailed ReportingLoad Results APM - New Relic Real Browser - Selenium

Waterfall Front End Recommendations Errors




Thanks!

Thank you for attending.We’ll send out an email with the recording and the deck.

Q & AFor more information about Performance Testing and JMeter:http://BlazeMeter.com/blog/[email protected]@BlazeMeter



http://BlazeMeter.com/blog/

http://BlazeMeter.com/blog/

