8/6/2019 Wp Perform Realistic Web Testing

1/27

8/6/2019 Wp Perform Realistic Web Testing

2/27

Perform RealisticWebTesting To Ensure BlazingFast Web Site Performance

Mike GualtieriSenior Analyst

Forrester Research

James StatenPrincipal Analyst

Forrester Research

June 16, 2009

8/6/2019 Wp Perform Realistic Web Testing

3/27

Realistic Web

performance testing iscritical to achieving

flawless user

experiences.

8/6/2019 Wp Perform Realistic Web Testing

4/27

4 Entire contents 2008 Forrester Research, Inc. All rights reserved.

Agenda

Why your customers wont wait What is realisticperformance testing?

Recommendations

8/6/2019 Wp Perform Realistic Web Testing

5/27

5 Entire contents 2008 Forrester Research, Inc. All rights reserved.

Agenda

Why your customers wont wait What is realisticperformance testing?

Recommendations

8/6/2019 Wp Perform Realistic Web Testing

6/27

6 Entire contents 2008 Forrester Research, Inc. All rights reserved.

Raw page load speed Gomez Media HomePage Benchmark

April 10 09 May 10 090:00 - 24:00 EST

Performance means:

8/6/2019 Wp Perform Realistic Web Testing

7/27

7 Entire contents 2008 Forrester Research, Inc. All rights reserved.

Gomez Media ArticleSearch Transaction

BenchmarkApril 10 09 May 10 090:00 - 24:00 EST

Customer workflow speed

Performance means:

1

2

3

8/6/2019 Wp Perform Realistic Web Testing

8/27

Blazing fastWeb sites = customers

8/6/2019 Wp Perform Realistic Web Testing

9/27

9 Entire contents 2008 Forrester Research, Inc. All rights reserved.

Traditional Web performance testingdoesnt cut it

Traditional testing is expensive. Cost of licenses, hardware, and training

Time-consuming to implement

Idiosyncrasies of the software are often difficult tomaster.

Traditional testing is not realistic.

Scope is limited to internal, clean-room testing.

Not focused on end-user point of view

Misses too many pieces in the Web applicationdelivery chain such as content delivery network(CDN), third-party components, geography, etc.

8/6/2019 Wp Perform Realistic Web Testing

10/27

10 Entire contents 2008 Forrester Research, Inc. All rights reserved.

Most developers are building Web appsWhat types of new custom applications are your firms developers building?

(Multiple responses accepted)

Base: 977 platform software decision-makers at North American and European enterprises and SMBs

Source: Enterprise And SMB Software Survey, North America And Europe, Q4 2008

8/6/2019 Wp Perform Realistic Web Testing

11/27

11 Entire contents 2008 Forrester Research, Inc. All rights reserved.

New trends make optimal userexperiences even more important

The Millennial generation expects more. 18- to 27-year-olds

The tech-savvy generation

Web site redesigns Rich internet applications (RIA)

More Web sites are composed of third-partycomponents.

Virtualization of infrastructure, including cloud

Mobile apps availability is exploding.

8/6/2019 Wp Perform Realistic Web Testing

12/27

12 Entire contents 2008 Forrester Research, Inc. All rights reserved.

Agenda

Why your customers wont wait? What is realisticperformance testing?

Recommendations

8/6/2019 Wp Perform Realistic Web Testing

13/27

Realistic testing means taking a

walk in your customers shoes.

8/6/2019 Wp Perform Realistic Web Testing

14/27

14 Entire contents 2008 Forrester Research, Inc. All rights reserved.

Realistic testing means testing fromyour customers point of view

Where do they access your site from? Bangkok, Cannes, Des Moines, Dubrovnik,

Edmonton, LA, London, Miami, Osaka, Pusan

What do they do? Key tasks, transactions, and business processes

How do they do it?

Browsers galore, mobile devices

When do they do it (and how frequently)?

Peak times, spikes

8/6/2019 Wp Perform Realistic Web Testing

15/27

15 Entire contents 2008 Forrester Research, Inc. All rights reserved.

The users distance from the contentmatters

Source: Tom Leighton, Improving Performance on the Internet, Queue, October 2008

8/6/2019 Wp Perform Realistic Web Testing

16/27

16 Entire contents 2008 Forrester Research, Inc. All rights reserved.

Boston users of forrester.com have thefastest response time

Source: Gomez (www.gomez.com)

8/6/2019 Wp Perform Realistic Web Testing

17/27

17 Entire contents 2008 Forrester Research, Inc. All rights reserved.

Browsers render differently

Source: Gomez (http://www.gomez.com)

8/6/2019 Wp Perform Realistic Web Testing

18/27

18 Entire contents 2008 Forrester Research, Inc. All rights reserved.

What features should a realistic Webperformance testing platform have?

It should:

Test from the end users point of view.

Different locations

Different browsers Different loads

Different tasks

Be easy for developers, testers, and businesspeopleto use.

Identify and resolve problems along the entire Webapplication delivery chain.

8/6/2019 Wp Perform Realistic Web Testing

19/27

19 Entire contents 2008 Forrester Research, Inc. All rights reserved.

Web sites are increasingly held hostageby third-party apps

Source: Gomez (www.gomez.com)

8/6/2019 Wp Perform Realistic Web Testing

20/27

20 Entire contents 2008 Forrester Research, Inc. All rights reserved.

Vendors offering performancemeasurement solutions

Gomez

Keynote Systems

Cordiant Technologies

8/6/2019 Wp Perform Realistic Web Testing

21/27

21 Entire contents 2008 Forrester Research, Inc. All rights reserved.

Agenda

What do customers want? What is realisticperformance testing?

Recommendations

8/6/2019 Wp Perform Realistic Web Testing

22/27

22 Entire contents 2008 Forrester Research, Inc. All rights reserved.

Recommendations

Design a test plan based on how real users interact

with your Web application. Use testing tools that allow you to test from yourusers point of view:

Where, what, how, and when

Test the entire Web application.

Democratize testing:

Build a test team that includes anyone who has astake in the outcome.

8/6/2019 Wp Perform Realistic Web Testing

23/27

23 Entire contents 2008 Forrester Research, Inc. All rights reserved.

Recommendations (cont.)

Test early to nip problems in the bud.

Test often to maintain a consistently supreme userexperience.

Follow the Blazing Fast Web Site Performance best

practices to keep your Web site humming.

8/6/2019 Wp Perform Realistic Web Testing

24/27

Dont leave user experience tochance.

8/6/2019 Wp Perform Realistic Web Testing

25/27

25 Entire contents 2008 Forrester Research, Inc. All rights reserved.

Perform realistic Web testingto achieve blazing fast Web

site performance.

8/6/2019 Wp Perform Realistic Web Testing

26/27

26 Entire contents 2008 Forrester Research, Inc. All rights reserved.

Thank you

Mike Gualtieri+1 617.613.6145

mgualtieri@forrester.com

James Staten

+1 650.380.3733

jstaten@forrester.com

www.forrester.com

8/6/2019 Wp Perform Realistic Web Testing

27/27

27 Entire contents 2008 Forrester Research, Inc. All rights reserved.

Selected Forrester research

February 4, 2009, Best Practices: Attaining AndMaintaining Blazing Fast Web Site Performance

February 4, 2009, Case Study: How Orbitz TakesYou Places Faster

August 15, 2008, Best Practices: Blazing Fast WebSite Infrastructure

August 15, 2008, Case Study: How Msnbc.com Is

First In News