Building a Performance A-Team

© 2015 SOASTA. All rights reserved. May 3, 2023 2CONFIDENTIAL – Not for Distribution

Presenters

Howard ChorneyTechnical Director

James PulleyChief Geek, LiteSquare

Moderator: Kathy LamProduct Marketing

It’s All About the Benjamin's!!!!!!!

Why does it matter?

© 2014 SOASTA. All rights reserved. May 3, 2023 4CONFIDENTIAL – Not for Distribution

All I want is to add my stuff to my cart.

Slow Site = Unhappy Customer = Bye Bye

Is it ever going to load?!?

© 2014 SOASTA. All rights reserved. May 3, 2023 5CONFIDENTIAL – Not for Distribution

AssumptionsYou Understand:

• Industry Standard Automated Performance Testing Tools• How to Write a Performance Requirements Document• Test Planning • Basic Reporting and Analysis

© 2014 SOASTA. All rights reserved. May 3, 2023 6CONFIDENTIAL – Not for Distribution

Agenda• Today’s Performance Testing Challenges• Step One “Team”• Step Two “Key Requirements”• Step Three “ Four Levels of Performance Testing• Step Four “ Key Performance Indicators”• Q & A

SoftwareNetwork

Hardware

The First Challenge of Testing for Website Performance

© 2014 SOASTA. All rights reserved. May 3, 2023 8CONFIDENTIAL – Not for Distribution

It’s All of Us Against the Beastie

• The Business• Development• Performance Engineering• Ops

© 2014 SOASTA. All rights reserved. May 3, 2023 9CONFIDENTIAL – Not for Distribution

Use What You Can Control to Optimize for What You Cannot Control

© 2014 SOASTA. All rights reserved. May 3, 2023 10

CONFIDENTIAL – Not for Distribution

Hardware

o Serverso Storageo CPUo Memoryo NW Layer One

Internal - Control

© 2014 SOASTA. All rights reserved. May 3, 2023 11

CONFIDENTIAL – Not for Distribution

Softwareo OS

o eCommerce Suite• Webserver

• App-server

• Database

• Search Engine

• Ordering

• Order Fulfillment

o Service Bus

o Third Party Callouts

o Content Management

o Consumer Access • Web

• Mobile Web

• Native MobileInternal - Control

© 2014 SOASTA. All rights reserved. May 3, 2023 12

CONFIDENTIAL – Not for Distribution

Network •

Internal-

Control

External-

No Control

© 2014 SOASTA. All rights reserved. May 3, 2023 13

CONFIDENTIAL – Not for Distribution

Step One: Team Core Components

o Performance Architect• Strategic Vision

• Technical Communications • Technical Leadership• Business Leadership• All Technical Teams

o Sr. Performance Engineer• Performance Analytics

• Lead Test Development

o Performance Engineer• Coding and Testing

© 2014 SOASTA. All rights reserved. May 3, 2023 14

CONFIDENTIAL – Not for Distribution

Flip the IceBerg

Tools 5-15%

Foundation Skills 85-95%

© 2014 SOASTA. All rights reserved. May 3, 2023 15

CONFIDENTIAL – Not for Distribution

Foundation Skills?o Test Acumeno Architectureo Developmento Requirements o Communicationso Project Management

Platform Expertise (Database/Web/App Server/ …)Systems Analysis

Small teams

mandate higher skills

© 2014 SOASTA. All rights reserved. May 3, 2023 16

CONFIDENTIAL – Not for Distribution

Put it all together and it spells - YIKES!!!!!!

Step Two: Gathering Three Key Requirements

•SLAs

•Business Flows

•Transaction Volumes

Step Three: Four Levels of Performance TestingFour Level Test Approach

© 2014 SOASTA. All rights reserved. May 3, 2023 19

CONFIDENTIAL – Not for Distribution

Level One: Coding for Performance

o Performance Testing Can Take the Lead• Define best practices and introduce to your development group

• Plug yourself in.• Write a paper on it.

o Champion Code Review Rules Engine

• SONAR

• 88 Performance Based Ruleso Go For The Ounce Of Prevention!!!!

Code Reviews

© 2014 SOASTA. All rights reserved. May 3, 2023 20

CONFIDENTIAL – Not for Distribution

o If Your Test Tool Can’t Handle It, Get One That Can

Level Two: Attack the Service Level

© 2014 SOASTA. All rights reserved. May 3, 2023 21

CONFIDENTIAL – Not for Distribution

o Sample Business Flow• Navigate to site• Browse for item• Select item • Read product description page• Add to cart• Complete checkout

o Virtualize Outside Calls• LISA

Level Three: Logical End to End Business Process

© 2014 SOASTA. All rights reserved. May 3, 2023 22

CONFIDENTIAL – Not for Distribution

o Execute all Business Process in Parallelo Test Under Peak Traffic

• Black Friday

• Cyber Monday

o Deploy Funnelingo Execute With All User Types

• Web

• Mobile Web

• Native Mobie

o Add API with the Business Process Flowso Virtualize Third Party Callouts include Delays

Level Four: Full Site Test Execution

© 2014 SOASTA. All rights reserved. May 3, 2023 23

CONFIDENTIAL – Not for Distribution

No Better Place To Ensure Your Site Will Scale.

GO FOR IT!!! BUT

Be Prepared!

© 2014 SOASTA. All rights reserved. May 3, 2023 24

CONFIDENTIAL – Not for Distribution

o Product Healtho Project Healtho Process Healtho Conversion Rateo Production Stats

Level Five: Monitoring KPI’s

Top 5

© 2014 SOASTA. All rights reserved. May 3, 2023 25

CONFIDENTIAL – Not for Distribution

Fast Site = Happy Customer = Higher Revenue

$$ CHA-CHING $$

Your orderConfirmationis 0U812

© 2014 SOASTA. All rights reserved. May 3, 2023 26

CONFIDENTIAL – Not for Distribution

? Questions ?