Navigating through the Cloud – connecting your users with your apps

Zeus Technology

Connecting Your Users to Your Applications

Owen Garrett, Director of Cloud Solutions

• Setting the scene: Why performance matters

• “The cloud has infinite resource. Why should I care about performance?”

• Industry Solutions

• What is an „Application Delivery Controller?‟

• Three case studies:

• How Zeus customers have built high-performance cloud applications

• Solutions to Application Delivery

• Consistent delivery of applications from a combination of physical, virtual

and cloud datacenters.

© Zeus Technology 20102

Agenda

• “Virtualization creates new sources and destinations for traffic

in a moment's notice. Network managers in the past didn't have

to worry about that rate of change. It's [now] a much more

dynamic environment.”

Jim Frey, research director at Enterprise Management

Associates

• You must ensure the availability of applications in fluid cloud and

virtual environments


What is the problem?

A delicate balancing act

4 © Zeus Technology 2010

Availability

Performance

Cost

Revenue

0

2

4

6

8

10

12

1997 1998 1999 2000 2001 2002 2003 2004 2005 2006

0

2

4

6

8

10

12

1997 1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010

The „N‟-second rule...

• 10-second rule (Jakob Nielsen, March 1997)

• 8-second rule (Zona Research, June 2001)

• 4-second rule (JupiterResearch, June 2006)

Latency problems impact revenue

• Google

• 10-result page: 0.4 seconds load time

• 30-result page: 0.9 seconds load time

• Google Maps

• Home page down from 100KB to 70-80KB

• Amazon.com

• Experimented with page load times:

• Microsoft Bing

• Search results slowed by 1 second:

• Search results slowed by 2 seconds:

Traffic and ad revenues

down 20%

Traffic up 10% in week

1, 37% in weeks 2, 3, 4

Queries down by 1.0%;

Revenue down by 1.5%

Queries down by 2.5%;

Revenue down by 4.4%

Every 100 ms increase

revenue down by 1%

Aberdeen Report: The Performance of Web Applications


-11%

-7%

-16%

-20%

-18%

-16%

-14%

-12%

-10%

-8%

-6%

-4%

-2%

0%

Page Views Conversions Customer Satisfaction

Average impact of 1 second delay in response time for Web users

The Performance of Web Applications: Customers Are Won or Lost in One Second

Bojan Simic, Aberdeen Group

Gomez average performance metrics

Industry Response Time (sec) Availibility (%)

Retail 2.31 99.88

Banking 3.30 99.85

Media 4.98 99.88

Travel (Airlines) 3.55 99.90

• Poor site performance costs:

• Lost Revenues

• Brand Damage

• More customer support calls

• Increase in service delivery costs


Data based upon Gomez November 2009 U.S. Benchmark Data

• Cloud Computing services reduce costs …

…but…

• Cloud Computing may make it more difficult to deliver

the performance and reliability your customers are

used to.


The conundrum many IT managers face

• Application Delivery Controllers


The industry solution

“I would rather my IT team spent time developing our services, rather than

dealing with performance, clustering and other application delivery problems.”

Application Delivery Controllers


Traffic Managers /

Application Delivery Controllers

• Traffic Management Rules

• Full Traffic Manipulation

• Additional Functionality

Advanced Load

Balancers

• Traffic Shaping

• Optimization

• Acceleration

Basic Load

Balancers

• High Availability

• Scalability

• Load Balancing

1998 2003 2008


• “By 2013, SoftADCs will account for nearly one third of all ADC

units shipped”

Joe Skorupa, Gartner

Zeus Traffic Manager

SSL Decryption

Service Protection

TCP Offload

Rate Shaping

Application Firewall

request

response

Web and Application

Servers

Pool

(server

connections)

Content Compression

HTTP Caching

TCP Offload

Service Level Monitoring

Bandwidth Shaping

Transaction Logging

Application Firewall

Virtual Server

(client connections)

Monitors

Request Rules

RuleBuilder

TrafficScrip

t

Java

Web-based Admin Interface

Real-Time and Historical analytics and reporting

TrafficCluster traffic sharing and fault tolerance

SOAP and Command Line APIs

SNMP and SOAP interfaces for real-time status

Event Handling interface

Response Rules

RuleBuilder

TrafficScrip

t

Java

Load Balancing

Session Persistence

Bandwidth Shaping

SSL Encryption

HTTP Multiplexing

Concurrency Control

Application Auto-

Scaling

Zeus Traffic Manager: Architecture

• “Virtualization creates new sources and destinations for traffic

in a moment's notice. Network managers in the past didn't have

to worry about that rate of change. It's [now] a much more

dynamic environment.”

Jim Frey, research director at Enterprise Management

Associates

• An Application Delivery Controller abstracts away the network

connection between the sources and destinations and manages the

transactions


Our original problem

• Mozilla Foundation

• “Strategically get content closer to users where it makes sense.”

• YottaServe

• „Virtual‟ does not have to mean „slow‟.

• Seamless upgrade of applications

• No downtime, no loss of sessions.


Three examples of applications in Cloud

environments

• http://blog.mozilla.com/mrz/2008/12/01/christmas-load-balancers/


Strategically get content closer to users where it makes

sense

• http://blog.mozilla.com/mrz/2008/12/01/christmas-load-balancers/


Mozilla

• http://blog.mozilla.com/mrz/2009/09/18/2-seconds/


Mozilla – the “Amsterdam reboot”



Mozilla – the “Amsterdam reboot”



Mozilla – In Singapore

• http://blog.mozilla.com/mrz/2009/09/25/where-in-the-world-is-amo-part-vi-we-did-it-

again/


Mozilla – In Singapore

„Virtual‟ does not have to mean „slow‟

22

Find the case study on www.zeus.com.

Initial application tests show that response times

rose sharply - up to over 100 seconds for a page

request - as the number of users were ramped

up.

After application acceleration and traffic

optimization, response times were less than 100

milliseconds - a complete performance

transformation!

YottaServe

23

“We were able to demonstrate that placing Zeus Traffic Manager in

front of the application transformed the number of concurrent users

from ten into thousands – with no application modifications needed.”

Jeff Rhys-Jones, Founder, YottaServe


Cloud Bursting necessary to deliver content at realistic cost

http://www.zeus.com/resources/

case_studies/comic-relief.html

No downtime, no loss of sessions

• In the cloud, your „app‟ becomes an infinitely divisible quantity


Smooth application upgrade process...

• Three application instances running



• Clone one and direct developer users to it



• Ready to deploy... Clone the new application version



• Smoothly migrate users from „old‟ to „new‟



• Reap the old application once all sessions are complete

No downtime

No interruption in service

No time pressure during

testing

Fully process controlled

Can roll-back at any point


Migrating users

How do you migrate users

from one generation of an application

to another, seamlessly?

$cookie = http.getCookie( "MyPool" );

if( $cookie ) {pool.select( $cookie );

}# If no cookie, Zeus will use the default pool

TrafficScript

$cookie = http.getCookie( "MyPool" );

if( !$cookie ) {http.setResponseCookie( "MyPool", connection.getPool() );

}

TrafficScript


• Several techniques are evident:

• Global Traffic Management

• Local Application Acceleration

• Intelligent Traffic Control

• Other techniques used by cloud and virtualized applications:

• AutoScaling

• Orchestration of workload bursting

• Application staging

• Monitoring and deep analytics


What techniques have these

case studies illustrated?

• Cloud is just one of the technologies an enterprise may use when

hosting and delivering applications and services.

• Enterprises require consistent delivery of applications from a

combination of physical, virtual and cloud datacenters.


When delivering your services to a

global audience becomes strategic

• Where do current solutions fall short?


Enterprise Solutions to Application Delivery

US

Europe

Japan

Development

• Management

• Consistency

• Global Traffic Direction

• Cross-platform support

• Visualization

• ROI measurement

Zeus Product Portfolio

35

Any Combination of Platforms

36

One Application Delivery Fabric

US

Single-site

deployment

Wide-area (global) load balancing

(traffic directed across multiple locations)

Disaster recovery

(US fails over to Europe)

Developme

nt

environmen

t

Auto-scaling in any

„elastic‟ location

Europe

Japan

Development

Elastic Application Delivery platform use cases

37

• Cloud is a journey. It‟s probably not even the endpoint. However,

even if you‟re not going to use the cloud, there are benefits in taking

a „cloud-ready‟ approach

• Application Delivery Controllers are key to assuring the successful

delivery of applications from datacenter to user

• They are not your Grandad‟s load balancer

• Multiple customer successes achieved using ADCs to manage user

interactions

• If delivering services is strategic to your business, look towards the

emergence of strategic solutions – Application Delivery platforms


Closing observations


About Zeus

• Application Delivery software vendor based in San Mateo and Cambridge UK

• Delivering Traffic Management solutions to:

• 7 of the top 10 Global Telcos

• Major Broadcasters and Media companies

• eCommerce sectors, spanning retail, game and leisure businesses

• Demanding Cloud and Service Providers

Over

1,300customers worldwide

AT&T, Verizon Communications, Nippon Telegraph and Telephone, Telefonica, France Telecom, Vodafone, Telecom

Italia, BT , BBC, Sky, Direct TV, ITV, C4, BT Vision, Virgin Media, Amazon

EC2, Rackspace, Joyent, 3Tera, Terremark, EMC, GoGrid, Play.Com, Gilt Groupe, Virgin

Media, PKR, Skybet, Iwantoneofthose.com, Disney, Whitepages, NASA

Other

MediaTelco Hosting & Cloud eRetail

Keeping Key Brands Online

© Zeus Technology 201040 Confidential40 © Zeus Technology 2010

• Come and see us on stand 670

• Visit us: www.zeus.com

• Get in touch: [email protected] or [email protected]

• Try it out: run Zeus application delivery solutions in EC2 or in the

cloud of your choice, or on physical or virtual servers


Find out more

http://www.zeus.com/

mailto:[email protected]

mailto:[email protected]