Data Center Virtualization @ Cisco

Cisco Confidential 1 Copyright © 2008 Cisco Systems, Inc. All rights reserved.

Jim Robshaw IT Director – Cisco Systems

April 2009

Data Center Virtualization Facility Business Risk Business Agility


Cisco - VMware Logistics

 The Need for Virtualization

 Cisco’s Stats & “Things to Consider”

 Break (15 min)

 Our Hope for the Future of UCS and VMware


Cisco at A Glance


WW Headcount 66,000 employees*

35% Engineering 27% Sales 38% all others

WW Portfolio: 18. 9 million sf (60% owned, 40% leased)

283 metros 90 countries 444 buildings

51 data centers & server rooms 1500+ labs (500+ in San Jose)

20,000 Channel Partners 110+ ASPs 210+ Business & Support Development Partners

End of Q2 FY08 * Persons Housed (excluding SA, Webex, & Ironport)

Over 180,000 people around the world in the extended Cisco family

128+ Acquisitions


The Data Center Reality Why Virtualization

  3 Major Issues Power Space Cooling

Production Data Center

Business Agility

  3 Phases of virtualization Where We Were

Where We Are

Where Are We Going


Constraints

Time Factors

•  65 Data Centers •  230,000 sq ft of Raised DC floor globally •  150 Megawatts of Power •  45%+ of Cisco Data Centers Required Action

•  DC Construction requires 2 - 3 years •  Application provisioning and data migration may add 1

- 2 years, or 3 – 5 years total

•  Services responsible for Cisco revenue •  Business Continuance •  Green technologies not built into older DC designs

Cisco’s Data Center Journey – Wake Up Call!


Data Center / Business Agility Challenges “IT runs the business – downtime is not an option” “I want to see more business value out of IT”

“Our applications are the ‘face’ of our business” “It’s all about keeping the application available”

“As long as my servers are up I’m OK” “We have too many underutilized servers”

“Our information is our business. We need to protect our data everywhere – in transit and at rest”

“I can’t keep up with the amount of storage that needs to be backed up, replicated and archived ”

CxO

Apps

Server

SecOps

Storage

Network “I need to provide lots of bandwidth between data centers, and make sure users can get to the apps”

© 2006 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID 7


Technology Leadership Business Strategy Cisco Green Initiative

  Minimize energy consumption

  Consider power from renewable sources

  Technical innovation   Environmental compliance   Enable new Green

business models   Demonstrate corporate

citizenship

  Drive for growth

  Enable market transitions

  New business models

  Globalization

  Technology and business architecture

  Enable every move we make with IT

  Early Adoption

  Flexibility through modularity

  Product quality improvement

  BU/IT/AS Joint discovery

  Early value realization

  Acquisition opportunities

Acceleration

Automation

Virtualization

Next-Gen DC Networking

Adoption Curve

Management

New Opportunities

Accelerated Adoption

So – Now What? What’s The Plan?


A Concept! Service Oriented Data Center (SODC)

SODC Target State: Pooled Virtual Resources, Automated, Standard Services Based, Secure, Intelligent Unified Data Center Network

Service Oriented

Data Center

Vision

Vision Enablers

Software Technology

Business Processes People Hardware

Technology


Cisco’s Data Center Evolution – Roadmap for “virtual machine deployment”

2005 2004 2006 - 2009 2010 - 2013

•  Standardization •  Virtual Machines

•  4 Tier Silos •  Heterogeneous OS •  Storage Silos •  Low Utilization

•  IP Connectivity

•  Perimeter Security

•  Application Silos •  Distributed

•  Server Orchestration •  VM Mobility •  Storage

Virtualization •  Unified Network

Services FCoE

•  Policy Based Security

•  WAAS ACE

•  Infrastructure Aligned to Application Services

•  Policy Based Management

•  Unified I/O •  Tiered Recovery •  Usage and SLA-

based Funding Model

•  Cloud Based Apps & Services

Legacy Data Center

Virtual Data Center

Service Oriented Data Center

Consolidated Data Center

Consolidation Phase Virtualization Phase

Automation Phase

Compute

Storage

Network

Security

Application

•  SANs, VSANs •  Tiered Storage

•  Consolidate, Centralize

•  Consolidated Network Services

•  Secure Each Application Tier


Service Oriented Data Center –SODC 2 Tracks - Tech Track & Business Track

IT Architecture

IT Operations

Data Center Architecture WAN Optimization Data Center Provisioning

Critical Systems Resiliency Tracks Application Enterprise Architecture Application Dependency Mapping Common Management Database

Agility and Resiliency


SODC Design Phases

 Consolidate Optimize Data Center Resources

Increase Resource Utilization

 Virtualize Virtual Resource Pools

Increase Availability and Agility

 Automate Adaptive Orchestration

Rapid Delivery of Services


SODC Server Virtualization Architecture

Data Center Aggregation

Block

Network Services

Block

Catalyst 4948

Catalyst 6509

Catalyst 6509

SAN B SAN A

Ethernet Fiber Channel


Cisco Data Centers (65)

SJ-12 SJ-K Linksys

RTP 5

Amsterdam

Business Data Center Data Centers Engineering R&D Data Center

Total of 245,000 square feet of

raised Data Center space at Cisco

Scientific Atlanta


Why A New Data Center? (Business Risk)

PDC infrastructure does not support increasing technical requirements, and does not scale cost effectively

“…a significant percentage of new business requests are delayed due to current limitations…”

PDC architecture presents significant business continuity risks

“70% of US computing resources lie within a major earthquake and flood zone”

PDCs are not geared to showcasing the Cisco message

“Cisco technologies such as “Business Ready Data Center” cannot be showcased as designed in our existing data centers”

• US PDCs have been running at capacity for 12 to 18 months; incremental expansion strategies are costly and introduce risk of construction-related disruptions

•  Lack of infrastructure redundancy requires complete data center shutdown to perform thorough testing & maintenance

• Cooling and load bearing constraints limit efficient use of floor space and increase deployment time

• Current applications and technical architecture does not support full business resiliency

•  Location based risks are not currently mitigated and present exposure to potential disruptions

• Cisco cannot fully support Advanced Technologies in our own production environment

• Current PDC environment is a generation behind and does not represent a best-in-class showcase


PDC Site Selection Strategy From 420 Metro Areas Down to 8, Then 1

Must-haves:   U.S. or Canada   Negligible environmental

risk (e.g. earthquake, hurricane, tornadoes, etc.)

  Fiber service   At least 2 long

distance providers

Additional Criteria:   Electrical power cost; long-term price stability   Other costs: real estate, labor, taxes, govt incentives   Proximity to existing Cisco IT operations

  Close to customers   Availability of technical labor

  Regulatory environment

Earthquakes Hurricanes

Tornado Fiber


Where we are (Storage – Compute – Data Center)


Cisco today! Standards based approach

2005 2004 2006 - 2009 2010 - 2013







Virtualization

•  Unified Network Services FCoE


•  WAAS ACE




based Funding Model


Legacy Data Center

Virtual Data Center




Automation Phase

Compute

Storage

Network

Security

Application






Consolidation of Network Fabrics Today in Mountain View

Data Center Aggregation

Block

Network Services

Block

10 GbE Server Access

Nexus 5000

Nexus 7000

Catalyst 6509

SAN B SAN A

Ethernet Fiber Channel

Consolidated transports

SAN Aggregation


  Over 13 PB of “raw” storage

  Overall Growth Rate: FY’02=69%, FY’03=32%, FY’04=50%, FY’05=58%, FY’06=29%, FY’07=52%, FY’08=48%

Cisco Data Center Storage Landscape


SODC Storage Results to date

 Overall utilization increased from 20% to 68% over past 6years

 Managed storage per FTE increased from 25 TB to 750 Terabytes over past 6 years

 Total Cost of Ownership reduced from .21/MB to .01/MB over past 6 years

  $71 Million in cost avoidance over past 4 fiscal years ($9M in FY04, $14M in FY05, $27M in FY06, $21M in FY07)


  Data Center Server Consolidation Improve Operational Agility Lower Data Center Operating Expense

  Increase Utilization of Physical Servers Optimize TCO Improve Data Center Capacity Management

  Reduce Service Provisioning Times Rapid deployment of Operational Services

  Increase Operational Efficiencies Support of Environments Zero down time Operations

SODC Server Virtualization


Cisco Data Center Server Landscape (Standards)

  14,230 virtual/physical servers

  3,802 Applications   1263 DBs (279 prod)

Source: Cisco IT, July 2008

Solaris 20.5% 2,911

Linux 50% 7,101

HPUX 1.5% 217

Windows 28% 4,001


Farms online

Farm Pending go-live

Syd and HK Under Discussion

~3,160 VMs Deployed to Date

~2,609 Active VMs ~43% of IT Business Servers ~203 TB of Storage

204 VMware Servers Across 25 Clusters in 8 Data Centers

~300 New VMs/Qtr (Greenfield)

Target 80% of All New Servers deployed as a Virtual Machine

(currently at 60%)

Service Oriented Data Center – VMware Landscape & Growth


Over $20.4M in Total Cost Avoidance To Date!

Improved Server utilization from 8% to 65%

Service Oriented Data Center – Vmware Financial Results


Server Virtualization Considerations

  Support Model Support Model must drive operational objectives Managed by core SODC Team

  Risk vs. Virtualization Targets ISV’s Support? Reduced Risk = Reduced Potential Savings

  Keep Clients In Mind Minimize Impact of Migrating to Virtual Servers Platespin, VM Converter Software is Crucial

  Communicate VMware Strategy and Direction Success Depends on Leadership Support


Production Data Center (On-Line June 08)

1.0 General & Operations

1.1 Collection & storage recyclables 1.2 Consolidation of equipment 1.3 Construction waste re-cycling 1.4 Energy star appliances 1.5 Building commissioning 1.6 Indoor air quality

2.0 Site

2.1 Erosion control 2.2 Wildlife habitat 2.3 Relocation of trees 2.4 Reduction in automobile use

3.0 Building Shell

3.1 Fly ash 3.2 Glazed screening 3.3 Re-use of existing facility

4.0 Interior Construction

4.1 Recycled content finishes 4.2 Low VOC materials 4.3 Non-CFC fire extinguishers 4.4 No gas suppression system 4.5 Carbon monoxide monitoring 4.6 Lighting controls 4.7 Re-use of building systems 4.8 Salvage & stock materials

5.0 Electrical

5.1 Generator emission controls 5.2 Distributed battery pack 5.3 Lighting controls 5.4 Generator test under build load 5.5 Transformer efficiency 5.6 Electronic ballasts 5.7 T8 flourescent lamps

6.0 Mechanical

6.1 Waterside economizer 6.2 Pump curves 6.3 Chiller efficiencies 6.4 Cooling tower water treatment 6.5 Non CFC refrigerant 6.6 VFD’s 6.7 UPS heat tempering 6.8 Heat recovery for office space 6.9 Chilled water operating temps 6.10 Motion activated fixtures 6.11 Vapour barrier 6.12 N+2 chiller configuration


Data Center Operational Choices

 Active-Standby

  Same as today   Doesn’t work well today   Only critical apps   Idle hardware   Different configuration in both DCs

  Min infra complexity   Med apps complexity

 Active-Active

  Used by financial institutions (E.g. metro clusters, multi-master data)

  Majority of apps   Vendor specific

  High infra complexity   High apps complexity


Cisco Data Centers (51)

SJ-12 SJ-K Linksys

RTP 5

Amsterdam

Business Data Center Data Centers Engineering R&D Data Center

Total of 230,000 square feet of

raised Data Center space at Cisco

Scientific Atlanta


Break - 15 Minutes


Cisco’s Future with Virtualization! Unified Computing System & VMware


The Vmware VMMark benchmark – 164% increase over prior top-scoring two-socket systems based on previous-generation Intel processors.

Vmware Benchmark - UCS 164% Increase

UCS and Vmware will exploit all of the next generation features & functionality!


Cisco’s Data Center Future – Roadmap for “virtual machine deployment”

2005 2004 2006 - 2009 2010 - 2013







Virtualization •  Unified Network

Services FCoE


•  WAAS ACE




based Funding Model


Legacy Data Center

Virtual Data Center




Automation Phase

Compute

Storage

Network

Security

Application






Virtualization Architecture Unified Computing System

Network Services

Block

Nexus 7000

Catalyst 6500

SAN A

An even simpler arrangement

SAN B


From cabling to your Data Center organization – UCS simplifies

From ad hoc and inconsistent…

…to structured, but siloed, complicated

and costly… …to simple, optimized

and automated

What does your Data Center organization look like?


Plant / Business Risk / Agility The differences (Airflow/cables, etc.)

What UCS provides: Less Cabling Increased Air flow Less Power Less Components Greater Memory Greater Density

We will be able to: Defer Data Center build 3yrs Better asset utilization Automate Services Reduce Opex Reduce Capex Offer Cloud based services

IaaS PaaS SaaS

Drive VMs per Kwatt Tighter Partnership with Vmware and Intel


… Evolution: You have been building the foundation since 1993

Legacy Virtualization + consolidated infrastructure

+ Unified Data Center

Compute

Storage

Network

Management

Dedicated Physical Multi-OS Servers

Dedicated Storage Infrastructure

Dedicated Network Infrastructure

Single Element Management per Technology

Multiple virtuals in physical server.

Multiple Storage Fabrics on single Physical Infrastructure Services virtualized and migrated into Network

Element Managers deployed for virtual and physical infrastructure

Higher performance virtual servers

Improved performance with fewer nodes

Migration to single Data Center Infrastructure

Servers optimized across I/O, memory and cpu

Storage integration into compute plane

Data Center integrated and holistically managed

Network fully integrated into data center platform

Integration of Storage and networks into single Management platform


Global DC Presence – Target End State 51 – 20 by FY13

Netherlands – Metro-based DC Pair (Tier-III)

Single-Instance Order Management (OM/AR) -

AsiaPAC TBD – Single DC (Tier-III) + land Continental hub for SaaS, Unified

Communications and software development

1 A 1 x Type - A ( Tier - III ) 2 A sc 2 x Type - A at Synchronous Capable Distance

1 A 2 A sc

2 A sc

1 A

Mountain View (CA) –

Early Adopter DC

E

E Early Adopter DC

(~Uptime Tier-II) (~Uptime Tier-III)

B

B Type - B ( Tier - II ) 1 x Type - A ( Tier - III ) B

2 x Type - A at Synchronous Capable Distance

B

40 ms rtt

B B

B

B

B B

B B

Distributed standalone DCs (Tier-II)

Latency-sensitive software development at lower availability

Richardson (TX) – Metro-based DC Pair (Tier-III)

Global hub for business applications Continental hub for SaaS and communications

Global Disaster Recovery Strategy

Short to Mid-Term: Leverage Current Assets

Long-Term: Part of Decision Process (Make/Buy)

1 x Type - A ( Tier - III ) 2 x Type - A at Synchronous Capable Distance

BC / DR Plan Type - B ( Tier - II ) 1 x Type - A ( Tier - III ) 2 x Type - A at Synchronous Capable Distance

BC / DR Plan

1 A


Data Center 3.0 Evolution Path

Unified Computing

Consolidation Virtualization Automation Utility Cloud

Data Center Networking

Unified Fabric

Unified Computing

Enterprise Class Clouds

Inter - Cloud

Location Freedom

HW Freedom

Provisioning Freedom

Virtualization has created a market transition . “Servers” are becoming fluid objects in the network. The data center must evolve to continue to scale. Cisco is offering a fresh alternative to traditional ad-hoc add-on approaches for virtualized data centers.

…


Thank You!

Jim Robshaw [email protected]