© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 1Cisco Confidential 1© 2011 Cisco and/or its affiliates. All rights reserved.

Tony Harvey

Cisco Power Case Study

Senior Product Manager SSVPG

June 2012

© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 2

Overview• Multi-billion dollar organization experiencing significant datacenter growth

• Based on growth the current datacenter and service design would rapidly fill the existing facility

• The project was to build a private cloud with the following goals:1) Reduced cabling

2) Reduced power consumption

3) Reducing physical server deployment time frames

4) Increased server density/better floor space utilization

5) Faster service deployment

6) Increased service availability

© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 3

Existing POD Design

• POD

• 800 sq ft

• 40 Server Cabinets

• 100kW Power

• 240-320 Servers

• EDA - Equipment Distribution Area

• 6 – 8 Servers per Cabinet

• ~2.5kW Power Cabinet

• 24x CAT 7a Copper Ports to HDA

• 24x LC Fibre Ports every third cabinet to storage MDA

• HDA - Horizontal Distribution Area

• 120x CAT 7a Copper & 48x LC Fibre to MDA

• 128x analog and 32x serial KVM ports to MDA

• 4x telecom relay racks

• 2x server access switches (2x 10GbE & 312 GbE ports)

• 1x Utility Switch(2x 10GbE, 312 GbE ports)

Main Distribution Area

© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 4

High Density POD

• POD

• 800 sq ft

• 40 Server Cabinets

• 280kW Power

• ~1280 Servers

• Micro POD EDA - Equipment Distribution Area

• 32 Servers per Cabinet/ 160 Per Micro POD

• ~7kW Power Cabinet

• 8-16x CAT 7a Copper to HDA

• 72-96x LC Fibre Ports to HDA

• HDA - Horizontal Distribution Area

• 48x CAT 7a Copper & 48x LC Fibre to MDA

• 2x telecom relay racks

• 2x Optional storage/legacy server racks

• 2x server access switches (N5K)

© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 5

POD Design Comparison

POD Type Cabinets/POD

Sq footage Power/ POD Servers/ POD Servers/ sq foot

Power/ Server

Power/ Cabinet

Low Density

40 800 ft2 100 kW 280 0.35 / ft2 357 watts 2.5 kW

High Density

40 800 ft2 280 kW 1,280 1.6 / ft2 219 watts 7.0 kW

Change 0% 0% 180% 350% 350% (39%) 180%

© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 6

Service Deployment

© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 7

Issues• Traditionally IT divided into separate areas

Network

Servers

Storage

• Changes to installed base required sign-off by all 3

• New installs required additional sign-off by Facilities

• Physical connection layout dictated a servers role

• Each team dedicated to maximizing the effective use of their own assets but little co-ordination on providing the most effective service

© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 8

UCS: Embedded AutomationIntegrated, Policy-Based Infrastructure Management

Server Policy…

Storage Policy…

Network Policy…

Virtualization Policy…

Application Profiles…

Subject Matter Experts Define Policies1

StorageSME

ServerSME

NetworkSME

Policies Used to Create

Service Profile Templates

2

Service ProfileTemplatesCreate Service Profiles

3

Associating Service Profiles with Hardware Configures Servers

Automatically

4

Unified Management

Server NameUUID, MAC, WWN

Boot InformationLAN, SAN ConfigFirmware Policy

Server NameUUID, MAC, WWNBoot InformationLAN, SAN ConfigFirmware Policy

Server NameUUID, MAC, WWNBoot InformationLAN, SAN ConfigFirmware Policy

Server NameUUID, MAC, WWNBoot InformationLAN, SAN ConfigFirmware Policy

Server NameUUID, MAC, WWNBoot InformationLAN, SAN ConfigFirmware Policy

© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 9

VDI Users

Servers Needed – 140 Peak

Rapid Re-provisioningVDI Servers In Use

7:00 8:00 9:00 10:00 11:00 12:00 13:00 14:00 15:00 16:00 17:00 18:00 19:000

50010001500200025003000

• Significant amounts of unused server capacity in off-hours

• UCS Service Profiles enable dynamic H/W re-provisioning

• Servers can repurposed to other jobs

• Compute farm

• Sell unused capacityCustomer use example: http://www.chrisatkinson.com/?p=81

7:00 8:00 9:00 10:00 11:00 12:00 13:00 14:00 15:00 16:00 17:00 18:00 19:000

50

100

150

© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 10

Results• Current implementation of 400 servers

Power Saved = 55.2kW

$48,355 per annum

• Full POD – 1280 servers176.6kW power saved

$154,736 per annum

2,800 sq feet of floor space

Total Cable Savings $90,000.

4380 Cat7a cables at $20 per cable

72 LC Fibre Cables at $75 per cable

• Provisioning Time20:1 reduction in provisioning time

© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 11

Thank you.