Ibm Lehman Datacenter

7/30/2019 Ibm Lehman Datacenter

1/25

2011 IBM Corporation

A Blueprint for a Smarter Data CenterData Center Services helps you respond to change

Bret W. Lehman, PE

GTS Site and Facilities Services

March 25, 2011


2/25

2 2011 IBM Corporation

A Blueprint for a Smarter Data Center

82M Servers installedby 2013

650% Storage growthby 2012

75%

2-3%

Of data centersare > 7 years old

70 Of every $1 is spenton maintaining

existing environment

71%

5-60% Of IT workloadsmay becloud-enabled

Of CIOsanticipate a

stronglycentralizedinfrastructurein 5 years

Change is accelerating

IT demand Cost pressures Need for flexibility

20% Server workloadshave beenvirtualized


3/25



Analytics-based approach provides insight for action

Determinethe next

focus area

Modeloutcomes

beforeyou

implement

Justifyexpenditure

Leverageautomation

Use discoverytools to gaininsights to

prioritize youractions

Evaluatealternatives to

predict

outcomes andreduce risk

Provide theTCO and FTEimpacts to

drive returnon investment

Execute faster andwith less dependencyon critical staff by

infusing intelligenceinto tools

Future Proof Rationalize the Portfolio Flexible Design

Integrated Management

Double IT capacity orReduce OpEx by 50%

Defer 40-50% of capitaland operating expenses


4/25



Middleware Strategy

and Design Services

Storage Optimization

Services

Server Virtualization

Services

ApplicationRationalization

StorageExplosion

VirtualizationLog Jam

IBM Lexington leveraged IT and data center infrastructure analyticsto avoid $50M and gained 8x IT capacity

Diagnose

Establishbaseline energyuse

20x moreservers than

needed

Consolidate &Virtualize

10xincreasein assetutilization

Compute

Resources

8x growth in ITcapacity

2x growth innumber ofservers

ImprovedOperations

10% improvement from lessover cooling

Best

Practices

Right size infrastructure tovirtualized IT workloads

Visibility,Automation,

Control

15-20% power savingsfrom actual usage

White paper:Extend the life of an existing data centerhttp://www935.ibm.com/services/us/cio/outsourcing/ case_studies.html

Future proof


5/25



Server Virtualization Analytics cut transformation time in half andprovide 6-18 month ROI for complex Wintel environments

Challenge

10-30% virtualization success

Majority is non-critical,infrastructure workloads

Not able to tackle more complexvirtualizations

Benefits

50% reduced transformation costs

40-80% reduction in time to

virtualize 6-18 months ROI on complex

Wintel environments

Up to 220% increase in instancesmanaged per FTE

Use Virtualization Fast Pathprescriptive actions and finely tuned

migration factory dedicated resourcesfor rapid implementation

Use Fit for virtualization analyticsto profile workload into 6 scenarios

Future proof


6/25



Define standard data types (15-20)

Size Availability Performance

OperationalRecovery

Disaster

Recovery

Enter data type needed

User input requested

DatabaseSpace

TransactionLogs

ArchiveLogs

DatabaseBinaries

EmailSpace/Store

EmailLogs

EmailArchive

SharedFile Space

Static FileSpace

Active FileSpace

User HomeDirectories

Voice Video Backup Exports

AppBinaries

AppLogs

OS

Define key performance indicators Data

Security Compliance

Migration Archive Disposal

Storage

Backup/Recovery

Network

Archive

Architect to infrastructure Disaster

Recovery

System

BusinessContinuity

Services

Storage provisioned

DEFINE

ONCE

USE

OFTEN

Before

Meetings to reach consensus

Storage experts engaged ateach step

Most expensive storage tierrequested

After

Increase utilization to >50%

Free 50% of architects time

10-20% tier 1 storage reduction Policies, not people, drive

decisions

Intelligent Storage Service Catalog automates storage requests sothe right resources are used for the right task at the right time

Future proof


7/25



IBMs data center strategy uses tools to address complex decisionsto balance the business requirements with objective analysis

Rationalize

Ensure availability

Cost of outagesVulnerabilities

Resiliency level

Data replication techniques

Improve efficiency

In-source or out-sourceLease or own

Shift spending to newapplication development

Enable growth

New business andacquisition plans

Virtualization and cloudadoption plans

How many and where

are assets needed


8/25


A Blueprint for a Smarter Data CenterRationalize

Physical InfrastructureCapacity AnalysisPrimary Data Center UPS

Resiliency RationalizationResiliency Value ($) to Outages per Year

Exposure ($ Thousands) Per Hour

100 200 300 400 500 600 700 800 9000

2468

1012

14

16

Res

iliency

Va

lue

$M

(capex

+opex

+ris

k)

0

Single Site

Twin SitesOn Campus

Twin SitesIn Region

Twin SitesOut of Region

Cash Flow Analysis

0

200

400

600

800

1000

1200

kva

2011 2013 2015 2017 2019 1 2 3 4 5

15

20

25

30

$(Millions

)

Consolidating to a new data center has thehighest up-front costs, but reduces the annualbudget by 33 percent.

Performing end-of-life consolidations spreadsout the costs, but only saves 4 percent over thefive years.

Retrofitting existing facilities yields animmediate budget savings of 12 percent.

Current budget is growing 6 percent per year.

Ourdata center strategy analytics model outcomes and justifyexpenditures to reduce operating costs by 50%

Year


9/25



Analytics for logical dependency mapping applies mathematicalmodeling to identify application & server dependencies for relocation

Deliver seamless transition

Discover ~100% of the assets &dependencies in 50% less time; fixunsupported environments

Reduce Risk

Move dependent applications andequipment together

Rationalize

9

Example:27 servers


10/25



IBM has designed over 480 modular data centers in the last 3years to be responsive to change

Watch a video at :http://www-03.ibm.com/systems/data/flash/dynamicinfrastructure/datacenterdesignsolutions/

Scalable modularScalable modulardata centerdata center

Enterprise modularEnterprise modulardata centerdata center

Portable modularPortable modulardata centerdata center

High densityHigh densityzonezone

15-25% lower TCOthan traditionaldata centers

Defer 40-50% ofcapex and opexcost

Fullyfunctionaldata center

35% lowercost thansite retrofit

Flexible Design

We design to provide

Capacity before you need it so it is ready when you need itMaximize flexibility for future technology and computing models

Provide insight to make capital and operating trade-off decisions

Interconnect IT, data centers and buildings for operations management excellence


11/25



Modular data centers can defer 40-50% of the lifecycle costs toprovide flexibility for the future

Data center capital costs

Focus on the 60% costs frommechanical and electrical systems

Shell7%

Mechanical20%

Fees24%

Fit-UpCosts

9%

Instrumentation& Controls4%

Power

36%

Source: IBM Estimates

Data Center operating costs

Can be 3 to 5 times the capital costs

Cumu

lati

ve

Cos

to

fOpera

tions

($Millions

)

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20

$100

$150

$200

$250

$50

0

Cumu

lati

ve

Cos

to

fOpera

tions

($Millions

)

Year

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20

$100

$150

$200

$250

$50

0

Energy Cost

Staffing

Bldg. Maint. & Mgmt.

R E Tax

Total Capex Cost

Reduced Opex Costs

Flexible Design


12/25



Data center design lifecycle cost analytics help clarify trade-offsbetween capital and operating costs over the life of the facilityExample: 20,000 square foot data center, Computer room air conditioners

Source: IBM Estimates

Capital CostsCapital costs for Computer Room Air

Conditioners can vary by 5x

Under-floorCooling

CombinedSystems

Close CoupledCooling

$2

1.5

1

.5

0

$Millions

Operational CostsOperational cost for Computer RoomAir Conditioners can vary by 140%

2

1.5

1

.5

0

Year

1 2 3 4 5 6 7 8 9 10

2.5

$3

$Millions

Under-floor Cooling

Combined Systems

Close Coupled

Close Coupled, RDHX

Although highly efficient, close coupled cooling doesn't always provide the lowest TCO

Rear door heat exchanger is the lowest cost solution to support high density equipment

Raised floor cooling is cost effective for low density environment

Flexible Design


13/25



Maximize capacity and flexibility for technology and computingmodel adoption

1. ASHRAE Publication: Datacomm Equipment Power and Cooling Applications, 2005, page 24

Business challenge:

Server power density trends1: 20x

0%

5%

10%

15%

20%

25%

30%

35%

0 5 10 15 20 25 30 35

h

Solution

Create a demand model which plans for rack density changes over time

32 kW rack equates to 1600 w/sf peak verses 100 w/sf average on data center floor

Design for air cooling as primary but provide liquid cooling without disrupting operations

Modularity creates agility

Raleigh site challenge:

Expected IT kW/rack power density

Source: Page 4, Figure 1.3, Best Practices for Datacom Facility EnergyEfficiency Second Ed. (c) 2009.

Kilowa

tts

/rac

k

0

10

20

30

40

2000 2002 2004 2006 2008 2010 2012 2014

Flexible Design


14/25



Modular design allows for expansion of power and cooling densitywith minimal disruption to operations

Improved servicewith lower risk forminimal cost"

Any to any connectivitybetween chillers, waterside economizers, andpumps.

Meet growthrequirement without

down time; matchspending to growth

Electrical switchgear sizedto grow. Electrical

distribution scalable permodule

Adapt Opex andCapex to businessneeds

Modular UPS design andchiller plant design.

Meeting future highdensity ITrequirement

Provisioned for potentialwater cooling.

5 to 10% initial costincrease DC life

expectancy

Electrical and Mechanicalsystem sized to meet

future capacity needs.

Piping for water cooling

Modular design future CRAC capacity

Electrical switch gear sized to grow

Flexible Design


15/25



Meet SLA agreements with cost-effective high availability

Reduce energy andincrease availability formaintenance

Adopt free cooling

Improved energy andresiliency

Select variable drive andefficient chillers.

Added resiliency withoperation in mind

Wet cell battery capacityprovides 15 minutes ofride-through power

Added resiliency tohigh density

Provide chilled waterstorage for lower costbackup.

A cost effectivesolution to resiliency

Employ N+1 generatorsfor standby for critical

workloads.

N+1 Generators

Chilled water storage

Wet cell batteries

Flexible Design


16/25



No regrets design decisions with 1-3 yr paybackBased on cost of $0.10 kilowatt hour

1,000 hours with lessthan 5 years

Adopt free cooling, checkyour climate zone foravailable the number ofhours per year.

Less than 3 yearsSelect higher efficiency

chillers.

Less than 3 yearsUse plug fans and EC

motors on CRACs.

Less than 2 years

Provide VariableFrequency Drives (VFD)on pumps and motors.

Less than 1 yearEmploy premium

efficiency motors. VariableFrequencyPump

HighEfficiencyChillers

Freecooling -Water sideeconomizer

Flexible Design


17/25



Raleigh integrates IT, data center & building management toimprove availability, capacity planning & energy management

IT and Facilitiesmetrics and dashboards

Alerting tobusiness impacts

Optimal assetplacement

Optimize energy withthermal mapping

IBM Tivoli MonitoringITM for Energy Management, TBSM, Netcool

Active Energy Manager, Director

OSISoftPI

IBM Asset LifecycleManagement

Key data, facility requirements

IBM MMTThermal measurement,

modelling, spatialplanning

ITServer data; Asset data DATA CENTERRoom sensors; CRACs; PDUs BUILDINGSiemens BMS; SquareD



18/25



Integration allows for improved asset purchase & placementdecisions to help meet service level objectives throughout lifecycle

Do I have the capacityto install new servers?

IT & Facilities Dashboard

Where can I locatethe new servers?

How to run at higherASHRAE standards yetavoid hot spots?

Asset Planning Information Thermal Analysis for Placement

Real-time data for visibility to

how much system capacity isavailable at all times.

Improve visibility to power andcooling utilization for planning ofnew equipment.

Include data center and facility

assets in the service model.

Collection and integration of

assets and metered data withCAD layout to select optimallocation in the service model.

Reduced time and cost todeploy new IT equipment.

Continuous feedback on

utilization of critical systems.

Analyze what if scenarios with

Measurement and ManagementTechnology (MMT) CFD modeling.

Operate at higher ASHRAEtemperatures (72-80o F); reduceenergy costs & maintain availability.

Use IBM asset management to keep

model content up to date.



19/25



Instrumentation and interconnectivity allows for dynamic adjustmentof the physical infrastructure to changes in IT workload

SwitchgearIntegratedtools

Pressure

PDU

Pumps

CRACChiller

VFD

VFD

Utility

Cooling Tower

VFD

DATA CENTER BUILDING

ITTemperature

VFD

Generator

BMS

Integrated tools enable optimal placement ofadditional IT workload in the data center.

Temperature sensors provide visibility tochanges due to increased IT workload.

Interconnectivity between IT and physical

infrastructure communicates need foradditional cooling.

Increase in IT Workload

Design of facilities infrastructure equipment withvariable speed drives provides on demandcooling.

Use of variable speed drives in chiller plantautomatically responds to the increased cooling

requirement with just the right amount of additionalcapacity.

Physical Infrastructure

BMS



20/25



LEED Certification Objective

Pursuing LEED Gold

95% original building shell reused

80% original materials recycled 20% new materials from recycled

products

Harvesting rainwater

Energy Management Programs

Government Incentives of $ 750,000

Renewable Energy Certificates

Cooling

Free cooling for 44% of thecalendar year with water-side

economizer Variable speed drives on chilled

water pumping, chillers and airhandlers

Variable speed motors onCRACs

Increased set point to 10oC

chilled water supply

Electrical

Modular power density up to32 kilowatts per rack

High efficiency components for

UPS, PDU Support for high density zones

Other building systems

Energy Efficient Lighting

High R Value Insulation

Design / Build

9,300 sq m raised floor

Economies of scale 18,600 sq m site

High availability design point

Support liquid cooled IT equipment

Up to 15MW of IT power

Operate

Cloud computing support for public and

private clouds

Energy efficient of DCiE 66% to 71%

High virtualization utilization

Best practices equipment layout with hot/ cold aisle configuration

Continuously self-regulating energy

efficient data center with integrated IT,facilities and building automationsystems

Real-time CFD monitoring and control forIT equipment placement

GreenFacilities RelatedIT RelatedSummary of IBM Raleigh Leadership Data Center


21/25



RTP Building 301 Floor Plan

60,000square-footwhite space

Chillers &Pumps

CustomerViewing Area

Loading Dock

ElectricalSpine

Phase 3: 40,000square-foot whitespace

Cooling Towers &Thermal Storage

Tanks

High DensityArea


22/25



Tivoli Live monitoring services drastically reduced the time to isolateand diagnose a critical system problem for a mid-market client


Business challenge

Rapidly growing IT environment

Escalating costs, recurringdowntimes and lost productivity

Technical talent required to solveproblems

Existing solutions are not effective

Benefits

30% reduction in Severity 1 incidents

17% application availabilityimprovement

88% reduction in alerts to operatorsby using automation

Shortened MTTRPossibleIncident Avoidance

Alert 7 am,proactiverepairtime

Mean time to recovery

Notice thresholdissue at 11 am, becoming Severity 1


23/25



Data center integrated monitoring and management analyticshelp you improve availability, capacity planning and energy efficiency

Description

Enhances their visibility to manage IT and facilities operations for mid-size clients

Includes sensors, softwareand services

Provide end-to-endimplementation

Benefits

Correlate IT and facilities events

Improve planning to supporttechnology implementations

Save up to 10% of total powerand cooling capacity

Reduce staffing requirements

Typically deployed in a few days



24/25



Leverage IBMs experience to help

Overall: www.ibm.com/dynamicinfrastructure

For CIOs: www.ibm.com/cio

For facilities managers: www.ibm.com/services/siteandfacilities

Bret W. Lehman, PE

IBM GTS Site and Facilities Services

[email protected]


25/25

2011 IBM Corporation

For more information about the

RTP Leadership Data Center(including photos and videos of the facility):

http://www.ibm.com/services/us/cio/smarterdc/

Research Triangle Park, NC

Documents

Ibm Lehman Datacenter