Upload
datacenters
View
557
Download
1
Tags:
Embed Size (px)
SynapSens eSynapSens e
. .www SynapSens e com. .www SynapSens e com
WSN Market EvolutionWSN Market Evolution
2000 2007 2010
WSN 2nd GenerationThe “Commercial” Era
Customer Requirements: Hardware platform flexibilityHardware platform flexibility Accelerated application development timeAccelerated application development time Enable broadly varying sensor networksEnable broadly varying sensor networks Rapid adoption of continuously emerging Rapid adoption of continuously emerging
technology improvementstechnology improvements
Result: Complete, commercial solutionsResult: Complete, commercial solutions
WSN 1st GenerationThe “Research” Era
Issues:Incomplete Solutions
Subject to the Tech TreadmillMany non-standard platforms
Difficult to build, deploy and manageDomain-specific languages
Result: Few complete solutions, Result: Few complete solutions, fragmented value-chainfragmented value-chain
System OverviewSystem Overview
System Software
Stack
Applications
1
802.15.4Network
Stack
2Data
Integration
0102030405060708090
100
Tem
p
Humid
ty PH
Particle
Cou
nt
East
West
North
!
AlertSystem
7
GUI
6
Gateway
EAI Web Services, SNMP, BACnetModBus
5
Data and Control Bus
Data Analysis
4
DataAnalysisSoftware
………..
..
..
…
4212:302
4212:001
TempTimeNode
Storage
XML,SCADA
3
The Ecosystem ChallengeThe Ecosystem Challenge
SensorsSensors
WSN boardsWSN boards Data CollectionData Collection
DatabaseDatabaseWSN PackagesWSN Packages
Business IntelligenceBusiness Intelligence
InstallationInstallation
Service & SupportService & Support
VisualizationVisualization
WSN InfrastructureWSN InfrastructureChipsChips BoardsBoards Kits Kits
Oki Tendril XBowMango Augusta Arch RockAtmel Integration EmberTI Airbee Dust
Aginova
WSN SolutionsWSN Solutions
SiemensEmerson
GESentilla
Data Center Wired SolutionsData Center Wired Solutions
IBMLiebert Sitescan
HP Dynamic Smart CoolingAPC NetBotz
Very DifficultVery DifficultBag of PartsBag of Parts Expensive &Expensive &IntrusiveIntrusive
Access
Service
Gateway
Service
RDBMS
802.15.4
Synapsense Sensor Nodes
Gateway
Device Manager
SNMPPlugin
Plugin
BACnetPlugin
Plugin
BACnetdevice
SNMP device
SNMP BACnet
4-20 mAPlugin
Plugin
VFD
Analog
ModbusPlugin
Plugin
Modbus
device
Modbus
Web Application
Container
SynapSoft™ Console
Browser
SynapSNMP
Agent
http(s)
SNMP
MIBMIB
BACNet
Gateway
SynapAlert™
SMTP
BACNet/IP
Network Management System (NMS)
Building Automation System (BAS)
E-mail / SMS Notifications
Live Imaging Server™
Access
Service
Gateway
Service
RDBMSRDBMS
802.15.4
Synapsense Sensor Nodes
802.15.4
Synapsense Sensor Nodes
Gateway
Device Manager
SNMPPlugin
Plugin
BACnetPlugin
Plugin
BACnetdevice
SNMP device
SNMP BACnet
4-20 mAPlugin
Plugin
VFD
Analog
ModbusPlugin
Plugin
Modbus
device
Modbus
SNMPPlugin
Plugin
BACnetPlugin
Plugin
BACnetdevice
SNMP device
SNMP BACnet
4-20 mAPlugin
Plugin
VFD
Analog
ModbusPlugin
Plugin
Modbus
device
Modbus
Web Application
Container
SynapSoft™ Console
Browser
SynapSoft™ Console
Browser
SynapSNMP
Agent
http(s)
SNMP
MIBMIBMIB
BACNet
Gateway
SynapAlert™
SMTP
BACNet/IP
Network Management System (NMS)
Building Automation System (BAS)
E-mail / SMS Notifications
Live Imaging Server™
SynapSense Solution OverviewArchitectural Overview
Rack Thermals Rack Thermals
LeakLeakDetectionDetection
Door StatusDoor Status
Branch Circuit MonitoringBranch Circuit Monitoring
Power MeteringPower Metering
Air PressureAir Pressure
Chilled Water BTUChilled Water BTU
Sensor TypesSensor Types
Room RH & Dew PointRoom RH & Dew Point
RackTemperature
RHCurrentPower
Sub-floorPressure
Differential
CRAHSupply & Return Air Temp
Supply RHChilled Water Supply & Return Temp
Fan Power
Chilled Water Flow(Captured at
CRAH)
PDUCurrent, Voltage
& Power
SynapSense Solution Overview
Li ve I magi ng™ S SynapSoft™ 4.0
Ground-breaking 2D maps use your real-time data center analytics to create a visual description of your environment.
Live Environmental Imaging™ is a special service for SynapSense customers.
2D Thermal Map 2D Pressure Map 2D Humidity Map
9
Towards a Greener Data Center: Tools & Techniques
UCCSC 2008, UC Santa Barbara
Gregory BellActing Chief Technology Architect, IT Division
Lawrence Berkeley National Laboratory
July 21, 2008
10
Motivation
• Energy efficiency = core DOE mission several LBNL researchers study power consumption
of IT equipment (data centers, servers, power supplies, cooling, UPS technology)
• More pragmatically: data center resources are increasingly scarce! power, space, cooling all in short supply
• Why? Significant growth in cluster computing: 40% of LBNL scientific teams need or use clusters 70% interested in cycles on shared cluster
10
11
Motivation: scientific computing
• Demand for computing cycles is growing rapidly on many campuses, not just LBNL
the direct expression of a broad scientific need
• IT’s primary data center runs out of capacity between 2010 and 2012 depending on cluster growth rate (7% - 20%)
• Strategically, we must maximize efficiency of current data center even as we locate new space
11
12
The story of a data center: 50B-1275
• Several decades old ~5000 sq ft 18” raised floors ~.5MW total power consumption
• Combination of clusters and business systems clusters account for almost all new demand
• Unusual cooling system 7 down-shot CRACs for under-floor supply supplementary overhead supply (chiller coil + fans)
13
The story of a data center: 50B-1275
• Starting summer of 2007, IT began a data center efficiency effort
• In collaboration with researchers in EETD, we perform a series of engineering studies documenting electrical, mechanical systems measuring loads & capacities; performing CFD calculating efficiency identifying opportunities for improvement deploying wireless sensor system (more later)
14
What we learned
• The data center was overcooled but this is the norm
• Abundant low-hanging fruit simultaneous humidification & dehumidification blanking panels missing excessive number of perforated floor tiles air-flow pathologies (mixing, short-circuiting)
• The data center was relatively efficient! none of the clusters backed by UPS
15
Taking steps to increase efficiency
• Improved airflow overhead plenum converted to hot-air return supplementary cooling directed under floor floor-tile tuning blanking panels, curtains, etc
• Virtualization• Water cooling• Wireless environmental monitoring system
16
Steps to increase efficiency
• Improved airflow overhead plenum converted to hot-air return supplementary cooling directed under floor floor-tile tuning blanking panels, curtains, etc
• Virtualization• Water cooling• Wireless environmental monitoring system
focus of remainder of talk
17
The importance of visualization
17
•systems & network administrators have tools for visualization
•useful for debugging, benchmarking, capacity planning, forensics
•data center managers have comparatively poor visualization tools
18
One form of visualization: CFD
Images: ANCIS
19
Visualization and real-time monitoring
• We installed a wireless sensor net from SynapSense 200 monitoring points temperature, humidity, under-floor pressure, current
• For the first time, we have a detailed understanding of environmental conditions in the data center real-time and historical graphs underlying database
• SynapSense is a technology transfer success story from UC Davis CTO and co-founder is Raju Pandey, also Computer Science professor at UCD http://www.synapsense.com “You can’t control or manage what you don’t measure.”
20
SynapSense hardware
• wireless sensor network• “self-organizing” nodes• 802.15.4 (not 802.11)• multi-hop routing• non-invasive installation• 2 internal & 6 external
sensors per node• we measure temp.,
humidity, pressure, current
• we could measure liquid flow, liquid presence, particle count
Image: SynapSense
21
Learning from the sensors
• lesson #1: eat your spinach!
• effect of adding one 12” blanking panel to the middle of a rack
• conventional wisdom is correct: blanking panes are essential
• other data center clichés also borne out eliminate leaks in floor manage floor tile
permeability
Top of rack
Middle of rack
22
Visualizing impact of site modifications
• Graphing impact of major maintenance (redirection of overhead cold air supply underfloor) on air pressure in some areas, under-floor pressure increased by almost 50% impact varies according to distance from new air supply
23
Visualizing impact of maintenance
• each CRAC turned off in turn, for service
• hot spots monitored during maintenance
• two-fold benefit real-time feedback enhanced knowledge of
data center redundancy characteristics
• provisionally turn off one or more CRAC units?
Under-Floor Pressure
Rack-Top Temperatures
24
Feedback on floor-tile tuning
• in the course of one day 24 perforated floor tiles
removed 6 floor tiles converted
from high- to low-flow 4 floor tiles converted
from low- to high-flow
Before
After
25
Feedback on floor-tile tuning
• with instrumentation, we can observe results in real time
• when airflow is restricted, under-floor pressure
increases rack-top temperatures
decrease
• without monitoring and visualization, this process is guesswork how many tiles to remove?
Under-Floor Pressure
Rack-Top Temperatures
26
Focus on a single sensor
• iterative process: too cold, too hot, just right• monitor with laptop in data center for convenience
27
‘LiveImaging’ heat-map movies
27
Data Center ValueData Center Value
MonitoringMonitoring
24x 7 Visibility /24x 7 Visibility / Alerts & Alarms / AnalysisAlerts & Alarms / Analysis
PUE / DCiE / RTIPUE / DCiE / RTI
DC Health & Efficiency MetricsDC Health & Efficiency Metrics
Branch Circuit MonitoringBranch Circuit Monitoring
Capacity PlanningCapacity Planning
ControlControl
DC AutomationDC Automation
DC OptimizationsDC Optimizations
Air Mixing MitigationAir Mixing Mitigation
AdaptiveAdaptiveCoolingCoolingControlControl
33
Air FlowAir FlowManagementManagement
22
VisibilityVisibility
11
SynapSense 3-Step Process to SynapSense 3-Step Process to Adaptive CoolingAdaptive Cooling
Environmental Baseline & ResultsEnvironmental Baseline & ResultsSynapSense Thermal LiveImaging™SynapSense Thermal LiveImaging™
Baseline
CHH C
No Containment
High Degree of Air Mixing
High Inlet Temperatures
SynapSense Solution OverviewSynapSense Solution OverviewCold Aisle ContainmentCold Aisle Containment
Environmental Baseline & ResultsEnvironmental Baseline & ResultsSynapSense Thermal LiveImaging™SynapSense Thermal LiveImaging™
After Containment
CHH C
Cold Aisles Contained
No Change to CRAHs
Overcooled
Environmental Baseline & ResultsEnvironmental Baseline & ResultsSynapSense Thermal LiveImaging™SynapSense Thermal LiveImaging™
With Control
CHH C
Controlled CRAHs
ASHRAE Inlet Temperatures
Increased Return Temperatures
Environmental Baseline & ResultsEnvironmental Baseline & ResultsSynapSense Thermal LiveImaging™SynapSense Thermal LiveImaging™
With ControlAfter ContainmentBaseline
CHH CCHH CCHH C
One Solution – Three VectorsOne Solution – Three Vectors
Balance Cooling Capacity Balance Cooling Capacity Optimize: Optimize:
Air Pressure & Flow Air Pressure & Flow
CRAC/CRAH Utilization CRAC/CRAH Utilization
Synergize IT & Facilities – Synergize IT & Facilities – One DashboardOne DashboardIntegrated Tool Suite Integrated Tool Suite Optimized Capacity Planning Optimized Capacity Planning Balanced IT & Infrastructure Balanced IT & Infrastructure
Improve Energy ManagementImprove Energy Management
UPS Capacity Planning UPS Capacity Planning
Energy Baseline Energy Baseline
Metrics – PUE / DCIE Metrics – PUE / DCIE
CoolingCooling
PowerPower
OperationsOperations
OptimizationOptimization
BalanceBalance
EfficiencyEfficiency
Qualified for Utility RebatesQualified for Utility Rebates
SMUD: will provide SMUD: will provide incentive $0.14/kWh incentive $0.14/kWh saved not to exceed saved not to exceed 30% of project cost 30% of project cost or $50,000or $50,000
“PG&E encourages continuous monitoring by the customer, as changes are invariably made when racks are added or moved. The SynapSense Wireless Sensor Network is an excellent way for the customer to ensure that his/her airflow is maintained at optimal efficiency.”
Francois Rongere, PG&E
PG&E: Once improvements made, customer receives incentive of $.08 per kWh saved, up to half cost of improvements
SVP: will rebate $0.18/kWh saved up to 80% of the solution cost with proven savings