16
NAS 2011 Liang Kai,Xiaofang Zhang, Xiao Zhang Northwestern Polytechnical University 2011-7-28 Research on Energy Consumption of General Network Storage System

NAS 2011 Liang Kai,Xiaofang Zhang, Xiao Zhang Northwestern Polytechnical University 2011-7-28 Research on Energy Consumption of General Network Storage

Embed Size (px)

Citation preview

Page 1: NAS 2011 Liang Kai,Xiaofang Zhang, Xiao Zhang Northwestern Polytechnical University 2011-7-28 Research on Energy Consumption of General Network Storage

NAS 2011

Liang Kai,Xiaofang Zhang, Xiao Zhang

Northwestern Polytechnical University

2011-7-28

Research on Energy Consumption of General Network Storage System

Page 2: NAS 2011 Liang Kai,Xiaofang Zhang, Xiao Zhang Northwestern Polytechnical University 2011-7-28 Research on Energy Consumption of General Network Storage

Energy Consumption of Network Storage System

Outline• Background

• Energy consumption model

• Experiments

• Conclusion and Future work

NAS2011 (2/15)

Page 3: NAS 2011 Liang Kai,Xiaofang Zhang, Xiao Zhang Northwestern Polytechnical University 2011-7-28 Research on Energy Consumption of General Network Storage

Energy Consumption of Network Storage System

NAS2011 (3/12)

Challenge

Source: IBM Corporate Strategy analysis of IDC data, Sept. 2007

Global Annual IT SpendingEstimated US$B 1996-2010

$0B

50

100

150

200

250

300

1996

1997

1998

1999

2000

2001

2002

2003

2004

2005

2006

2007

2008

2009

2010

New Server Spending

Server Mgt and Admin Costs

Power and Cooling Costs

Page 4: NAS 2011 Liang Kai,Xiaofang Zhang, Xiao Zhang Northwestern Polytechnical University 2011-7-28 Research on Energy Consumption of General Network Storage

Energy Consumption of Network Storage System

Background

Research on Energy Consumption of General Network Storage System

Some energy consumption standard has been released in industry

China promote the development of network storage technology

Huge energy consumption in Network Storage Systems

Energy conservation, green storage promote low-carbon economy

From the perspective of the whole system accurately reflect real-time energy consumption

Analyse, establish the general energy

consumption model of networks storage system

Reseach pReseach purposeurpose

Thesis signigicanceThesis signigicance

Thesis backgroundThesis background

Page 5: NAS 2011 Liang Kai,Xiaofang Zhang, Xiao Zhang Northwestern Polytechnical University 2011-7-28 Research on Energy Consumption of General Network Storage

Energy Consumption of Network Storage System

Structure and research method

Introduction

Reseach on EC of NSS

Conclusions

Analysis and test EC Verify model validation

Establish EC model Server EC Disk array ECSwitch EC

Based on system expansion and

workload conditions evaluates EC

Basic ECData transmission and Port

used number ECWorkload EC

Page 6: NAS 2011 Liang Kai,Xiaofang Zhang, Xiao Zhang Northwestern Polytechnical University 2011-7-28 Research on Energy Consumption of General Network Storage

Energy Consumption of Network Storage System

EC model

NAS2011 (6/15)

Appl i cation Servers

Disk arrays

Swi tch

FC/IB network

FC/IB network

Manager CenterManager Center

Client Client

A common storage network system is consist of the file system servers, switches and disk arrays

Base Energy Consumption

Energy Consumption

=

+Variable Energy Consumption according to workload

Page 7: NAS 2011 Liang Kai,Xiaofang Zhang, Xiao Zhang Northwestern Polytechnical University 2011-7-28 Research on Energy Consumption of General Network Storage

Energy Consumption of Network Storage System

Detail model

NAS2011 (7/15)

In the complex structure and changing workload of storage network environment, it refines the energy consumption of each functional part as: basic energy consumption Ebase and workload energy consumption  Eload. Namely:

Servers, switches and disk arrays are the main functional components of the storage network, and also the major components of the energy consumption. Thus, the full energy consumption of the storage network E should include: server energy consumption Es, switch and disk array energy consumption, Esw, Eda, namely:

Disk array = Controllers +Disk enclosure + Disks

Page 8: NAS 2011 Liang Kai,Xiaofang Zhang, Xiao Zhang Northwestern Polytechnical University 2011-7-28 Research on Energy Consumption of General Network Storage

Energy Consumption of Network Storage System

System Extension

NAS2011 (8/15)

Extend type Basic EC Additional EC

Server Added 1 serverAdded 1 server 1*1* E Ebasebase 1*Port1*Port

Switch Added 1 Added 1 1*1* E Eswbaseswbase 2*Port2*Port

Disk Array

Added 1 diskAdded 1 disk 1*1* E Edbasedbase ignoredignored

Added 15 disksAdded 15 disks 15*15* E Edbasedbase 1*1* E Edaebasedaebase

Added 1 DEAdded 1 DE 1*1* E Edaebasedaebase ignoredignored

Added 12 DEAdded 12 DE 12*12* E Edaebasedaebase 2*Port+1*2*Port+1* E Edabasedabase

Considering the added energy consumption for the extended structure in the System-A Eadd. Eadd also includes two parts: the basic and additional energy consumption of the added hardware, Ebase, Esub, namely:

The below Table lists the added EC pattern caused by extending hardware in the system.

Page 9: NAS 2011 Liang Kai,Xiaofang Zhang, Xiao Zhang Northwestern Polytechnical University 2011-7-28 Research on Energy Consumption of General Network Storage

Energy Consumption of Network Storage System

Server-basic EC test

NAS2011 (9/15)

1)Server's Idle Mode energy consumption test: Put the server into the status of single power supply, test the average effective power under the Idle Mode for 10 minutes. The results can be described as follows:

The average effective power on the server Idle mode

Power(W)

Test time:13:17:12——13:27:13 Time scale:30s

Effective power

195

193

191

189

187

185

Page 10: NAS 2011 Liang Kai,Xiaofang Zhang, Xiao Zhang Northwestern Polytechnical University 2011-7-28 Research on Energy Consumption of General Network Storage

Energy Consumption of Network Storage System

Server-Workload EC test

NAS2011 (10/15)

Energy consumption test between server and workload: On the server, we use the SPECpower_ssj2008 quantifies energy consumption and generates workloads, test status of the changing server energy consumption. Obtained the test data can be formatted below the figure:

The average powerPower(W)

2252001751501251007550250

209 W

Load

Page 11: NAS 2011 Liang Kai,Xiaofang Zhang, Xiao Zhang Northwestern Polytechnical University 2011-7-28 Research on Energy Consumption of General Network Storage

Energy Consumption of Network Storage System

Switch EC test1)Basic EC : The basic energy consumption test of switch: The method of the basic energy consumption test on switch is identical to that of server Idle Mode. The result in our environment is 17.93W

2) EC per activate port: The energy consumption test between switch and the number of used port: Make the switch in the state of no host accessing, one by one join 8 hosts, each of the states hold for 5 minutes. Test on every added a port leads to energy consumption increase. The result is 1.06W

3)EC change according to data transfer: It's difficult to quantify and control the specific data transferred rate of the switch. So, assuming that the data transmission of the switch has only two states: full-bandwidth data transmission and no data transmission, using the Iperf control full-bandwidth data transmission between a pair ports. EC changes very little.

NAS2011 (11/15)

Effective power

Power(W)

26.55

26.5

26.45

26.4

26.35

26.30\0 1\1 2\2 3\3 4\4

The average effective power

The number of hosts with full-Bandwidth data transmission

Switch takes a small role in the whole system

Page 12: NAS 2011 Liang Kai,Xiaofang Zhang, Xiao Zhang Northwestern Polytechnical University 2011-7-28 Research on Energy Consumption of General Network Storage

Energy Consumption of Network Storage System

Disk array EC test1)Basic EC Test: The basic energy consumption test on the hardware of disk array: Successively increase components in the disk array  (disk block number from 5 to 15, the disk enclosure from 0 to 1), use Power Analyzer to detect the  changed information of power, get the energy consumption status by calculated on the various components of the disk array.

2) Workload EC Test: The energy consumption test between disk array and the workload: Read and write IO operation of the disk array is the main workload, usually indicated by the values of IOPS, which is controlled by IOPSCtrl  in this test. In the RAID's organizational model , RAID0 has non-redundant operation and the least impact on disk's energy consumption, so all the disk blocks on disk array is comprised of the RAID0 mode , and the full capacity of which mount  to a directory on the server to test the maximum value of IOPS in disk by Iometer. From no IO operation, every 10% of the maximum IOPS until the maximum workload is increased by IOPSCtrl, each state for 10 minutes.

NAS2011 (12/15)

Increasing HW Increasing EC

Per disk 11.36W

Per disk enclosure 109.49W

Power and controller 312.11W

Experiments show workload takes little affect on EC, We think disk keep working even there isn’t any IO operation. But MAID2.0 technology may change this.

Page 13: NAS 2011 Liang Kai,Xiaofang Zhang, Xiao Zhang Northwestern Polytechnical University 2011-7-28 Research on Energy Consumption of General Network Storage

Energy Consumption of Network Storage System

Verification• Use one server and one switch and one disk array to verify the model. According the

model, calculate result is 828.993W; Test result of 830.352W, difference is very little.

NAS2011 (13/15)

Page 14: NAS 2011 Liang Kai,Xiaofang Zhang, Xiao Zhang Northwestern Polytechnical University 2011-7-28 Research on Energy Consumption of General Network Storage

Energy Consumption of Network Storage System

General usage• If there are X servers , Y disks and  L pairs of the ports in the network storage system, the

entire system's total energy consumption:

NAS2011 (14/15)

Page 15: NAS 2011 Liang Kai,Xiaofang Zhang, Xiao Zhang Northwestern Polytechnical University 2011-7-28 Research on Energy Consumption of General Network Storage

Energy Consumption of Network Storage System

Future work• Cooling system EC takes a import role in data

center, we need take temperature into consider in the future.

• New medias such as SSD will have different EC features.

• Some green technologies need more researches. MAID(massive array of idle disks) slow down the rotation speed of disk to save energy.

• Need more experiments in big system to verify the model.

NAS2011 (15/15)

Page 16: NAS 2011 Liang Kai,Xiaofang Zhang, Xiao Zhang Northwestern Polytechnical University 2011-7-28 Research on Energy Consumption of General Network Storage

Energy Consumption of Network Storage System

NAS2011

Thanks