26
Computer Science 246 David Brooks Computer Science 246 Advanced Computer Architecture Fall 2003 Harvard University Instructor: Prof. David Brooks [email protected]

Computer Science 246 Advanced Computer Architecturedbrooks/cs246-fall2003/cs246-lecture1.pdf · Computer Science 246 David Brooks Computer Science 246 Advanced Computer Architecture

Embed Size (px)

Citation preview

Page 1: Computer Science 246 Advanced Computer Architecturedbrooks/cs246-fall2003/cs246-lecture1.pdf · Computer Science 246 David Brooks Computer Science 246 Advanced Computer Architecture

Computer Science 246David Brooks

Computer Science 246Advanced Computer Architecture

Fall 2003Harvard University

Instructor: Prof. David [email protected]

Page 2: Computer Science 246 Advanced Computer Architecturedbrooks/cs246-fall2003/cs246-lecture1.pdf · Computer Science 246 David Brooks Computer Science 246 Advanced Computer Architecture

Computer Science 246David Brooks

Course Outline

• Instructor• Prerequisites• Topics of Study• Course Expectations• Grading• Class Scheduling Conflicts

Page 3: Computer Science 246 Advanced Computer Architecturedbrooks/cs246-fall2003/cs246-lecture1.pdf · Computer Science 246 David Brooks Computer Science 246 Advanced Computer Architecture

Computer Science 246David Brooks

Instructor

• Instructor: David Brooks ([email protected])– Office Hours: TBD, MD141, stop by/email whenever

Page 4: Computer Science 246 Advanced Computer Architecturedbrooks/cs246-fall2003/cs246-lecture1.pdf · Computer Science 246 David Brooks Computer Science 246 Advanced Computer Architecture

Computer Science 246David Brooks

Prerequisites• CS141 (or equivalent)

– Digital Logic/Pipelined Processors– i.e. Hennessey & Patterson Jr. (HW/SW Interface)

• CS146 is good, but not necessary– Hennessey & Patterson Sr. (Quantiative) Computer Architecture

• If not much architecture background, but interested in low-power design– Background in one of compilers, OS, or Circuits/VLSI should be

good enough– You will become the discussion leader in the power-aware

OS/compiler/Ckts papers• C Programming, UNIX for Project (or similar skills)

Page 5: Computer Science 246 Advanced Computer Architecturedbrooks/cs246-fall2003/cs246-lecture1.pdf · Computer Science 246 David Brooks Computer Science 246 Advanced Computer Architecture

Computer Science 246David Brooks

Topics of CS246• Introduction to Power-Aware Computing• Architectural Level Power Modeling• OS Level Power Modeling/Measurement• Chip and System Level Temperature Modeling• Newer Trends in Power-Aware Computing (di/dt, reliability,

leakage power, etc)• Architectural, Compiler, and O/S Techniques to reduce

power/temperature/etc– Chip/HW level techniques– OS/Compiler/Software techniques– Data center energy management

Page 6: Computer Science 246 Advanced Computer Architecturedbrooks/cs246-fall2003/cs246-lecture1.pdf · Computer Science 246 David Brooks Computer Science 246 Advanced Computer Architecture

Computer Science 246David Brooks

Detailed Topics from Last Year• High-level Power modeling (power abstractions)• Power Measurement for OS control• Temperature Aware Computing• Di/Dt Modeling• Leakage Power Modeling and Control• Frequency and Voltage Scheduling Algorithms• Power in Data Centers• Dynamic Power Reduction in Memory• Disk Power Modeling/Management• Application and Compiler Power Management• Dynamic adaptation for Multimedia applications• Intel XScale Microprocessor, IBM Watchpad• Human Powered Computing

Page 7: Computer Science 246 Advanced Computer Architecturedbrooks/cs246-fall2003/cs246-lecture1.pdf · Computer Science 246 David Brooks Computer Science 246 Advanced Computer Architecture

Computer Science 246David Brooks

Course Expectations

• Seminar style course:– Expectation: you will read the assigned papers before

class so we can have a lively discussion about them– Will setup online-web page to post

comments/questions/discussion before class– Paper reviews – very short “paper review” highlighting

interesting points, strengths/weaknesses of the paper– Discussion leadership – somewhere in the middle of the

semester students will be assigned to present the paper/lead the discussions

Page 8: Computer Science 246 Advanced Computer Architecturedbrooks/cs246-fall2003/cs246-lecture1.pdf · Computer Science 246 David Brooks Computer Science 246 Advanced Computer Architecture

Computer Science 246David Brooks

Course Expectations

• Course project – Several possible ideas will be given– Also you may come up with your own– Depending on enrollment, I will schedule weekly/bi-

weekly meetings with each individual/group (1/2hr per project) to discuss results/progress

– There will be two presentations• First, a short “progress update” (before Winter break)• Second, a final presentation scheduled at the end of reading

week• Finally, a project writeup written in research paper style

Page 9: Computer Science 246 Advanced Computer Architecturedbrooks/cs246-fall2003/cs246-lecture1.pdf · Computer Science 246 David Brooks Computer Science 246 Advanced Computer Architecture

Computer Science 246David Brooks

Grading

• Grade Formula – Class Participation – 50%– Project (including final project presentation)– 50%

Page 10: Computer Science 246 Advanced Computer Architecturedbrooks/cs246-fall2003/cs246-lecture1.pdf · Computer Science 246 David Brooks Computer Science 246 Advanced Computer Architecture

Computer Science 246David Brooks

Class Scheduling

• Have some students who’d like to take the class, but conflict.– Any time besides MW 1-2:30 or T/Th 10-11:30– Maybe MW 11-12:30?

Page 11: Computer Science 246 Advanced Computer Architecturedbrooks/cs246-fall2003/cs246-lecture1.pdf · Computer Science 246 David Brooks Computer Science 246 Advanced Computer Architecture

Why worry about power dissipation?

Environment

Thermal issues: affect cooling, packaging, reliability, timing

Batterylife

Page 12: Computer Science 246 Advanced Computer Architecturedbrooks/cs246-fall2003/cs246-lecture1.pdf · Computer Science 246 David Brooks Computer Science 246 Advanced Computer Architecture

Moore's Law

1.E+001.E+011.E+021.E+031.E+041.E+051.E+061.E+071.E+08

1970 1980 1990 2000

Tran

sist

ors

Per

Die

8008 80808086

80286386

486

PentiumPentium

Pro

PentiumIIPentiumIII

Moore’s Law & Power Dissipation...

1

10

100

1000

1980 1985 1990 1995 2000 2005 2010

Pow

er D

ensi

ty (

W/c

m2 )

Intel Data

Hot Plate

Nuclear Reactor

386486

Pentium

Pentium Pro

Pentium II

Pentium III

1

10

100

1000

1980 1985 1990 1995 2000 2005 2010

Pow

er D

ensi

ty (

W/c

m2 )

Intel DataSIA Projection

Hot Plate

Nuclear Reactor

386486

Pentium

Pentium Pro

Pentium II

Pentium III

Page 13: Computer Science 246 Advanced Computer Architecturedbrooks/cs246-fall2003/cs246-lecture1.pdf · Computer Science 246 David Brooks Computer Science 246 Advanced Computer Architecture

Power-Aware Needed across all computing platforms

• Mobile/portable (cell phones, laptops, PDA)– Battery life is critical

• Desktops/Set-Top (PCs and game machines)– Packaging cost is critical

• Servers (Mainframes and compute-farms)– Packaging limits– Volumetric (performance density)

Page 14: Computer Science 246 Advanced Computer Architecturedbrooks/cs246-fall2003/cs246-lecture1.pdf · Computer Science 246 David Brooks Computer Science 246 Advanced Computer Architecture

Battery Capacity Projections

Expected battery lifetime increase over the next 5 years: 30 to 40%

From From RabaeyRabaey, 1995, 1995

65 70 75 80 85 90 95 0

10

20

30

40

50 Rechargable Lithium

Year

Nickel-Cadmium

Ni-Metal Hydride

Nom

inal

Cap

acity

(W-h

r/lb)

Battery(40+ lbs)

Page 15: Computer Science 246 Advanced Computer Architecturedbrooks/cs246-fall2003/cs246-lecture1.pdf · Computer Science 246 David Brooks Computer Science 246 Advanced Computer Architecture

Where does the juice go in laptops?

• Others have measured ~55% processor increase under max load in laptops [Hsu+Kremer, 2002]

Page 16: Computer Science 246 Advanced Computer Architecturedbrooks/cs246-fall2003/cs246-lecture1.pdf · Computer Science 246 David Brooks Computer Science 246 Advanced Computer Architecture

Packaging costFrom Cray (local power generator and refrigeration)…

Source: Gordon Bell, “A Seymour Cray perspective”http://www.research.microsoft.com/users/gbell/craytalk/

Page 17: Computer Science 246 Advanced Computer Architecturedbrooks/cs246-fall2003/cs246-lecture1.pdf · Computer Science 246 David Brooks Computer Science 246 Advanced Computer Architecture

Packaging costTo today…• IBM S/390: refrigeration:

– Provides performance (2% perf for 10ºC) and reliability

Source: R. R. Schmidt, B. D. Notohardjono “High-end server low temperature cooling”IBM Journal of R&D

Page 18: Computer Science 246 Advanced Computer Architecturedbrooks/cs246-fall2003/cs246-lecture1.pdf · Computer Science 246 David Brooks Computer Science 246 Advanced Computer Architecture

Intel Itanium packagingComplex and expensive (note heatpipe)

Source: H. Xie et al. “Packaging the Itanium Microprocessor”Electronic Components and Technology Conference 2002

Page 19: Computer Science 246 Advanced Computer Architecturedbrooks/cs246-fall2003/cs246-lecture1.pdf · Computer Science 246 David Brooks Computer Science 246 Advanced Computer Architecture

P4 packaging• Simpler, but still…

Source: Intel web site

0

10

20

30

40

0 10 20 30 40Power (Watts)

Tota

l Pow

er-R

elat

edP

C S

yste

m C

ost

($)

From Tiwari, et al., DAC98

Page 20: Computer Science 246 Advanced Computer Architecturedbrooks/cs246-fall2003/cs246-lecture1.pdf · Computer Science 246 David Brooks Computer Science 246 Advanced Computer Architecture
Page 21: Computer Science 246 Advanced Computer Architecturedbrooks/cs246-fall2003/cs246-lecture1.pdf · Computer Science 246 David Brooks Computer Science 246 Advanced Computer Architecture

Cooking Aware Computing

Page 22: Computer Science 246 Advanced Computer Architecturedbrooks/cs246-fall2003/cs246-lecture1.pdf · Computer Science 246 David Brooks Computer Science 246 Advanced Computer Architecture

Server Farms• Internet data centers are like heavy-duty factories

– e.g. small Datacenter 25,000 sq.feet, 8000 servers, 2MegaWatts– Intergate Datacenter, Tukwila, WA: 1.5 Mill. Sq.Ft, ~500 MW– Wants lowest net cost per server per sq foot of data center space

• Cost driven by:– Racking height– Cooling air flow– Power delivery– Maintenance ease (access, weight)– 25% of total cost due to power

Page 23: Computer Science 246 Advanced Computer Architecturedbrooks/cs246-fall2003/cs246-lecture1.pdf · Computer Science 246 David Brooks Computer Science 246 Advanced Computer Architecture

Environment• Environment Protection Agency (EPA): computers consume

10% of commercial electricity consumption– This incl. peripherals, possibly also manufacturing– A DOE report suggested this percentage is much lower (3.0-3.5%)– No consensus, but it’s still a lot– Interesting to look at the numbers:

• http://enduse.lbl.gov/projects/infotech.html

• Data center growth was cited as a contribution to the 2000/2001 California Energy Crisis

• Equivalent power (with only 30% efficiency) for AC• CFCs used for refrigeration• Lap burn• Fan noise

Page 24: Computer Science 246 Advanced Computer Architecturedbrooks/cs246-fall2003/cs246-lecture1.pdf · Computer Science 246 David Brooks Computer Science 246 Advanced Computer Architecture

Computer Science 246David Brooks

Now we know why power is important

• What can we do about it?

• Two components to the problem:– #1: Understand where and why power is dissipated– #2: Think about ways to reduce it at all levels of

computing hierarchy– In the past, #1 is difficult to accomplish except at the

circuit level– Consequently most low-power efforts were all circuit

related

Page 25: Computer Science 246 Advanced Computer Architecturedbrooks/cs246-fall2003/cs246-lecture1.pdf · Computer Science 246 David Brooks Computer Science 246 Advanced Computer Architecture

Computer Science 246David Brooks

Modeling + Design

• First Component (Modeling/Measurement):– Come up with a way to:

• Diagnose where power is going in your system• Quantify potential savings

• Second Component (Design)– Try out lots of ideas

• This class will focus on both of these at many levels of the computing hierarchy

Page 26: Computer Science 246 Advanced Computer Architecturedbrooks/cs246-fall2003/cs246-lecture1.pdf · Computer Science 246 David Brooks Computer Science 246 Advanced Computer Architecture

Computer Science 246David Brooks

Next Time• Bit more overview, feel out background of class• Course website:

http://www.eecs.harvard.edu/~dbrooks/CS246.htm• Paper readings for this week:

– “Power-Aware Microarchitecture: Design and Modeling Challenges for Next-Generation Microprocessors,” IEEE MICRO.

– “Power: A First-Class Architectural Design Constraint,” IEEE Computer

• Web Page Browsing:– Information Technology and Resource Use:

http://enduse.lbl.gov/projects/infotech.html• Questions?