18
Announcing the 11 th Graph500 List! Graph500 Co-Founders: David A. Bader, Georgia Tech Andrew Lumsdaine, Indiana University Richard Murphy, Micron Technology, Inc. Marc Snir, Argonne National Laboratory and U. of Illinois 1

Announcing the 11 th Graph500 List! Graph500 Co-Founders: David A. Bader, Georgia Tech Andrew Lumsdaine, Indiana University Richard Murphy, Micron Technology,

Embed Size (px)

DESCRIPTION

History of the Graph500 Graph500 announced at ISC10 (June 2010) 1 st Graph500 List: 9 machines at SC10 (Nov. 2010) 2 nd Graph500 List: 29 machines at ISC11 (June 2011) 3 rd Graph500 List: 51 machines at SC11 (Nov. 2011) 4 th Graph500 List: 88 entries at ISC 12 (June 2012) 5 th Graph500 List: 124 entries at SC12 (Nov. 2012) 6 th Graph500 List: 142 entries at ISC13 (June 2013) 7 th Graph500 List: 160 entries at SC13 (Nov. 2013) 8 th Graph500 List: 174 entries at ISC14 (June 2014) 9 th Graph500 List: 183 entries at SC14 (Nov. 2014) 10 th Graph500 List: 192 entries at ISC15 (July 2015) 11 th Graph500 List: 200 entries at SC15 (Nov. 2015) [TODAY!] 3

Citation preview

Page 1: Announcing the 11 th Graph500 List! Graph500 Co-Founders: David A. Bader, Georgia Tech Andrew Lumsdaine, Indiana University Richard Murphy, Micron Technology,

1

Announcing the 11th Graph500 List!

Graph500 Co-Founders:David A. Bader, Georgia Tech

Andrew Lumsdaine, Indiana UniversityRichard Murphy, Micron Technology, Inc.

Marc Snir, Argonne National Laboratory and U. of Illinois

Page 2: Announcing the 11 th Graph500 List! Graph500 Co-Founders: David A. Bader, Georgia Tech Andrew Lumsdaine, Indiana University Richard Murphy, Micron Technology,

2

What is the Graph500?• New benchmark to complement the Top 500 for large-scale data analysis problems• Executive Committee:• David A. Bader, Peter Kogge, Andrew Lumsdaine, Rich Murphy

• International Multidisciplinary Steering Committee• Jeremy Kepner (Chair)• Jim Ang, Brian Barrett, Jon Berry, Bill Brantley, Almadena Chtchelkanova, John Daly, John Feo, Michael Garland,

John Gilbert, Bill Gropp, Bill Harrod, Bruce Hendrickson, Anton Korzh, Jure Leskovec, Bob Lucas, Mike Merrill, Hans Meuer, David Mizell, Shoaib Mufti, Richard Murphy, Nick Nystrom, Fabrizio Petrini, Wilf Pinfold, Steve Poole, Arun Rodrigues, Rob Schreiber, John Simmons, Thomas Sterling, Blair Sullivan, T.C. Tuan, Jeff Vetter, Mike Vildibill

• Three Kernels• Search (Concurrent Search, the Ranking Kernel)• Optimization (Single Source Shortest Path, released)• Edge Oriented (Maximal Independent Set, in specification)

Page 3: Announcing the 11 th Graph500 List! Graph500 Co-Founders: David A. Bader, Georgia Tech Andrew Lumsdaine, Indiana University Richard Murphy, Micron Technology,

3

History of the Graph500• Graph500 announced at ISC10 (June 2010)• 1st Graph500 List: 9 machines at SC10 (Nov. 2010)• 2nd Graph500 List: 29 machines at ISC11 (June 2011)• 3rd Graph500 List: 51 machines at SC11 (Nov. 2011)• 4th Graph500 List: 88 entries at ISC 12 (June 2012)• 5th Graph500 List: 124 entries at SC12 (Nov. 2012)• 6th Graph500 List: 142 entries at ISC13 (June 2013)• 7th Graph500 List: 160 entries at SC13 (Nov. 2013)• 8th Graph500 List: 174 entries at ISC14 (June 2014) • 9th Graph500 List: 183 entries at SC14 (Nov. 2014)• 10th Graph500 List: 192 entries at ISC15 (July 2015)• 11th Graph500 List: 200 entries at SC15 (Nov. 2015) [TODAY!]

Page 4: Announcing the 11 th Graph500 List! Graph500 Co-Founders: David A. Bader, Georgia Tech Andrew Lumsdaine, Indiana University Richard Murphy, Micron Technology,

4

Five Business Areas• Cybersecurity• 15 Billion Log Entires/Day (for large enterprises)• Full Data Scan with End-to-End Join Required

• Medical Informatics• 50M patient records, 20-200 records/patient,

billions of individuals• Entity Resolution Important

• Social Networks• Example, Facebook, Twitter• Nearly Unbounded Dataset Size

• Data Enrichment– Easily PB of data– Example: Maritime Domain Awareness

• Hundreds of Millions of Transponders• Tens of Thousands of Cargo Ships• Tens of Millions of Pieces of Bulk Cargo• May involve additional data (images, etc.)

• Symbolic Networks– Example, the Human Brain– 25B Neurons– 7,000+ Connections/Neuron

Page 5: Announcing the 11 th Graph500 List! Graph500 Co-Founders: David A. Bader, Georgia Tech Andrew Lumsdaine, Indiana University Richard Murphy, Micron Technology,

5

www.GRAPH500.org

Page 6: Announcing the 11 th Graph500 List! Graph500 Co-Founders: David A. Bader, Georgia Tech Andrew Lumsdaine, Indiana University Richard Murphy, Micron Technology,

6

The Rankings

Page 7: Announcing the 11 th Graph500 List! Graph500 Co-Founders: David A. Bader, Georgia Tech Andrew Lumsdaine, Indiana University Richard Murphy, Micron Technology,

7

11th Graph 500 List(followed by special highlights)

•Will present the Top3 now, and highlight the Top10•Torsten Hoefler: “Green” Graph500 measure

1st 2nd 3rd 4th 5th 6th 7th 8th 9th 10th 11th

928

5188

124142

160 174 183 192 200

# of Entries

Page 8: Announcing the 11 th Graph500 List! Graph500 Co-Founders: David A. Bader, Georgia Tech Andrew Lumsdaine, Indiana University Richard Murphy, Micron Technology,

8

11th Graph 500 ListCountry # entries % of entriesAustralia 1 0.5%Canada 7 3.5%China 9 4.5%Czech Republic 1 0.5%France 2 1.0%Germany 3 1.5%Italy 2 1.0%Japan 55 27.5%Luxembourg 1 0.5%Netherlands 2 1.0%Poland 3 1.5%Russia 11 5.5%Saudi Arabia 1 0.5%South Korea 1 0.5%Switzerland 6 3.0%Taiwan 6 3.0%UK 4 2.0%USA 85 42.5%Total 200

Page 9: Announcing the 11 th Graph500 List! Graph500 Co-Founders: David A. Bader, Georgia Tech Andrew Lumsdaine, Indiana University Richard Murphy, Micron Technology,

9

Page 10: Announcing the 11 th Graph500 List! Graph500 Co-Founders: David A. Bader, Georgia Tech Andrew Lumsdaine, Indiana University Richard Murphy, Micron Technology,

10

Page 11: Announcing the 11 th Graph500 List! Graph500 Co-Founders: David A. Bader, Georgia Tech Andrew Lumsdaine, Indiana University Richard Murphy, Micron Technology,

11

Page 12: Announcing the 11 th Graph500 List! Graph500 Co-Founders: David A. Bader, Georgia Tech Andrew Lumsdaine, Indiana University Richard Murphy, Micron Technology,

12

11th Graph 500: Trends -- TEPS

Slide credit: Scott Beamer

Page 13: Announcing the 11 th Graph500 List! Graph500 Co-Founders: David A. Bader, Georgia Tech Andrew Lumsdaine, Indiana University Richard Murphy, Micron Technology,

13

11th Graph 500: Trends -- Cores

Slide credit: Scott Beamer

Page 14: Announcing the 11 th Graph500 List! Graph500 Co-Founders: David A. Bader, Georgia Tech Andrew Lumsdaine, Indiana University Richard Murphy, Micron Technology,

14

11th Graph 500: Trends -- Efficiency

Slide credit: Scott Beamer

Page 15: Announcing the 11 th Graph500 List! Graph500 Co-Founders: David A. Bader, Georgia Tech Andrew Lumsdaine, Indiana University Richard Murphy, Micron Technology,

15

11th Graph500 List, Top Vendors

Vendor CountIBM 35Cray 23Intel 16Convey 13Dell 13

Page 16: Announcing the 11 th Graph500 List! Graph500 Co-Founders: David A. Bader, Georgia Tech Andrew Lumsdaine, Indiana University Richard Murphy, Micron Technology,

16

11th Graph500: Top 10Rank Machine Vendor Type Installation Site Country Nodes Cores

Mem. (TB) Scale GTEPS

1 K computer Fujitsu Custom RIKEN AICS Japan 82944 663552 1.33 PB 40 38621

2DOE/NNSA/LLNL Sequoia IBM BlueGene/Q

Lawrence Livermore Nat. Lab. USA 98304 1572864 1.57 PB 41 23751

3DOE/SC/Argonne Mira IBM BlueGene/Q Argonne Nat. Lab. USA 49152 786432 768 40 14982

4 JUQUEEN IBM BlueGene/Q Forschungszentrum Juelich Germany 16384 262144 256 38 5848

5 Fermi IBM BlueGene/Q CINECA Italy 8192 131072 128 37 2567

6Tianhe-2 (MilkyWay-2) NUDT MPP Changsha China 8192 196608 512 36 2061

7 Blue Joule IBM BlueGene/Q Daresbury Laboratory UK 4096 65536 64 36 1427

7 DIRAC IBM BlueGene/Q University of Edinburgh UK 4096 65536 64 36 1427

7 Zumbrota IBM BlueGene/Q EDF R&D France 4096 65536 64 36 1427

7 Avoca IBM BlueGene/Q Victorian Life Sciences CI Australia 4096 65536 64 36 1427

7 Turing IBM BlueGene/Q CNRS/IDRIS-GENCI France 4096 65536 64 36 1427

Page 17: Announcing the 11 th Graph500 List! Graph500 Co-Founders: David A. Bader, Georgia Tech Andrew Lumsdaine, Indiana University Richard Murphy, Micron Technology,

17

Highlights of the 11th Graph500 List• K Computer and IBM BlueGene/Q continue to dominate the top of the list.

• Main observations:• No changes in the top 10• The top results seem unchanged. Arguably, the top end performance has plateaued due to no

new hardware or implementation improvements. The oscillation between Sequoia and K Computer being number one is visible in the plots as an oscillation in number of cores and per-core efficiency.

Page 18: Announcing the 11 th Graph500 List! Graph500 Co-Founders: David A. Bader, Georgia Tech Andrew Lumsdaine, Indiana University Richard Murphy, Micron Technology,

18

ANNOUNCEMENT

•The 12th Graph500 List will be released at ISC16, Summer 2016