Upload
doris-obrien
View
214
Download
0
Embed Size (px)
Citation preview
National Computational Science Alliance
A Review of User Projects at the Alliance Leading Edge Site
• Opening Talk to the Alliance Allocation Board
• Hosted by the Maui High Performance Computing Center, Maui, Hawaii, December 5, 1998.
National Computational Science Alliance
The National PACI Program -Partners and Supercomputer Users
850 Projects in 280 Universities60 Partner Universities
National Computational Science Alliance
PITAC Draft Refinement of High-End Acquisition Recommendation
• Fund the Acquisition of the Most Powerful High-End Computing Systems to Support Long Term Basic Research in Science and Engineering
• Access for (Highest Priority):
– ALL Academic Researchers– ALL Disciplines– ALL Universities
• Access for (Second Priority):– Government Researchers– Industrial Researchers
National Computational Science Alliance
Emerging Multi-Agency Effort to Create a Persistent National Technology Grid
• NSF Establishes PACI Program• DOE Raises the Bar
– ASCI and SSP– Data and Visualization Corridors
• DoE Discussing with NSF: – How to Get Highest-End Capacity– PACI ET and AT Teams Linking to ASCI, SSP
• NASA and NSF on Information Power Grid• DoD Mod. PET Innovating Infrastructure • NIH Seen As Critical Partner
National Computational Science Alliance
Deputy Director Bordogna on NSF Leadership in Information Technologies
• Three Important Priorities for NSF in the Area of IT for the Future:
– The First Area Is Fundamental and High-Risk IT Research and Advanced Computation Research.
– The Second Priority Area for NSF Is Competitive Access and Use of High-end Computing and Networking.
– The Third Priority Is Investing in IT Education at All Levels.
Congressional Testimony 10/6/98
National Computational Science Alliance
NCSA is Combining Shared Memory Programming with Massive Parallelism
1
10
100
1000
10000
Jan
-94
Jan
-95
Jan
-96
Jan
-97
Jan
-98
Jan
-99
Jan
-00
Jan
-01
SG
I Pro
cess
ors
Doubling Every Nine Months!
Challenge
Power Challenge
Origin
SN1
National Computational Science Alliance
The Rapid Increase in High End Capacity at NCSA
0
1
2
3
4
5
FY93 FY94 FY95 FY96 FY97 FY98
NU
s U
se
d A
nn
ua
lly (
Mill
ion
s)
Millions of NUs Used at NCSA FY93 to FY98
National Computational Science Alliance
NCSA Users by System -SGI Origin Takes Off!
0
100
200
300
400
500
600S
ep
94
Nov9
4
Jan
95
Mar9
5
May9
5
Jul9
5
Sep
95
Nov9
5
Jan
96
Mar9
6
May9
6
Jul9
6
Sep
96
Nov9
6
Jan
97
Mar9
7
May9
7
Jul9
7
Sep
97
Nov9
7
Jan
98
Mar9
8
May9
8
Jul9
8
Sep
98
Nu
mb
er
of
Users
SGI Power Challenge ArrayCM5
Convex C3880Convex ExemplarCray Y-MPOriginSPP-2000
C3880 (retired 10/95)
SPP-1200
Y-MP
(retired 12/94)
Origin
SPP-2000
CM-5(retired 1/97)
PCA(retired 7/98)
(retired 5/98)
National Computational Science Alliance
Distribution of Project Size at NCSA in FY98
10
100
1000
10000
100000
1000000
1
34
67
10
0
13
3
16
6
19
9
23
2
26
5
29
8
33
1
Projects in Ranked Order
An
nu
al N
Us
Pe
r P
roje
ct Super
Medium
Large
Small
Tiny
AAB
SAC
NRAC
National Computational Science Alliance
NCSA Has Greatly Increased High-End Capacity
0
500000
1000000
1500000
2000000
2500000
Super Large Medium Small Tiny
NU
s P
er
Ye
ar
FY94
FY98
National Computational Science Alliance
Little Percentage Change in Shares Over Five Years
0
0.1
0.2
0.3
0.4
0.5
0.6
Super Large Medium Small Tiny
Perc
en
t o
f To
tal FY94
FY98
National Computational Science Alliance
Migration of NCSA User Distribution Toward the High End
0
20
40
60
80
100
120
140
160
180
200
Super Large Medium Small Tiny
Nu
mb
er
of
An
nu
al P
roje
cts
FY94
FY98
+400%
+350%
+114%
-27%
-79%
Number of Projects
National Computational Science Alliance
Let’s Blow This Up!Let’s Blow This Up!
The Growth Rate of the National Capacity is Slowing Down Again
10,000
100,000
1,000,000
10,000,000
100,000,000
1,000,000,000
1986
1988
1990
1992
1994
1996
1998
2000
2002
Fiscal Year
No
rmal
ized
CP
U H
ou
rs
Total NU
70% Annual Growth This Year
Source: Quantum Research
National Computational Science Alliance
Major Gap Has Developed in National Usage at NSF Supercomputer Centers
-
500,000
1,000,000
1,500,000
2,000,000
2,500,000
3,000,000
3,500,000
Oct
-95
Ap
r-96
Oct
-96
Ap
r-97
Oct
-97
Ap
r-98
Oct
-98
Ap
r-99
Oct
-99
NU
s U
sed
Per
Yea
r
Grand Total
70% Growth Rate
Projection
National Computational Science Alliance
Fastest Machine in Top500 vs. Fastest Machine in NSF Supercomputer Centers
0
500
1000
1500
1994 1995 1996 1997 1998
Year
Gig
afl
op
sHighest NSF highest
Source: ACIR, NSF
National Computational Science Alliance
Alliance Efforts to Increase Capacity and Capability
• Alliance LES– Took Early Delivery of 5th and 6th 128p Origin in June ‘98– Just Ordered 256 SSI Origin to Complete 1024p
– Goal is Production by March ‘99
– Hardening the 256p NT Supercluster for Selected Users– May Upgrade HP Exemplar to HPUX V-Series– Sun E10000 Data Mining Server?
• Alliance PACS– Allocating up to 1 Million SUs in FY99– LES/PACS Discussions on:
– Linux Intel Superclusters at Maui– Combining HPs at U Kentucky– Linux/NT Compaq (DEC) Alpha SMP Cluster at BU– Grid Alpha/Beta Testbed in CIC
National Computational Science Alliance
The Transformation of an Industry in Five Years- TOP500 Systems by Vendor
TOP500 Reports: www.netlib.org/benchmark/top500.html
CRI
SGI
IBM
Convex
HP
SunTMCIntel
DECCompaqJapanese
Other
0
100
200
300
400
500Ju
n-9
3
No
v-93
Jun
-94
No
v-94
Jun
-95
No
v-95
Jun
-96
No
v-96
Jun
-97
No
v-97
Jun
-98
No
v-98
Nu
mb
er
of
Sy
ste
ms
Other
Japanese
Compaq
DEC
Intel
TMC
Sun
HP
Convex
IBM
SGI
CRI
National Computational Science Alliance
Cycles Used by NSF Community at the NSF Supercomputer Centers by Vendor
SGI/Cray
IBM
HP
DEC
SGI SN1 is the Natural Upgrade for 84% of Cycles!
June 1, 1997 through May 31, 1998CTC, NCSA, PSC, SDSC
1019 Projects Using 100% of the Cycles
T3D/EOrigin/PC
C/T90
National Computational Science Alliance
• Clustered Shared Memory Architecture– Will Dominate for 5-10 Years– Builds on Market Supported Segments
• Scalability Has Acquired Two Dimensions– Parallelism of Shared Memory Nodes– Number of Shared Nodes in Cluster
• New Challenges for Supercomputing Users– Memory Hierarchies– Fault Tolerance– Hybrid Programming Models
Capability Computing Will Be Done on Scalable Clusters of Shared Memory Modules
National Computational Science Alliance
Most Capacity in High End Computing Will Be Local
0
0.2
0.4
0.6
0.8
1
1.2
1.4
1995 1996 1997
Wo
rkst
atio
ns
Sh
ipp
ed (
Mill
ion
s)
UNIX
NT
The Emerging Wintel Supercomputer
Linux, NT Scalable ClustersCondor, Symera LANs of Workstations
Harvesting the Web
National Computational Science Alliance
128 Hewlett Packard 300 MHz
64 Compaq 333 MHz
• Andrew Chien, CS UIUC-->UCSD• • Rob Pennington, NCSA• Reagan Moore, SDSC
• Plan to Link UCSD & UIUC Clusters
“Supercomputer performance at mail-order prices”-- Jim Gray, Microsoft
PACI Fostering Commodity Computing
Various Applications Sustain 7 GF on 128 Processors
National Computational Science Alliance
0
1
2
3
4
5
6
7
0
10
20
30
40
50
60
Processors
Gig
afl
op
s
Origin-DSM
Origin-MPI
NT-MPI
SP2-MPI
T3E-MPI
SPP2000-DSM
Solving 2D Navier-Stokes Kernel - Performance of Scalable Systems
Preconditioned Conjugate Gradient Method With Multi-level Additive Schwarz Richardson Pre-conditioner
(2D 1024x1024)
Danesh Tafti, Rob Pennington, NCSA; Andrew Chien (UIUC, UCSD)
VariousApplicationsSustaining
7 GF on 128 Processors
NT Supercluster
National Computational Science Alliance
QCD Performance on Various High End Computers
Doug Toussaint and Kostas Orginos, University of Arizona
Conjugate Gradient Calculation of Quark Propagators in QCD With Kogut-Susskind Quarks
National Computational Science Alliance
User Web BrowserOutput to User
User Input
Format Translator, Query Engine and Program Driver
Workbench Server
Results to User
User Instructions and queries
Application Programs
(May have varyinginterfaces and be written in different
languages)Results
Instructions
Information Sources(May be of
varying formats)
Information
Queries
NCSA Computational Biology Group
The NCSA Information Workbench - An Architecture for Web-Based Computing
National Computational Science Alliance
Structure & Function
Pathways & Physiology
Populations& Evolution
Ecosystems
Genomes
Gene Products
Using a Web Browser to Run Programs and Analyze Data Worldwide
NCSA Biology WorkbenchHas Over 10,000 Users From Over 25 Countries