NCEP Site Update WG-CSAB – Spring 2011

NCEP Site UpdateWG-CSAB – Spring 2011

Allan DarlingDeputy Director, NCEP Central Operations

[email protected]

April 13-14, 2011

2CSAB Spring Meeting - April 13-14 2011

CSAB Spring Meeting - April 13-14 2011 3

Computing Capability

IBM POWER6 P575 Operational August 2009 73.1 Tflops Linpack sustained 156 POWER6 32-way Nodes 4,992 processors @ 4.7GHz 20 Terabytes of memory 330 Terabytes of disk space 18 PB tape archive

4

350 1179 1179 1849 18494379 4379

13990 15470

69735

0

10000

20000

30000

40000

50000

60000

70000

80000

1999 2000 2001 2002 2003 2004 2005 2006 2007 2008

Years

Gig

aflo

ps (L

inpa

ck)

2009

15470

2010

69735

CSAB Spring Meeting - April 13-14 2011

NCEP Supercomputing Performance Growth

5

Future Operational HPC Request for Proposal posted to FedBizOpps.gov on January 12, 2011 RFP is to acquire advanced high performance computing systems (HPCS)

to meet NOAA’s operational computing requirements. The new primary and backup Weather and Climate Operational Supercomputing System (WCOSS) will replace the current operational HPCS platforms at NCEP headquartered in Camp Springs, Maryland.

Completed proposal packages are due March 31, 2011 Delivery, subject to the availability of funds, is anticipated for award in

October 2011. Contract will consist of a five (5) year base period with a three (3) year

option period and a two (2) year transition option. The total duration of the contract, inclusive of all options, shall not exceed ten (10) years.

The amount of all orders placed under the contract shall not exceed $502M.


6

Future R&D HPC Site A – CMRS “Gaia” Oak Ridge National Lab

Now: Cray XE6 LC – 259 TF, 1288 24-core nodes Feb 2012: Cray XE6 LC - 1106 TF, 3760 32-core

nodes (aggregate) Site B – Fairmont, WV

Expected availability late 2012 System architecture and size TBD

Gaithersburg R&D system “Vapor” will be replaced by NOAA Site B


7

Production HWM (02/16/2010)

0

10

20

30

40

50

60

70

80

90

100

110

120

130

140

00:0

0:00

00:5

6:00

01:5

2:00

02:4

8:00

03:4

4:00

04:4

0:00

05:3

6:00

06:3

2:00

07:2

8:00

08:2

4:00

09:2

0:00

10:1

6:00

11:1

2:00

12:0

8:00

13:0

4:00

14:0

0:00

14:5

6:00

15:5

2:00

16:4

8:00

17:4

4:00

18:4

0:00

19:3

6:00

20:3

2:00

21:2

8:00

22:2

4:00

23:2

0:00

Supercomputer Production UtilizationFebruary 2010



00:0201:1402:2603:3804:5006:0207:1408:2609:3810:5012:0213:1414:2615:3816:5018:0219:1420:2621:3822:500

10

20

30

40

50

60

70

80

90

100

110

120

130

140

STRATUS HWM 1/20/2011Production System Utilization

FY11 FY12 FY13 FY14FY10April April April April April

10%

90%

80%

70%

60%

50%

40%

30%

20%

14.46%

51.48%

Production Node Utilization based on P5 growth history

Predicted P6 System Utilization based on P5 Growth Rate

Post-GFS System Utilization (26.92%)

Post-CFS System Utilization (39.07%)

Post-NAM System Utilization (54.01%)

Post-SREF System Utilization (55.82%)

Post-HYCOM System Utilization (43.75%)

07/06/2010


00:0201:1102:2003:2904:3805:4706:5608:0509:1410:2311:3212:4113:5014:5916:0817:1718:2619:3520:4421:5323:020

10

20

30

40

50

60

70

80

90

100

110

120

130

140

CIRRUS HWM 1/20/2011Standby System Utilization


Yearly Average

2006: 99.42%2007: 99.70%2008: 99.82%2009: 99.85%2010: 99.83%

Product On-Time Percentage


End to End Lag Times Trend

0

5

10

15

20

25

30

Month

Aver

age

Mon

thly

Lag

(Min

utes

)

AWIPS Decoded Lag

TOC Lag

NCEP Delay

Yearly Average (2006-2009): 364s 125s 98s 69s

Model Delivery to AWIPS/NOAAPort


2011 System/Operations Initiatives

Model Implementation Model implementation process re-engineering

launched this year

Production Supercomputers Additional 300TB disk storage (multicluster-GPFS)

completed New Operational Supercomputer acquisition and

transition – 2012-2013

14

Dissemination System Redundancy

NCEP Internet dissemination systems hosted at two locations since October 2010 Silver Spring, MD Boulder, CO

Redundant Systems FTPPRD – http://ftpprd.ncep.noaa.gov NOMADS – http://nomads.ncep.noaa.gov

Identical live data feeds to sites at both locations Customers access only one site to eliminate latency

differences Access switched by NOAA without customer intervention


Model Analysis and GuidanceWeb Site

Operational Now

Replaces the Model Analysis & Forecast site in August

Nine Models

Twelve Geographic Areas

http://mag.ncep.noaa.gov

Questions?Online FAQ [email protected]


http://mag.ncep.noaa.gov/

16

Access to Numerical Forecast Guidance data, tailored to user needs -http://nomads.ncep.noaa.gov

Data downloaded via Grib Filter and OpenDAP Methods

NOMADS


17

Dissemination Services Utilization


ftp, 70%

http, 14%

nomads(dods), 1%

nomads(gribfilter), 15%

feb mar apr may jun jul aug sep oct nov dec020,000,000,00040,000,000,00060,000,000,00080,000,000,000

100,000,000,000120,000,000,000140,000,000,000160,000,000,000180,000,000,000

Monthly 2010 NCEP Model Product Access

ftp Linear (ftp) httpnomads (gribfilter) Linear (nomads (gribfilter)) nomads (dods)

Feb – Dec 2010FTP use up 40%

NOMADS use up 52%Overall use up 44%

18

CY10-11 Completed Implementations

GEFS: 2/23/2010 – resolution increase to ~70 km out to 16 days, conversion to ESMF, additional parameters

GFS: 7/28/2010 – resolution increase to T574 (27 km) GLOFS: 12/7/2010 – became operational on NCEP computers;

run extended to 60 hours RTMA: 9/28/2010 – implemented RTMA for Guam,

enhancements to HI, CONUS, resolution increase to 2.5 km NUOPC IOC: access to GEFS, Canadian global and FNMOC

NOGAPS output on NOMADS CFS: 3/20/2011 - 16 runs every day out to 45 days, four of

which will go out to 9 months (monthly and seasonal) NOS Operational Forecast systems for Chesapeake, Delaware

and Tampa Bay: 3/29/2011 – new implementation

GFS Implementation Implemented July 28, 2010 Horizontal resolution increased from 35 km to 27 km (through 192 hours in

support of the GFS MOS development) Upgraded: radiation and cloud package, specification of gravity wave drag,

boundary layer scheme, deep convection scheme Higher resolution grid for hurricane relocation, snow analysis New mass flux shallow convection scheme

19

24 hr rainfall ending 12Z, Sept 29, 200836-60 hr forecast

20

21

FY11 Planned Implementations

Q3 Planned Implementations HWRF V5.0.0 (AOP) GFDL V9.0.0 Real Time Global SST (AOP) NOS Northern Gulf of Mexico Operational Forecast System V1.0.0 GFS-based Hi-Res MOS V1.0.0 Experimental QPF NAM NEMS Upgrade V3.0.0 (Compute Resources for Parallel)

22

FY11 Planned Implementations

Q4 Planned Implementations Global HYCOM (1/12 degree) V1.0.0 NCO Parallel to Production (AOP) Rapid Refresh V6.0.0 (AOP) Adding FNMOC data to Wave Ensemble V2.1.0 (AOP) Interim Dust predictions: HYSPLIT Upgrades V1.0.0 (NCO Parallel to

Production) SWPC Enlil V1.0.0 (NCO Parallel) (AOP) MADIS FOC V2.0.0 CCS Development/Production Environment Equivalence Project SREF NEMS Upgrade V6.0.0(Compute Resources for Parallel) NAEFS: GEFS Upgrade V10.0.0 (Compute resources for both parallel and

Production)

23

Notification of UpcomingImplementations

NCO WEB Sitehttp://www.nco.ncep.noaa.gov/pmb/changes/

Model Evaluation Mailing List Notification of availability of test data for major model upgrades:https://lstsrv.ncep.noaa.gov/mailman/listinfo/ncep.list.modelevalinfo

Weekly Change MemoList of every module, script, or data flow change:https://lstsrv.ncep.noaa.gov/mailman/listinfo/ncep.list.jifmemo


Documents

NCEP Site Update WG-CSAB – Spring 2011