An Operational Enterprise Ground Solution for S-NPP and Beyond

2015 AMS Annual Meeting

Dylan Powell, Ph.D. Lockheed Martin ESPDS-NDE Development Science Engineer dylan.powell@noaa.gov Office Phone: () -

Peter MacHarrie, Solers Inc. Dan Beall, Solers Inc.

Jamison Hawkins, Lockheed Martin

2

NOAA Satellite Operations Facility (NSOF)

2

Svalbard S-NPP

NDE 1.0 Ingest

Product Generation Product Distribution

System Monitoring User Services

Data Records (xDRs)

External/Internal Users Archive – CLASS (NUPs only)

xDRs NDE Science Applications

Tailored Products

NASA VIIRS Image

JPSS Common Ground System

3

Ingest

Ingested Data 103 TB (4,904,851 files)

Product Generation

Number of Production Jobs 1,510,997

Generated Data 25.1 TB (2,815,623 files)

Production Job Success Rate 99.992%

Product Distribution

Distributed Data 28.8 TB (4,481,362 files)

Distribution Job Success Rate 99.947%

Subscription Based Services

Number of Users 29

Number of Subscriptions (active)

254

Process for algorithm development and transition from STAR

is mature Well defined and simple interface for algorithm integration

allowing for repeatable process and small integration team Easily scalable (just add processors) and highly available (all

algorithms are deployed to multiple processors) Allows for processing of any satellite data ◦ Data driven (no schedules) ◦ Define inputs/outputs ◦ Define parameters (flags, static ancillary data, etc.)

4

5 5

Develop Algorithm • Preliminary Design Review • Critical Design Review • Unit Test Readiness Review • System (Algorithm) Readiness Review

Prepare and Deliver Delivered Algorithm Package (DAP) • Algorithm Delivery Standards, Integration, and Test V1.4 (DAP document) • Configuration Management of DAP

Develop Algorithm Enhancements and Updates • Redeliver DAP

Develop/Test in NDE Sandbox • NDE environment • NDE operating system • NDE compilers • Science libraries

Integrate DAP into NDE • Configuration management • Production rules • Unit testing

Test Algorithm within Test Environment • System Test • Performance Test

Generate Operational Product within Production Environment • Operations • 24/7 Monitoring

Satellite Products and Services Review Board (SPSRB) approves product for operations

STAR

NDE

KEY

1

2

3

5

6

7

Calibration/ Validation

Office of Satellite and Product Operations (OSPO) performs software review 4

Define Requirements (JPSS Level 1)

8

Microwave Integrated Retrieval System (MiRS)

Advanced Clear-Sky Processor for Oceans (ACSPO)

Sea Surface Temperature

Total Precipitable Water

7

NOAA Unique CrIS/ATMS Processing System (NUCAPS)

VIIRS IR Image AWIPS2 NUCAPS Sounding

8

Green Vegetation Fraction (GVF)

VIIRS Polar Winds (VPW)

9

Vegetation Health (VH)

Tropical Cyclones (TC)

10

Aggregation

Resample

NDE VIIRS Image

Filtering

Remapping

NDE VIIRS RGB NDE VIIRS RGB

NDE VIIRS RGB

375 m 3 km

NDE ACSPO SST

11

Funny River Fire, Alaska VIIRS I1 (Visible)

VIIRS I3 (Fire)

12

12

Svalbard S-NPP, JPSS-1/2, GCOM-W1

JPSS CGS IDPS

NDE 2.0 (PG) Services

Ingest Product Generation

Product Management SDRs & EDRs (xDRs)

Products File Availability Notifications: - S-NPP/JPSS xDRs - NESDIS Unique Products (NUPs) - Tailored Products - GCOM-W L1/L2 Products

Ancillary Data File Availability Notifications

NASA VIIRS Image

ESPDS Common Infrastructure Platform

PDA (PD) Services

Product Distribution to Consumers Ancillary Data Acquisition

Enterprise Shared Storage

Product and Ancillary Data Files

Product and Ancillary Data Files

13

JPSS Risk Reduction Products

Clouds Snow/Ice Aerosols

GCOM AMSR2 Products

Winds

Clouds

Soil Moisture