View
218
Download
1
Category
Tags:
Preview:
Citation preview
3/3/2002
1
HRD In-Situ Ground System
Bridging Technologies Between EOS, NPP and the Future
International TOVS Study Conference - XII
PI: Patrick Coronado
Code 935/Applied Information Sciences Branch
patrick.coronado@gsfc.nasa.govhttp://directreadout.gsfc.nasa.gov
Presented by: Gail Reichert
Code 935 /Applied Information Sciences Branch
gail.reichert@gsfc.nasa.gov
3/3/2002
2
Who?
NPP Direct Readout Lab (DRL)
• We are the NPP In-Situ Ground System element.
• As part of the NPP, our job is to design & prototype a Direct Readout Ground System, which will– Serve as an advanced technology test bed– Act as a compatibility test unit for pre-launch spacecraft (e.g.,
NPP)– Be back compatible with EOS spacecrafts and instruments
3/3/2002
3
The Problem
More satellitesmore complex instruments
+larger more complex data sets
more complex processing requirements
+ +
= big headache (!) for general users
Our Goals:
Design Develop Integrate Test
Hardware/Software technologies needed to acquire/process DB data
Make available via release to public domain technology transfer
Overall: Be a bridge between satellite missions (Terra, Aqua, NPP…) & general user community
& “Pave the road” to NPP
Mission
3/3/2002
4
• Real-Time Software Telemetry Processing System (RTSTPS)
Outline
• Real-Time Instrument Data Streaming (Simulcasting)
• Mobile NISGS: Advanced Technology Test Bed– Phase 1: Land-going
• Web site for distribution of software algorithms– Level 0 (RTSTPS) + other protocol processing– MODIS Level 1 (geolocation & calibration)– Institutional & DB Level 2
• NPP ESTO Portal for Science, Technology and Environmental Research (NEpster)– Phase 1: Level 0 & Level 1 data
*Charts with asterisks next to their page numbers signify pages with supplemental information.
*
3/3/2002
5
Direct Readout Roadmap to NPP
POES/DMSP/SeaStar Terra Aqua
AVHRRSeaWiFS
OLS
MODISMODISAIRS
AMSUHSB
NPP
VIIRSCrIS
ATMS
Evolution of Concurrent Ground System Supporting Technologies and Algorithm Development
Standardization & Increasing RF, Modulation & Bandwidth Requirements
S/C & Instrument Evolution
•Custom Frame Formatters & Ingest software•Analog Custom Receivers•NOAA Level1B (AVHRR)•Limited Data Distribution mechanisms
•L,S-band•.665 - 2Mbps•Bi-Phase L
•X-band•13.1Mbps•Viterbi•OQPSK
•X-band•15Mbps•OQPSK•NRZM
•X-band•15Mbps•QPSK•NRZM•Viterbi•Compression
•S/C specific STPS•Level-0•Return Link Processor•Analog Configurable Receiver
•MODIS Level-1•DAAC & MODIS Simulcast
•Reconfigurable RT-STPS•Return Link Processor•Digital re-Configurable Receiver•MODIS & AIRS Level-1
•DAAC & NEpster with L0 & L1 data
•Reconfigurable RT-STPS•Digital re-Configurable Receiver (PC-based)•ALL Instru. Level-1 Software•DAAC & NEpster with L0, L1 & EDRs•Simulcast of all Instruments
Now
3/3/2002
6
• Standalone processing software system
Real-Time Software Telemetry Processing System
• Takes raw satellite data stream from receiver & processes to EOS Level-0 in real time:– Synchronizes frames (CCSDS version 2)– Applies Reed-Solomon error detection and correction– Reassembles packets into 1+ Level 0 format data files (by SCID, VCID &/or APID)
• Written in Java (runs on any computer with JRE 1.3+)
• Modular design, easy to reconfigure– Processing modules linked by data pathways as set in configuration file– Interactive control via graphical application viewer
• Runs in batch &/or server mode
*
3/3/2002
7
• Multi-threaded server:– Runs continuously
– 1st thread listens for TCP/IP packets (unsynchronized telemetry)– 2nd thread listens for user commands (load, shut down, get status info)
RTSTPS Major Components
• Graphical application viewer– Runs on remote computer or user’s local machine – Sends load & shutdown commands– Updates & displays status info
• Web viewer (planned)– Connected to STPS server, shows status info
• Graphical editor (under development)– Users may create/edit configuration files– Config files may be on user's or server's computer
*
3/3/2002
8
Real-Time STPS Context
RawTelemetry
Frames CADUs VCDUs B_PDUs Packets
Frame Synchronizer
RS/CRC/PNDecoders
CCSDSServices
CORE
AcquisitionBoard
SERVER
NetworkPorts
ViewerEditor SetupFiles
Files
Status SetupRemote User Interfaces
Web
Status
see http://directreadout.gsfc.nasa.gov/projects/rt-stps/stps.htm
3/3/2002
9
Real-Time STPS versus STPS
RTSTPS STPS
written in Java C
speed as fast or faster
reconfigurable Yes
(most CCSDS compliant s/c)
Not
easily
interface Java tool simple text
create PDS “on the fly”? Yes No
process AQUA data? Yes No
sort by time? No Yes
remove duplicate packets? No Yes
detect VCDU header errors? No Yes
handle NRZ-L/NRZ-M correction? next release Yes
*
3/3/2002
10
Simulcasting
Rate Buffer
Level-0
Ingest Computer(PC/NT)
Real-TimeServer
Real-TimeClients
Realtime FlowLow Rate Flow
Receiver
Products
Purpose: Distribute & visualize DB data in real time Current System: Prototype, tested using Terra MODIS data
Planned: Multi-mission, multi-instrument
see http://directreadout.gsfc.nasa.gov/projects/simulcasting/simulcasting.htm
3/3/2002
11
• Web site: http://directreadout.gsfc.nasa.gov/software_main.html
Distribution of Software Algorithms
• Currently available in standalone mode:– Level 0 (RTSTPS) + other protocol processing (STPS, Sorcerer,
MODIS band extractor, DPREP)– MODIS Level 1: DAAC, IMAPP (offsite), winIMAPP (offsite)– MODIS Fire Detection (Level 2)– NEpster interface (NOI)– Simulcasting Server/Client
• Soon to be available:– MODIS NDVI (Level 2)– Level 1, Fire Map, NDVI Viewers
• Planned:– Institutional Level-2 algorithms (by Institution, not converted to
standalone mode)– MODIS BRDF converted to standalone mode, with lessons learned
3/3/2002
12
Distribution of Software Algorithms (continued)
• To download any DRL-provided algorithm, user must fill out User Account Form (for authentication purposes only)
• To download any software algorithm, user must electronically sign software disclosure form for each algorithm
– Member LogIn Page– Only have to sign form for each algorithm once
Algorithms for Future Missions:
• With Terra (& Aqua), we are “paving the road” to NPP in terms of– Conversion of institutional algorithms to DB standalone mode– Algorithm & product staging– Distribution & version management
*
3/3/2002
13
Algorithms for Future Missions (continued)
• Don’t miss the following poster:
“Weather and Climate Information Available from EOS and NPP Direct Broadcasts”, J. Dodge (NASA)
• Highlights algorithm & product roadmap from EOS spacecrafts to NPP: – MODIS As Real Time Camera - vegetation, coastal conditions, flooding,
fires, weather phenomena, …– New Sensor Data For AQUA DB– AIRS Temperature/Moisture Soundings– AMSR-E Over US To Be Available– Some Potential New Uses For AQUA Data– NPP Data Products
*
3/3/2002
14
NPP ESTO Portal … (NEpster)
• Impetus: Unprecedented requirements for– (for DB) Geographically dispersed collection– Complex processing– Very large data volumes (for NPP Level 0 estimate 1 Gbyte/day/site)
• Concept: – Virtually connected network of data archive systems that share & exchange
remote sensing data
– Peer-to-peer architecture – Borrows from Napster, but relevant to other science areas as well (Particle Physics, Medical Imaging, Astronomy…)
• Will be developed in 2 phases
*
3/3/2002
15
NEpster Phase I
RODIN(metadata)
NOI
MetadataExtractor
Broker
Peer-to-peer data sharing
Temporary stagingarchive
see http://directreadout.gsfc.nasa.gov/projects/nepster/nepster.htm
3/3/2002
16
Nepster Phase I (continued)
• Metadata Extractor:– Automated, runs at DRL and remote archive sites– Extracts metadata as new data is collected– (or: remote site may choose to have regular downloads via ftp)
• Intelligent Broker: – Maps extracted metadata to RODIN database– Resolves remote site policies (transparent to user)
Components:
• RODIN: Direct Readout Lab database (MYSQL)– Stores extracted metadata– Allows searches on metadata fields (e.g., time, geolocation station)
• Nepster Observation Interface (NOI):– Web-based data search interface
• Temporary Staging Archive:– Stages remote data at DRL for possible future requests– Convenient for remote sites with narrow “pipes”
*
3/3/2002
17
QuickTime™ and aGIF decompressor
are needed to see this picture.
NEpster Phase II
Provides: • Real-Time notification of data acquisition at a remote site• A web-based query mechanism for all participating acquisition sites and data repositories• A temporary archive for remote sites with limited bandwidth• Automatic routing between the user and data source
DAAC“deep”archive
RealTime
“Deep” archive metadata store
*
Recommended