17
IDS DATA CENTER UPDATE Carey Noll IDS Data Flow Coordinator NASA GSFC Greenbelt, MD USA Pascal Willis IGN/JPL Pasadena, CA USA IDS Workshop Biarritz, France June 13-14, 2002

IDS Data Center Update - NASA · 2013-11-29 · IDS Workshop 2000 | Biarritz, France | June 13, 2002 | 2 IDS DATA CENTERS XTwo proposal received and accepted for IDS data centers:

  • Upload
    others

  • View
    2

  • Download
    0

Embed Size (px)

Citation preview

Page 1: IDS Data Center Update - NASA · 2013-11-29 · IDS Workshop 2000 | Biarritz, France | June 13, 2002 | 2 IDS DATA CENTERS XTwo proposal received and accepted for IDS data centers:

IDS DATA CENTERUPDATE

Carey NollIDS Data Flow Coordinator

NASA GSFCGreenbelt, MD USA

Pascal WillisIGN/JPL

Pasadena, CA USA

IDS WorkshopBiarritz, France

June 13-14, 2002

Page 2: IDS Data Center Update - NASA · 2013-11-29 · IDS Workshop 2000 | Biarritz, France | June 13, 2002 | 2 IDS DATA CENTERS XTwo proposal received and accepted for IDS data centers:

IDS Workshop 2000 | Biarritz, France | June 13, 2002 | 1

IDS DATA CENTER UPDATE

Data Center Overview

Archive Structure

Data and Product Availability

Users of DORIS Data

Data Availability Issues

Page 3: IDS Data Center Update - NASA · 2013-11-29 · IDS Workshop 2000 | Biarritz, France | June 13, 2002 | 2 IDS DATA CENTERS XTwo proposal received and accepted for IDS data centers:

IDS Workshop 2000 | Biarritz, France | June 13, 2002 | 2

IDS DATA CENTERSTwo proposal received and accepted for IDS data centers:– Crustal Dynamics Data Information System (CDDIS), NASA GSFC,

Greenbelt, MD USA– Institut Géographique National (IGN), Paris France

CDDIS is a dedicated data center supporting the internationalspace geodesy community since 1982The CDDIS serves as one of the primary data centers for thefollowing IAG services:– International GPS Service (IGS)– International Laser Ranging Service (ILRS)– International VLBI Service for Geodesy and Astrometry (IVS)– International DORIS Service (IDS)– International Earth Rotation Service (IERS)

CDDIS has archived DORIS data since launch of TOPEX/Poseidonin 1992The IGN data center currently undergoing a “revitalization”;DORIS data archiving activities to resume in summer 2002

Page 4: IDS Data Center Update - NASA · 2013-11-29 · IDS Workshop 2000 | Biarritz, France | June 13, 2002 | 2 IDS DATA CENTERS XTwo proposal received and accepted for IDS data centers:

IDS Workshop 2000 | Biarritz, France | June 13, 2002 | 3

DATA FLOW FOR IAG SERVICES

Network StationsContinuously operationalTimely flow of data

Data CentersInterface to network stationsPerform QC and data

conversion activitiesArchive data for access to

analysis centers and users

Analysis CentersProvide products to users

(e.g., station coordinates,precise satellite orbits, Earthorientation parameters, atmospheric products, etc.)

Central BureauManagement of serviceFacilitate communicationsCoordinate activities

Governing BodyGeneral oversight of serviceFuture direction

Page 5: IDS Data Center Update - NASA · 2013-11-29 · IDS Workshop 2000 | Biarritz, France | June 13, 2002 | 2 IDS DATA CENTERS XTwo proposal received and accepted for IDS data centers:

IDS Workshop 2000 | Biarritz, France | June 13, 2002 | 4

DORIS DATA FLOW(CDDIS)

CNES deposits data in incoming disk area on CDDIS host computer

IDS analysis centers also deposit solutions in incoming disk area onCDDIS computer

Automated routines peruse incoming data and product area fornew files

New files copied to public disk area

Summaries generated from DORIS data files and loaded into Oracledata base

Data base information includes satellite, site, time span, andnumber of observations per pass

Data base used to generate reports on DORIS data holdings

During first five months of 2002, over eighty groups in 20 countrieshave accessed DORIS data and information from the CDDIS

Page 6: IDS Data Center Update - NASA · 2013-11-29 · IDS Workshop 2000 | Biarritz, France | June 13, 2002 | 2 IDS DATA CENTERS XTwo proposal received and accepted for IDS data centers:

IDS Workshop 2000 | Biarritz, France | June 13, 2002 | 5

DORIS ARCHIVE CONTENTData

CDDIS currently archives DORIS data from threesatellites: TOPEX, SPOT-2, and SPOT-4

Data from JASON, ENVISAT, and SPOT-5 expected“soon”

Historic archive of SPOT-3 data also available

Currently, data are stored in multi-day (typically10-day) cycle files

Data available ~ 10 days after the last observationday (TOPEX); longer for SPOT

Files approximately two Mbytes in size (UNIXcompressed)

Page 7: IDS Data Center Update - NASA · 2013-11-29 · IDS Workshop 2000 | Biarritz, France | June 13, 2002 | 2 IDS DATA CENTERS XTwo proposal received and accepted for IDS data centers:

IDS Workshop 2000 | Biarritz, France | June 13, 2002 | 6

DORIS ARCHIVE CONTENTCDDIS

Launch 12/07/2001; data not yet released to datacenters (available since 01/15/2002)JASON

05/01/1998 through presentSPOT-4

Launch 03/14/2002; data not yet released to datacenters (available since 04/23/2002)ENVISAT

Launch 05/04/2002; data not yet released to datacentersSPOT-5

02/01/1994 through 11/09/1996SPOT-3

03/31-07/04/1990

11/04/1992 through presentSPOT-2

09/25/1992 through presentTOPEX/Poseidon

Time SpanSatellite

Page 8: IDS Data Center Update - NASA · 2013-11-29 · IDS Workshop 2000 | Biarritz, France | June 13, 2002 | 2 IDS DATA CENTERS XTwo proposal received and accepted for IDS data centers:

IDS Workshop 2000 | Biarritz, France | June 13, 2002 | 7

DORIS ARCHIVE CONTENTProducts

Archived by Analysis Center (AC) and data type– Station coordinates (SINEX)

GlobalTime series (daily, weekly, monthly)

– Geocenter variations– EOP (X, Y, UT1-UTC rate)– Orbits– Ionospheric data or models– Etc.

SINEX solutions received from two ACs thus far– IGN (weekly and monthly, 1992-2001)– SSALTO (monthly,01/2001-04/2002)

EOP and geocenter solutions received from IGN

Page 9: IDS Data Center Update - NASA · 2013-11-29 · IDS Workshop 2000 | Biarritz, France | June 13, 2002 | 2 IDS DATA CENTERS XTwo proposal received and accepted for IDS data centers:

IDS Workshop 2000 | Biarritz, France | June 13, 2002 | 8

ARCHIVE CONTENTDirectory Structure

Directory File Name Description

Data Directories

/doris/satname satcodedata###.dat.Z DORIS data for satellite satcode and cycle number ###

satname.files File containing multi-day cycle filenames versus time span

/doris/satname/sum satcodedata###.sum.Z Summary of contents of DORIS data file for satellitesatcode and cycle number ###

Product Directories

/doris/ccc cccyydvv.snx.Z Global DORIS (d) SINEX solutions of station coordinates foranalysis center ccc, year yy, solution version number vv

cccyydddtvv.snx.ZPeriodic SINEX solutions for analysis center ccc, starting onyear yy and day of year ddd, type t (m=monthly,w=weekly, d=daily) solution version number vv

cccyytvvaaaa.snx.Z

Station coordinate time series SINEX solutions for analysiscenter ccc, starting on year yy and day of year ddd, type t(m=monthly, w=weekly, d=daily) solution version numbervv, for station aaaa

Other Directories

/doris/dorismail dorismail.#### DORISMail message number ####

/doris/general General DORIS information such as satellite maneuver files

Page 10: IDS Data Center Update - NASA · 2013-11-29 · IDS Workshop 2000 | Biarritz, France | June 13, 2002 | 2 IDS DATA CENTERS XTwo proposal received and accepted for IDS data centers:

IDS Workshop 2000 | Biarritz, France | June 13, 2002 | 9

USAGE OF DORIS DATA AT CDDIS(01-05/2002)

0

200

400

600

800

1000

1200

1400

1600

1800

Australia France Germany Russia TheNetherlands

U.S.Commercial

U.S. Education U.S.Government

U.S. Network UnitedKingdom

Other

Country

Num

ber

of F

iles

0

2

4

6

8

10

12

14

Num

ber

of H

osts

No. ofFilesInstitution

39U. Texas, USA

45Johns Hopkins APL, USA

46TU Delft, The Netherlands

51CNES, France

60LRZ, Germany

64NASA GSFC, USA

70U. Newcastle, UK

113RAS, Russia

227CLS, France

519DGFI, Germany

629IGN, France

793TRW, USA

1,018Ohio State, USA

1,113AUSLIG, Australia

1,536NASA JPL, USA

Top Users in 2002

Page 11: IDS Data Center Update - NASA · 2013-11-29 · IDS Workshop 2000 | Biarritz, France | June 13, 2002 | 2 IDS DATA CENTERS XTwo proposal received and accepted for IDS data centers:

IDS Workshop 2000 | Biarritz, France | June 13, 2002 | 10

ISSUES

Start of delivery of data from recent missions(JASON, ENVISAT, SPOT-5)

New DORIS format to accommodate recentsatellites

Delay in delivery of SPOT-2 and -4 data to datacenters

Need routine delivery of satellite maneuverinformation to data centers and IDS Central Bureau

Need other ancillary information (e.g., satellitemacro-model) prior to release of initial data sets

Need feedback from CNES when replacement datafiles are issued

Page 12: IDS Data Center Update - NASA · 2013-11-29 · IDS Workshop 2000 | Biarritz, France | June 13, 2002 | 2 IDS DATA CENTERS XTwo proposal received and accepted for IDS data centers:

IDS Workshop 2000 | Biarritz, France | June 13, 2002 | 11

DELAY IN DELIVERY OF DORIS DATA(All Satellites, 01/2000-05/2002)

0

10

20

30

40

50

60

70

80

90

100

01/00 01/00 03/00 03/00 04/00 05/00 06/00 07/00 08/00 09/00 10/00 11/00 12/00 01/01 02/01 03/01 04/01 05/01 06/01 07/01 08/01 09/01 10/01 11/01 12/01 01/02 02/02 03/02 04/02 05/02

Date of Last Obs. (MM/YY)

Del

ay in

Del

iver

y (D

ays)

TOPEX SPOT-2 SPOT-4

Page 13: IDS Data Center Update - NASA · 2013-11-29 · IDS Workshop 2000 | Biarritz, France | June 13, 2002 | 2 IDS DATA CENTERS XTwo proposal received and accepted for IDS data centers:

IDS Workshop 2000 | Biarritz, France | June 13, 2002 | 12

FUTURE PLANS

Efforts to enhance the DORIS data center at IGN inFrance will start in late summer 2002

– Contacts Loic Daniel and Edouard Gaulue

Procedures will be established at both data centers toregularly compare data holdings

IDS Steering Committee has recommended datacontinue to be archived in files by cycle as released byCNES

Expand the data archive to include data fromrecently-launched satellites

Continue to enhance the on-line product archive

Page 14: IDS Data Center Update - NASA · 2013-11-29 · IDS Workshop 2000 | Biarritz, France | June 13, 2002 | 2 IDS DATA CENTERS XTwo proposal received and accepted for IDS data centers:

IDS Workshop 2000 | Biarritz, France | June 13, 2002 | 13

QUESTIONS?

Contact:

Carey NollCDDIS ManagerNASA GSFCCode 920.1Greenbelt, MD 20771 USA

301-614-6542 (voice)301-614-5970 (fax)

[email protected]://cddisa.gsfc.nasa.govftp://cddisa.gsfc.nasa.gov/pub/doris

Page 15: IDS Data Center Update - NASA · 2013-11-29 · IDS Workshop 2000 | Biarritz, France | June 13, 2002 | 2 IDS DATA CENTERS XTwo proposal received and accepted for IDS data centers:

IDS Workshop 2000 | Biarritz, France | June 13, 2002 | 14

BACKUP SLIDES

Page 16: IDS Data Center Update - NASA · 2013-11-29 · IDS Workshop 2000 | Biarritz, France | June 13, 2002 | 2 IDS DATA CENTERS XTwo proposal received and accepted for IDS data centers:

IDS Workshop 2000 | Biarritz, France | June 13, 2002 | 15

DORIS DATA FLOW

Page 17: IDS Data Center Update - NASA · 2013-11-29 · IDS Workshop 2000 | Biarritz, France | June 13, 2002 | 2 IDS DATA CENTERS XTwo proposal received and accepted for IDS data centers:

IDS Workshop 2000 | Biarritz, France | June 13, 2002 | 16

USAGE OF DORIS ARCHIVE AT CDDIS

0

200

400

600

800

1000

1200

1400

1600

1800

Austr

alia

Belgi

umCa

nada

Chin

a

Czec

h Re

publi

cDen

mark

Finlan

dFr

ance

German

y

Italy

Japa

nPe

ruPo

land

Russi

aSp

ainSw

itzer

land

The N

ethe

rland

s

U.S. C

ommer

cial

U.S. Ed

ucat

ion

U.S. G

over

nmen

tU.S.

Net

work

Unite

d Kin

gdom

Country

Num

ber

of F

iles

0

2

4

6

8

10

12

14

Num

ber

of H

osts