Embed Size (px)
Citation preview
EOVSA Catalog Design and VSO Integration
D. Zarro
1
EOVSA Kickoff Meeting 24-26 September 2012
Build on IDL Database
Heritage: IUE, UIT, SOHO/CDS, Hinode/EIS
IDL-based, with supporting routines in SSW
OS- and Platform-independent
(Windows, Unix/Linux, Mac OS X)
2
Catalog Design Considerations
What data products will be searched (images, spectra, lightcurves)?
What metadata will be stored in catalog (observing ids, engineering parameters)?
What metadata will be searchable (e.g. time, frequency)?
3
#itemsTL_ID I*4 Timeline ID from planning softwareOBSTITLE C*80 Observing program titleTARGET C*40 Target of observationSTUD_ACR C*40 Study AcronymOBS_DEC C*240 Description of observationOBS_NUM I*2 Sequential number of observationJOP_ID I*2 Joint Observing Program ID.EIS_SC C*120 Description of EIS science objectiveOBSERVER C*60 Name of chief observerDATE_OBS R*8 Date/time of beginning of observationDATE_END R*8 Date/time of end of observationNOAA_NUM I*2 NOAA Active Region Number (from planning software)NOAA_AR I*2 NOAA Active Region Number (calculated)SCI_OBJ C*80 Science objectiveXCEN R*4 Actual pointing of center of image in solar XYCEN R*4 Actual pointing of center of image in solar YFOVX R*4 Width of field of view in solar XFOVY R*4 Width of field of view in solar YDATE C*80 Date the FITS file was writtenFILENAME C*80 Name of FITS file study data was retrieved from.
4
Example EIS Catalog entries
Archive of searchable data products
Catalog writer/updater
Catalog reader/browser
5
Catalog Requirements
Catalog Population Pipeline
EOVSA Processed Data Archive
SSW IDL
EOVSA Catalog
VSO Registry
6
Continuous process:1. Extract metadata from data file headers.2. Populate catalog with metadata.3. Push catalog to SSW.4. Pull search entries into VSO.
=> Search catalog via VSO clients and/or IDL directly.
SSW/IDL database reader returns data structures with fields that match metadata entries
7
IDL> list_eis_main,’1-may-11’,’2-may-11’,obs
** Structure EIS_MAIN_LIST, 28 tags, length=304, data length=296: TL_ID LONG 21996 OBSTITLE STRING 'HOP 185. AR magnetism with SST. TARGET STRING 'Active Region ' OBS_DEC STRING 'Switch to returning AR on NE limb. JOIN_SB STRING 'E,S,X ' OBS_NUM INT 0 JOP_ID INT 185 STUDY_ID LONG 360' EIS_SC STRING 'UNKNOWN DATE_OBS DOUBLE 1.6830148e+09 DATE_END DOUBLE 1.6830176e+09 SCI_OBJ STRING 'AR XCEN FLOAT 362.712 YCEN FLOAT -260.052 FOVX FLOAT 39.9360 FOVY FLOAT 120.000 DATE STRING '2011-05-07 FILENAME STRING 'eis_l0_20110502_080935.fits.gz
VSO/IDL client returns selected metadata and file URL locations
8
IDL> files=vso_search('1-may-08','10-may-08',inst='eis',/url)Records Returned : SDAC_EIS : 206/206
http://sdac.virtualsolar.org/data/hinode/eis/level0/2008/05/01/eis_l0_20080501_054833.fits.gz
http://sdac.virtualsolar.org/data/hinode/eis/level0/2008/05/01/eis_l0_20080501_055014.fits.gz
http://sdac.virtualsolar.org/data/hinode/eis/level0/2008/05/01/eis_l0_20080501_114027.fits.gz
http://sdac.virtualsolar.org/data/hinode/eis/level0/2008/05/01/eis_l0_20080501_120700.fits.gz
