CAA inventory plots and graphical products overview

Delphine Herment (ESTEC)ESAC - 17/03/2011

Pre-generated inventory plots• One plot per instrument• Available in 3 resolutions (1 day, 1 month, 1 year)• Only displays a sub-set of the experiment datasets (flagged with

inventory=1 in the DB)• One line on the plot can be valid for several datasets (for example for

datasets delivered in multiple units)

• A perl script checks the “Inventory table” of the DB to get the list of data/gap interval for the required datasets/time

• It also requests the telemetry mode and event files (CEF datasets) from the DB – they are displayed on the first 2 panels

• It calls IDL to generate the inventory plot• The intervals with data are marked by a vertical blue line, gap by an

horizontal purple line and white means no files delivered for this interval• The CEF products are shown first and then the non-CEF ones

Pre-generated inventory plots

C1_CP_CIS-HIA_HS_MAG_IONS_CS C1_CP_CIS-HIA_HS_MAG_IONS_PEFC1_CP_CIS-HIA_HS_MAG_IONS_PFC1_CP_CIS-HIA_HS_MAG_IONS_PSDC1_CP_CIS-HIA_HS_MAG_IONS_RC

Inventory files

• The inventory files are generated after new files are ingested in the DB and the information they contain is then imported to the DB.

• They are monthly files generated per dataset.• Each records contains 3 fields:

– Time interval– Number of records in this interval (CEF) or number of files in this interval (non-CEF)– Higher file version (-1 = no file ingested)

• For non-CEF files we don’t have any information on the gaps it may contain, just if there is a file covering this interval.

• Example of an inventory file (CEF file):– C1_CP_WHI_NATURAL_2002-11-01.gap

…2002-11-04T11:07:43.152000Z/2002-11-06T18:49:57.560000Z, 88078, 3 => DATA2002-11-06T18:49:57.560000Z/2002-11-06T19:03:32.408000Z, 0, 3 => GAP2002-11-06T19:03:32.408000Z/2002-11-08T23:59:59.999999Z, 83896, 3 => DATA2002-11-08T23:59:59.999999Z/2002-11-09T03:53:57.224000Z, 23036, 2 => DATA2002-11-09T03:53:57.224000Z/2002-11-09T04:07:32.072000Z, 0, -1 => NO FILE DELIVERED…

Panels

Line plot

Spectrogram

On-demand only panel

Panels

Pre-generated panels• A sub-set of the available graphical products is available as pre-generated

panels.• They are generated in 3 resolutions (1 day, 6 hours, 1 hour) and 2 formats

(PS, PNG).• They are not downloadable from the GUI or command line as they don’t

include any time information.• When a list of pre-generated panels is requested the individual PNG

panels and the time axis panel are located from the DB and displayed on the screen.

• If the user requests to download the file then the PS panels are merged together with the adequate time axis panel (pre-generated too) into one PS file.

Pre-generated panels

PNG

PS

On-demand panels

• GUI calls a perl script with a list of panels to plot + time interval.• From this list the perl script determines the list of CEF datasets needed

(note that one panel may require several input CEF datasets … eventually from different experiments).

• The perl script queries the DB to get the CEF files corresponding to these dataset(s) and time interval.

• It calls idl to process the CEF data and create the plot(s) as well as the time axis panel.

• It merges the individual PS panels and the axis panel into one PS file (if more than 7 panels are requested then the PS file has multiple pages) and converts the PS file to PNG(s).

• Then the PS file, PNG files and input CEF files are returned to the GUI -> PNG files for display and CEF and PS files for download.

One dataset

Panel

2+ datasets

PS panel PS panel PS panel

PS plot

PNG plot

CAA GUI

Panel Panel

CEF file CEF file CEF file

Time interval

CAA GUI

IDL

perl

axis panel

DB

On-demand panels

PEACE + EFW input datasets

Multiple sub-panels

Processed component

One component of a variable

Multiple-lines plot

Multiple STAFF input datasets

2 parameters displayed