The ESA FRM4DOAS project · 2019. 11. 19. · part of the ESA FRM program •Main objectives: Further harmonising MAXDOAS systems and data sets through: 1. Development and demonstration

BELGISCH INSTITUUT VOOR RUIMTE-AERONOMIE INSTITUT D’AERONOMIE SPATIALE DE BELGIQUE BELGIAN INSTITUTE OF SPACE AERONOMY BELGISCH INSTITUUT VOOR RUIMTE-AERONOMIE INSTITUT D’AERONOMIE SPATIALE DE BELGIQUE BELGIAN INSTITUTE OF SPACE AERONOMY BELGISCH INSTITUUT VOOR RUIMTE-AERONOMIE INSTITUT D’AERO

The ESA FRM4DOAS project

AGU FM 2018, Washington DC, 14 December 2018 1

BIRA-IASB (Lead): F. Hendrick, C. Fayt,M. Friedrich, and M. Van Roozendael

IUP-Bremen: A. Richter, T. Bösch, L.Alvarado

IUP-Heidelberg: U. Friess, L. Tirpitz

MPIC: T. Wagner, S. Beirle, Y. Wang, S.Dörner

KNMI: A. Piters

BK Scientific: K. Kreher

External partners: A. Cede (LuftBlick)and E. Lend-Spinei (VirginiaTech/NASA)

ESA: A. Dehn, S. Casadio


• 2-year project started in July 2016 and ended in November 2018, as part of the ESA FRM program

• Main objectives:

Further harmonising MAXDOAS systems and data sets through:

1. Development and demonstration of a first near-real-time (24hlatency) MAXDOAS centralised Processing System to beoperated within NDACC

2. Support to the preparation of the CINDI-2 MAXDOASintercomparison campaign (Cabauw (NL), September 2016)

3. Establishment of link with other UV-visible networks, likethe Pandonia Global Network (PGN)

To be a key contributor in the operational validation of currentand future atmospheric composition satellite missions (ESA Sentinels, TEMPO in the US, and GEMS in Asia)

FRM4DOAS objectivesFiducial Reference Measurements for Ground-Based DOAS Air-Quality Observations


FRM4DOAS centralised processing

system



system

1



system

1 2



system

13

2



system

13

4

2



system

13

4

5

2


(MAX-)DOAS Best Practices

Assessment• Based on past and current EU ‘harmonisation’ projects (GeoMon, NORS,

QA4ECV) and MAX-DOAS intercomparison campaigns like CINDI-1 (Cabauw, 2009), MADCAT (Mainz, 2013), and CINDI-2 (Cabauw, 2016)

• MAX-DOAS Instrument Calibration and Operation Guidelines:


FRM4DOAS Round-Robin exercise

ParameterisationOptimal Estimation


Participant Method Algorithm nameForward

Model

BIRA-IASB OEM bePro LIDORT

BIRA-IASB OEM MMF LIDORT

IUPUB OEM Boreas SCIATRAN

IUPHD OEM HEIPRO SCIATRAN

KNMI Parametrised Mark DAK

MPIC Parametrised MAPA MC, LM McArtim

MPIC OEM Priam SCIATRAN

NASA Quicklook NASA N/A

Tropospheric profiling algorithm selection:




Model









Round-Robin strategy

Target species: Aerosols (O4) @ 360 and 477 nm, HCHO, NO2 (vis)

Creation of a synthetic SCD reference dataset based on the output of 5 different RTMs for 9 trace gas profiles and 11 aerosol profiles; use of prescribed settings (e.g. altitude grid)

>20 000 simulated SCDs and 3 960 retrieved profiles for the different scenarios and viewing geometries

Tropospheric profiling algorithm selection:




Model










Tropospheric profiling algorithm selection: Target species: Aerosols (O4) @ 360 and 477 nm, HCHO, NO2 (vis)






Model










Tropospheric profiling algorithm selection: Target species: Aerosols (O4) @ 360 and 477 nm, HCHO, NO2 (vis)




Round-Robin results (step 1)

Forward model SCD comparison



Round-Robin results (step 2)

Regression analysis results – Near surface (0-200m) concentration/extinction



Round-Robin selection

Numerical performance

Final selection:

BIRA-MMF (OEM)

MPIC-MAPA (param.)

Assessment matrix

Friess et al., submitted in AMTD+

Beirle et al., The Mainz Profile algorithm(MAPA), AMTD, in review, 2018


Other selected algorithms

• No Round-Robin selection for the spectral fitting S/W and the total O3 column and stratospheric NO2 profile retrieval tools, given their much higher level of maturity

Stratospheric NO2 vertical profiles: Total O3 vertical column densities:

BIRA OEM-basedprofiling tool

(Hendrick et al., ACP, 2004)

OEM )(

)()(

AMF

RCDDSCDVCD

Standard NDACC approach based on AMF LUTs(see http://ndacc-uvvis-wg.aeronomie.be)

BIRA QDOAS spectral fitting S/W:

http://uv-vis.aeronomie.be/software/QDOAS/

http://ndacc-uvvis-wg.aeronomie.be/


Processing System Architecture

• Event-driven approach using asynchronous modules triggered by the presence of queues of input files created by the preceding module(s)

• Execution of a module is controlled by an independent entity called wrapper

FRM4DOAS Final Meeting, ESA/ESRIN, 20-21 November 2018 18

Wrapper name Check frequency time

L1_incoming hh:01 to hh:59 every 15 min

qdoas hh:03 to hh:59 every 15 min

mmf hh:07 to hh:59 every 5 min

no2strato hh:09 to hh:59 every 15 min

o3strato hh:07 to hh:59 every 15 min

5 main modules

high level of modularity and flexibility

Full open source code (bash, python, Fortran)


Data processing status –

Processing system validation


NRT Mode:STATION Type Channel

nr.

Daily

submission

start date

MMF/MAPA Total O3 Stratospheric

NO2

XIANGHE Research grade 2 01/07/2018 x x x

UCCLE Research grade 2 01/07/2018 x x x

HARESTUA Research grade 2 29/06/2018 N/A x x

NY.ALESUND Research grade 2 01/07/2018 x x x

BREMEN Research grade 2 01/07/2018 x x x

ATHENS Research grade 1 01/07/2018 x x x

DE BILT Mini-DOAS Hof. 1 19/07/2018 x x x

MAINZ Research grade 4 31/07/2018 x N/A x

HEIDELBERG EnviMes 2 01/08/2018 x x x

NEUMAYER Research grade 2 Offline x x x


36 MAXDOAS instruments from 30 Institutes/17 countries

IN-SITU

RamanLidar

LP-DOAS

NO2 lidar

NO2 SondeCeilometer

CINDI-2 campaign set-up(Cabauw, 12-28 September 2016)

http://www.tropomi.eu/data-products/cindi-2


STATION Type Channel

nr.

Daily

submission

start date


NO2











NRT Mode:Instrument

number

Type Channel

nr.

MMF/

MAPA

Total

O3

Stratospheric

NO2

aiofm-1 Research grade 1 x N/A x

auth-3 Research grade 2 x N/A x

bira-4 Research grade 2 x x x

boku-6 Research grade 2 x x x

cma-7 Mini-DOAS Hof. 1 x N/A x

cma-8 Mini-DOAS Hof. 1 x x x

dlrustc-13 EnviMes 2 x x x


iupb-18 Research grade 2 x x x

iuph-19 EnviMes 2 x x x

knmi-23 Pandora 2 x N/A x

luftblick-27 Pandora 2 x x x

mpic-28 Research grade 1 x N/A x

lmumim-35 EnviMes 2 x x x

Off-line Mode:



21


STATION Type Channel

nr.

Daily

submission

start date


NO2











NRT Mode: Off-line Mode:



Sub-selection for FRM4DOAS validation:

Res. grade, high S/N

Res. grade, low S/N

EnviMes

22

Instrument

number

Type Channel

nr.

MMF/

MAPA

Total

O3

Stratospheric

NO2

aiofm-1 Research grade 1 x N/A x

auth-3 Research grade 2 x N/A x

bira-4 Research grade 2 x x x

boku-6 Research grade 2 x x x

cma-7 Mini-DOAS Hof. 1 x N/A x

cma-8 Mini-DOAS Hof. 1 x x x



iupb-18 Research grade 2 x x x

iuph-19 EnviMes 2 x x x

knmi-23 Pandora 2 x N/A x

luftblick-27 Pandora 2 x x x

mpic-28 Research grade 1 x N/A x

lmumim-35 EnviMes 2 x x x


Validation based on CINDI-2 data

Good overall agreement with independent observations:


Res. grade, high S/N

Res. grade, low S/N

EnviMes

Near surface (0-200m) HCHO concentration: MAX-DOAS versus LP-DOAS


• The first NRT MAX-DOAS centralised processing system has been successfully developed and demonstrated in NRT and off-line modes.

• Although it was a demonstration project, the operational level of the processing system is already high: fully automatic operation, detection of retrieval or data stream failures, automatic QC reporting through e-mail, etc

• Further developments (from 2019): Conversion into a full operational system integrated as part of NDACC and ESA EVDC, extension to additional stations and target species (e.g. tropospheric O3, CHOCHO)

Concluding remarks



Potential extension of FRM4DOAS


Based on the Technology Readiness Level questionnaire circulated amongthe MAX-DOAS community


Thank you for your attention !

For further details, see http://frm4doas.aeronomie.be/

Documents

The ESA FRM4DOAS project · 2019. 11. 19. · part of the ESA FRM program •Main objectives: Further harmonising MAXDOAS systems and data sets through: 1. Development and demonstration