of 21/21
Servicios marinos y supercomputación: experiencias y retos futuros Santiago de Compostela, 27 th September 2017 CMEMS IBI-MFC Forecasting Service Operational forecast and reanalysis in North Atlantic waters R&D Team: M.G. Sotillo, R. Aznar, E. Gutknecht, G. Reffray, S. Cailleau, B. Levier, T. Dabrowski, P. Bowyer, L. Aouf, A. Dalphinet, R. Rainaud, J.E. Barrera, C. Toledano, A. Amo- Baladrón, P. Lorente, A. Pascual, E. Alvarez-Fanjul. CESGA Team: P. Rey, A. Rodríguez, J. Villasuso, A. Feijoo, C. Fernández, A. Gómez, I. López.

CMEMS IBI-MFC Forecasting Service Aznar.pdfServicios marinos y supercomputación: experiencias y retos futuros Santiago de Compostela, 27th September 2017 CMEMS IBI-MFC Forecasting

  • View
    1

  • Download
    0

Embed Size (px)

Text of CMEMS IBI-MFC Forecasting Service Aznar.pdfServicios marinos y supercomputación: experiencias y...

  • Servicios marinos y supercomputación: experiencias y retos futuros Santiago de Compostela, 27th September 2017

    CMEMS IBI-MFC Forecasting Service

    Operational forecast and reanalysis in North Atlantic waters

    R&D Team: M.G. Sotillo, R. Aznar, E. Gutknecht, G. Reffray, S.Cailleau, B. Levier, T. Dabrowski, P. Bowyer, L. Aouf, A.Dalphinet, R. Rainaud, J.E. Barrera, C. Toledano, A. Amo-Baladrón, P. Lorente, A. Pascual, E. Alvarez-Fanjul.

    CESGA Team: P. Rey, A. Rodríguez, J. Villasuso, A. Feijoo, C.Fernández, A. Gómez, I. López.

  • Servicios marinos y supercomputación: experiencias y retos futuros Santiago de Compostela, 27th September 2017

    Copernicus: The European Earth

    Observation Programme

    Copernicus Marine Environment Monitoring Service (CMEMS)

    2012/04

    MyOcean MyOcean-2 MyOcean-FO

    2014/10 2015/052009/04

    • Environment protection.

    • Management of urban areas.

    • Forestry.• Fisheries.• Health.• Transport.• Climate change.• Sustainable

    development.• Civil protection.• Tourism.

    Land Atmosphere MarineClimatechange

    Emergencymanagement

    Security

    http://www.myocean.eu/

  • Servicios marinos y supercomputación: experiencias y retos futuros Santiago de Compostela, 27th September 2017

    Short & Medium Weather Forecast

    CMEMS objectives

    Seasonal Forecast

    Oil Spill Combat

    Ice Shipping Route

    Search & Rescue

    Offshore Energy

    Water Pollution

    Coastal Environment Climate Change

    SustainableAquaculture

    Ecosystem-basedfisheries management

    Marine biology

  • Servicios marinos y supercomputación: experiencias y retos futuros Santiago de Compostela, 27th September 2017

    CMEMS organization

    http://marine.copernicus.eu/ocean-colour-thematic-center-oc-tac/http://marine.copernicus.eu/ocean-sea-ice-thematic-center-osi-tac/http://marine.copernicus.eu/global-monitoring-forecasting-center-glo-mfc/http://marine.copernicus.eu/arctic-monitoring-forecasting-centre-arc-mfc/http://marine.copernicus.eu/baltic-monitoring-forecasting-centre-bal-mfc/http://marine.copernicus.eu/north-west-shelf-monitoring-forecasting-centre-nws-mfc/http://marine.copernicus.eu/iberia-biscay-irish-monitoring-forecasting-centre-ibi-mfc/http://marine.copernicus.eu/mediterranean-monitoring-forecasting-centre-med-mfc/http://marine.copernicus.eu/black-sea-monitoring-forecasting-centre-bs-mfc/http://marine.copernicus.eu/situ-thematic-centre-ins-tac/

  • Servicios marinos y supercomputación: experiencias y retos futuros Santiago de Compostela, 27th September 2017

    CMEMS IBI-MFC: what is IBI?

    Check of physical processes:- Eddies- Coastal Upwelling (western African & Iberian coasts)- Gibraltar inflow/outflow- Slope/shelf currents in the Bay of Biscay

    The IBI (Iberia-Biscay-Ireland) area

  • Servicios marinos y supercomputación: experiencias y retos futuros Santiago de Compostela, 27th September 2017

    The IBI Consortium

    More than 30 experts in the IBI Team

    IBI-MFC COORDINATION

    PHYSICAL BIOGEOCHEMICAL WAVES

    OPERATION & SERVICE

    CROSS-CUTTING

    R&D

  • Servicios marinos y supercomputación: experiencias y retos futuros Santiago de Compostela, 27th September 2017

    CMEMS IBI-MFC: Current products

    IBI Products disseminated to end-users through CMEMS web catalogue:

    TEMP, SAL, U, V & SSH

    IBI_ANALYSIS_FORECAST_PHYS_005_001

    dataset-ibi-analysis-forecast-phys-005-001-hourly

    dataset-ibi-analysis-forecast-phys-005-001-daily

    Near Real Time Forecast (1/36º)

    (2012-Today)

    Chl, Fer, NH4, NO3, O2, PO4, Si, Phytoplanckton,

    Primary production & Euphotic depth

    IBI_ANALYSIS_FORECAST_BIO_005_004

    dataset-ibi-analysis-forecast-bio-005-004-daily

    VPED, VHM0_SW1, VTM02, VTM10, VTPK, VMDR,

    VHM0_SW2, VTM01_SW2, VTM01_SW1,

    VMDR_SW2, VMDR_SW1, VTM01_WW, VMDR_WW,

    VHM0_WW, VSDY, VSDX, VHM0

    IBI_ANALYSIS_FORECAST_WAV_005_005

    dataset-ibi-analysis-forecast-wav-005-005-hourly

    TEMP, SAL,U,V & SSH

    IBI_REANALYSIS_PHYS_005_002

    dataset-ibi-reanalysis-phys-005-002-hourly-regulargrid

    dataset-ibi-reanalysis-phys-005-002-daily-regulargrid

    dataset-ibi-reanalysis-phys-005-002-monthly-regulargrid

    dataset-ibi-reanalysis-phys-005-002-monthly-nativegrid

    Chl, Fer, NH4, NO3, O2, PO4, Si, Phytoplanckton,

    Primary production & Euphotic depth

    IBI_REANALYSIS_BIO_005_003

    dataset-ibi-reanalysis-bio-005-003-monthly-regulargrid

    dataset-ibi-reanalysis-bio-005-003-monthly-nativegrid

    Multi-year (1/12º) (2002-2014)

    VPED, VHM0_SW1, VTM02, VTM10, VTPK, VMDR,

    VHM0_SW2, VTM01_SW2, VTM01_SW1,

    VMDR_SW2, VMDR_SW1, VTM01_WW, VMDR_WW,

    VHM0_WW, VSDY, VSDX, VHM0

    IBI_REANALYSIS_WAV_005_006

    dataset-ibi-reanalysis-wav-005-006-hourly

    Sotillo et al. 2015: The MyOcean IBI Ocean Forecast and Reanalysis Systems: operational products and roadmap to thefuture Copernicus Service. J of. Op. Oc., Vol. 8 , Iss. 1

  • Servicios marinos y supercomputación: experiencias y retos futuros Santiago de Compostela, 27th September 2017

    Behind the IBI-MFC: PHY component

    IBI NEMO v3.6 is a 3D baroclinic model that:

    Solves Navier-Stockes and state equations in geopotential coordinates under hydrostatic and

    Boussinesq approximations.

    Solves high-frequency shelf processes.

    Horizontal Resolution: 1/36° (≈ 2 km).

    Vertical Resolution: 50 z-coord levels.

    Grid size 1093 x 1894 x 50 = 1.035e08 grid points.

    Composite Bathymetry from ETOPO 2 & GEBCO.

    Tidal forcing at OBC & tidal astronomic potential.

    (11 harmonics from FES2004 and TPXO7.1 tidal models solutions)

    High frequency Atmospheric forcing (3h atmospheric forcing from ECMWF Model)

    Nesting into CMEMS GLOBAL system (Lateral Open Boundary Condition: daily 1/12º data

    interpolated to the NEMO grid. 3D T, S, Sea Level & velocities)

    Daily update of river discharge inputs (River flowrates sources for 33 rivers)

    Run daily forecast + 2 weekly hindcasts (Mon & Wed) with spectral nudging (Data

    Assimilation from April 2018)

  • Servicios marinos y supercomputación: experiencias y retos futuros Santiago de Compostela, 27th September 2017

    • New IBI-NRT-BIO forecast service in V3 (April 2017).

    • PISCES model v3.6

    • High resolution (1/36º - 50lev) biogeochemical forecast

    (+7D), updated weekly (on Thu).

    • PISCES 3.6 Application:

    – 24 state variables. Delivers chlorophyll, oxygen,

    iron, nitrate, ammonium, phosphate, silicate, net

    primary production and the euphotic zone depth,…

    • On-line coupling with IBI NRT PHY Solution.

    • Nested (BIO OBC) to CMEMS GLOBAL BIO Solution.

    • Detailed System description in PUM.

    2014 Annual average chlorophyll. IBI_ANALYSIS_FORECAST_BIO_005_004 only delivered for the IBI service domain (in red).

    Behind the IBI-MFC: BIO component

    The IBI BIO-Team: Mercator Ocean-Marine Institute-PdESci Development: MOQualification: MI & PdETransition into operations: MO & PdEProduction & validation: PdE

  • Servicios marinos y supercomputación: experiencias y retos futuros Santiago de Compostela, 27th September 2017

    • New IBI-NRT-WAV forecast service in V3 (April 2017).

    • MFWAM model code used as base.

    • 10Km resolution.

    • Spectral resolution 24 directions and 30 frequencies

    (start at 0.035Hz).

    • 3h ECMWF wind forcing (same as IBI PHY) .

    • OBC from CMEMS WAV GLOBAL.

    • Run twice a day, 5 day forecast on daily basis.

    • Product contains the usual wave variables, including

    swell and wind wave separation.

    • Additionally, wave inputs for phy-wav coupling:

    computation of Stoke Drift.Altimeter Ja-2 & saral (JFM-2015)

    The IBI WAV-Team: MF-AEMET-PdESci Development: MF & AEMETQualification: MF, AEMET & PdETransition into operations: AEMET & PdEProduction & validation: PdE

    SWH

    Behind the IBI-MFC: WAV component

  • Servicios marinos y supercomputación: experiencias y retos futuros Santiago de Compostela, 27th September 2017

    NARVAL web tool

    Use of diverse observational networks encompassing both in situ and remote sensing instruments, available within IBI domain

    NARVAL (North Atlantic Regional VALidation)

    • Real Time (« Online-mode»)Performed automatically performs after forecast consistency metrics

    • Delayed ModeMonthly / Quarterly / annual basis

  • Servicios marinos y supercomputación: experiencias y retos futuros Santiago de Compostela, 27th September 2017

    Number of CMEMS Users/Subscribers since January 2013(Data source: CMEMS Service Monitoring report)

    The CMEMS User community

    ModellingObservations

    Number of users by product family(Data source: CMEMS Service Monitoring report)

    IBI

    Heterogeneous:

    Public Agencies, Universities, companies, etc… (Ex.: The SpanishIBI User Group)Active:

    Many User feedbacks

    i.e. questions, requests, warning onservice anomalies, bug detection, …

    Satisfied (but asking for more…):

    Operational Users looking for an

    efficient way to downscale IBI solution.

    Growing:

    98 IBI Users in April-June 2017 & Top-4 most downloaded modelling CMEMS products

    Sea LevelGlobal SST Med Oceancolour

    In situ NWS Baltic Arctic Sea Ice Black SeaWind

    ModellingObservations

  • Servicios marinos y supercomputación: experiencias y retos futuros Santiago de Compostela, 27th September 2017

    Downstream use cases

    Oleg Naydenov Oil Spill

    Gran Canaria

    … actions taken by local and national authorities and emergencyservices to mitigate the environmental damage. Monitoringevolution of the spill during the crisis, one of them. The CMEMS IBIforecast product played a significant role in achieving this goal.

  • Servicios marinos y supercomputación: experiencias y retos futuros Santiago de Compostela, 27th September 2017

    Flying gliders with IBI

    Now: SILBO

    Entered IBI domain on

    18th October 2016

    Downstream use cases

  • Servicios marinos y supercomputación: experiencias y retos futuros Santiago de Compostela, 27th September 2017

    The IBI-MFC systems

    – Increase of complexity of IBI NRT PHY Op suite.

    • SAM2 Data Assimilation Tool already in V3 (running Spectral Nudging Solution).

    – New BIO & WAV Op.

    – Increase of number of products to be generated, managed, stored & disseminated.

    • Challenging Hourly 3D Product.

    Noticeable upgrade of operational services at V3:

  • Servicios marinos y supercomputación: experiencias y retos futuros Santiago de Compostela, 27th September 2017

    224G(PHY)1.8T(PHY)!! 244G(BIO) 1G(WAV)

    24G(PHY)197G(PHY) 61G(BIO) 1G(WAV)

    4351 (44 PHY/BIO + 7 WAV)

    V2 V3Nodes

    (24 cores)

    Output

    Disk spacefor run

    HPC resources for IBI-MFC

    – Increment in the number of nodes (+8). 1032 cores for PHY/BIO; 144 for WAV.

    – Increment in outputs size.

    – Huge increment in the temporary disk space for PHY run (hourly 3D products).

    Noticeable upgrade of operational services at V3: Increase of HPC resources to face IBI V3 upgrade.

  • Servicios marinos y supercomputación: experiencias y retos futuros Santiago de Compostela, 27th September 2017

    0

    20

    40

    60

    80

    100

    120

    140

    160

    180

    PHY forecast(2,3h)

    WAV forecast(0,6h)

    PHY hindcast(2,3h)

    BIO hindcast(2,8h)

    BIO forecast(1,6h)

    3 0 4 7 6

    60

    20

    95

    130

    60

    60

    15

    30

    20

    20

    12

    1

    7

    5

    5

    3

    1

    2

    3

    2

    Computing time (min)

    pre-proc model post-proc dissemination storage

    DailyMon &

    Wed

    Thu

    Wed

    Twicea day

    HPC resources for IBI-MFC

    Virtual machines:- puertos2.cesga.es (OP): MOTU (webserver), THREDDS, M-FTP (CMEMS FTP server) installed.- test-puertos2.cesga.es: test machine (same as OP) for new products dissemination testing

    (i.e., 3D hourly products).- puertos.cesga.es: for double dissemination (1month) when new version update.

    +

  • Servicios marinos y supercomputación: experiencias y retos futuros Santiago de Compostela, 27th September 2017

    IBI-MFC systems performance

    Incidents/Problems/PSO

    Status of the period (from 1/5/2016 to 31/03/2017)

    How many have been raised?

    How long did theytake? [mean in days]

    How many are stillopen?

    Incidents 6 1 0

    Problems 0 0 0

    Planned ServiceOutages

    3 1 (

  • Servicios marinos y supercomputación: experiencias y retos futuros Santiago de Compostela, 27th September 2017

    Products

    Status of the period (1/5/2016 to 31/03/2017)

    Availability:

    % Availability of download

    mechanisms (HTTP/FTP)

    Timeliness:%Products ready for

    download

    How manyquestions from

    users

    Are some of yourproducts

    distributed by another service?

    SUB-DGF/WMS/MFTP99.83/99.92/99.95

    98.81 4 No

    • Questions from users related to:

    Problems with data download (metadata info through subsetterinterface).

    Request of variables not distributed.

    Problem with postprocessed data (BIO)

    IBI-MFC systems performance

  • Servicios marinos y supercomputación: experiencias y retos futuros Santiago de Compostela, 27th September 2017

    SAMPA & SAMOA: PdE coastal

    downscaling capabilities

    Algeciras

    Las Palmas

    S.C. deLa Palma

    S.S. deLa Gomera

    S.C. deTenerife

    Ferrol

    Barcelona

    Tarragona

    Bilbao

    SAMPA

    SAMOA systems

    Local HR Harbor Circulation Systems:

    Almería

    PRT-FER

    PRTFER: 197 x 92

    (dx~dy ≈ 70m)

    CST-FER

    CSTFER: 120 x 74

    (dx~dy ≈ 350m)

    CMEMS IBI

    CMEMS GLO

    PdE CST

    PdE PRT

    https://youtu.be/W1JthJ85naE

  • Servicios marinos y supercomputación: experiencias y retos futuros Santiago de Compostela, 27th September 2017

    The IBI-MFC Team