18
© ECMWF October 4, 2016 Web Coverage Service for meteorological data Experience from the EarthServer-2 project Julia Wagemann [email protected] Workshop: Implementation and potential of INSPIRE coverage data and WCS (I) INSPIRE conference 2016, Barcelona 30 September 2016

Web Coverage Service for meteorological data · 2016-10-04 · Workshop: Implementation and potential of INSPIRE coverage data and WCS (I) INSPIRE conference 2016, Barcelona 30 September

  • Upload
    others

  • View
    1

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Web Coverage Service for meteorological data · 2016-10-04 · Workshop: Implementation and potential of INSPIRE coverage data and WCS (I) INSPIRE conference 2016, Barcelona 30 September

© ECMWF October 4, 2016

Web Coverage Service for meteorological dataExperience from the EarthServer-2 project

Julia [email protected]

Workshop: Implementation and potential of INSPIRE coverage data and WCS (I)INSPIRE conference 2016, Barcelona30 September 2016

Page 2: Web Coverage Service for meteorological data · 2016-10-04 · Workshop: Implementation and potential of INSPIRE coverage data and WCS (I) INSPIRE conference 2016, Barcelona 30 September

2EUROPEAN CENTRE FOR MEDIUM-RANGE WEATHER FORECASTS

Who is familiar with meteorological data?

Page 3: Web Coverage Service for meteorological data · 2016-10-04 · Workshop: Implementation and potential of INSPIRE coverage data and WCS (I) INSPIRE conference 2016, Barcelona 30 September

This might be familiar…

3EUROPEAN CENTRE FOR MEDIUM-RANGE WEATHER FORECASTS

Page 4: Web Coverage Service for meteorological data · 2016-10-04 · Workshop: Implementation and potential of INSPIRE coverage data and WCS (I) INSPIRE conference 2016, Barcelona 30 September

This might be familiar…

4

ce air temperature anomaly 16 relative to the August ge for the period 1981-2010 WF, Copernicus C3S)

Monthly gmean surtemperatuanomaliesto 1981-2

Page 5: Web Coverage Service for meteorological data · 2016-10-04 · Workshop: Implementation and potential of INSPIRE coverage data and WCS (I) INSPIRE conference 2016, Barcelona 30 September

It is getting more complex…

5

River discharge forecast hydrograph for 8 April 2008

(Source: GloFAS)

10-day epsgram for 2m air temperature – base date: Tuesday, 27 September(Source: ECMWF)

Page 6: Web Coverage Service for meteorological data · 2016-10-04 · Workshop: Implementation and potential of INSPIRE coverage data and WCS (I) INSPIRE conference 2016, Barcelona 30 September

Meteorological data structures – a challenge

3D 4D 5D

• Large data volumes

• Multi-dimensional

• Lots of metadata

• Heterogeneous (forecast, analysis, etc)

• GRIB data format

• Large data volumes

• Multi-dimensional

• Lots of metadata

• Heterogeneous (forecast, analysis, etc)

• GRIB data format

Complexity &

Page 7: Web Coverage Service for meteorological data · 2016-10-04 · Workshop: Implementation and potential of INSPIRE coverage data and WCS (I) INSPIRE conference 2016, Barcelona 30 September

Meteorological and Archival Retrieval System• World’s largest archive of meteorological

data• > 90 PBs (and continues to grow by 3 PB

per month)

Page 8: Web Coverage Service for meteorological data · 2016-10-04 · Workshop: Implementation and potential of INSPIRE coverage data and WCS (I) INSPIRE conference 2016, Barcelona 30 September

Efficient data retrieval service for experts

MARS

MARS request

Expert user

.GRIB / .netCDF

Raw data / subsets

Page 9: Web Coverage Service for meteorological data · 2016-10-04 · Workshop: Implementation and potential of INSPIRE coverage data and WCS (I) INSPIRE conference 2016, Barcelona 30 September

9

Challenge

Data is complex and

large

Challenge

Download service

for expert users

11 22

Page 10: Web Coverage Service for meteorological data · 2016-10-04 · Workshop: Implementation and potential of INSPIRE coverage data and WCS (I) INSPIRE conference 2016, Barcelona 30 September

10EUROPEAN CENTRE FOR MEDIUM-RANGE WEATHER FORECASTS

WCS for Climate Data (EarthServer-2)

WCS is of great valfor data providers

developers and scien

Objective Conclusi

• Provide access to over 1 PB of global climate reanalysis data

• Offer server-based data access and processing

• Make ECMWF data more accessible to users, especially outside the MetOcean domain

Page 11: Web Coverage Service for meteorological data · 2016-10-04 · Workshop: Implementation and potential of INSPIRE coverage data and WCS (I) INSPIRE conference 2016, Barcelona 30 September

WCS as part of the data-processing chain

11EUROPEAN CENTRE FOR MEDIUM-RANGE WEATHER FORECASTS

Developer

GIS User

Scientist

Useful for:

Page 12: Web Coverage Service for meteorological data · 2016-10-04 · Workshop: Implementation and potential of INSPIRE coverage data and WCS (I) INSPIRE conference 2016, Barcelona 30 September

From a service for expert users to a service for “users”

WC(P)SWC(P)S

MARS

rasdamanrasdaman

MARS request

Expert user

.GRIB / .netCDF

Raw data / subsets

WC(P)Srequest

MARS request?

User

Raw data / subsets / time-series

.netCDF, image formats,further processing

Nature of data requ

Scalability?

In what data structustore/register data/met

Efficiency?

Limit of data volumerequest?

Page 13: Web Coverage Service for meteorological data · 2016-10-04 · Workshop: Implementation and potential of INSPIRE coverage data and WCS (I) INSPIRE conference 2016, Barcelona 30 September

Right representation of meteorological data structures

From a general “data description”…

to a systematic meteorological (data application profile!

Page 14: Web Coverage Service for meteorological data · 2016-10-04 · Workshop: Implementation and potential of INSPIRE coverage data and WCS (I) INSPIRE conference 2016, Barcelona 30 September

But all the PBs will be useless, if…

Page 15: Web Coverage Service for meteorological data · 2016-10-04 · Workshop: Implementation and potential of INSPIRE coverage data and WCS (I) INSPIRE conference 2016, Barcelona 30 September

And this includes…

KEEP IT SIMPLAND HIDE

COMPLEXITY

ATA FORMATSFormats such as GeoJSON, netCDF

ETADATA INFORMATIONExample: lat/lon information for ad-hoc plotting

UMAN vs. MACHINE READABLEExample: ansi date format

Page 16: Web Coverage Service for meteorological data · 2016-10-04 · Workshop: Implementation and potential of INSPIRE coverage data and WCS (I) INSPIRE conference 2016, Barcelona 30 September

Conclusion

WCS HAS GREAT POTENTIAL• to offer an on-demand pull service, supplementa

expert systems in place• to increase data uptake, especially to users of oth

communities

CHALLENGES• Variety of data structures• Keep the user in focus that usage of download

service is ensured• Paradigm change – from data-to-user to user-to-

data

Page 17: Web Coverage Service for meteorological data · 2016-10-04 · Workshop: Implementation and potential of INSPIRE coverage data and WCS (I) INSPIRE conference 2016, Barcelona 30 September

THANK YOU!Questions?

More information

• WCS for Climate Data: http://earthserver.ecmwf.int

• OGC WCS tutorial: http://nbviewer.jupyter.org/github/earthserver-eu/OGC_WCS_tutorial/blob/master/index

• EarthServer-2: http://www.ecmwf.int/en/earthserver-2

Do you want to become a WCS test user?

• Contact us via [email protected]

17EUROPEAN CENTRE FOR MEDIUM-RANGE WEATHER FORECASTS

Page 18: Web Coverage Service for meteorological data · 2016-10-04 · Workshop: Implementation and potential of INSPIRE coverage data and WCS (I) INSPIRE conference 2016, Barcelona 30 September

ata Policy Workshop | 28 February –1 March 2017Workshop on Meteorological Operational Systems (MOS) | 1–3 March 2017opendatahack – Discover the potential of weather data | 4–5 March 2017

18