40
The ICA&D concept Robert Leander Royal Netherlands Meteorological Institute On behalf of the ECA&D project team Aryan van Engelen Else van den Besselaar Albert Klein Tank Gerard van der Schrier http:// eca.knmi.nl

The ICA&D concept Robert Leander Royal Netherlands Meteorological Institute On behalf of the ECA&D project team Aryan van Engelen Else van den Besselaar

Embed Size (px)

Citation preview

Page 1: The ICA&D concept Robert Leander Royal Netherlands Meteorological Institute On behalf of the ECA&D project team Aryan van Engelen Else van den Besselaar

The ICA&D conceptRobert Leander

Royal Netherlands Meteorological Institute

On behalf of the ECA&D project team

Aryan van Engelen

Else van den Besselaar

Albert Klein Tank

Gerard van der Schrier

http://eca.knmi.nl

Page 2: The ICA&D concept Robert Leander Royal Netherlands Meteorological Institute On behalf of the ECA&D project team Aryan van Engelen Else van den Besselaar

Contents

• Definition and purpose what is the ICA&D concept?

• Key componentsComponents and their connection

Implementation requirements

• Look and feel of the web-portalA swift browse through the ECA&D site

Let’s fantasize about the WACA&D site

Contents

Page 3: The ICA&D concept Robert Leander Royal Netherlands Meteorological Institute On behalf of the ECA&D project team Aryan van Engelen Else van den Besselaar

Contents

• Daily station data

• Quality controlled

• Regional

• Climate changes indices

Definition and purpose

Characteristics

International Climate

International Climate Assessment & Dataset

Page 4: The ICA&D concept Robert Leander Royal Netherlands Meteorological Institute On behalf of the ECA&D project team Aryan van Engelen Else van den Besselaar

ICA&D examplesECA&D, SACA&D, LACA&D….

Page 5: The ICA&D concept Robert Leander Royal Netherlands Meteorological Institute On behalf of the ECA&D project team Aryan van Engelen Else van den Besselaar

For example

???

ECA&D, SACA&D, LACA&D….

why not WACA&D ?

Page 6: The ICA&D concept Robert Leander Royal Netherlands Meteorological Institute On behalf of the ECA&D project team Aryan van Engelen Else van den Besselaar

ContentsKey components

MySQLdatabase

Apache

Webserver

“Fullcycle”:

•QC •Blending•Index calculation•Homogeneity tests•Trends, climatology,

extreme analysis

DevelopmentMaintenance

of data + metadataUpdate cycle

Page 7: The ICA&D concept Robert Leander Royal Netherlands Meteorological Institute On behalf of the ECA&D project team Aryan van Engelen Else van den Besselaar

ContentsKey components

MySQLdatabase

Apache

Webserver

MySQLdatabase

Apache

Webserver

“Fullcycle”:

•QC •Blending•Index calculation•Homogeneity tests•Trends, climatology,

extreme analysis

Development OperationalMaintenance

of data + metadataUpdate cycle

Page 8: The ICA&D concept Robert Leander Royal Netherlands Meteorological Institute On behalf of the ECA&D project team Aryan van Engelen Else van den Besselaar

• Updating series + metadata

• Quality control

• Blending stations

• Indices calculation

• Homogeneity tests

• Trend analysis

climatology, anomalies and extreme analysis ….

Update cycle

“Fullcycle”:

•QC •Blending•Index calculation•Homogeneity tests•Trends, climatology,

extreme analysis

Update cycle

Bash-scripting,

C/F77 routines

Manual intervention required

Page 9: The ICA&D concept Robert Leander Royal Netherlands Meteorological Institute On behalf of the ECA&D project team Aryan van Engelen Else van den Besselaar

• Updating raw series + metadata

• Quality control

• Blending stations

• Indices calculation

• Homogeneity tests

• Trend analysis

climatology, anomalies and extreme analysis ….

“Fullcycle”:

•QC •Blending•Index calculation•Homogeneity tests•Trends, climatology,

extreme analysis

Update cycle

Bash-scripting,

C/F77 routines

Fully automated process

Update cycle

Page 10: The ICA&D concept Robert Leander Royal Netherlands Meteorological Institute On behalf of the ECA&D project team Aryan van Engelen Else van den Besselaar

“Fullcycle”:

•QC

•Blending•Index calculation•Homogeneity tests•Trends, climatology,

extreme analysis

Update cycle

Blending

• Extending and completing a station series with data from nearby stations

• Stations within certain proximity and within a certain range of altitude are considered, depending on the element

SYNOP data is the least preferred source ….

only used if no suitable historical data available

Page 11: The ICA&D concept Robert Leander Royal Netherlands Meteorological Institute On behalf of the ECA&D project team Aryan van Engelen Else van den Besselaar

“Fullcycle”:

•QC •Blending

•Index calc.•Homogeneity•Trends, climatology,

extreme analysis

Update cycle

Index calculation

• ETCCDI indices (same as in RClimdex)

• Additional Impact-related indices

• Comfort indices like UTCI, Tourism index

• Specific “agricultural” indices Viticulture-related indices

• Hydrological indices like hydrologic intensity HY-INT (Giorgi)

And more …

new index definitions can smoothly be integrated into the system

Page 12: The ICA&D concept Robert Leander Royal Netherlands Meteorological Institute On behalf of the ECA&D project team Aryan van Engelen Else van den Besselaar

“Fullcycle”:

•QC •Blending•Index calculation

•Homogeneity •Trends, climatology,

extreme analysis

Update cycle

Homogeneity

• Four tests on some indices (RR, TGG, etc):

• Von Neumann Ratio Test

• Buishand Range Test

• Alexanderson SNHT

• Pettit Test} Identify break

• Classification of series: suspect 3 or more tests detect change doubtfull 2 tests detect break usefull not more than 1 test detects break

Page 13: The ICA&D concept Robert Leander Royal Netherlands Meteorological Institute On behalf of the ECA&D project team Aryan van Engelen Else van den Besselaar

“Fullcycle”:

•QC •Blending•Index calculation•Homogeneity

•Trends, ….

Update cycle

Various analyses

• For those series whose series are not suspect

• Climatology

• Anomalies

• Trends

• Returnvalues

Page 14: The ICA&D concept Robert Leander Royal Netherlands Meteorological Institute On behalf of the ECA&D project team Aryan van Engelen Else van den Besselaar

ContentsDatabase (devel)

MySQLdatabase

•Primary variables (daily resolution): tg,tx,tn,rr,hu,ss,sd,cc,ff,fx,dd

•Raw daily series•Blended daily series•QC results•Annual index series•Homogeneity test results•Station metadata•Analyses results

• Trends• Climatology• Extremes• …..

} Operational database

Up

dat

e cy

cle

Webserver (devel)

Newraw data

Page 15: The ICA&D concept Robert Leander Royal Netherlands Meteorological Institute On behalf of the ECA&D project team Aryan van Engelen Else van den Besselaar

ContentsWeb server(s)

Apache

Webserver

Apache

Webserver

Internal web-server External web-server

External DatabaseInternal Database

• PHP – based

• JPGRAPH for plotting

• MapServer / MapScript for mapping

Page 16: The ICA&D concept Robert Leander Royal Netherlands Meteorological Institute On behalf of the ECA&D project team Aryan van Engelen Else van den Besselaar

• Separate linux-baseddevelopment and operational system.

• Web-content generation real-time

• Apache 2.0, MySQL 5.0.45, PHP 5.1.6

• Mapserver 4.10.2 (maps) , Jpgraph (plots)

• C, shell scripting (update cycle)

• Fortran (some of the calculations, gridding)

Infrastructure

Summarizing:

Page 17: The ICA&D concept Robert Leander Royal Netherlands Meteorological Institute On behalf of the ECA&D project team Aryan van Engelen Else van den Besselaar

ECA Website walkthrough..

http://www.ecad.eu

Page 18: The ICA&D concept Robert Leander Royal Netherlands Meteorological Institute On behalf of the ECA&D project team Aryan van Engelen Else van den Besselaar

2009 ECA&D : data inventory

Page 19: The ICA&D concept Robert Leander Royal Netherlands Meteorological Institute On behalf of the ECA&D project team Aryan van Engelen Else van den Besselaar

2009 ECA&D : (Raw) Daily data

Raw and blended daily station data for the take…

…..but ONLY the PUBLIC data !! The participant decides

Page 20: The ICA&D concept Robert Leander Royal Netherlands Meteorological Institute On behalf of the ECA&D project team Aryan van Engelen Else van den Besselaar

2009 ECA&D walkthrough: Daily data

Raw and blended daily station data for the take…

…..but ONLY the PUBLIC data !! The participant decides

Page 21: The ICA&D concept Robert Leander Royal Netherlands Meteorological Institute On behalf of the ECA&D project team Aryan van Engelen Else van den Besselaar

2009 ECA&D : Extreme events

Page 22: The ICA&D concept Robert Leander Royal Netherlands Meteorological Institute On behalf of the ECA&D project team Aryan van Engelen Else van den Besselaar

2009 ECA&D : Extreme events

Page 23: The ICA&D concept Robert Leander Royal Netherlands Meteorological Institute On behalf of the ECA&D project team Aryan van Engelen Else van den Besselaar

2009 ECA&D : Indices

Page 24: The ICA&D concept Robert Leander Royal Netherlands Meteorological Institute On behalf of the ECA&D project team Aryan van Engelen Else van den Besselaar

2009 ECA&D : Timeseries plots

Page 25: The ICA&D concept Robert Leander Royal Netherlands Meteorological Institute On behalf of the ECA&D project team Aryan van Engelen Else van den Besselaar

2009 ECA&D : Index time series

May 20May 2010

Page 26: The ICA&D concept Robert Leander Royal Netherlands Meteorological Institute On behalf of the ECA&D project team Aryan van Engelen Else van den Besselaar

2009 ECA&D : Indices maps

Page 27: The ICA&D concept Robert Leander Royal Netherlands Meteorological Institute On behalf of the ECA&D project team Aryan van Engelen Else van den Besselaar

2009 ECA&D : Indices maps

Page 28: The ICA&D concept Robert Leander Royal Netherlands Meteorological Institute On behalf of the ECA&D project team Aryan van Engelen Else van den Besselaar

2009 ECA&D walkthrough

Page 29: The ICA&D concept Robert Leander Royal Netherlands Meteorological Institute On behalf of the ECA&D project team Aryan van Engelen Else van den Besselaar

2009 ECA&D : Index map: RR1

Page 30: The ICA&D concept Robert Leander Royal Netherlands Meteorological Institute On behalf of the ECA&D project team Aryan van Engelen Else van den Besselaar

2009 ECA&D : Index map: RH

Page 31: The ICA&D concept Robert Leander Royal Netherlands Meteorological Institute On behalf of the ECA&D project team Aryan van Engelen Else van den Besselaar

2009 ECA&D : Climatology RR1

Page 32: The ICA&D concept Robert Leander Royal Netherlands Meteorological Institute On behalf of the ECA&D project team Aryan van Engelen Else van den Besselaar

2009 ECA&D : Anomalies RR1

Page 33: The ICA&D concept Robert Leander Royal Netherlands Meteorological Institute On behalf of the ECA&D project team Aryan van Engelen Else van den Besselaar

2009 ECA&D : Trend RR1

Page 34: The ICA&D concept Robert Leander Royal Netherlands Meteorological Institute On behalf of the ECA&D project team Aryan van Engelen Else van den Besselaar

WACA&D : CWD Trend

http://82.157.123.58/rcc/utils/mapserver/trend.php

http://192.168.2.10/rcc/utils/mapserver/trend.php

Page 35: The ICA&D concept Robert Leander Royal Netherlands Meteorological Institute On behalf of the ECA&D project team Aryan van Engelen Else van den Besselaar

WACA&D : CWD TrendWACA&D : CWD Trend

Page 36: The ICA&D concept Robert Leander Royal Netherlands Meteorological Institute On behalf of the ECA&D project team Aryan van Engelen Else van den Besselaar

2009 WACA&D : CWD TrendWACA&D : CWD Trend

http://82.157.123.58/rcc/utils/mapserver/index-availability.php

http://192.168.2.10/rcc/utils/mapserver/index-availability.php

Page 37: The ICA&D concept Robert Leander Royal Netherlands Meteorological Institute On behalf of the ECA&D project team Aryan van Engelen Else van den Besselaar

ICA&D is useful in climate monitoring • Participants can profit from the analyses

• Still they have full control over data distribution

• The system is simpel in design and straightforward to maintain and extend

• We are there to share the software,our innovations and assist in the local setup

• The ICA&D concept is very well portable

Conclusion

Page 38: The ICA&D concept Robert Leander Royal Netherlands Meteorological Institute On behalf of the ECA&D project team Aryan van Engelen Else van den Besselaar

Meteorologist:What is the use of climate data ??”

Page 39: The ICA&D concept Robert Leander Royal Netherlands Meteorological Institute On behalf of the ECA&D project team Aryan van Engelen Else van den Besselaar

Meteorologist:What is the use of climate data ??”

Page 40: The ICA&D concept Robert Leander Royal Netherlands Meteorological Institute On behalf of the ECA&D project team Aryan van Engelen Else van den Besselaar

Thank You for your attention!

Merci beaucoup pour votre attention!