TCM data 2006: TCM data 2006: Data submissions, QA work Data submissions, QA work

and problems identifiedand problems identified

Jørgen Nørrevang JensenJørgen Nørrevang Jensen

ICESICES

TCM data sourcesTCM data sources

• Data submitted through the EIONET Data submitted through the EIONET systemsystem

• Data from the ICES Data Centre (data Data from the ICES Data Centre (data from the various commissions, OSPAR, from the various commissions, OSPAR, HELCOM, AMAP and “voluntary” HELCOM, AMAP and “voluntary” contributions)contributions)

• MEDPOL Data and other data in a MEDPOL Data and other data in a different format than specified in the different format than specified in the EIONET system. EIONET system.

ICES Data Handling ICES Data Handling proceduresprocedures

Oceanographic dataOceanographic data• The oceanographic data submitted to ICES is The oceanographic data submitted to ICES is received in nearly any kind of format provided received in nearly any kind of format provided that it is well structured and documented. Data that it is well structured and documented. Data are then converted to the ICES formatare then converted to the ICES format• The data are checked by a wide range of QA-The data are checked by a wide range of QA-procedures before data are uploaded to the procedures before data are uploaded to the ICES databaseICES database• The procedures mention above implies a time-The procedures mention above implies a time-lag between the submission of data and the lag between the submission of data and the uploadupload• In case of serious errors/correction the In case of serious errors/correction the countries are asked to either resubmit or countries are asked to either resubmit or confirm potential unit errors etc. This will further confirm potential unit errors etc. This will further delay the upload of data to the ICES databasedelay the upload of data to the ICES database

ICES Data Handling ICES Data Handling proceduresprocedures

Data on contaminants in biota, sediment Data on contaminants in biota, sediment and seawaterand seawater• The data on contaminants are submitted in a The data on contaminants are submitted in a specific formatspecific format • The data are checked for structural The data are checked for structural consistency and QA by a screening programme consistency and QA by a screening programme before the upload to the ICES databasebefore the upload to the ICES database• Based on the result of the screening data are Based on the result of the screening data are either uploaded to the database or the either uploaded to the database or the submitter is asked to resubmit a corrected submitter is asked to resubmit a corrected versionversion• The procedures mentioned above implies in The procedures mentioned above implies in principle no time-lag between the submission principle no time-lag between the submission and upload (provided that the data submitter and upload (provided that the data submitter has used the screening programme and these has used the screening programme and these data are without errors)data are without errors)

TCM data: Overview of data submissions 2007 (1)TCM data: Overview of data submissions 2007 (1)

   

Hazardous sub.Biota

Hazardous subs. Sediment

Hazardoussubs.Seawater

Nutrients & Oxygen

Chlorophyll a EIONET stations

Data on fishingfleet capacity fromFAO, EUROSTAT or DG MARE

Score(Smileys)

AL Albania       12   No ☻☻

BABosnia and Herzegovina       48 3

NA☻☻☻

BE Belgium 372 136/1081 4150 983/568 53/81   Yes ☻☻☻

BG Bulgaria     89 6 Yes ☻☻☻

HR Croatia 267 42   4327 630 47 No ☻☻☻

CY Cyprus 468 5 4 567 136 55 Yes ☻☻☻

DE Germany   65   11581   Yes ☻☻

DK Denmark 2720     9573 666   Yes ☻☻

EE Estonia (650)     3319/2203 462 39 Yes ☻☻☻

ES Spain   568     Yes ☻☻

FI Finland 1079     16904 534   Yes ☻☻

FR France       1693 370   Yes ☻☻

GBUnited Kingdom 4456 12802   10413 871   Yes ☻☻☻

GR Greece           Yes 0

 Data submitted via EIONET

 Data submitted via ICES

 Data submitted via MEDPOL

TCM data: Overview of data submissions 2007 (2)TCM data: Overview of data submissions 2007 (2)

   

Hazardous sub.Biota

Hazardous subs. Sediment

Hazardoussubs.Seawater

Nutrients & Oxygen

Chloro-phyll a

EIONET stations

Data on fishingfleet capacity fromFAO, EUROSTAT or DG MARE

Score(Smileys)

IE Ireland 291         Yes ☻☻

IS Iceland           Yes ☻☻

IT Italy 1059 1793   94725 30184   Yes ☻☻☻

LT Lithuania 291 227 551 1756 88 12 Yes ☻☻☻

LV Latvia       1372/2650 79 16 Yes ☻☻☻

MT Malta   1045 1449 1244 119 Yes ☻☻☻

ME Montenegro           No 0

NL Netherlands 798 1575       Yes ☻☻

NO Norway 10255 1417       Yes ☻☻☻

PL Poland 420   70 3128/9989 138/54 36 Yes ☻☻☻

PT Portugal           Yes 0

RO Romania 112 568 649 466 33 Yes ☻☻☻

SE Sweden 14     14116/43286 950/2629 42 Yes ☻☻☻

SI Slovenia 90 7   71   Yes ☻☻☻

TR Turkey 826 135   610 41   No ☻☻☻

 Data submitted via EIONET

 Data submitted via ICES

 Data submitted via MEDPOL

Spatial data coverage 2006 for Spatial data coverage 2006 for CSI023 indicatorCSI023 indicator

Spatial data coverage 2006 for Spatial data coverage 2006 for CSI021 indicatorCSI021 indicator

Temporal data coverage for CSI023 Temporal data coverage for CSI023 indicator (chlorophyll a)indicator (chlorophyll a)

  1997 1998 1999 2000 2001 2002 2003 2004 2005 2006

BE 443 415 343 134 89 92 78 95 75 134

CY               276 238 278

DE 68 260 73 541 151 139 292 607 220  

DK 2534 21060 17143 5355 5064 4406 7226 6738 4428 1082

EE     823 125 396 350 321 588 676 462

FI 54 758 1328 1469 1060 2297 1780 1885 672 644

FR 2677 9735 13484 298 466 471 180 226 420 369

GB 1497 4786 1041 730 1969 1361 3969 1193 1691 1238

GR     50 227 125 478   716 408  

HR   627 683 571 755 806 809 933 1024 627

IT 8356 9465 13206 10249 43748 76816 40205 7950011625

4 30184

LT 60 62 110 69 55 64 98 86 180 88

LV 69 116 138 111   246 254 255 616 284

NL 830   4     571 556 544 524  

NO 2544 2249 2111 2290 2841 2579 2637 2482 419  

PL 37 169   247 90 203 207 428 482 249

RU   104                

SE 2591 2305 3895 4020 4303 3541 3820 4086 4349 4430

SI     57 104 458 234 204 107 112  

TR                   41

Temporal data coverage for CSI021 Temporal data coverage for CSI021 indicator (nutrients) (1)indicator (nutrients) (1)

  1997 1998 1999 2000 2001 2002 2003 2004 2005 2006 2007

Al               56 59 3  

BA         8 12 12 12 12 12  

BE 473 403 345 169 142 144 132 149 107 169  

BG           105 105 140 72 48  

CY         78 62 32 276 244 116  

DE 7808 8729 2771 5455 3698 6828 2821 2969 3577 4091  

DK 4956 28396 24842 7380 6591 5648 9405 8798 5638 1745  

EE     1255 732 879 354 342 953 700 289  

FI 1330 6667 5829 7328 6232 7992 6242 8293 3357 3050  

FR 2850 3994 7643 304 556 579 180 322 180 162  

GB 4143 5094 5269 8338 4538 1476 1573 3553 2570 4355 104

GR     102 475 331 420 424 797 440    

HR   713 763 641 1036 1045 1160 1246 1280 618  

Temporal data coverage for CSI021 Temporal data coverage for CSI021 indicator (nutrients) (2)indicator (nutrients) (2)

 

1997

1998

1999

2000

2001

2002

2003

2004

2005

2006

2007

IE   154 254 259 287 251 354 437 376    

IS 361 420 444   277 768 322        

IT 5500 5886 9047 7248 2469 4440 2415 4820 6959 3404  

LT 109 106 224 120 94 298 236 248 245 140  

LV 254 454 540 464   1240 1834 1661 2911 1283  

MT             438 473 467 62  

NL 763 870 53 49 64 660 599 578 549    

NO 5832 4278 3270 3650 4499 4102 4895 3928 649    

PL 1303 669 789 801 1334 1265 2362 1677 1563 1062  

RO         72 81     71 78  

RU   104                  

SE 5964 5745 10383 7396 8688 8486 8764 9011 8428 8677  

SI     20 57 486 234 204 107 124    

TR                   41  

Temporal data coverage for contaminants in Temporal data coverage for contaminants in biotabiota

  1997 1998 1999 2000 2001 2002 2003 2004 2005 2006 2007

AL         154 81 594 2200 880    

BE 389 390 195 390 390 584 195 195 875 372  

CY     798 1350 1580 2970 246 192 108 1842  

DE 2576 2188 1751 991 1516 390 502 238      

DK 447 2551 2835 4121 3594 3357 4161 2909 2646 2556  

ES               13548 16935    

FI 50 2456 1790 602 1726 974 291 284 807 1079  

FR 5247 2635 4965 3337 4718 2820 1826 10736 1784    

GB     3511 1392 1744 1936 2924 2969 4556 4355 63

GR     84 4       8153      

HR     376 2547 1560 4366 3952 3710 4134 534  

IE 55 87 178 414 260 118 496 654 665 279  

IS 365 489 427 339 424 287 445 339 339    

IT 336 642 962 933 1536 3328 1938 3924 3000 1059  

LT           150 72 126 573 551  

LV 20       145 499          

NL 1104 1105 1125 876 980 662 919 755 614 798  

NO 9288 9301 9289 8035 8915 8746 8289 9902 10936 10181 1

PL   327 314 365 377 1497 1494 1260 1260 1260  

RO                 80    

SE 2398 2383 3602 3521 2292 2508 1843 2514 2361 42  

SI       152 186 166 152 200 240 200  

TR   160 2536 2240 4002 800 2156 80 459 2081  

QA checking QA checking mistakes/errors foundmistakes/errors found

1.1. DryWetRatio < 1 DryWetRatio < 1

This is very likely a unit error – ratio given This is very likely a unit error – ratio given instead of % (Denmark and Croatia) instead of % (Denmark and Croatia) Danish values corrected after Danish values corrected after correspondence with data submittercorrespondence with data submitter

2.2. NationalStationID not valid NationalStationID not valid

(measurements with no link to station) (for (measurements with no link to station) (for Estonia)Estonia)

3.3. Basis (of determination) not filled inBasis (of determination) not filled inThis information is mandatory and crucial for This information is mandatory and crucial for

recalculation in relation to basis (D or W) recalculation in relation to basis (D or W) (Croatia and Romania)(Croatia and Romania)

QA checking QA checking mistakes/errors foundmistakes/errors found

4.4. Latitude and/or longitude out of Latitude and/or longitude out of rangerange

In this case most probably caused by a swap In this case most probably caused by a swap of latitude and longitude (Romania). Data of latitude and longitude (Romania). Data corrected accordingly and data submitter corrected accordingly and data submitter notified and asked to confirm.notified and asked to confirm.

5.5. Concentrations NULL Concentrations NULL If an determinand has not been measured no If an determinand has not been measured no

records should be reportedrecords should be reported

QA checking QA checking mistakes/errors foundmistakes/errors found

6.6. High values of concentrationsHigh values of concentrations

(Croatia and Italy). Data submitter asked for (Croatia and Italy). Data submitter asked for clarification clarification

7.7. Determinand names not according to Determinand names not according to codelistcodelist

(Bulgaria, Croatia, Estonia, Italy, Latvia, (Bulgaria, Croatia, Estonia, Italy, Latvia,

Malta, Poland and Romania)Malta, Poland and Romania)

QA checking QA checking mistakes/errors foundmistakes/errors found

8.8. Column names not according to Column names not according to EIONET templateEIONET template

9.9. SamplingDepth < 0SamplingDepth < 0

(Italy) Data corrected to positive sampling (Italy) Data corrected to positive sampling depthdepth

10.10. Unit problemsUnit problems

µg/kg is not the same as µg/kg. Unit µg/kg is not the same as µg/kg. Unit converted to the “correct” formatconverted to the “correct” format

Closing these gaps inClosing these gaps inspace and time?space and time?

• Data from other sources – in a Data from other sources – in a different format than the ICES or different format than the ICES or EIONET format:EIONET format:

1.1. UNEP/MAP database copy UNEP/MAP database copy 2.2. Collection of Black Sea dataCollection of Black Sea data

• Stronger legal enforcement:Stronger legal enforcement:1.1. WFDWFD2.2. MSFDMSFD

• Producing data products that makes Producing data products that makes these gaps obvious – might encourage these gaps obvious – might encourage countries to submit datacountries to submit data

Suggestion for a change to the ‘Smileys’ data submission scoring system:

The present scoring system is based on the following rules:• No data submission: 0• Delayed delivery of data: 1 Smiley.• Submission of at least one data type: 2 Smileys• Submission of at least 3 data types: 3 Smileys

Bias in present system• Easy to get 2 Smileys by just sending one set of data • Data types are equally important

Suggested change to the scoring system:• No data submission: 0• Submission of at least one data type: 1 Smiley• Submission of two or more data types including one data type that is basis for a CSI or a candidate CSI (in this case nutrients/chlorophyll-a and hazardous substances in biota): 2 Smileys • Submissions of three or more data types including two or more data types that are the basis for a CSI or a candidate CSI (in this case nutrients/chlorophyll-a and hazardous substances in biota): 3 Smileys

Tasks and deadlines in 2008  for NRC

Answer QA questions in relation to 2006 data(ASAP)

Submissions of the 2007 EIONET data - business as usual (31 October 2008)

Questions for EIONET Marine and Coastal NRCs1.Incomplete NRC contact person list. Could you endeavour to help your NFP to keep the list updated with the names of appropriate NRC contact persons?2.In case you happen to be on the list of NRC contact persons without being the right person for ‘data issues’ could you redirect us to the appropriate NRC contact for that?3.In case that your country has not submitted any data directly or indirectly to EIONET-Water could your explain why this has not happened?

Questions for EIONET Marine and Coastal NRCs (continued)

4. Incomplete data series. Are you aware that this may be the case for your country and do you know why?

5. Could you endeavour to collaborate with the EEA-ETC/WTR (ICES as Marine Data Centre) to follow-up the results of the quality assurance checking of EIONET-Water data?

6. Could you agree with the EEA-ETC/WTR ideas to improve the Smileys scoring system for data submissions?

Thank you for your attention