17
SDN Annual Meeting 20090326 Distributed data management in The Netherlands Taco de Bruin NIOZ Royal Netherlands Institute for Sea Research Chair - National Oceanographic Data Committee (NODC)

SDN Annual Meeting 20090326 Distributed data management in The Netherlands Taco de Bruin NIOZ Royal Netherlands Institute for Sea Research Chair - National

Embed Size (px)

Citation preview

Page 1: SDN Annual Meeting 20090326 Distributed data management in The Netherlands Taco de Bruin NIOZ Royal Netherlands Institute for Sea Research Chair - National

SDN Annual Meeting 20090326

Distributed data management in The Netherlands

Taco de Bruin

NIOZ Royal Netherlands Institute for Sea Research

Chair - National Oceanographic Data Committee (NODC)

Page 2: SDN Annual Meeting 20090326 Distributed data management in The Netherlands Taco de Bruin NIOZ Royal Netherlands Institute for Sea Research Chair - National

National Oceanographic Data Committee (NODC)

• Committee – no centre

• Based on Memorandum of Understanding (MoU) (1997-)

• Fully distributed structure

Currently 8 Partners:

- Rijkswaterstaat Water Dienst (RWS-WD)

- Royal Netherlands Institute for Sea Research (NIOZ) (Academic community)

- TNO – Bouw en Ondergrond (TNO – B & O)

- Hydrographic Service (KM-HYD)

- Rijkswaterstaat Data en Informatie Dienst (RWS-DID)

- Centre for Estuarine and Marine Ecology (NIOO-CEME)

- Imares

- Deltares

1997-2008: Royal Netherlands Meteorological Institute (KNMI)

- Advisor: Marine Information Services (MARIS)SDN Annual Meeting 20090326

Page 3: SDN Annual Meeting 20090326 Distributed data management in The Netherlands Taco de Bruin NIOZ Royal Netherlands Institute for Sea Research Chair - National

National Oceanographic Data Committee (NODC)

• Very interesting mix of government agencies (3), research institutes (2)

and privatized, former government agencies (3)

• Government agencies have specific tasks, limited to territory and EEZ of the Kingdom of The Netherlands, Netherlands Antilles and Aruba.

• Other NODC Partners may operate all over the world

• Data from all disciplines: Coastal research, bathymetry, geology, biology, ecology, physical oceanography, marine meteorology, etc, etc.

• Many different data types

SDN Annual Meeting 20090326

Page 4: SDN Annual Meeting 20090326 Distributed data management in The Netherlands Taco de Bruin NIOZ Royal Netherlands Institute for Sea Research Chair - National

The NL-NODC is the national platform for oceano-graphic data management

• Objectives:

1) to further data management and the delivery of quality data to a broad user group

2) to lower thresholds and barriers (organisational, technical, financial)

for data exchange

• National Data Policy

• Participation in international initiatives (IODE, ICES, EU-projects like Sea-Search, SeaDataNet, EMODNET projects, etc.)

Page 5: SDN Annual Meeting 20090326 Distributed data management in The Netherlands Taco de Bruin NIOZ Royal Netherlands Institute for Sea Research Chair - National

Situation of data exchange within NL-NODC a couple of years ago:

Online accessibility and availability of data

• Waterbase (RIKZ)• CODIS (NIOZ)• KODAC (KNMI)• Watermarkt (RIKZ + many other partner institutes)• HYDRA (KNMI)• COREBASE (NIOZ)• DINO (TNO- B&O)• Getij.nl (RIKZ)• Waterstat.nl (RIKZ)• many more …..

- user had no overview of data availability

- user had to do all format conversions and syntheses

SDN Annual Meeting 20090326

Page 6: SDN Annual Meeting 20090326 Distributed data management in The Netherlands Taco de Bruin NIOZ Royal Netherlands Institute for Sea Research Chair - National

NODC: Organisational structure for data exchange:

• MoU

• Data Policy

No technical infrastructure for data exchange:

• Different RDBMS

• Different formats

• Some databases online, others are not

SDN Annual Meeting 20090326

Page 7: SDN Annual Meeting 20090326 Distributed data management in The Netherlands Taco de Bruin NIOZ Royal Netherlands Institute for Sea Research Chair - National

National infrastructure for access to oceanographic and marine data and information:

NODC-i

Objectives of the project:

• central index of all data in the partner databases

• transparent access via Internet to the partner databases (fully distributed system)

Project:

• February 2005 – December 2008 ( 2 phases)

• 1 M Euro (500k from Bsik – Ruimte voor Geo-Informatie (RGI))

        

SDN Annual Meeting 20090326

Page 8: SDN Annual Meeting 20090326 Distributed data management in The Netherlands Taco de Bruin NIOZ Royal Netherlands Institute for Sea Research Chair - National

SeaDataNet to the rescue:

SeaDataNet is developing techniques, standards and formats,

which can be applied within NODC-i and vice versa

SeaDataNet ensures a high level of standardization

SeaDataNet is implementing on an European level, what NODC-i has implemented on a national level

NL-NODC is an ideal test bed for SeaDataNet

SDN Annual Meeting 20090326

Page 9: SDN Annual Meeting 20090326 Distributed data management in The Netherlands Taco de Bruin NIOZ Royal Netherlands Institute for Sea Research Chair - National

SDN Annual Meeting 20090326

Go to http://www.nodc.nl Link: Data access

Page 10: SDN Annual Meeting 20090326 Distributed data management in The Netherlands Taco de Bruin NIOZ Royal Netherlands Institute for Sea Research Chair - National

SDN Annual Meeting 20090326

Go to http://www.nodc.nl Link: Data access

Page 11: SDN Annual Meeting 20090326 Distributed data management in The Netherlands Taco de Bruin NIOZ Royal Netherlands Institute for Sea Research Chair - National

SDN Annual Meeting 20090326

Go to http://www.nodc.nl Link: Data access

Page 12: SDN Annual Meeting 20090326 Distributed data management in The Netherlands Taco de Bruin NIOZ Royal Netherlands Institute for Sea Research Chair - National

SDN Annual Meeting 20090326

Go to http://www.nodc.nl Link: Data access

Page 13: SDN Annual Meeting 20090326 Distributed data management in The Netherlands Taco de Bruin NIOZ Royal Netherlands Institute for Sea Research Chair - National

SDN Annual Meeting 20090326

Go to http://www.nodc.nl Link: Data access

Page 14: SDN Annual Meeting 20090326 Distributed data management in The Netherlands Taco de Bruin NIOZ Royal Netherlands Institute for Sea Research Chair - National

SDN Annual Meeting 20090326

Go to http://www.nodc.nl Link: Data access

Page 15: SDN Annual Meeting 20090326 Distributed data management in The Netherlands Taco de Bruin NIOZ Royal Netherlands Institute for Sea Research Chair - National

SDN Annual Meeting 20090326

Go to http://www.nodc.nl Link: Data access

Page 16: SDN Annual Meeting 20090326 Distributed data management in The Netherlands Taco de Bruin NIOZ Royal Netherlands Institute for Sea Research Chair - National

SDN Annual Meeting 20090326

NL-NODC

The NODC web site is the Dutch node in the SeaDataNet network, linking the Dutch partner databases directly to the SeaDataNet infrastructure

Page 17: SDN Annual Meeting 20090326 Distributed data management in The Netherlands Taco de Bruin NIOZ Royal Netherlands Institute for Sea Research Chair - National

SDN Annual Meeting 20090326

Renewed Memorandum of Understanding will be signed by the directors of the 8 partner institutes on April 9, 2009.

- New definitions of objectives and tasks, reflecting current situation and lessons learnt

- Updated data policy

- Sustained maintenance of the SeaDataNet infrastructure in The Netherlands