Embed Size (px)
Citation preview
TM
SI/
IDM
/SIS
ME
R
1
SIS
ME
R 2
000
SIS
ME
R 2
000
SISMERSISMER Systèmes d’Informations Scientifiques pour la Mer
French NODC
Contribution to IODE and New Perspectivesin the frame of the Operational Oceanography
presented by Catherine MAILLARDJODC Meeting, Hydrographic Department of Japan,
Tokyo March 2000
TM
SI/
IDM
/SIS
ME
R
2
SIS
ME
R 2
000
SIS
ME
R 2
000 Summary of the presentation
Context and History National Oceanographic Data Bank Projects Quality Assurance New developments for Real Time Data
Management Human Support and Facilities Conclusion, Perspectives, New Challenges for
Data Management in France and in Europe
TM
SI/
IDM
/SIS
ME
R
3
SIS
ME
R 2
000
SIS
ME
R 2
000 IFREMER
IFREMER (the French Institute of Research and Exploitation of the Sea), a public institute of industrial and commercial nature, created by a decree of 5 June 1984, is the only French body with an exclusively maritime vocation.
It is placed under the joint authority of the Ministries of Research and Technology, of Fisheries and Equipment and Transport.
Annual budget : one billion French Francs, 1700 executives, researchers, engineers, seamen, technicians
and administrative staff, 72 laboratories and research departments, located in 24 stations
and centres along the metropolitan coast and overseas, 7 vessels, 2 manned submersibles, equipped with scientific
instruments.
TM
SI/
IDM
/SIS
ME
R
4
SIS
ME
R 2
000
SIS
ME
R 2
000 History of the Data Centre
• SISMER (Systèmes d'Informations Scientifiques pour la Mer) was created in 1990, and since 1997 belongs to the Informatics and Marine Data Department (IDT) of IFREMER, the main French government research agency devoted to ocean research and exploitation.
• SISMER is the Designated National Oceanographic Data Centre for France (French NODC) for the International Oceanographic Data Exchange programme (IODE) of UNESCO Intergovernmental Oceanographic Commission, following the former Bureau National des Données Océaniques (BNDO). This national data banking activity dates from 1968, and covers the fields of marine physics, chemical, underway geophysics and general information on French oceanographic cruises and data sets.
• SISMER contributes to data management structures of several national and international scientific projects, especially in the frame of the European MAST programme.
TM
SI/
IDM
/SIS
ME
R
5
SIS
ME
R 2
000
SIS
ME
R 2
000 IFREMER IDM Department and Facilities
• Brest Services– RIC : network, archiving system and centralised facilities– ISIB : information system engineering in Brest– SISMER : data centre– COM : Oceano-meteo services
• Centralised Facilities in Brest– Brest centre mainframe - RDBS & WWW servers– Central archiving backup system – Network Administration– RDBS + GIS Software Administration
• Distributed Facilies– SUN UNIX Work stations– DOS personal computers + Office software – Software : MATLAB, Expert QC software, Loading/Extracting Data
– CDROM engraving
TM
SI/
IDM
/SIS
ME
R
6
SIS
ME
R 2
000
SIS
ME
R 2
000 MISSIONS
• to design and operate scientific information systems and databases in the domain of the sea;
• sets the standards of quality to be respected for data storage;
• maintains an inventory of information systems and databases, the responsible scientists and rules for their availability;
• represents IFREMER within national and international authorities concerned with the management of sea data;
• provides training and transfer of knowledge within its field of competence.
TM
SI/
IDM
/SIS
ME
R
7
SIS
ME
R 2
000
SIS
ME
R 2
000 National Oceanographic Data Bank
Catalogues -Meta-databases French Oceanographic Cruise Summary Reports -
ROSCOP (>4700 cruises)
Marine Data Sets Inventory - MEDI/EDMED
National Geophysical Data Bank National Physical and Chemical Data Bank Real Time Data Management - Operational
Oceanography Reference Data - Data Products from other
data centres
TM
SI/
IDM
/SIS
ME
R
8
SIS
ME
R 2
000
SIS
ME
R 2
000 Projects
Catalogues - Meta-Databases– MAST-EURONODIM - European cooperative network for oceanographic data &
information management
Related with the Geophysical Data Bank – DORSALES
Related with the Physical and Chemical Database– MAST-MEDAR/MEDATLAS II
– MAST-MTP II/MATER
– MAST-OCTOPUS - Tomographie Acoustique
– MAST-ROBLINKS - Propagation Acoustique
Related with the (Pre-)Operational Oceanography– TOGA/WOCE/CLIVAR
– MAST-MFSPP- Mediterranean Forecasting System
– MAREL
– CORIOLIS
TM
SI/
IDM
/SIS
ME
R
9
SIS
ME
R 2
000
SIS
ME
R 2
000
TM
SI/
IDM
/SIS
ME
R
10
SIS
ME
R 2
000
SIS
ME
R 2
000
TM
SI/
IDM
/SIS
ME
R
11
SIS
ME
R 2
000
SIS
ME
R 2
000 National Geophysical Data Bank
Vertical Bathymetry : 353 Cruises Multibeam Bathymetry : 278 Cruises Gravity : 213 Cruises Magnetism : 256 Cruises imagery : 64 Cruises
Related Project : DORSALES-RIDGE
TM
SI/
IDM
/SIS
ME
R
12
SIS
ME
R 2
000
SIS
ME
R 2
000 DORSALES-RIDGE
TM
SI/
IDM
/SIS
ME
R
13
SIS
ME
R 2
000
SIS
ME
R 2
000 National Physical and Chemical Data Bank
CTD 16 790 Bottle Casts 34 111 Current Meter Time Series 1853 Thermistor Chain Time Series 126
Related Projects : MEDAR/MEDATLAS, MATER, OCTOPUS, ROBLINKS
0
500
1000
1500
2000
2500
Bouteilles
CTD
CourantosBo
TM
SI/
IDM
/SIS
ME
R
14
SIS
ME
R 2
000
SIS
ME
R 2
000
MTPII-MATERMAss Transfer and Ecosystem Response
(MAS3-CT96-0051)Physics
VERTICAL PROFILES TIME SERIES
3013 CTD CTD TIME SERIE
572 XBT 21 THERMISTOR STRING
461 ADCP VERTICAL PROFILES 110 CURRENT METER
LAGRANGIAN FLOAT
Biochemistry
VERTICAL PROFILES TIME SERIES
1473 BOTTLES STATIONS 37 SEDIMENT TRAPS
269 BIOLOGICAL STATIONS
Other parameters :
meteorology, biology, model outputs
3 Regional Data Centres and an Animation Task
105 Oceanographic Cruises
126 Moorings
TM
SI/
IDM
/SIS
ME
R
15
SIS
ME
R 2
000
SIS
ME
R 2
000
MAST- MEDAR/MEDATLASIIMediterranean Data Archaeology and Rescue
of Temperature, Salinity and Bio-chemical Parameters
IFREMER/SISMER Brest, France
IEO Madrid, Spain
UL/GHERLiège, Belgium
ICESCopenhaguen, Dk
INRH/DOTMCasablanca, Morocco
ISMALAlger, Algeria
NCMR/HNODCAthens, Hellas
TN/DNHOIstanbul, Turkey
NIMHSofia, Bulgaria
IOCParis, France
UM-POMsida, Malta
RIHMI-WDCObninsk, Russia
MHI/MISTSevastopol, Ukraine
NIOF/ENODCAlexandria,
Egypt
FD-MANRE/CyNODCNicosia, Cyprus
NCSR-NCMSBatroun, Lebanon
IOLRHaifa, Israel
ENEALa Spezia, Italy
OGSTrieste, Italy
CNR/IMGABologne, Italy
Collaborations and Scientific Advisers : GODAR Project - WDC-A, NODC-Croatia, DNA Tunisia, DNA Georgia
EUROGOOS, MEDGOOS, IODE Network
TM
SI/
IDM
/SIS
ME
R
16
SIS
ME
R 2
000
SIS
ME
R 2
000
MEDAR/MEDATLAS II OBJECTIVES AND METHODOLOGY
1. to complete the data-void areas in the Eastern and Southern parts of the Mediterranean Sea and Black Sea with new observations, through a wide co-operation of the Mediterranean countries; the core parameters identified as necessary to archive for the ecosystem following up and modelling are :
2. to make available comparable and compatible data sets of temperature, salinity and bio-chemical profiles issuing from different sources, by using a common protocol for formatting and quality checking based on the available preliminary knowledge of the core parameters distribution and the internationally agreed standards;
3. to prepare value added products including climatological gridded statistics and maps that will be useful for the understanding and modelling of the Mediterranean and Black Sea by using efficient and robust objective analysis techniques;
4. to extend the protocol for data qualification to each stage of the data processing;5. to facilitate the access to the archived data and enhance the data for various
scientific, educational, industrial and environmental needs, through electronic publishing on widely disseminated media and promotion.
Temperature Salinity Oxygen Nitrate Phosphate Alkalinity Nitrite Total P pH Ammonia Silicate H2S Total Nitrogen Chlorophyll-a
TM
SI/
IDM
/SIS
ME
R
17
SIS
ME
R 2
000
SIS
ME
R 2
000
Centre International de Données de sub-surface
TOGA/WOCE/CLIVAR 474688 profiless of temperature 1985-1998 (2000) Automatic and Visual QC WWW Interface to access data
Related Projects : CORIOLIS , MFSPP
TM
SI/
IDM
/SIS
ME
R
18
SIS
ME
R 2
000
SIS
ME
R 2
000
MFSPPMediterranean Forecasting Pilot
Project(MAS3-CT98-0171)
Model predictions with Assimilation of RT in situ data from VOS, from multidisciplinary mooring in Aegean Sea, satellite and
meteorological data
TM
SI/
IDM
/SIS
ME
R
19
SIS
ME
R 2
000
SIS
ME
R 2
000
Loading and Extraction Tools
– ON LINE Data Extraction
– Input interface
+ dedicated software for automatic file indexation
TM
SI/
IDM
/SIS
ME
R
20
SIS
ME
R 2
000
SIS
ME
R 2
000 Publication Tools
• Automatic edition of WWW Catalogues from RDBS : htql
• Paperprint catalogues and Mailing• Data products on Cdrom
data selection through several criterions including geographical areas
TM
SI/
IDM
/SIS
ME
R
21
SIS
ME
R 2
000
SIS
ME
R 2
000 Data Dissemination
1998 : DATA FROM NATIONAL DATA BANKS 113 REQUESTS
IFREMER36%
FrancePublic Sector
41%
FrancePrivate Sector
8%
Foreign15%
Base TOGA/WOCE/CLIVAR : 50 (8 on line, 42 manual diffusion) Cdrom MEDATLAS : 14 exchanged + 30 sold Cruise catalogue : about 200 hit /day on WWW
TM
SI/
IDM
/SIS
ME
R
22
SIS
ME
R 2
000
SIS
ME
R 2
000 COASTAL MONITORING - MAREL
TM
SI/
IDM
/SIS
ME
R
23
SIS
ME
R 2
000
SIS
ME
R 2
000 CORIOLIS provor float cycling
launching reference date reference date + 1 period
cycle 0does not match
the period
cycle 1 cycle 2
cycle period cycle period
argosargosargos
TM
SI/
IDM
/SIS
ME
R
24
SIS
ME
R 2
000
SIS
ME
R 2
000
CORIOLIS data center functions
Interopérability with argo
data basecatalogue - archive
gts
mailmailing lists
webfavorite medium
controldata quality control
technical monitoring of equipments
collectionmailinternetgtscd-rompaper...
disseminationpublic / private
productsgraphics and charts
statisticsanalyses
cd-romor other support
on request
quality insurance for exploitation hardware & software management - backup
TM
SI/
IDM
/SIS
ME
R
25
SIS
ME
R 2
000
SIS
ME
R 2
000 provor profilers
TM
SI/
IDM
/SIS
ME
R
26
SIS
ME
R 2
000
SIS
ME
R 2
000 description of a provor
TM
SI/
IDM
/SIS
ME
R
27
SIS
ME
R 2
000
SIS
ME
R 2
000 display of a provor profile
TM
SI/
IDM
/SIS
ME
R
28
SIS
ME
R 2
000
SIS
ME
R 2
000 provor in pommier area
TM
SI/
IDM
/SIS
ME
R
29
SIS
ME
R 2
000
SIS
ME
R 2
000 provor temperature map
TM
SI/
IDM
/SIS
ME
R
30
SIS
ME
R 2
000
SIS
ME
R 2
000 Reference Data
Gridded Climatologies ... (Levitus, MODB, MEDATLAS, Atlantique T. Reynaud)
Topographic Data(ETOP5, TOPO_2mn, Gravi_2mn, traits de cote, IGN)
Tide Predictions - SHOM Data products on CDroms & diskettes
received at SISMER Dissemination on Internet or Intranet
depending on copyright
TM
SI/
IDM
/SIS
ME
R
31
SIS
ME
R 2
000
SIS
ME
R 2
000 FORMATS
• Meta-data : RDBS• Small-medium size files :
autodescriptive ASCII (MEDATLAS)• Large volume files : NetCDF• Satellite data format
TM
SI/
IDM
/SIS
ME
R
32
SIS
ME
R 2
000
SIS
ME
R 2
000 Quality Assurance
QC0 : Check the format and the completeness of the informationQC1 : Check the location and dateQC2 : Check the data points
References - Standards– CIEM-Marine Data Management working Group (CIEM)– UNESCO/COI/IODE : International Oceanographic Data & Information Exchange
TM
SI/
IDM
/SIS
ME
R
33
SIS
ME
R 2
000
SIS
ME
R 2
000
QC1 Control of the location and Date
- Data collected in station
TM
SI/
IDM
/SIS
ME
R
34
SIS
ME
R 2
000
SIS
ME
R 2
000
QC1: Control of the location and Date
- Time series on fixed mooring
TM
SI/
IDM
/SIS
ME
R
35
SIS
ME
R 2
000
SIS
ME
R 2
000
QC2 - Control of the Data points
TM
SI/
IDM
/SIS
ME
R
36
SIS
ME
R 2
000
SIS
ME
R 2
000
Conclusion 1 Current Objectives of Data
Management
• to insure perennial safeguarding, access and promotion of the national data holdings
• to make available long time series of coherent and comparable observations of the same type
• to contribute to a better exploitation of the oceanographic work among scientific, engineering educational and decision maker community
• to have access to foreign data sets through data exchange
• to assist the scientists in preparing projects
TM
SI/
IDM
/SIS
ME
R
37
SIS
ME
R 2
000
SIS
ME
R 2
000
Conclusion 2 New Needs & Challenges
FURTHER NEEDS EXPRESSED BY THE USERS Access to multidisciplinary data, especially biochemical data Archives of large volumes Real time or near RT data
Convince the scientists to decrease the time lag between data collection and data submission to data centres - avoid to the data to become archaeological
Quality data to get compatibility and comparability within long times series
DATA MANAGERS SHOULD IMPROVE THEIR EXPERTISE for automatic data collection, Data Centres should take in charge part of
the scientific validation to prepare value added products easy to process by non-specialists
NEED FOR INTERNATIONAL COOPERATION to get information on data availability to establish and develop standards - Reference Manuals to share the tasks during international projects
