View
218
Download
2
Category
Tags:
Preview:
Citation preview
Federal Department of Home Affairs FDHAFederal Statistical Office FSO
Meeting of the OECD Expert Group on SDMX
13 - 14 September, OECD, Paris
Centralized Metadata System based on SDMX”Case Study : Swiss Federal Statistical Office
Jean-François Fracheboud
2 Meeting of the OECD Expert Group on SDMX / Centralized Metadata System based on SDMX
Author : FSO / Jean-François Fracheboud
Federal Department of Home Affairs FDHAFederal Statistical Office FSO
SDMX through the GSBPM
1Specify
Needs
2 Design
3 Build
4 Collect
5 Process
6 Analyse
7 Disseminate
8 Archive
9 Evaluate
SDMX generally focuses on dissemination (transmission of
data and metadata)
What about SDMX in the production of statistics ?
Case Study ot the Swiss Federal Statistical OfficeHow a statistical metadata system based entirely on
SDMX has been implemented
3 Meeting of the OECD Expert Group on SDMX / Centralized Metadata System based on SDMX
Author : FSO / Jean-François Fracheboud
Federal Department of Home Affairs FDHAFederal Statistical Office FSO
Challenges
• A centralised system for a decentralised management of metadata
• An integrated system for the whole life cycle of statistics
• A unique entry of metadata and a multiple usage of them
• A harmonisation of metadata on several levels :
• Harmonisation of the form : according to SDMX model
• Harmonisation of codelists
• Harmonisation of variables (concepts)
• Harmonisation of data and metadata models
• Acceptance of the system and adoption by the statistician
4 Meeting of the OECD Expert Group on SDMX / Centralized Metadata System based on SDMX
Author : FSO / Jean-François Fracheboud
Federal Department of Home Affairs FDHAFederal Statistical Office FSO
• Improve the comparability of data and metadata at national and international levels
• Support for harmonisation
• More efficiency in every statistical processes
• Optimise reuse of metadata and data
• Ensure the tracability in statistics
• Improve the quality of metadata and data
Why a SMS ?
• Reduce delays in publishing
5 Meeting of the OECD Expert Group on SDMX / Centralized Metadata System based on SDMX
Author : FSO / Jean-François Fracheboud
Federal Department of Home Affairs FDHAFederal Statistical Office FSO
Contrat
Repository
Repository
Repository
Repository
Web Server IIS
Web S
ervices
SDMX editor
ETLSASC#, .NET, etc.
Standard request
Standard documents
Repository
SMS Architecture
6 Meeting of the OECD Expert Group on SDMX / Centralized Metadata System based on SDMX
Author : FSO / Jean-François Fracheboud
Federal Department of Home Affairs FDHAFederal Statistical Office FSO
Admin
Metadata Editing
Advanced Functions
Plug-ins
Functionalities
7 Meeting of the OECD Expert Group on SDMX / Centralized Metadata System based on SDMX
Author : FSO / Jean-François Fracheboud
Federal Department of Home Affairs FDHAFederal Statistical Office FSO
Manage-ment
Base
Fonctionnalités avancées
Plugins
Functionalities
Metadata editing
Entry Create, Modify, Validate,Versions, Historic, Save
Import-Export SDMX, excel, Word, pdf, etc.
Accessibility Web Services, Navigation, Visualisation
8 Meeting of the OECD Expert Group on SDMX / Centralized Metadata System based on SDMX
Author : FSO / Jean-François Fracheboud
Federal Department of Home Affairs FDHAFederal Statistical Office FSO
Advanced Functions
Plug-ins
Metadata Editing
Admin
Functionalities
Plugins (extensions)
• Export of metadata on other systems (SAS,
Oracle, SQL Server, etc.), automatic creation
of tables (from a DSD for example)
Generator of codebook (DDI)
• Interface extension (customizing)
• Electronic questionnaire
• Validation of data with DSD
• Etc.• etc.
9 Meeting of the OECD Expert Group on SDMX / Centralized Metadata System based on SDMX
Author : FSO / Jean-François Fracheboud
Federal Department of Home Affairs FDHAFederal Statistical Office FSO
FunctionalitiesAdvanced Functions
Metadata Editing
Plug-ins
Admin
Vision for the future
• Accessing the data by the metadata
• Multidimensional visualisation of data
• Modeling and monitoring of business processes
10 Meeting of the OECD Expert Group on SDMX / Centralized Metadata System based on SDMX
Author : FSO / Jean-François Fracheboud
Federal Department of Home Affairs FDHAFederal Statistical Office FSO
Metadata through the GSBPM
Creation of metadata
Use of metadataMost of metadata should be created during the first three stages
11 Meeting of the OECD Expert Group on SDMX / Centralized Metadata System based on SDMX
Author : FSO / Jean-François Fracheboud
Federal Department of Home Affairs FDHAFederal Statistical Office FSO
Statistical
Domains
Variables
Classifications and codelists
Metadata Structure
Definitions
Data Structure
Definitions
Simplified Model
12 Meeting of the OECD Expert Group on SDMX / Centralized Metadata System based on SDMX
Author : FSO / Jean-François Fracheboud
Federal Department of Home Affairs FDHAFederal Statistical Office FSO
• Defining the statistical activities of FSO (political mandate)
• Organising these activities in one or more hierarchies (example : FSO statistical programme)
• Defining the data- and metadata-flows linked to these statistical activities
Statistical domains and activities
13 Meeting of the OECD Expert Group on SDMX / Centralized Metadata System based on SDMX
Author : FSO / Jean-François Fracheboud
Federal Department of Home Affairs FDHAFederal Statistical Office FSO
Model for Statistical Activities
Statistical Activity Instance
Statistical Activity
Statistical Activity Family
Statistical Activity Family
Statistical Activity
Statistical Activity Instance
1
14 Meeting of the OECD Expert Group on SDMX / Centralized Metadata System based on SDMX
Author : FSO / Jean-François Fracheboud
Federal Department of Home Affairs FDHAFederal Statistical Office FSO
Statistical
Activities
(occurences)
Metadataflows
Dataflows
Attach metadataflows and dataflows to the activities
15 Meeting of the OECD Expert Group on SDMX / Centralized Metadata System based on SDMX
Author : FSO / Jean-François Fracheboud
Federal Department of Home Affairs FDHAFederal Statistical Office FSO
Statistical
Domains
Variables
Classifications and codelists
Metadata Structures
Data Structures
Simplified Model
16 Meeting of the OECD Expert Group on SDMX / Centralized Metadata System based on SDMX
Author : FSO / Jean-François Fracheboud
Federal Department of Home Affairs FDHAFederal Statistical Office FSO
Variables / Concepts
Identification, nom et description des variables
Définition type et format
Nomenclatures associées
Hiérarchisation des variables
• Import standard ConceptSchemes
• Create domain specific ConceptSchemes
• Describe the variables/concepts (definition, format, reference, etc.)
• Link the codelist to the variables
17 Meeting of the OECD Expert Group on SDMX / Centralized Metadata System based on SDMX
Author : FSO / Jean-François Fracheboud
Federal Department of Home Affairs FDHAFederal Statistical Office FSO
Statistical
Domains
Variables
Classifications and codelists
Metadata Structures
Data Structures
Simplified Model
18 Meeting of the OECD Expert Group on SDMX / Centralized Metadata System based on SDMX
Author : FSO / Jean-François Fracheboud
Federal Department of Home Affairs FDHAFederal Statistical Office FSO
18
Classifications and codelists
• Import standard national and international codelists
• Create cross domain or domain specific classifications and codelists
19 Meeting of the OECD Expert Group on SDMX / Centralized Metadata System based on SDMX
Author : FSO / Jean-François Fracheboud
Federal Department of Home Affairs FDHAFederal Statistical Office FSO
Statistical
Domains
Variables
Classifications and codelists
Metadata Structures
Data Structures
Simplified Model
20 Meeting of the OECD Expert Group on SDMX / Centralized Metadata System based on SDMX
Author : FSO / Jean-François Fracheboud
Federal Department of Home Affairs FDHAFederal Statistical Office FSO
20
Data and MetadataStructure Definitions
• Modeling statistical data and metadata
• Description of data and metadata (tables or files)
• Defining attributes (quality, confidentiality, observation status, etc.) at required level (record, item, cell, etc.)
• Description of macro-data (times series, hypercubes, etc.)
21 Meeting of the OECD Expert Group on SDMX / Centralized Metadata System based on SDMX
Author : FSO / Jean-François Fracheboud
Federal Department of Home Affairs FDHAFederal Statistical Office FSO
Data Warehouse
data
Data Structure
22 Meeting of the OECD Expert Group on SDMX / Centralized Metadata System based on SDMX
Author : FSO / Jean-François Fracheboud
Federal Department of Home Affairs FDHAFederal Statistical Office FSO
identify describe
Structural Metadata
SDMX Artefacts
• Concepts• Codelists • Data Structures
Data Warehouse
metadata
data
Data Structure
23 Meeting of the OECD Expert Group on SDMX / Centralized Metadata System based on SDMX
Author : FSO / Jean-François Fracheboud
Federal Department of Home Affairs FDHAFederal Statistical Office FSO
identify describe
Statistical Metadata SystemStructural Metadata
SDMX Artefacts
• Concepts• Code lists • Data Structures
Data Warehouse
metadata
data
Data Structure
24 Meeting of the OECD Expert Group on SDMX / Centralized Metadata System based on SDMX
Author : FSO / Jean-François Fracheboud
Federal Department of Home Affairs FDHAFederal Statistical Office FSO
Predefined MetadataStatistical
Domains
Variables
Classifications and codelists
Metadata Structures
Data Structures
Extensions
Annotations
MSD
DSD
Metadata
Question-
naires
Quality
Metadata
25 Meeting of the OECD Expert Group on SDMX / Centralized Metadata System based on SDMX
Author : FSO / Jean-François Fracheboud
Federal Department of Home Affairs FDHAFederal Statistical Office FSO
The basic IT application for the SMS is available free of charge and can be found at the following adresses:
www.sdmx.org or
www.sdmx.ch
Download the IT application
26 Meeting of the OECD Expert Group on SDMX / Centralized Metadata System based on SDMX
Author : FSO / Jean-François Fracheboud
Federal Department of Home Affairs FDHAFederal Statistical Office FSO
For more information about the Swiss Statistical Metadata System
please contact :sms@bfs.admin.ch
Contacts
Recommended