Embed Size (px)
Citation preview
Tidarat NansingNational Statistical Office
Thailand
ADAPTATION OF THE SDMXUnder The Thai NSO Context
•A decentralized statistical system
•The 2007 Statistical Act has assigned the TNSO to manage and administrate the statistical system of the country, by using the Statistical Master Plan as a tool.
•Major missions are data production, service on statistical data and information and management of statistical system
The Thai National Statistical Office (TNSO)
• Background of Thailand Data Exchange
• Experience in working on SDMX
• Future work
• Challenges
• Lesson learned
Adaptation of the SDMXunder the TNSO context.
Background of Thailand Data Exchange
• Originally, TNSO developed a statXchange system for
exchanging statistical data and explanations of statistical data
and metadata. With various agencies Using statXML as the central
standard for exchanging information in the form of Web Services.
• The Working Group of Government Data Integration with representatives from 20 ministries was established.
• The server were installed at 20 Line Ministers and 20 Web services system.
• Universal Description Discovery and Integration (UDDI) was set up at the Technology and Information Centre, acted as yellow pages in searching linked data, at the time in each Line Ministry, there was tool for receiving and sending data for exchange
• Currently, the system is still in use. Some agencies have migrated data to the Cloud Technology
2006: IT platform and data sharing at National Statistical Office, Thailand
Background of TNSO’S Data Exchange
How project works in Thailand
CSV Template
statXchange
System
statXchange DB
Import File
DataBase/
Datawarehouse
Entry data by user
XML
Converter
Program
External
Data
Internal
Data
Web services/Data sharing On website
Web Input
1
2
3
Datasource
2006: IT platform and data sharing at National Statistical Office, Thailand
How to Input data to statXchange system
Experience in working on
SDMX
โครงการจดัท าสารสนเทศและตวัชีว้ดัเพือ่การพฒันาประเทศ(Key National Development Indicator : KNDI)
Experience in working on SDMX
10
Experience in working on SDMX:
A Project on UNSD-DFID Project
SDMX UN-Country Data
How project works in Thailand
• NSO staff were trained - SDMX and national registry set-up
• NSO respond for input our data and metadata – related to MDG
• Support the line agency to input their own data to the system and share to each other
NSO Staff trained (IT related)
INDICATOR LIST and CODELIST between statXML and MDG DSD
FREQ = ASERIES = SH_DYN_MORTUNIT = PER_1000_LIVE_BIRTHSLOCATION = TAGE_GROUP = 000_005_YSEX = TREF_AREA = THASOURCE_TYPE = NAUNIT_MULT = 0NATURE = NASOURCE_DETAIL = Ministry of Public Health
Ex: Under-five mortality rate (per 1,000 live births)
StatXML
Experience in working on SDMX
Experience in working on SDMX
THAILAND : SDMX Registry• Once converted, SDMX data is placed on a Web server and registered
with Fusion Registry, installed with UNSD assistance• Fusion Registry is an advanced implementation of the SDMX Registry
specification, developed by Matadata Technology.
Experience in working on SDMX
2014Implementing SDMX in statXchange v.2
• DATA COLLECTION• Data Entry System• Excel Loader
• DATA PROCESS• ETL :DATA WAREHOUSE
• DATA SERVICE• BI tool• Web search
• DATA EXCHANGE• Based on the SDMX Reference Infrastructure(SDMX-RI) provided by Eurostat
DATA PROCESS DATA SERVICE
DATA EXCHANGEData Entry System
ETL
Oracle BI
NSI.Net Client
DATA COLLECTION
statXchange
2014: IT platform and data sharing at National Statistical Office, Thailand
STATXCHANGE V.2 OVERVIEW
DATA EXCHANGE
Model Design to sharing data using SDMX Concept;Main steps to design for using IT Tools in TNSO
Study Official
Statistic data
(OS DATA)
Create Matrix Sheet
of OS List
Consider/create
common Code List
Design Concept,
DSD (excel)
Create CodeList
ConceptSchemes,
DSD
(sw: DSW / SAE)
Mapping Table data
and DSD
Data sharing with other agencies as
required.
statXchange V.2
SDMX infrastructure and tools• Based on the SDMX Reference Infrastructure provided by Eurostat
Developed to support data exchange via web services in SDMX-ML format
Expose the data to be pulled (WS, HUB)
SDMX infrastructure and tools
Based on the SDMX Reference Infrastructure provided by Eurostat
SDMX infrastructure and tools
Based on the SDMX Reference Infrastructure provided by Eurostat
Future work
The TNSO new additional missions• The Implementation of the 2nd Statistical Master Plan
• The Management of Information System (MIS) of the country
• The Implementation of the Competitiveness Indicators.
• The Implementation of the 2030 Sustainable Development Agenda (SDGs) to TNSO.
IT TOOLS AND INFRASTUCTURE The TNSO is expecting to construct the full automatic system to implement
• Database system for Web Portal and Web Services.
• Web service system according to international standards.
• Web Portal system for statistical information services.
• BIG DATA Analytic
• OPEN DATA concept
Challenges
•Most of the stakeholders are not familiar with SDMX.
•Statistical units of the Line Ministries are not fully aware of mutual benefits.
•SDMX implementation requires high level policy involvement in settling provision agreement.
•Statisticians and IT persons need to work more synergized.
Lesson learned
•Project continuity and regular monitoring are needed.
•Personnel skills should be always enhanced.
•Silo system is rather problematic.
•Connectivity among statistical units must be improved.
•Gap in communication.
