25
The Open Data Strategy of Official Statistics in Japan Takao Itou ExDirectorGeneral for Policy Planning (Statistical Standards) Ministry of Internal Affairs and Communications Government of Japan Session 4 Learning from Good PracticesDisseminating and Communicating Statistics Inclusive and Sustainable Development in East and NorthEast Asia Strengthening National Capacity to Produce and Use Statistical Information

The Open Data Strategy of Official Statistics in Japan ·  · 2015-01-30The Open Data Strategy of Official Statistics in Japan ... Labour and Welfare ... take other appropriate measures

  • Upload
    dotruc

  • View
    218

  • Download
    0

Embed Size (px)

Citation preview

The Open Data Strategy of Official Statistics 

in Japan

Takao ItouEx‐Director‐General for Policy Planning (Statistical Standards)

Ministry of Internal Affairs and Communications Government of  Japan

Session  4  Learning  from  Good  Practices‐Disseminating and Communicating StatisticsInclusive and Sustainable Development in East and North‐East Asia

Strengthening National Capacityto Produce and Use Statistical Information

1. Role of the Director-General for Policy Planning (Statistical Standard

2. Outline of Japanese Official Statistics

3. The New Open Data Strategy in the New Statistics Act (Act No.53 in 2007))

3.1 Fundamental Principles3.1 Fundamental Principles

3.2. More Specific Regulations for the Publication of Statistical Information

in the New Statistics Act

3.3. Other strategies introduced by the New Statistics Act

3.4. My Comments on the Three Strategies

4. Concrete4. Concrete Measures for Improving Statistical Publication Services in JapaMeasures for Improving Statistical Publication Services in Japann

4.1 The Optimization Plan of Operations and Systems for Statistical The Optimization Plan of Operations and Systems for Statistical Work Work

and the Sand the Start of “e-Stat”

4.2. Statistical Survey Operations and the Outline of Inter‐Ministry Information 

Systems for Official Statistics (IMISOS)

4.3. Outline of the Portal Site of Official Statistics of 4.3. Outline of the Portal Site of Official Statistics of Japan (Japan (““ee--StatStat””))

4.4. Explanation of the function of 4.4. Explanation of the function of ““ee--StatStat””(examples)(examples)

4..5. Achievements4..5. Achievements

2. Outline

of

Contents

1.政策統括官(統計基準担当)の業務1. Role of the Director-General for Policy Planning (Statistical Standards)

Comprehensive coordination concerning statistics administrationTo plan and design the statistical system, establish statistical standards and coordinate statistical affairs from the viewpoints of systematic development of Japan’s overall official statistics, assurance of trust in statistics, and reduction of burdens on respondents

Comprehensive coordination concerning statistics administrationTo plan and design the statistical system, establish statistical standards and coordinate statistical affairs from the viewpoints of systematic development of Japan’s overall official statistics, assurance of trust in statistics, and reduction of burdens on respondents

Statistics Commission(Cabinet Office)

Statistics Commission(Cabinet Office)

Director-General for Policy Planning (Statistical Standards)

the Ministry of Internal Affairs and Communications

Director-General for Policy Planning (Statistical Standards)

the Ministry of Internal Affairs and Communications◆ Planning, designing and promotion of statistical system・Establishment, revision or abolition of statistics laws and regulations・Preparation of the basic plan for the development of official statistics・To promote the effective use of statistical data; to manage the local government

statistical systems , etc.◆Examining plans and budgets for statistical censuses and surveys・ Examining plans and budgets for statistical censuses and surveys conducted by

each office and ministry

◆ Establishing statistical standards for statistical surveys・ To establish the Japan Standard Industrial Classification, etc.

◆ Cooperation concerning international statistical affairs・ To coordinate international statistical affairs・ Cooperation on the United Nations Statistical Institute for Asia and the

Pacific(SIAP)

Cabinet Office

Cabinet Office

Ministry of Internal Affairs and Communications(Statistics Bureau)

Production of Fundamental Statistics of the state of the Nation

Ministry of Internal Affairs and Communications(Statistics Bureau)

Production of Fundamental Statistics of the state of the Nation

Ministry of 

JusticeMinistry of 

Justice

Ministry of 

Foreign Affairs

Ministry of 

Foreign Affairs

Ministry of 

FinanceMinistry of 

Finance

Ministry of

Education, C

ulture, S

ports, Science

and Technology

Ministry of

Education, C

ulture, S

ports, Science

and Technology

Ministry of H

ealth, Labour and Welfare

Ministry of H

ealth, Labour and Welfare

Ministry of 

Agriculture, 

Forestry and Fisheries

Ministry of 

Agriculture, 

Forestry and Fisheries

Ministry of 

Economy, Trade 

and Industry

Ministry of 

Economy, Trade 

and Industry

Ministry of Land, 

Infrastructure, Transport and Tourism

Ministry of Land, 

Infrastructure, Transport and Tourism

Ministry of the 

Environment

Ministry of the 

Environment

Ministry of 

Defense

Ministry of 

Defense

3

2. Outline of Japanese Official StatisticsOfficial Statistics Provided by Ministries and Agencies of the Central Government and other public organs including Bank of Japan are divided into the following types

1 Statistics Compiled by Statistical SurveysFundamental  Statistics    (eg. Population  Census ) 

Important statistics among the statistics that are produced by national governments and designated by the Minister of  Internal Affairs and  Communications.

51 statistics are designated as Fundamental Statistics as of September  1, 2012.

General  Statistics             (more than 300)

Statistics other  than  Fundamental Statistics

In FY2012, more than 220 statistical surveys are scheduled to be  undertaken .(monthly, quarterly, annually, biannually, tri‐annually, every five years, and  on an ad‐hoc basis)

2. Processed StatisticsStatistics produced by processing survey statistics, administrative statistics and other data.

Fundamental Statistics (5) and Others     (eg.  SNA )  

3. Statistics Compiled by Administrative Data ( more than 300, monthly, quarterly, and  on  an annual basis)     

(eg.  Traffic  Accident  Statistics,  Crime  Statistics.

These three types  are under the jurisdiction of Minster of  Ministry of  Internal  Affairs and  Communications (Director‐General  for Policy Planning (Statistical Standards))  based on the Statistics Law.The  authority of  the minister  to approve the  operation  of statistical  surveys  in  type 1 is the strongest  one for the coordination of statistical administration in Japan.

Notes1.Some important statistics or important economic data such as “Exchange Rates” are published by non‐governmental  public entities. 2.Opinion Polls and other surveys  which ask the consciousness of  respondents are conducted by Cabinet Office and other ministries  and agencies.

3. The New Open Data Strategy in the New Statistics Act (Act No.53 in 2007)

Article 3(1) Official statistics shall be developed systematically through mutual cooperation and the    appropriate sharing of roles among administrative organs, etc. 

(2) Official statistics shall be produced with appropriate and reasonable methodologies, so as to ensure neutrality and reliability.

(3) Official statistics shall be provided widely for the public so that they are easily accessible for their effective use. 

(4) Confidential matters concerning individuals or juridical persons, or other organizations that were used for producing official statistics shall be protected. 

NotesBack ground of these principles are the Principles of Official Statistics by the Statistical Commission of UN.

3.1 Fundamental Principles

Publication of Fundamental Statistics, etc. Article 8 (1) The head of an administrative organ shall, when having produced

fundamental statistics, promptly publicize the fundamental statistics and matters specified by the Cabinet Order concerning fundamental statistics through the Internet or through other appropriate methods.

(2) The head of an administrative organ shall, when intending topublicize the fundamental statistics prescribed in the preceding paragraph, specify the date and methods of publication and publicize them through the Internet or through other appropriate methods in advance.

(3) The head of an administrative organ shall preserve informationon fundamental statistics on a long term and systematic basis and take other appropriate measures so that the public may always have easy access to such information.

3.2. More Specific Regulations for the Publication of Statistical Information  in theNew Statistics Act 

Publication of General Statistics, etc.

Article 23 (1) The head of an administrative organ shall, when having

compiled the results of a general statistical survey, promptly publicize the results of the general statistical survey and matters specified by the Cabinet Order concerning generalstatistical surveys through the Internet or through other appropriate methods; provided, however, that if there are anyspecial circumstances, the whole or a part of them may bewithheld from being publicized.

(2) The provision of Article 8, paragraph (3) shall apply mutatis information concerning the results of general statistical surveys.

Article 3 and 6 (2) of Cabinet Order on Statistics Act (Cabinet Order No.334 in 2008)

Basic Information to be publicized which are necessary for the better understanding and use of statistics

• The matters specified by the Cabinet Order in the first sub‐session of article 8 in the Statistics Act are follows. This provision is applied for both  fundamental statistics and general statistics which are compiled by statistical surveys;

1 The title and the purpose of the fundamental statistics.2    The  fact that the fundamental statistics are compiled by the fundamental 

statistical survey.3    The coverage of the survey4    Matters on which a report is requested and the reference date or period; 5    Individuals/juridical persons/other organizations requested to report; 6    Methods for requesting a report 7 Definition of  words used in the statistics or statistical survey8 Other information valuable to the use of the statistics.

3.3. Other strategies introduced by the New Statistics Act

(Secondary Use of Questionnaire Information) Article 32 and 33. (omitted) These provide the use of questionnaire information for statistical 

research and preparation of the lists for surveys in order to produce statistics by administrative organs themselves and mutual use among them. 

(Production of Statistics, etc. by Entrustment) So-called Order-made Compilation of Statistics Article 34

The head of an administrative organ or an incorporated administrative agency, etc. under Article 25 may conduct  the production of statistics, etc. by utilizing questionnaire information pertaining to statistical surveys conducted by himself/ herself in response to  request from the public, pursuant to the provision of an Ordinance of the Ministry of Internal Affairs and Communications(MIC), within limits that would not cause any hindrance to the performance of his/her business, when finding that it would contribute to the development of academic researches or in other cases specified by an Ordinance of the MIC. 

Notes.1 .Concerning 23 statistical surveys, related administrative agencies have prepared tomeet the request of order‐maide compilation of statistics. A fee is requested.

2. In the past three years, 26 cases concerning 10  statistical surveys have beencompiled. More than half of  them were requests for the Population Census.

(Production of Anonymous Data) Article 35

(1) The head of an administrative organ or an incorporated administrative agency, etc.under Article 25 may produce anonymous data by processing questionnaireinformation pertaining to statistical surveys they have conducted. (2) (omitted) Necessary consultation with the Statistics Commission in advance. 

(Provision of Anonymous Data) Article 36

The head of an administrative organ or an incorporated administrative agency, etc. under Article 25 may provide anonymous data produced pursuant to the provision of Article 35, paragraph (1) upon a request from the public, pursuant to the provision of an Ordinance of the MIC, when finding that it would  contribute to the development of academic researches or in other cases specified by an Ordinance of the MIC. 

Notes.1.Contents of Ordinance of the MIC; only for statistical compilation, only for academic research,  the publication of the results and appropriate management of the data. 

Necessary fees  are also required.2.Until the end of March 2012, anonymous data of 6 Fundamental Statistics has been prepared for a certain period of time, and in 60 cases they have been used.

3.4. My Comments on the Three Strategies

The principles concerning dissemination of official statistics described in Article 3 and specific regulations described in Articles 8 and 23 in the Statistics Act of Japanare very important rules concerning the publication of  official statistics and theseare common rules  for many NSOs/administrative agencies providing official statistics.  

2.    Concerning the so‐called order‐made compilation of questioner information collected by government statistical surveys and provision of anonymous data,there are of course a few needs . However, there are some problems related to these matters. In Japan, one of the main needs from business sectors is the use of individual data, and such needs interfere with the confidentiality of respondent information.Concerning the provision of anonymous data, its development began from surveys of individuals and households, relatively large scale surveys and the surveys of high  interest . However the actual use of such data is not common.Anonymous data of surveys on business sectors are still undeveloped because it is very difficult to keep the confidentiality of business entities.Furthermore these measures are high‐cost and require techniques including ICT. Therefore, I am rather skeptical on these matters from the viewpoints of cost‐effectiveness.For each NSO, it is very important to consider priorities in these matters.

4. Concrete Measures for Improving Statistical Publication Servicesin Japan

4. Concrete4. Concrete Measures for Improving Statistical Publication ServicesMeasures for Improving Statistical Publication Servicesin Japanin Japan

○ In 2003, the Japanese government made a government‐wide strategic plan in order to construct an “e‐government” as a  part of administrative reform.

○ In many administrative fields , optimization plans of operations and  systemswere established.

○ “The Optimization Plan of Operations and Systems for Statistical Work” was adopted in 2006 for the following purposes.▪ to improve public statistical services▪ to improve convenience and security of responses by survey respondents▪ to reduce public statistical work load▪ to save public statistical expenditure▪ to centralize the statistical information systems 

4.1 The Optimization Plan of Operations and Systems for StatisticalThe Optimization Plan of Operations and Systems for StatisticalWork and the Work and the Start of “e‐Stat”

The statistical information systems of different ministries wereThe statistical information systems of different ministries were integrated into the integrated into the 

““InterInter‐‐Ministry Information System for Official Statistics (IMISOS)Ministry Information System for Official Statistics (IMISOS)”” in2008.in2008.

Copyright (c) Statistics Bureau, 2011. All rights reserved. 14

PublicationTabulationTabulationField worksPreparation forfield worksPlanning

4.2. Statistical Survey Operations and the Outline of Inter‐Ministry  Information System for Official Statistics (IMISOS)

Government Statistics Sharing Center(Application Service Provider: ASP)

Statistical geographic information systemAuthentication system

Regional statistics analysis system

Portal site of G

overnment statistics (

e-Stat)

Statistical table management system

Statistical information database

Standard region code management system

Statistical classification database

Survey item database

Authentication

Portal site of Government online survey(Online survey system)

Enumerator management system

Establishment and enterprise database

利用機関総合窓口(業務ポータルサイト)

※ASP:Enterprises which provide user organizations with business information systems through network.

Operator: Incorporated Administrative Agency “National Statistics Center”

Administrative agencies

(as statistics users)

Population surveyed

Administrative agencies

System

of ministries

and agencies

Portal site of G

overnment statistics

(e-Stat

Portal site for user organizations (Portal site for operations)

Survey item database

Standard region code management system

Statistical information database

Statistical table management system

Statistical classification database

Portal site of Government online survey(Online survey system)

Enumerator management system

Establishment and enterprise database

Kasum

igaseki WA

N・

LG W

AN

Statistics users

Internet

Authentication

Subsystems of the Inter-Ministry Information System for Official Statistics are used in each phase of statistical survey operations, namely “planning”, “preparation for field works”, “field works”, “verification”, “tabulation” and “publication”The following chart shows available system applications for each phase.This system is managed by the Bureau of Statistics and operated by the National Statistics Center with the cooperation of

other Ministries and Agencies.

Verification

15

4.3. 1 Outline of the Portal Site of Official Statistics of Japan (“e‐Stat”)

4.3. 1 Outline of the Portal Site of Official Statistics of Japa4.3. 1 Outline of the Portal Site of Official Statistics of Japan (n (““ee‐‐StatStat””))

The “e‐Stat” site provides a “One‐Stop‐Service”

collects and integrates statistical information from the websites  of all ministries 

provides various statistical services via the Internet  

http://www.e‐stat.go.jp/SG1/estat/eStatTopPortalE.do

17

18

4.4. Explanation of the function  of “e‐Stat”(Example )4.4. Explanation of the function  of 4.4. Explanation of the function  of ““ee‐‐StatStat””(Example(Example ))

Search for Statistics  e‐Stat saves Excel, CSV or PDF files of statistical tables 

Users can search by keyword, theme, and ministries

Users can browse, download, and draw out tables and graphs

Easy Access to Main Statistics  Users can gain an understanding of  the latest statistical indicators through numbers and graphs

4.4. Explanation of the function  of “e‐Stat”(Example )4.4. Explanation of the function  of 4.4. Explanation of the function  of ““ee‐‐StatStat””(Example(Example ))

Regional Statistics Analysis System  Users can browse principal data such as population and the total 

land area of each prefecture and municipality in detail

4.4. Explanation of the function  of “e‐Stat”(Example )4.4. Explanation of the function  of 4.4. Explanation of the function  of ““ee‐‐StatStat””(Example(Example ))

Statistical Geographical Information System Users can easily grasp the situation concerning the merging of 

municipalities

Emergency measures The e‐Stat system contributed to providing information about 

the “ Great East Japan Earthquake”For example, we had posted a map of the flooded area, and  population and number of households there

4.4. Explanation of the function  of 4.4. Explanation of the function  of ““ee‐‐StatStat””(Example(Example) ) 

4.4. Explanation of the function  of “e‐Stat”(examples)4.4. Explanation of the function  of 4.4. Explanation of the function  of ““ee‐‐StatStat””(examples(examples))

Survey Items Database

records items and questionnaires used in statistical surveys

users can search metadata such as definitions of items

Statistical Classification Management System 

Japan Standard Industrial Classification

Japan Standard Occupational Classification

Japan Standard Commodity Classification

Classification of Diseases, Injuries and Causes of Death

Statistical Area Code Management System

manages information concerning changes regarding 

municipalities such as mergers, name or boundary changes, and 

a Statistical Area Code

possible to grasp these transitions via a timeline

Statistical survey results in e‐Stat  The e‐Stat system delivers the data of about 450 statistic

including survey statistics, administrative statistics and

processed statistics,  and 870 thousand statistical tables.

Most of the main statistics in Japan have been stored in 

IMISOS, and we are making efforts to increase them.

The number of accesses from users to e‐Stat  The number of hit have has increased each year.

The number in FY 2011 was more than 57 million.

4.5.   Achievements4.5.   Achievements4.5.   Achievements

Thank you very muchThis presentation was completed with the help of colleages in my office and the Bureau of Statistics. Some of the slides were made based on the materials made by Mr. HirotakaKato  and  the Statistical Information Systems Division, Statistics  Bureau in MIC.