30
United Nations Development Account 10th tranche Statistics and Data Institutional Framework: International principles and good practices Sound institutional environment, cooperation, dialogue and partnerships for the production and utilization of SDG indicators Arab Workshop 6-8 February 2018, Tunis, Tunisia

Institutional Framework: International principles and good ... · Quality assurance and quality monitoring: International principles and good practices Sound institutional environment,

  • Upload
    others

  • View
    2

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Institutional Framework: International principles and good ... · Quality assurance and quality monitoring: International principles and good practices Sound institutional environment,

United Nations Development Account 10th tranche Statistics and Data

Institutional Framework:

International principles and good practices

Sound institutional environment, cooperation, dialogue and partnerships

for the production and utilization of SDG indicators

Arab Workshop

6-8 February 2018, Tunis, Tunisia

Page 2: Institutional Framework: International principles and good ... · Quality assurance and quality monitoring: International principles and good practices Sound institutional environment,

Value of Official Statistics

▪ Authoritative [decision-making]

▪ Independent, objective and transparent [trust]

▪ Highest professional standards and ethics [confidentiality]

▪ Fitness-for-purpose [user-oriented quality]

▪ Universal [equal access]

▪ Flexible and resilient [reliable]

▪ Efficient and effective [coordinated]

Page 3: Institutional Framework: International principles and good ... · Quality assurance and quality monitoring: International principles and good practices Sound institutional environment,

The Journey to the Fundamental Principles

▪ Ethical Guidelines for Statistical Practice, American Statistical Association

(ASA), adopted in 1979 and last revised 2016

▪ Declaration on Professional Ethics, International Statistical Institute (ISI),

adopted in 1985 and last revised in 2010

▪ Fundamental Principles of Official Statistics, UNECE, adopted by the

Conference of European Statisticians in 1991 and at political level in 1992

▪ United Nations Fundamental Principles of Official Statistics (UN-FPs)

adopted by the UN Statistical Commission in 1994

▪ UN-FPs adopted by the General Assembly in 2014 (A/RES/68/261)

Page 4: Institutional Framework: International principles and good ... · Quality assurance and quality monitoring: International principles and good practices Sound institutional environment,

UN-FPs

▪ Impartiality, objectivity and equal access

▪ Relevance, accessibility, accuracy, timeliness and punctuality

▪ Professional independence, ethics and methodology

▪ Prevention of misuse and right to comment on erroneous interpretation

▪ Sources of official statistics and Non-excessive burden on respondents

▪ Statistical confidentiality and exclusive use for statistical purposes

▪ Accountability and transparency

▪ National coordination, coherence and comparability

▪ International cooperation and standards

… values and principles governing statistical work to be guaranteed

by legal and institutional frameworks (A/RES/71/313 from 6 July 2017)

Page 5: Institutional Framework: International principles and good ... · Quality assurance and quality monitoring: International principles and good practices Sound institutional environment,

National Law on Official Statistics [the Law]

▪ Delineation of the National Statistical System (NSS) and parties to the Law

▪ National Statistical Office and other producers

▪ Chief Statistician

▪ Statistical Council (session 2)

▪ Coordination mechanisms and instruments (session 2)

▪ Mandate for data collection and statistical registers (session 4)

▪ Confidentiality and exchange of data within the NSS (session 4)

▪ Advanced release calendar and equal access (session 4)

▪ Open data and access to micro-data for research purposes (session 4)

▪ Other provisions …

Page 6: Institutional Framework: International principles and good ... · Quality assurance and quality monitoring: International principles and good practices Sound institutional environment,

Delineation of the NSS and other parties to the Law

▪ All producers of statistics that comply with the provisions of the Law

and the Principles:

• National Statistical Office (main producer)

• Other producers of official statistics (listed in the statistical programme)

▪ But the Law also grants rights and imposes obligations on other

parties:

• Users: equal and simultaneous access to statistical releases

• Respondents: obligation to provide information

• National and local authorities: obliged to provide, free of charge, data

and metadata in their possession

• Statistical Council: composition, mandate and tasks

• …

Page 7: Institutional Framework: International principles and good ... · Quality assurance and quality monitoring: International principles and good practices Sound institutional environment,

National Statistical Office (NSO)

▪ Main producer of Official Statistics

▪ Professionally independent body

▪ Coordinates activities for the development, production and

dissemination of statistics within the NSS

▪ Not to be assigned responsibilities or getting instructions conflicting

with the Principles

Other Producers of Official Statistics (OPOS)

▪ Operate in compliance with the Law and adopted standards

▪ Professionally independent entities within their respective

organizations

▪ Responsible for their assigned activities in the statistical

programmes

Page 8: Institutional Framework: International principles and good ... · Quality assurance and quality monitoring: International principles and good practices Sound institutional environment,

Chief Statistician

▪ Highest Statistical Authority and executive manager of the NSO

▪ Mandate cannot be terminated for any reasons compromising the

implementation of the Law and the Principles

▪ Fosters and monitors the compliance of all producers of official

statistics with the Law and the Principles

▪ Submits to the Government the statistical programmes after

consultations with the Statistical Council and other producers

▪ Issues standards and guidelines for the entire NSS on the

development, production and dissemination of official statistics

▪ Promotes the use of official statistical standards and classifications

beyond the NSS (partnerships and dialogue)

Page 9: Institutional Framework: International principles and good ... · Quality assurance and quality monitoring: International principles and good practices Sound institutional environment,

SDG Indicators: challenges and opportunities

SDG Indicators

Scope

> 230 indicators

Granularity

Data disaggregation

Quality

Timelinessreliability

Data Eco-system

Digital transformation

Data sources

Geo-spatial

Data community

Data providers& producers

Modernisation

Integration & Standardisation

Interoperability

Methodology

Mix-mode

Institutional environment

Resources &

Capability

Infrastructure

IT & applications

Know-how

HR development

Leadership

Coordination

Partnership

Challenges Opportunities Capacity building - Transformation

Page 10: Institutional Framework: International principles and good ... · Quality assurance and quality monitoring: International principles and good practices Sound institutional environment,

The Law vs. Transformation

▪ The Law not a “corset” against transformation but to enable

modernization while safeguarding the Principles

▪ Necessity to revise statistical legislations to raise the challenges and

grasp the opportunities

Need to enhance the managerial autonomy of the Chief Statistician

PrinciplesTransformation

Page 11: Institutional Framework: International principles and good ... · Quality assurance and quality monitoring: International principles and good practices Sound institutional environment,

While revising/updating the Law

▪ Advocacy and consultation, not only with the Government but also

the public, civil society, data community, media …

▪ Identify “champions” to bring the message to all stakeholders

▪ Seek support from the international community

▪ Exchange experience with countries that are in the process or

recently revised their statistical Legislations

▪ Identify early in the process other national legislation and by-laws

that need to be aligned with the new Law

Page 12: Institutional Framework: International principles and good ... · Quality assurance and quality monitoring: International principles and good practices Sound institutional environment,

Generic Law on Official Statistics

Generic Law on Official Statistics

Page 13: Institutional Framework: International principles and good ... · Quality assurance and quality monitoring: International principles and good practices Sound institutional environment,

For questions and comments:

Gabriel Gamez | Inter-regional AdviserOrganisation and management of NSS | Statistics Division

Department of Economic and Social Affairs | United Nations

2 UN Plaza | Room DC2-1518 | New York, NY 10017, USA

Email: [email protected] | Tel: +1-917-367-5443 | Cell: +1-646-944-3735

Page 14: Institutional Framework: International principles and good ... · Quality assurance and quality monitoring: International principles and good practices Sound institutional environment,

United Nations Development Account 10th tranche Statistics and Data

Governance and Coordination:

International principles and good practices

Sound institutional environment, cooperation, dialogue and partnerships

for the production and utilization of SDG indicators

Arab Workshop

6-8 February 2018, Tunis, Tunisia

Page 15: Institutional Framework: International principles and good ... · Quality assurance and quality monitoring: International principles and good practices Sound institutional environment,

Sound institutional environment - Reminder

▪ Value: enhance public trust and promote the use of official statistics

▪ UN Fundamental principle => Statistical Law

▪ Clear delineation of the NSS

▪ NSO professional independent body, main producer of official

statistics

▪ Chief Statistician represents and leads the NSS in the country and

abroad

▪ OPOS to operate in compliance with statistical legislation and

adopted standards

Page 16: Institutional Framework: International principles and good ... · Quality assurance and quality monitoring: International principles and good practices Sound institutional environment,

Coordination instruments of the NSS /1

▪ National statistical programmes are the main coordination

instruments of the NSS

▪ National statistical programmes to be used for the budget

appropriation

▪ The programmes cover the entire NSS, including development,

production and dissemination of SDG indicators

▪ The programmes to be submitted by the Chief Statistician to the

relevant government body for approval

Page 17: Institutional Framework: International principles and good ... · Quality assurance and quality monitoring: International principles and good practices Sound institutional environment,

Coordination instruments of the NSS /2

▪ Multiannual statistical programme (Master plan, NSDS):

• strategic development of NSS

• Vision and priorities

▪ Annual statistical programme:

• Programme of work

• Annual operational translation of multiannual programme

• List of producers of official statistics and their respective deliveries

• List of major surveys, and other data sources (administrative), registers

Page 18: Institutional Framework: International principles and good ... · Quality assurance and quality monitoring: International principles and good practices Sound institutional environment,

Statistical Council

▪ Main user advisory body (no controlling functions)

▪ Advises NSS and government - opinions and reports are public

▪ Allows users to provide input regarding their needs and on

implementation of the statistical work programme

▪ Broadly represents user communities (not producers) within and

outside the government

▪ Provides opinion on:

• Draft (multi-)annual statistical programmes from a user perspective

• Reports on implementation of the statistical programs

• Quality reports

Page 19: Institutional Framework: International principles and good ... · Quality assurance and quality monitoring: International principles and good practices Sound institutional environment,

Other coordination mechanisms and tools

▪ NSS Coordination Committee

• Advisory committee to the Chief Statistician (producers)

• Preparation of the statistical programmes before submission to the

Statistical Council

• Discuss data collection and sharing, methodology, guidelines,

development of common tools, training programmes…

• Preparation of international high-level statistical meetings and reports

▪ Meeting with producers of administrative data and registers

▪ Meetings with the data community, academia, researchers and other

advanced users

▪ Meeting with the media

▪ …

Page 20: Institutional Framework: International principles and good ... · Quality assurance and quality monitoring: International principles and good practices Sound institutional environment,

For questions and comments:

Gabriel Gamez | Inter-regional AdviserOrganisation and management of NSS | Statistics Division

Department of Economic and Social Affairs | United Nations

2 UN Plaza | Room DC2-1518 | New York, NY 10017, USA

Email: [email protected] | Tel: +1-917-367-5443 | Cell: +1-646-944-3735

Page 21: Institutional Framework: International principles and good ... · Quality assurance and quality monitoring: International principles and good practices Sound institutional environment,

United Nations Development Account 10th tranche Statistics and Data

Quality assurance and quality monitoring:

International principles and good practices

Sound institutional environment, cooperation, dialogue and partnerships

for the production and utilization of SDG indicators

Arab Workshop

6-8 February 2018, Tunis, Tunisia

Page 22: Institutional Framework: International principles and good ... · Quality assurance and quality monitoring: International principles and good practices Sound institutional environment,

What do we mean by quality?

Fit-for-purpose

Page 23: Institutional Framework: International principles and good ... · Quality assurance and quality monitoring: International principles and good practices Sound institutional environment,

Quality Assurance Framework (QAF)

▪ Institutional and organizational set-up

▪ Statistical Input

▪ Statistical business architecture and production processes

▪ Statistical output

• Relevance

• Accuracy and Reliability

• Timeliness and Punctuality

• Coherence and Comparability

• Accessibility and Clarity

Page 24: Institutional Framework: International principles and good ... · Quality assurance and quality monitoring: International principles and good practices Sound institutional environment,

QAF – Organisational set-up

▪ A quality policy is made publicly available with clear principles and

objectives

▪ An organizational structure is in place to deal with quality

management (cross-cutting)

▪ Procedures are in place and implemented to asses, plan, monitor

and report on quality of input, processes and outputs

▪ A quality report is submitted to the Statistical Council and made

publicly available

Page 25: Institutional Framework: International principles and good ... · Quality assurance and quality monitoring: International principles and good practices Sound institutional environment,

QAF - Input

▪ Clear mandate for data collection for NSS (Law and programmes)

▪ Access to/transfer of administrative data with identifier

▪ Obligation for respondents to participate

▪ Statistical confidentiality

▪ Balance costs, response burden and quality

▪ Sharing data among partners of the NSS

▪ NSO consulted when collection of administrative data changes

(scope, quality, periodicity, granularity, timeliness…)

▪ Interactions with holders of other data sources (NGOs, Big Data,

geospatial information) to explore jointly the potential of this data for

the production of official statistics

Page 26: Institutional Framework: International principles and good ... · Quality assurance and quality monitoring: International principles and good practices Sound institutional environment,

Quality is embedded in processes

Page 27: Institutional Framework: International principles and good ... · Quality assurance and quality monitoring: International principles and good practices Sound institutional environment,

QAF – Business architecture and processes

▪ Sound methodology is used throughout the production process

▪ Adequate tools, procedures and expertise are deployed to support

the production of statistics (business architecture)

▪ Production processes are mapped (GSBPM) and documented

▪ Production processes are efficient, effective and statistical

confidentiality secured; including when data are stored

▪ Before launching a statistical survey an assessment of existing data

sources is conducted (quality vs. costs)

Page 28: Institutional Framework: International principles and good ... · Quality assurance and quality monitoring: International principles and good practices Sound institutional environment,

QAF - Output

▪ Users are regularly consulted (content, format, timing of releases)

▪ Users have equal and simultaneous access to official statistics

▪ Official Statistics are disseminated in a user-friendly way

▪ Statistics are disseminated with metadata

▪ Advance release calendar with clear updating procedures are

publicly available

▪ No political statement in statistical publications

▪ Errors are corrected and users informed accordingly

▪ Direct and undirect Confidatential data are not

▪ Right for NSS to comments on misinterpretation of statistics

Page 29: Institutional Framework: International principles and good ... · Quality assurance and quality monitoring: International principles and good practices Sound institutional environment,

▪ Know your starting point

▪ Assess costs and benefits of institutional improvement

▪ Prioritize - Identify sustainable “quick wins”

▪ Seek support

▪ Target resources accordingly

Improving the Institutional Environment and Quality

Page 30: Institutional Framework: International principles and good ... · Quality assurance and quality monitoring: International principles and good practices Sound institutional environment,

For questions and comments:

Gabriel Gamez | Inter-regional AdviserOrganisation and management of NSS | Statistics Division

Department of Economic and Social Affairs | United Nations

2 UN Plaza | Room DC2-1518 | New York, NY 10017, USA

Email: [email protected] | Tel: +1-917-367-5443 | Cell: +1-646-944-3735