The revised Quality Assurance Framework of Eurostat

Markus Baumann, Federal Statistical Office, Switzerland

Strategic Management Seminar, Ankara, 24./25.10.2019

Markus Baumann, Strategic Management Seminar, Ankara, 24./25.10.2019 1

Goal of the presentation

“Explain the different changes between the now three versions of the QAF but mainly focusing on the changes to the latest version (2.0) while also showing how they relate to the revised CoP 2017.”

2Markus Baumann, Strategic Management Seminar, Ankara, 24./25.10.2019

What is the aim of Eurostat Quality Assurance

Framework (QAF)?

• Together with the 2011 version of the Code of Practice, the European Statistical System Committee adopted the Quality Assurance Framework.

• The Quality Assurcance Framework serves as guidance on how to implement the European Statistics Code of Practice.

3Markus Baumann, Strategic Management Seminar, Ankara, 24./25.10.2019

What superordinate structure does the QAF follow?

The structure of the QAF follows basically the structure of the Code of Practice (CoP).

The structure of the CoP defines three important dimensions ofquality management principles and indicators (measures):

• Institutional environment

• Statistical Processes

• Statistical Output

4Markus Baumann, Strategic Management Seminar, Ankara, 24./25.10.2019

What is the structure of the QAF content / document?

1st level: Three dimensions (Institutional, Processes, Output)

2nd level: Principles from the CoP

3rd level: Indicators from the CoP

4th level: 1) Institutional methods

2) Process / Output methods

5Markus Baumann, Strategic Management Seminar, Ankara, 24./25.10.2019

Markus Baumann, Strategic Management Seminar, Ankara, 24./25.10.2019 6

What are the main differences among the different QAF

versions?

7Markus Baumann, Strategic Management Seminar, Ankara, 24./25.10.2019

Version 1.0 (2011) and Version 1.1 (2012)

Name Referent/in, Organisationseinheit / Projekt | Titel der Präsentation | Anlass | Datum 8

A first version of the ESS QAF covering principles 4 and 7 to 15 of the CoP was published in August 2011.

P1 – Professional Independance

P1bis – Coordination and cooperation

P2 – Mandate for Data Collection

P3 – Adequacy of Ressources

P4 – Commitment to Quality

P5 – Statistical Confidentiality

P6 – Impartiality and Objectivity

P7 – Sound Methodology

P8 – Appropriate Statistical Procedures

P9 – Non-excessive Burden on Respondents

P10 – Cost effectiveness

P11 – Relevance

P12 – Accuracy and Reliability

P13 – Timeliness and Punctuality

P14 – Coherence and Comparability

P15 – Accessibility and Clarity

Insitutional environment

Statistical Processses

Statistical Output

Version 1.2 (2015)

• Work carried out in 2013 – 2015 by the ESS Task Force Peer Review

• Integration of Principles 5 and 6 of the CoP

• Changes are the result of analyzing the Frequently Ask Questions (FAQ) document produced during the peer reviews and proposals made by the ESS Task Force to develop the peer review methodology

9Markus Baumann, Strategic Management Seminar, Ankara, 24./25.10.2019

Version 1.2 (2015)

P1 – Professional Independance

P1bis – Coordination and cooperation

P2 – Mandate for Data Collection and Access to Data

P3 – Adequacy of Ressources

P4 – Commitment to Quality

P5 – Statistical Confidentiality and Data Protection

P6 – Impartiality and Objectivity

P7 – Sound Methodology

P8 – Appropriate Statistical Procedures

P9 – Non-excessive Burden on Respondents

P10 – Cost effectiveness

P11 – Relevance

P12 – Accuracy and Reliability

P13 – Timeliness and Punctuality

P14 – Coherence and Comparability

P15 – Accessibility and Clarity

10

Insitutional environment

Statistical Processses

Statistical Output

Markus Baumann, Strategic Management Seminar, Ankara, 24./25.10.2019

Version 2.0 (2019)

• Draft new methods and tools for Principles 1, 1bis, 2 and 3

• Make a minimum revision for the other principles

• A collection of good practices

• Be as comprehensive as possible

• Not binding, not used as a benchmark, beneficial for the NSS

11Markus Baumann, Strategic Management Seminar, Ankara, 24./25.10.2019

Version 2.0 (2019)

P1 – Professional Independance

P1bis – Coordination and cooperation

P2 – Mandate for Data Collection and Access to Data

P3 – Adequacy of Ressources

P4 – Commitment to Quality

P5 – Statistical Confidentiality and Data Protection

P6 – Impartiality and Objectivity

P7 – Sound Methodology

P8 – Appropriate Statistical Procedures

P9 – Non-excessive Burden on Respondents

P10 – Cost effectiveness

P11 – Relevance

P12 – Accuracy and Reliability

P13 – Timeliness and Punctuality

P14 – Coherence and Comparability

P15 – Accessibility and Clarity

12

Insitutional environment

Statistical Processses

Statistical Output

Markus Baumann, Strategic Management Seminar, Ankara, 24./25.10.2019

Version 2.0 (2019)

The new requirements of the ESCoP, such as

• the enhanced coordination role of the NSI

• the use of new data sources and better use of administrative data

• as well as modernization and innovation aspects

will nevertheless be highlighted during the next round of the ESS peer review 2021-2022.

13Markus Baumann, Strategic Management Seminar, Ankara, 24./25.10.2019

An example of how the Federal Statistical Office of

Switzerland applies the Quality Assurance Framework

14Markus Baumann, Strategic Management Seminar, Ankara, 24./25.10.2019

SFO-Quality Assurance Handbook

15

GSBPM (Generic

Statistical Business

Process Model) from

UNECE

Markus Baumann, Strategic Management Seminar, Ankara, 24./25.10.2019

Markus Baumann, Swiss Federal Statistical Office, markus.baumann@bfs.admin.ch

Markus Baumann, Strategic Management Seminar, Ankara, 24./25.10.2019