Key components of quality management system and further challenges Blagica Novkovska, State Statistical Office of the Republic of Macedonia European Conference

Key components of quality Key components of quality management system and further management system and further

challengeschallenges

Blagica Novkovska, Blagica Novkovska,

State Statistical Office of the Republic of Macedonia State Statistical Office of the Republic of Macedonia

European Conference on Quality in Official Statistics European Conference on Quality in Official Statistics

(Vienna, Austria, 2-5 June 2014)(Vienna, Austria, 2-5 June 2014)

REPUBLIC OF MACEDONIAREPUBLIC OF MACEDONIA

STATE STATISTICAL OFFICESTATE STATISTICAL OFFICE

CCOONNTTEENNTT

1. Introduction

2. Quality management framework2.1. Self-assessment based on EFQM2.2. Peer Review2.3. Metadata and quality management - Metadata driven production system2.4. The Euro-SDMX structure (ESMS)2.5. Statistical business process model2.6. Staff satisfaction surveys and customer satisfaction survey2.7. DESAP – the European Self Assessment Checklist for survey managers

3. Strategic documents and commitment to quality

4. Future challenges

SSO vision - to be recognized as an institution that provides high quality, timely and relevant statistical information by adhering to the 15 principles of the EU CoP



INTRODUCTIONINTRODUCTION

Quality framework based on permanent self-assessment for progress monitoring

Commitment for continuous improvements is monitored through the fulfillment of the indicators associated to certain principles of the CoP



INTRODUCTIONINTRODUCTION

Top-down quality management framework – EFQM

CAF EU CoP Peer Review

Bottom-up approach

Survey quality reporting DESAP



QUALITY MANAGEMENT FRAMEWORKQUALITY MANAGEMENT FRAMEWORK



QUALITY MANAGEMENT FRAMEWORK QUALITY MANAGEMENT FRAMEWORK Self-assessments based on EFQM Self-assessments based on EFQM

0

0.5

1

1.5

2

2.5

3Leadership

Strategy and planning

Human resources management

Partnership and resources

Management with processes and changes

User/citizen-oriented results

Results concerning the employees

Societal results

Results concerning key performances

2007 2010 2011



QUALITY MANAGEMENT FRAMEWORK QUALITY MANAGEMENT FRAMEWORK Peer Review Peer Review

The main findings of the peer review team were:

“Quality is considered to be a high priority of the SSO. Key office documents confirm the commitment of the management regarding quality issues….”

“The SSO places great emphasis on the quality of the data produced. Key documents published by the SSO (e.g. the vision of the SSO) confirm the SSO’s commitment to quality….”



QUALITY MANAGEMENT FRAMEWORK QUALITY MANAGEMENT FRAMEWORK Metadata and quality management Metadata and quality management

Basic principle - re-usability of metadata Building of the metadata system - creation of

standardized documents (used in Annual programme):

Catalogue of Tasks Catalogue of Activities

Metadata Strategy - development of a metadata driven production system



QUALITY MANAGEMENT FRAMEWORK QUALITY MANAGEMENT FRAMEWORK Metadata driven production system Metadata driven production system

Implementation of advanced technologies based on statistical metadata driven approach for statistical information production and dissemination

System for supporting automated data collection (eStat) - realization of the first priority task

First step in process-oriented data production approach

Specify Needs

Due to a small number of new surveys in yearly statistics production this phase is classified as

The third priority task

Develop and Design

Metadata creation directly into metadata system

Build

Applicable within development of stand alone production subsystems

Collect Process Analyse

The first priority task in the development of metadata driven system able to manage production processes

Disseminate Archive

The second priority task or long term perspective to expand the system

with functionality of involved processes



QUALITY MANAGEMENT FRAMEWORK QUALITY MANAGEMENT FRAMEWORK The Euro-SDMX structure (ESMS) The Euro-SDMX structure (ESMS)

1 Contact1.1 Contact organisationState Statistical Office1.2 Contact organisation unitDepartment for prices1.3 Contact nameElizabeta Trajkovska1.4 Contact person functionSenior Associate1.5 Contact mail address

1.6 Contact email [email protected] Contact phone number3295-6581.8 Contact fax number

2 Metadata update2.1 Metadata last certified6/11/20132.2 Metadata last posted6/11/20132.3 Metadata last update6/11/2013

ESMS structure includes data quality information - once statistics are documented, one can easily build predefined quality reports



QUALITY MANAGEMENT FRAMEWORK QUALITY MANAGEMENT FRAMEWORK Statistical business process model Statistical business process model

Annual Statistical Programme Activity Based Time Recording

DEADLINES FOR ACTIVITIES PER SELECTED STATISTICAL TASK

USER RECORDED DATE AND TIME PER SELECTED

STATISTICAL TASK AND ACTIVITY

Control and monitoring of Annual Programme execution

Deadline k > Date/Time 1Deadline k > Date/Time 2...Deadline k >= Date/Time m

SSO SBPM

Phase 8Phase 1

Sub-process

1.6

Sub-process

1.1

Sub-process

8.1

Activity 1.1.3

Activity 1.1.1

Activity 8.4.3

Activity 8.4.1

... ...

... ...

...

Information flow to Managerial Board

Deadline 1

Deadline k

Deadline n

...

Date/Time 1

Date/Time 2

Date/Time m

...

Catalogue of Activities

... ...

Overhead Activities

Activity n.1.m

Activity 1.1.1

Activity k.1.l

Sub-process

8.4



QUALITY MANAGEMENT FRAMEWORK QUALITY MANAGEMENT FRAMEWORK Staff satisfactions surveys and customer satisfaction Staff satisfactions surveys and customer satisfaction

surveys surveys

Staff Satisfaction Survey - Communication with staff and exchange of views on improving different aspects of an organization of work

User Satisfaction Survey – created web questionnaire provided information about the users’ habits in the use of statistics, their opinions on the statistics and on the principles of the EU CoP.



QUALITY MANAGEMENT FRAMEWORK QUALITY MANAGEMENT FRAMEWORK DESAP - the European Self Assessment Checklist for DESAP - the European Self Assessment Checklist for

survey managers survey managers

DESAP self-assessment questionnaire has been implemented as a pilot project with two selected surveys – HBS and Construction Survey

DESAP translated and adapted to the SSO statistical business process model

DESAP will be implemented on new surveys and on regular surveys with major quality issues

STRATEGIC DOCUMENTS AND COMMITMENT TO STRATEGIC DOCUMENTS AND COMMITMENT TO QUALITY QUALITY

Quality strategy and quality policy Quality strategy and quality policy



Quality Strategy - determine the activities and indicators for creating a quality monitoring and assessing system

Quality Policy - based on several pillars:

• EU CoP

• User orientation,

• Measuring the quality of statistical data and processes,

• Strengthening the cooperation with data providers,

• Human resource development,

• Total Quality Management

• Rational use of available resources

STRATEGIC DOCUMENTS AND COMMITMENT TO STRATEGIC DOCUMENTS AND COMMITMENT TO QUALITY QUALITY

Statistical confidentially - access to micro data Statistical confidentially - access to micro data



Managing statistical confidentiality and microdata

Original microdata

Confidential microdata

De-facto anonymised microdata

Fully anonymised microdata

Delete direct identifiers

Anonymization methods

Stronger anonymisation

methods

Degree of confidentiality

Degree of analysis potential

SSO’s Quality Policy – Guidance for:

Rational use of available resource Measuring quality of statistical data and

processes Total quality management



FUTURE CHALLENGESFUTURE CHALLENGES

Main fields of action:

Integrated IT system (eStat) put into daily practice Process change management

Further process standardization based on the SBPM Benchmarking of comparable statistics

Quality assurance – development of procedures for monitoring quality of processes

Self-assessment tool for the survey managers (DESAP)



FUTURE CHALLENGESFUTURE CHALLENGES



Thank You for Your Attention!Thank You for Your Attention!

Documents

Key components of quality management system and further challenges Blagica Novkovska, State Statistical Office of the Republic of Macedonia European Conference