16
Industrialization in official statistics A view on quality reporting and sufficient quality Max Booleman, Kees Zeelenberg NTTS 2013, Brussels

Industrialization in official statistics - European Commission · Improve process quality •Efficiency gain: same for less •Increase robustness: less product and process variation

  • Upload
    others

  • View
    1

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Industrialization in official statistics - European Commission · Improve process quality •Efficiency gain: same for less •Increase robustness: less product and process variation

Industrialization in

official statistics

A view on quality reporting and

sufficient quality

Max Booleman, Kees Zeelenberg

NTTS 2013, Brussels

Page 2: Industrialization in official statistics - European Commission · Improve process quality •Efficiency gain: same for less •Increase robustness: less product and process variation

Industrialization, sufficient quality

Content

• Industrialization: car industry vs statistical

production

• Quality reporting

• Sufficient quality: accountancy world

• Recommendations

• Conclusions

Page 3: Industrialization in official statistics - European Commission · Improve process quality •Efficiency gain: same for less •Increase robustness: less product and process variation

Industrialization

• All the same, every

time the same

• Constant quality

• Also for components

• Design separated

from production

Industrialization, sufficient quality

Page 4: Industrialization in official statistics - European Commission · Improve process quality •Efficiency gain: same for less •Increase robustness: less product and process variation

Industrialization

• Less human intervention

• Set specifications, install assembling line,

interpret

Industrialization, sufficient quality

Page 5: Industrialization in official statistics - European Commission · Improve process quality •Efficiency gain: same for less •Increase robustness: less product and process variation

Industrialization

• Specifications:

concepts and

quality

• Some flexibility

Industrialization, sufficient quality

Page 6: Industrialization in official statistics - European Commission · Improve process quality •Efficiency gain: same for less •Increase robustness: less product and process variation

Improve process quality

• Efficiency gain: same for less

• Increase robustness: less product and

process variation

And if

• Process quality is not according pre-set

process specifications or

process is not able to meet the product

specifications

Industrialization, sufficient quality

Page 7: Industrialization in official statistics - European Commission · Improve process quality •Efficiency gain: same for less •Increase robustness: less product and process variation

Improve product quality

Only if

• Pre-set quality level not met (yet)

• Corrections (ex post failures)

Otherwise it leads to

• change in specifications: new quality level

• specify needs

• process redesign

Industrialization, sufficient quality

Page 8: Industrialization in official statistics - European Commission · Improve process quality •Efficiency gain: same for less •Increase robustness: less product and process variation

Quality reporting

If we produce products

• with constant quality

• according specifications which

• include tolerances

Then no need for individual quality report

Only if specifications are not met: action with

warning

Industrialization, sufficient quality

Page 9: Industrialization in official statistics - European Commission · Improve process quality •Efficiency gain: same for less •Increase robustness: less product and process variation

Industrialization and sufficient quality

Pre-set in specifications:

• Quality level

• Tolerances

But how to set the ex-ante Quality level?

Industrialization, sufficient quality

Page 10: Industrialization in official statistics - European Commission · Improve process quality •Efficiency gain: same for less •Increase robustness: less product and process variation

Sufficient quality

• Specify needs and design phase

(GSBPM): intended use

• Monitor actual use

The quality of statistical information is

insufficient if a better figure resulted into

another decision.

Industrialization, sufficient quality

Page 11: Industrialization in official statistics - European Commission · Improve process quality •Efficiency gain: same for less •Increase robustness: less product and process variation

Example: Government deficit and debt

The quality is too low if

• Indicator >3% when reality <3%

• Indicator <3% when reality >3%

In case of contributions: explicit ex ante

quality with users

Industrialization, sufficient quality

Page 12: Industrialization in official statistics - European Commission · Improve process quality •Efficiency gain: same for less •Increase robustness: less product and process variation

Statistics production vs Car industry

• Really the same?

• Input quality constant?

• Interpret

• Flexibility

Industrialization, sufficient quality

Page 13: Industrialization in official statistics - European Commission · Improve process quality •Efficiency gain: same for less •Increase robustness: less product and process variation

Recommendations

• Formulate intended use

• Monitor actual use

• Aim constant quality

• Look out for similarities outside statistics

• Quality check: all ways

• Quality report: include in specifications

• Quality outside tolerances: action

Industrialization, sufficient quality

Page 14: Industrialization in official statistics - European Commission · Improve process quality •Efficiency gain: same for less •Increase robustness: less product and process variation

Conclusions (1)

• Industrialization needed for efficiency

• Standardisation needed for flexibility

Constant quality improves quality

Industrialization, sufficient quality

Page 15: Industrialization in official statistics - European Commission · Improve process quality •Efficiency gain: same for less •Increase robustness: less product and process variation

Conclusions (2)

• Quality level: depends on use

• Output channels: use oriented

• Sufficient quality:

The quality of statistical information is

insufficient if a better figure resulted into

another decision.

Industrialization, sufficient quality

Page 16: Industrialization in official statistics - European Commission · Improve process quality •Efficiency gain: same for less •Increase robustness: less product and process variation

Thank you for your attention

We don't make them like that anymore

and it's a good job too!

Max Booleman, senior methodologist and Quality Co-ordinator at Statistics Netherlands; e-mail: [email protected]

Kees Zeelenberg, Director of Methods and Statistical Policies (Chief Statistical Officer) at Statistics Netherlands, e-mail:

[email protected]

Industrialization, sufficient quality