13
Implementing ‘quality assurance procedures’ in monetary and financial statistics (MFS) Q2014 - European conference on quality in statistics Vienna, 3 June 2014 Violetta Damia Jean-Marc Israël European Central Bank Directorate General Statistics Monetary and Financial statistics Division ECB-PUBLIC

Implementing ‘quality assurance procedures’ in monetary and financial statistics (MFS)

  • Upload
    whitley

  • View
    43

  • Download
    3

Embed Size (px)

DESCRIPTION

ECB-PUBLIC. Violetta Damia Jean-Marc Israël European Central Bank Directorate General Statistics Monetary and Financial statistics Division. Implementing ‘quality assurance procedures’ in monetary and financial statistics (MFS). Q2014 - European conference on quality in statistics - PowerPoint PPT Presentation

Citation preview

Page 1: Implementing ‘quality assurance procedures’ in monetary and financial statistics (MFS)

Implementing ‘quality assurance procedures’ in monetary and financial statistics (MFS)

Q2014 - European conference on quality in statistics

Vienna, 3 June 2014

Violetta Damia

Jean-Marc Israël

European Central BankDirectorate General StatisticsMonetary and Financial statistics Division

ECB-PUBLIC

Page 2: Implementing ‘quality assurance procedures’ in monetary and financial statistics (MFS)

Rubric

www.ecb.europa.eu ©

Overview

Implementing ‘quality assurance procedures’ in monetary and financial statistics 2

1

2

3

Example 1. Enhancing MFS methodological soundness

Example 2. Revision analysis

MFS - Quality assurance procedures

4

5 Foreseen initiatives for 2014-2015

Example 3. “Top-down” analysis for balance sheet data

ECB-PUBLIC

[Please select]

Page 3: Implementing ‘quality assurance procedures’ in monetary and financial statistics (MFS)

Rubric

www.ecb.europa.eu ©

• Input: data collected from reporting agents by the NCBs and reported to the ECB

– methodologically sound data

– in line with internationally accepted standards and classifications

– ECB regulations & Guidelines set common harmonised standards

– according to a fixed and agreed timetable

• Throughput: several quality checks on the national contributions received

– completeness, internal and intra-period consistency

– external consistency

– Revision studies

– Plausibility checks

• Output: data accessibility & dissemination policy

– press releases

– ECB Statistical Data Warehouse and on the ECB’s website

Implementing ‘quality assurance procedures’ in monetary and financial statistics 3

ECB-PUBLICMFS - Quality assurance procedures (1)

Page 4: Implementing ‘quality assurance procedures’ in monetary and financial statistics (MFS)

Rubric

www.ecb.europa.eu © Implementing ‘quality assurance procedures’ in monetary and financial statistics 4

ECB-PUBLICMFS - Quality assurance procedures (2)

Main MFS statistical products Main quality elements

Monetary financial institutions balance sheet statistics

• Legal basis (Regulation or Guideline)

• Data collection (by NCBs from reporting agents) and coverage (full, modified census or stratification)

• Methodological sources (compliance with int. statistical standards)

• Reporting periodicity and transmission deadlines

• Revision policy

• Data quality management (quality checks, time series analysis, etc.)

• Compliance monitoring (~ to legal instrument)

• Dissemination (advance release calendar, press release, availability on the ECB’s Statistical Data Warehouse and on the ECB’s website, etc.)

MFS ‘hotline’ providing assistance to users on all statistical products.

Monetary financial institutions interest rate statistics

List of monetary financial institutions (MFIs)

Securities issues statistics

Payments and securities settlement systems statistics

Investment funds balance sheet statistics

List of investment funds (IFs)

Financial vehicle corporations (FVCs) balance sheet statistics

List of financial vehicle corporations (FVCs)

Page 5: Implementing ‘quality assurance procedures’ in monetary and financial statistics (MFS)

Rubric

www.ecb.europa.eu ©

• Development of MFS ~ meeting user requirements & in line with international statistical standards – also input to other stat. domains

• Until recently, several deviations with international statistical standards

– reporting units and sectors, counterpart sectors or sub-sectors, financial instruments, etc.

– other specific issues, e.g. the valuation principles applied, the treatment of accrued interest, and the treatment of non-performing loans.

• Additional requirements from users

substantial amendment of five ECB Regulations and Guideline on MFS (ECB/2014/15)

Regulations ECB/2013/33 on MFI balance sheet statistics, ECB/2013/34 on MFI interest rate statistics, ECB/2013/39 on Post Office Giro Institutions, ECB/2013/38 on Investment Funds and ECB/2013/40 on

Financial Vehicle Corporations

1st reporting in in Jan. 2015 with data for Dec. 2014 – publication in mid-2015

Implementing ‘quality assurance procedures’ in monetary and financial statistics 5

Example 1. Enhancing MFS methodological soundness ECB-PUBLIC

Page 6: Implementing ‘quality assurance procedures’ in monetary and financial statistics (MFS)

Rubric

www.ecb.europa.eu ©

• To evaluate the reliability of first releases

• Special features

– data can be revised at any release

– “ordinary revisions” vs. “exceptional” revisions (the latter related to to reclassifications and improved reporting

procedures)

• Revisions of the monthly monetary aggregates and components

differences between the revised period-on-period growth rates at a pre-determined lag and the first release

estimation of bias

Implementing ‘quality assurance procedures’ in monetary and financial statistics 6

Example 2. Revision analysis (1) ECB-PUBLIC

Page 7: Implementing ‘quality assurance procedures’ in monetary and financial statistics (MFS)

Rubric

www.ecb.europa.eu ©

Revisions to the month-on-month growth rates of M3 to better identify the timing of a given revision

Implementing ‘quality assurance procedures’ in monetary and financial statistics 7

Example 2. Revision analysis (2) ECB-PUBLIC

Figure 2: Revision of M3 growth rate (2013)

(No of occurrences (Y-axis), hundredths of a percentage point (Y-axis))

Revisions to the components of M3 at lag t+3 to understand the largest contributions to the overall M3 revisions

Page 8: Implementing ‘quality assurance procedures’ in monetary and financial statistics (MFS)

Rubric

www.ecb.europa.eu ©

• Traditionally, a “bottom-up approach” is followed for consistency and plausibility of aggregated series

focus on raw series

– vertical checks (TRUE/FALSE type of check)

– horizontal checks (based on statistical significance)

if developments are correct in raw series, they must be correct in derived aggregates

• New “top-down approach” for analysis and identification of possible special developments

focus on aggregated series

decomposition of the aggregate into its main underlying components and identification of the raw series responsible of the development

Implementing ‘quality assurance procedures’ in monetary and financial statistics 8

Example 3. “Top-down” analysis for balance sheet data (1) ECB-PUBLIC

Page 9: Implementing ‘quality assurance procedures’ in monetary and financial statistics (MFS)

Rubric

www.ecb.europa.eu ©

2-steps procedure

Step 1: run horizontal checks on selected aggregate series

– better statistical modelling of aggregates

– special development in raw series usually matters when impact on aggregate is significant

– MFI balance sheet statistics: run checks on country consolidated balance sheet

Step 2: Decompose the special development into components

– reverse engineer the set of raw series responsible for development

– ECB aggregation framework allows for identification of series dependencies in the aggregation tree

– User defined threshold, user friendly graphical output

Implementing ‘quality assurance procedures’ in monetary and financial statistics 9

Example 3. “Top-down” analysis for balance sheet data (2) ECB-PUBLIC

Page 10: Implementing ‘quality assurance procedures’ in monetary and financial statistics (MFS)

Rubric

www.ecb.europa.eu ©

Advantages:

– significantly reduce the number of processed series

– answers to typical questions such as “is development widespread?;

“which are the sectors responsible for it?”, etc

– combine checking for outliers with economic interpretation

– Step 2 can also be used independently of horizontal checks

Implementing ‘quality assurance procedures’ in monetary and financial statistics 10

Example 3. “Top-down” analysis for balance sheet data (3) ECB-PUBLIC

Page 11: Implementing ‘quality assurance procedures’ in monetary and financial statistics (MFS)

Rubric

www.ecb.europa.eu © Implementing ‘quality assurance procedures’ in monetary and financial statistics 11

Example 3. “Top-down” analysis for balance sheet data (4) ECB-PUBLIC

Page 12: Implementing ‘quality assurance procedures’ in monetary and financial statistics (MFS)

Rubric

www.ecb.europa.eu ©

Several work-streams are in the pipeline to

(1)increase MFS availability, and

(2)enhance the input to other statistical domains

•A new Regulation on assets and liabilities of Insurance Corporations

•A new Regulation on high frequency data on money market activity (MMSRR)

•The development of an “Analytical Credit dataset” (AnaCredit) across the ESCB

•the provision of necessary data for the ECB’s financial stability analysis of the euro area and to cover the European Systemic Risk Board (ESRB) needs

Implementing ‘quality assurance procedures’ in monetary and financial statistics 12

Foreseen initiatives for 2014-2015 ECB-PUBLIC

Page 13: Implementing ‘quality assurance procedures’ in monetary and financial statistics (MFS)

Rubric

www.ecb.europa.eu © Implementing ‘quality assurance procedures’ in monetary and financial statistics 13

ECB-PUBLIC