Statistics 2020 and Platform Approach

Te Käpehu Whetü

May 2011

Agenda

Current Legacy ArchitectureStatistics NZ Strategic Plan 2010-20Te Käpehu Whetü - Statistics 2020IT Strategy 2009–12Platform-based ArchitectureReuse, Integration and TransitionCurrent State of PlayStrategic Benefits

February 2011 2End to End Architecture Framework

3

Current Stovepiped Architecture

Collect50+ Collection

Systems

CollectionSystem 1

CollectionSystem 2

CollectionSystem 3

CollectionSystem 4

CollectionSystem 5

CollectionSystem 6

CollectionSystem 7

CollectionSystem 8

…

CollectionSystem 50

Process80+ Processing

Systems

ProcessingSystem 1

ProcessingSystem 2

ProcessingSystem 3

ProcessingSystem 4

ProcessingSystem 5

ProcessingSystem 6

ProcessingSystem 7

ProcessingSystem 8

ProcessingSystem 9

ProcessingSystem 10

ProcessingSystem 11

ProcessingSystem 12

ProcessingSystem 13

ProcessingSystem 14

ProcessingSystem 15

ProcessingSystem 16

…

ProcessingSystem 80

Analyse50+ Output Systems

OutputSystem 1

OutputSystem 2

OutputSystem 3

OutputSystem 4

OutputSystem 5

OutputSystem 6

OutputSystem 7

OutputSystem 8

…

OutputSystem 50

Disseminate25+ Dissemination

Systems

DisseminationTool 1

DisseminationTool 2

DisseminationTool 3

…

DisseminationTool 25

Statistics NZ Strategic Plan 2010-20

4

Te Käpehu Whetü – Statistics 2020

A waka is navigated by aligning the points of the craft with the points on the horizon where the sun and particular stars rise and set

Whetu (the stars) Kapehu (compass)

Generic Business Process Model

Describes Statistics NZ's end-to-end statistical business processIt has been used as a model for international GSBPMProcesses are generic, across Statistics NZ, down to the sub-process level for all statistical collections and outputs

6

Need Develop & Design Build Collect Process Analyse Disseminate

Need Develop & Design Build

Corporate

Statistical Architecture Framework

7

Collect Process Analyse Disseminate

Colle

ction

Diss

emin

ation

Standards & Methods

Infrastructure

Micro EconomicMicro Economic

Macro EconomicMacro Economic

Social and PopulationSocial and PopulationCENSUSCENSUS

IT Infrastructure

Platforms

Tools & Services

Data

Enterprise Architecture Framework

8

Need Develop & Design Build Collect Process Analyse Disseminate

Sup

ports

9

Enterprise Architecture FrameworkPlatforms

Tools & Services

Data

4

IT Infrastructure

Foundation Services

SQL Server (RDBMS)

SQL Server Integration Svcs

SQL Server Analysis Svcs

SQL Server Reporting Svcs SAS .Net Framework Internet Explorer MSCRM

Statistical Services Non Statistical Services Corporate Services

Statistical Data Non Statistical Data Corporate DataHH Survey Unit

Record

Time Series

Micro Economic Unit Record

Geospatial

Address Register

CENSUS

ClassificationsHousehold Frame

Business Frame Static & Dynamic

Research & Analysis Metadata

Concept Library

Statistical Activity Metadata

Runtime Metadata

Question Metadata

Location & Access Metadata

Collection Metadata

Paradata

Configuration

Customer

Finance

Human Resource

Editing(BANFF)

Selective Editing(SELEKT )

ConfigurationManagement

Collection Data PickupAggregation

Confidentiality Time Series Processing

Time Series Tools

Seasonal Adjust(X-12-ARIMA)

Classification Services

Dataset Definition Services Dataset CreationCoding

Imputation(BANFF)

Calc Weights(GregWt)

Jackknife(Estimation) Paradata Analysis Advertise

Metadata Management

Metadata Search

Customer Management

Workforce Management

Workflow

Editing (CANCEIS )

Imputation(CANCEIS )

Existing ProposedLegend:

Frames & Sampling

Collection

Micro-Economic

Macro-Economic

Social & Population

Dissemination

Information Analysis

Information Access

Metadata

Geospatial

Standards & Classifications

Platforms & Services Reuse

10

Platforms

Foundation Services

Tools & Services

Platform A Platform B

Combination of tools & services to perform business processes

Specialised – perform individual tasks

Performs task specific to collection

Reusable within platform

Platforms & Services Reuse

11

Platforms

Foundation Services

Tools & Services

Platform A Platform B

Combination of tools & services to perform business processes

Specialised – perform individual tasks

Performs task specific to collection

Reusable within platform

Cloud Services

12

Transition Phases – Current

Stats.govt.nzPOSS, BESt, DNA

Dissemination systems

25+

Processing systems

80+

Collection systems

50 +

Analysis/output systems

50 +

DisseminateProcessCollect Analyse(Produce Statistics)

Platforms

LegacySystems

Statistical Infrastructure systems – 50+

13

Transition Phases – Transition

Stats.govt.nz

Dissemination Platform

POSS, BEST & DNAHLFS Sub Annual

Surveys

DisseminateProcessCollect Analyse(Produce Statistics)

Platforms

LegacySystems

Statistical Infrastructure systems (foundation tools & services)

14

Transition Phases – Future

Stats.govt.nz

Dissemination Platform

Micro Economic PlatformMacro Economic Platform

Household & Population Platform

Collection Platform

DisseminateProcessCollect Analyse(Produce Statistics)

Platforms

LegacySystems

Statistical Infrastructure systems(foundation tools & services)

Household Survey Platform

15

Household Survey Platform - Survey Portal

Data Management

Metadata Management

Process Management Classify & Code

Micro Edit

Derive

FinaliseImpute

Calculate & Apply Weights Quality Assurance

Classify & Code5.1

Perform Micro Editing

5.2

Impute Missing Data5.3

Derive New Variables

5.4

Calculate & Apply Weights

5.5

Integrate Data5.6

Finalise Unit Record Data

5.7

Acquire Domain Intelligence

6.1

Produce Statistics

6.2

Check Quality of Statistics

6.3

Interpret & Explain

Statistics6.4

Prepare Statistics for

Dissemination6.5

Finalise Content6.6

5 Process

6 Analyse

Sup

ports

Aggregate Seasonally Adjust Confidentialise Advertise

Define Dataset

Household Survey Platform

16

Household Survey Platform - Survey Portal

Statistical Tools & Services Non Statistical Tools & Services

Data

IT Infrastructure

Data Management

Metadata Management

Classifications Configuration Process Logging Questionnaire Performance Household Frame Household Survey

Process Management Classify & Code

Micro Edit

Derive

FinaliseImpute

Calculate & Apply Weights

Quality Assurance

CodingCANCEIS (Imputation)

GregWt (Estimation)

Jackknife (Estimation)

ConfigurationManagement

Collection Data Pickup

Questionnaire Perform’ Analysis

SQL Server (RDBMS)

SQL Server Integration Services

SQL Server Analysis Services

SQL Server Reporting Services SAS .Net Framework Internet Explorer

Excel

Aggregation

Confidentiality Time Series Processing

Time Series Tools

Advertise

Time Series

Aggregate

Seasonally Adjust Confidentialise

X12(Seasonally Adjust)

Classification Services

Define Dataset

Micro Economic Platform

17

Micro Economic Platform – BESt UI

Data Management

Metadata Management

Process Management

Micro Edit

Derive

Impute

Quality Assurance

Classify & Code5.1

Perform Micro Editing

5.2

Impute Missing Data5.3

Derive New Variables

5.4

Calculate & Apply Weights

5.5

Integrate Data5.6

Finalise Unit Record Data

5.7

Acquire Domain Intelligence

6.1

Produce Statistics

6.2

Check Quality of Statistics

6.3

Interpret & Explain

Statistics6.4

Prepare Statistics for

Dissemination6.5

Finalise Content6.6

5 Process

6 Analyse

Sup

ports

Aggregate Seasonally Adjust Confidentialise Publish

Define Dataset

Micro Economic Platform

18

Micro Economic Platform – BESt UI

Statistical Tools & Services Non Statistical Tools & Services

Data

IT Infrastructure

Data Management

Metadata Management

Classifications Configuration Process Logging Business Frame Micro Economic

Process Management

Micro Edit

Derive

Impute

Quality Assurance

BANFF (Imputation) SELEKT (Editing) Configuration

ManagementCollection Data

Pickup

SQL Server (RDBMS)

SQL Server Integration Services

SQL Server Analysis Services SAS .Net Framework

Aggregation

Confidentiality Time Series Processing

Time Series Tools

X12(Seasonally Adjust)

Classification Services

Info Access – Dataset Def’n Svcs

Info Access – Dataset Creation

Define Dataset

Advertise

Strategic Benefits

5 Key Benefits

Continued supply of

important and trusted

statistics (B1)

An agile and responsive NSO able to respond

to changing needs (B2)

Costs to government, businesses,

and households

minimised (B3)

Increased use of government data

(B4)

Government has confidence that its investment in official statistics

is value-for-money

(B5)