Statistics New Zealand navigates towards online data collection:Planning and implementing an Internet-based survey

Emma Mawby, Helen Smith, and Colin Hewat

Statistics New Zealand

September 2013

SummarySuccessful Internet mode for census

Stats 2020 strategic priorities

Transform Collections Programme

Interim Internet Project

Challenges

Selecting the questionnaire design tool

Selecting the initial survey

Designing the questionnaire

Implementing Internet mode

Lessons learnt

Apr 19, 2023 2UNECE Seminar on Statistical Data Collection

Successful Internet mode for census

2006 Census – 7 percent completed online

2013 Census – 35 percent completed online

2013 Census pilot area – more than 65 percent completed online

Apr 19, 2023 3UNECE Seminar on Statistical Data Collection

Stats 2020 strategic priorities

1. Lead Official Statistics System so it efficiently produces the information New Zealand needs.

2. Obtain more value from the country’s investment in official statistics.

3. Transform the way Statistics NZ delivers statistics.

4. Be a more responsive, customer-focused, influential, and sustainable organisation.

Apr 19, 2023 4UNECE Seminar on Statistical Data Collection

Transform Collections Programme

Supports strategic priority 3: transform the way we deliver statistics

Design, develop, and implement a future operating model that will harness current technologies

Apr 19, 2023 5UNECE Seminar on Statistical Data Collection

Interim Internet Project

Staged and sequenced approach

Key success criteria included: • easy migration, logon, and authentication processes• respondent-specific pre-population of questionnaire

fields• respondent-customisable survey communications

Apr 19, 2023 6UNECE Seminar on Statistical Data Collection

Challenges

Common to other countries

Expected to adopt new technology quickly

Respondent experience

Mode effects

IT requirements for Internet questionnaires

Specific to New Zealand

Method of first contact

Privacy, security, authorisation, and authentication

Apr 19, 2023UNECE Seminar on Statistical Data

Collection7

Selecting the questionnaire design tool

‘Off the shelf’ rather than ‘bespoke’

Requirements:• cloud source based in New Zealand• functional requirements

– complex routing, calculations, data piping, validation

• easy to control look and feel of the questionnaire

Apr 19, 2023 8UNECE Seminar on Statistical Data Collection

Selecting the initial survey

‘Phased analysis, phased roll-out’ solution

‘Do-learn-do’ approach

New Zealand Energy Use Survey selected

Apr 19, 2023 9UNECE Seminar on Statistical Data Collection

Designing the questionnaire

Maximise benefits of Internet

Retain consistency with paper questionnaire

Minimise impact of mode effects

Respondents liked the finished product!

Apr 19, 2023 10UNECE Seminar on Statistical Data Collection

Implementing the Internet mode

Modes offered sequentially – Internet then paper

Issues:• security and privacy of pre-populated fields• authentication

Apr 19, 2023 11UNECE Seminar on Statistical Data Collection

Lessons learnt

Challenges larger or smaller than they seemed

Assumptions should be investigated

Insights:• unified objectives should drive the chosen approach• align aims with wider initiatives• unique situations need unique solutions

Apr 19, 2023 12UNECE Seminar on Statistical Data Collection