1
Empowering the NSS with the use of contextual information Dr Fabio R. Aricò School of Economics University of East Anglia [email protected] BACKGROUND National Student Survey (NSS) Running since 2005 Born as orientation tool for prospective students Increasing relevance and participation: Quality Assurance Fundamental to Government’s White Paper 06/10 “Students at the Heart of the System” Reference point to KIS indicators and League Tables CRITICISM Rough instrument – Difficult to interpret Does not measure Student’s Engagement Biased by students’ “survey fatigue” Used in a strategic way by many institutions QUESTIONS How to improve/preserve NSS scores or relative positioning? How to use the NSS output to improve the Student’s Experience? How to use the NSS output to improve learning & teaching? EMPOWERED APPROACH TO THE NSS Student’s Experience measured by NSS Inner L&T Factors : teachers and teaching administration students/teacher ratio IT provision and L&T facilities student population composition... Inner Contextual Factors : campus environment sports facilities Outer Contextual Factors : geographic location, climate shopping and services travel and transport rate of criminality... METHODOLOGY 1. for each HE institution, collect data on: Inner L&T factors, Inner Contextual Factors, and Outer Contextual Factors data is publicly available 2. estimate the relative impact of each factor affecting the NSS score 3. use the empirical findings to bring appropriate changes or to react strategically ADVANTAGES can assess what is the relative impact of different L&T dimensions on student’s satisfaction and provide feedback to administration and teaching practices can counteract the negative effect of factors not under HE control by introducing “compensation policies” create “own” specific model of excellence can use the model to dialogue with local and central government authorities can use the model to provide consultancy to HE institutions EXAMPLE Consider: No.PCs = Inner L&T Factor directly measured by NSS under HE control No.Bars = Inner Contextual Factor not directly measured by NSS under HE control Criminality = Outer Contextual Factor not directly measured by NSS not under HE control Estimate: NSS = 3 (No.PCs) + 2 (No.Bars) – 3 (Criminality Rate) Problem: Criminality 1% NSS 3 points Solutions: 1. dialogue with police authorities to increase security 2. No.PCs 1 NSS 3 points (back to previous level) 3. No.Bars 2 NSS 4 points (even 1 point higher) Conclusion: choose the cheapest / most convenient / most effective option to preserve or to increase the NSS score create own way to be excellent! • catering and recreation advice and support...

FR Arico - Empowering the NSS

Embed Size (px)

Citation preview

Page 1: FR Arico - Empowering the NSS

Empowering the NSS with the use of contextual information

Dr Fabio R. AricòSchool of EconomicsUniversity of East [email protected]

BACKGROUND

National Student Survey (NSS)• Running since 2005 • Born as orientation tool for prospective students• Increasing relevance and participation: Quality Assurance Fundamental to Government’s White Paper 06/10 “Students at the Heart of the System” Reference point to KIS indicators and League Tables

CRITICISM

• Rough instrument – Difficult to interpret

• Does not measure Student’s Engagement

• Biased by students’ “survey fatigue”

• Used in a strategic way by many institutions

QUESTIONS

• How to improve/preserve NSS scores or relative positioning?

• How to use the NSS output to improve the Student’s Experience?

• How to use the NSS output to improve learning & teaching?

EMPOWERED APPROACH TO THE NSS

Student’s Experiencemeasured by NSS

Inner L&T Factors:• teachers and teaching administration• students/teacher ratio• IT provision and L&T facilities• student population composition...

Inner Contextual Factors:• campus environment• sports facilities

Outer Contextual Factors:• geographic location, climate• shopping and services• travel and transport• rate of criminality...

METHODOLOGY

1. for each HE institution, collect data on: Inner L&T factors, Inner Contextual Factors, and Outer Contextual Factors data is publicly available

2. estimate the relative impact of each factor affecting the NSS score

3. use the empirical findings to bring appropriate changes or to react strategically

ADVANTAGES• can assess what is the relative impact of different L&T dimensions on student’s

satisfaction and provide feedback to administration and teaching practices

• can counteract the negative effect of factors not under HE control by introducing “compensation policies” create “own” specific model of excellence

• can use the model to dialogue with local and central government authorities

• can use the model to provide consultancy to HE institutions

EXAMPLE

Consider: No.PCs = Inner L&T Factor directly measured by NSS under HE control

No.Bars = Inner Contextual Factor not directly measured by NSS under HE control

Criminality = Outer Contextual Factor not directly measured by NSS not under HE control

Estimate: NSS = 3 (No.PCs) + 2 (No.Bars) – 3 (Criminality Rate)

Problem: Criminality 1% NSS 3 points

Solutions: 1. dialogue with police authorities to increase security 2. No.PCs 1 NSS 3 points (back to previous level) 3. No.Bars 2 NSS 4 points (even 1 point higher)

Conclusion: choose the cheapest / most convenient / most effective option to preserve or to increase the NSS score create own way to be excellent!

• catering and recreation• advice and support...