13
Assessment & Feedback The Devil is in the Detail. David Kane Birmingham City University [email protected]

Assessment & Feedback The Devil is in the Detail. David Kane Birmingham City University [email protected]

Embed Size (px)

Citation preview

Page 1: Assessment & Feedback The Devil is in the Detail. David Kane Birmingham City University david.kane@bcu.ac.uk

Assessment & Feedback The Devil is in the Detail.

David Kane

Birmingham City [email protected]

Page 2: Assessment & Feedback The Devil is in the Detail. David Kane Birmingham City University david.kane@bcu.ac.uk

Background• Examination of assessment & feedback in the

light of findings and concern in the UK National Student Survey;

• NSS reports that the lowest scoring course items relate to Assessment & Feedback;

• Institutions urged to ‘look at their data’;• Many institutions have been doing just that for

many years;• Analysis of existing data indicates that change

has resulted from efforts to address concerns.

Page 3: Assessment & Feedback The Devil is in the Detail. David Kane Birmingham City University david.kane@bcu.ac.uk

Approach• Student Satisfaction Approach – from 1989;• NSS items:

– 7. 'Feedback on my work has been prompt;’– 9. 'Feedback on my work has helped me clarify things I

did not understand;’• Usefulness of feedback;• Promptness of feedback;• Overall;• Discipline;• Mode of Study;• Personal Characteristics:

Age Ethnicity Gender

Page 4: Assessment & Feedback The Devil is in the Detail. David Kane Birmingham City University david.kane@bcu.ac.uk

Improvement (1)Overall satisfaction with usefulness of feedback,

Universities 1,2 & 3 1996–2007

40

45

50

55

60

65

70

1996 1997 1998 1999 2000 2001 2002 2003 2004 2005 2006 2007

Univ 1

Univ 2

Univ 3

Satisfactory

Page 5: Assessment & Feedback The Devil is in the Detail. David Kane Birmingham City University david.kane@bcu.ac.uk

Improvement (2)Overall satisfaction with promptness of feedback,

Universities 1,2 & 3 1996–2007

40

45

50

55

60

65

70

1996 1997 1998 1999 2000 2001 2002 2003 2004 2005 2006 2007

Univ 1 Univ 2

Univ 3 Satisfactory

Page 6: Assessment & Feedback The Devil is in the Detail. David Kane Birmingham City University david.kane@bcu.ac.uk

Variation by variable - Discipline

• 2005 NSS showed differences in mean scores between disciplines;

• Most institutions do not provide breakdowns by discipline – Faculty based;

• Science related subjects score less well.

Page 7: Assessment & Feedback The Devil is in the Detail. David Kane Birmingham City University david.kane@bcu.ac.uk

Variation by variable – Level, Mode & Year of Study

• Part-time students more satisfied than full-time;

• PGT students more satisfied than UG;

• 1st years more satisfied than those in later stages of study: ‘moments of stress’ issue?

• Local issues will impact upon ratings.

Page 8: Assessment & Feedback The Devil is in the Detail. David Kane Birmingham City University david.kane@bcu.ac.uk

• NSS reports differences based on age, ethnicity & gender;

• Female students/ aged 25+ more satisfied than male students/ aged <25;

• Asian and Chinese students less satisfied than those from other ethnic origins. Black students more satisfied.

Variation by variable – Personal Characteristics

Page 9: Assessment & Feedback The Devil is in the Detail. David Kane Birmingham City University david.kane@bcu.ac.uk

Age

30

35

40

45

50

55

60

65

70

75

80

85

90

95

100

1996 1997 1998 1999 2000 2001 2002 2003 2004 2005 2006 2007

<25

25 +

Satisfaction with usefulness of feedback by age, University 1, 1996–2007

Page 10: Assessment & Feedback The Devil is in the Detail. David Kane Birmingham City University david.kane@bcu.ac.uk

Ethnicity

30

35

40

45

50

55

60

65

70

75

80

85

90

95

100

1996 1997 1998 1999 2000 2001 2002 2003 2004 2005 2006 2007

Asian

Black

Chinese

White

Satisfaction with usefulness of feedback by ethnicity, University 1, 1996–2007

Page 11: Assessment & Feedback The Devil is in the Detail. David Kane Birmingham City University david.kane@bcu.ac.uk

Gender

30

35

40

45

50

55

60

65

70

75

80

85

90

95

100

1996 1997 1998 1999 2000 2001 2002 2003 2004 2005 2006 2007

Female

Male

Satisfaction with usefulness of feedback by gender, University 1, 1996–2007

Page 12: Assessment & Feedback The Devil is in the Detail. David Kane Birmingham City University david.kane@bcu.ac.uk

Conclusions

• What has looking at the data achieved;

• Improvements year on year;

• Upward trend for student satisfaction;

• Variation according to different variables;

• The importance of the local context;

• That the devil is in the detail.

Page 13: Assessment & Feedback The Devil is in the Detail. David Kane Birmingham City University david.kane@bcu.ac.uk

Assessment & Feedback The Devil is in the Detail.

David Kane

Birmingham City [email protected]