Quality of assessment

Quality of Assessment

Issues

• 1. How can the need for learners to pass assessment distort the curriculum content and teaching & learning?

• 2. How far do we assess only what we can grade - especially ‘numerically’?

• 3. Does assessment act as a gate-keeping mechanism to exclude rather than include?

• 4. Why are there tensions between ‘unseen exams/tests’ and coursework?

Previously we discussed Assessment methods

• Initial/ diagnostic

• Formative

• Summative

Mastery and Developmental

Mastery Objectives• Essential skills and knowledge which underpin course

studied• Assessed on pass/fail basisDevelopmental Objectives• Apply skills and knowledge in structured way to subject

and wider curriculum- e.g. transferable skills• Evaluation, analysis, interpretation, synthesis• Assessed on formative or graded basis

• http://pandora.cii.wwu.edu/cii/resources/outcomes/objectives.asp

MM DD

Bloom

Read Dunn’s Paper

• identify which of the outcome types are ‘mastery’ and which are ‘developmental’

• Suggest appropriate assessment methods in each section which are relevant to your subject specialism

Judging assessment quality

VACSR

Reliability

Getting the assessment right

• Consistent- the same result each timeMethods to ensure reliability: (what do you think?)• Marking scheme• Answer guideCertain types of assessments tend to be more reliable:

(?)• Oral questions with answer guide• Multiple choice• Closed questions• Assignments with suggested evidence --- TASK 2

Validity

Validity is all about getting the right assessment. If an assessment is valid it is measuring what it is supposed to be measuring.

For example, within the psychomotor domain (physical/manual skills) you would want them to demonstrate the skill rather than write about it.

Validity and Reliability

• Validity is concerned with getting the right assessment and reliability is concerned with getting the assessment right.

Reece, I. & Walker, S. (2000) Teaching, Training and Learning. Business Education Publishers, Sunderland (p. 420)

Sufficiency

This is to do with the amount of work the students have to do for you to determine whether they can do something or know something to a particular level.

Authenticity

“Is it real?” On a horticultural course is performing a gardening task

indoors in a pot is authentic?

PlagiarismAlso we need to ask, is the work their own.We can assess whether work is authentic as you get a feel

for the level that your learners are at.

So the work (as far as is possible) needs to be in an Authentic setting as well as authentic to the person that has produced it.

• Task 5

Currency

• Is it up to date?

…in class…

Today’s Targets

• Review previous session’s content

• Evaluate assessment types using key terminology

• Distinguish mastery from developmental objectives and assessment methods

• Define and exemplify key assessment quality terms

Group TaskIdentify one formative assessment and one summative assessment used by one member of the group. For each one make judgements about it according to reliability, validity, authenticity, sufficiency and fairness

VASK Doc

Review

• Look at your notes and the activities

• Text

• - one thing that is clear and useful

• - one thing that’s a bit muddy still