Assessment. Workshop Outline Testing and assessment Why assess? Types of tests Types of assessment...

Assessment

AssessmentWorkshop OutlineTesting and assessmentWhy assess?Types of testsTypes of assessmentSome assessment task typesBackwashQualities of a good testHow to increase reliabilityEvaluation of test materials (course books,

Cambridge tests)Discussion/ reflection on testing issues

Testing Vs AssessmentTesting is one way, and one way only, of

finding out about the performance or progress of learners.

Examples would include giving learners a picture dictation (this gives us information about listening and spelling) giving them a correct the error text (this gives us information about writing/spelling/vocabulary/ grammar), or a giving matching exercise (this gives us information about reading/listening comprehension, vocabulary/grammar).

Testing Vs Assessment

Assessment refers to the different ways we can measure our learners’ progress or performance.

We can measure progress or performance, for example, by observing learners’ work in class, asking them what they find easy of difficult, testing them, or by looking at their homework.

Why assess?

to provide feedback to learners on their progress (e.g. what they have done well and what they need to improve)

to provide feedback to learners on their achievement (ie how much they have learned at a particular point in time)

Why assess?

to get information about learners’ ability to understand or use target language structures or vocabulary – help teachers know how to help their learners

to get information about learners’ skills development

Why assess?

to find out whether learners like or dislike specific classroom activities (you could collect this information by asking and by observing)

For diagnostic purposes: to use information about learners’ strengths and weaknesses to provide information which can feed in to planning

Why assess?

to let learners know what standards they need to reach

to see whether learning objectives are being achieved

to provide records for schools

to provide information to parents

Types of Tests

1.Achievement test – measure what learners have learnt on a language course – usually given at the end of the course

2.Placement test – used before the beginning of courses, to determine learners’ language levels’ and based on this information ‘place’ them in the classes most appropriate for them

Types of Tests

3.Diagnostic test – identify learners’ strengths and weaknesses. Helps teachers to make decisions on what needs to be taught

4.Progress test – measure learners’ progress during a language course

Types of Tests

5. Proficiency test - measures language ability and based on what is needed for a particular purpose, e.g., English for secretaries, English for car mechanics etc

6. Summative test – end of year/end of course test measuring learners’ overall achievement of course objectives

Types of Tests

7.Objective test – scored according to ‘right’ or ‘wrong’ answers, ie, non-judgmental on part of examiners

8.Subjective test – compared to objective tests, the examiner judges learners’ answers

9.Oral test – measures learners’ speaking abilities

Types of AssessmentContinuous assessment

Learners are assessed regularly throughout their course, to provide both teachers and learners information on what they can do and identify any areas of weaknesses.

Formative assessment/evaluation This is developmental. It provides information about

learners’ understanding and helps to identify problems and give feedback to learners on what they need to do to improve. It is not graded pass/fail.

Types of AssessmentFormal assessment/evaluation

This involves the use of tests given to all learners in an institution studying at the same level. Learners receive a grade or score which indicates whether they have passed or failed.

Informal assessment/evaluation This is subjective, often carried out during normal

lesson activities. Teachers observe learners carrying out tasks and make judgements on how well they are performing.

Types of Assessment

Peer assessment/evaluation Learners provide feedback to their classmates

on their work.

Self-assessment/evaluation Learners monitor their own progress and

decide how well they are doing and which aspects they need to work on.

Some Assessment Task TypesOpen comprehension questionsTrue/ FalseMatchingSentence completionMultiple choiceClozeSentence transformationGap-fillEssaysRole plays

Backwash

Backwash = the effect of testing on teaching and learning Harmful

Backwash Beneficial

BackwashBackwash harmful if the test content

and test techniques are at variance with the objectives of the course.

Backwash beneficial when the test can improve language education, and integrate all parts of language competence.

Qualities of a Good Test

1. Validity2. Reliability3. Practicality

ValidityA test is valid if it tests what it sets out to

test.

ValidityContent validityConstruct validityFace validityPredictive validityConcurrent validity

ReliabilityTo have a reliable test, the results should be

consistent over time.

ReliabilityTest reliability (high if sample size is large;

low if sample size is small)Scorer reliability (high objective types; low

subjective types)

Practicality

A test should be economical in terms of Time MoneyResources (human, equipment, etc.)

How to increase reliability

1. Take enough samples of behaviour2. Do not allow candidates too much freedom 3. Write unambiguous items4. Provide clear and explicit instructions5. Ensure that tests are well laid out and

perfectly legible

How to increase reliability

6. Candidates should be familiar with test format and testing techniques

7. Provide uniform and non-distracting conditions of administration

8. Use items that permit scoring as objective as possible

9. Make comparisons between candidates as direct as possible

How to increase reliability

10.Provide a detailed scoring key11.Train scorers12.Agree acceptable responses and appropriate

scores at the outset of scoring13.Identify candidates by numbers, not names14.Employ multiple, independent scoring

References

Hughes, Arthur (2001) Testing for Language Teachers, CUP

TKT Essentials – materials on Assessment Types and Assessment activities (English global products: The British Council 2008)