Criterion-Referenced Testing and Curriculum-Based Assessment

EDPI 344

Class Outline

Group summaries

Article presentation

Group work

Principles in Constructing a CRT

1. Define clearly your learning task.

2. Define learning objectives.

3. Specify standards of performance.

4. Adequate sample of behaviours.

5. Items reflecting specific behaviours from the instructional objectives.

6. Scoring system.

Criterion Referenced Testing

CRT focused on description; Standardized (RT) classification.

CRT are important to determine what to teach.

By designing your own CRT, you are sure that you included all the contents and goals you want to teach.

Curriculum Based Assessment

Involves the measurement of the level of a student in terms of the expected curricula outcomes of the school.

Students are assessed based on the school’s curriculum.

Uses:

Assess students’ performance in the curriculum

Role of instructional material

Students’ errors and missing skills

Criterion-Referenced Curriculum-Based Assessment

Focuses on measurement of student mastery of objectives derived from classroom performance

CBA is not standardized, therefore comparison between subjects, schools is not feasible.

CR CBA is used for planning purposes.

CBM is more adequate to monitor the curriculum and decision making.

Why to design clear criteria and standards for grading????

Save time in the grading process

Allow you to make grading consistent and fair

Help students participate in their own learning, because they know what they are aiming for

Save you from having to explain your criteria to students after they have handed in their work, as a way of justifying the grades they are contesting

Primary Trait Analysis

PTA creates a scoring rubric that can be used to assess any student performance or portfolio of student performances.

Could be used to establish criteria for an external exam or for classroom work.

Unstated Criteria

Criterion Referenced

Norm referenced scoring

Criterion Referenced Scoring

Steps for constructing a PTA scale

1. Choose a test or assignment that tests what you want to assess.

2. Identify the criteria or traits that will count in the evaluation. They have to be nouns or noun phrases.

3. For each trait construct a two-to five-point scale.

4. Try out the scale with a sample of student work or review with colleagues.

Rating scales

Indicate the degree to which a particular dimension (trait, skill, knowledge) is present.

Three to ten is a good number.

The more number of points you include, the more informative for the student.

Descriptive (never, seldom, occasionally, frequently, always).

Gradation of the criteria (novice, intermediate, advanced, superior).

Rubrics

Scoring guide that uses criteria to differentiate between levels of student proficiency.

Organize and clarify the scoring criteria.

Related to assessment for learning.

Should be criterion-referenced (compare the students’ performance with the expectation).

No supporting arguments

Few supporting arguments that have weak plausibility and relevance

Some supporting arguments that have acceptable plausibility and relevance

Many supporting arguments that are clearly plausible and relevant

How to develop rubrics

Determine the levels of performance

Theory

Experts

Your own experience

Select performance samples and rank them.

Try the rubric.

Determine if the rubrics are holistic or analytical.

Comparison between Holistic and Analytic Rubrics

Each category contains several criteria, overall impression.

Quick grading.

Little indication of the criteria used to make judgments.

Each criterion receives a separate score.

Meaningful feedback.

Take longer to create and score.

Rubrics checklist

o Do criteria focus on important aspects of the performance?

o Is the type of rating matched with purpose?

o Are the traits directly observable?

o Are the criteria understandable?

o Are the traits clearly defined?

o Is scoring error minimized? (Halo effect, personal bias, generosity, severity…)

o Is the scoring system feasible?

Class exercise

1. Describe the characteristics of an “excellent” brownie .

2. Determine if holistic or analytic scale should be use.

3. Three groups: “pretty good”; “fair” & “poor”. Each group should link their characteristics with those defined for “excellent” cake.

4. Post the charts in order: 4=Excellent; 3=Pretty good; 2=Fair; 1=Poor. Check for value judgements or personal preferences.

Class exercise (2)

1. Volunteers… Use your senses to describe what you observe and taste. Then, determine which score point on the rubric most nearly matches your observation. Not comparisons please!!!

2. Refine the rubric criteria.

3. Discussion…

1. What considerations would you make for rubrics in inclusive classrooms?

2. Would you be willing to share with your students the design of these rubrics?

Triangle, square, and circle summary

Write 3 important points to remember

Write something that is squared away in your mind

Write a question that is still going around in your mind

Triangle, square, and circle summary