51
Quality Series: Quality in Assessment With Marc Ratcliffe

Quality in assessment

Embed Size (px)

Citation preview

Quality Series: Quality in

Assessment

With Marc Ratcliffe

Poll – What is your RTO role?

Opener - Thinkable

1. Hole in One 4. Prison Sentence2. Walking on Air 5. Walk in the Woods3. Easel 6. Pigs in a Blanket

The Quality Series

1. Quality in Administration2. Quality in Training3. Quality in Assessment4. Quality in Engagement with Stakeholders5. Quality for Students

The Quality Series

1. Quality in Administration2. Quality in Training3. Quality in Assessment4. Quality in Engagement with Stakeholders5. Quality for Students

Agenda

1 •What is Quality Assessment?

2 •Key Compliance Responsibilities

3 •The Importance of the Assessment Tool

4 •Tips and Templates

5 •Methods for improving the experience

What is Quality Assessment?

What is Quality Assessment?

Nail the evidence.

Organise yourself.

Be realistic about what you can capture.

Trial, review and refine.

Have great systems for recording and reporting.

What is your biggest issue experienced in planning, conducting or reviewing

assessment?

What are our key Compliance Responsibilities?

Standard 1The RTO is responsive to industry and learner needs and meets the requirements of training packages and VET accredited courses.

Implementing a comprehensive Training and Assessment Strategy (Clauses 1.1-1.14)

What?Where?

How?

Who?

Why?

Key points• It helps to determine whether the amount

of assessment conducted is sufficient.• It is in place to protect the integrity of the

qualification and the robustness of the outcomes.

• It supports a better transition from the learning environment to the workplace, as candidates can prove that they have skills and knowledge specified in a relevant training product (and needed by the job).

What ? - The Assessment Journey

Technical Principles of Assessment

Rules of Evidence

Elements,P.C.

Performance

Evidence

Knowledge

EvidenceAssessment

Conditions

Where? – Environment

How? – Capturing Evidence

Who? – Assessor and Validators

Qualifications

Vocational Competence

Reflecting on the needs of industry

Why do we need independent external validation?

Why? – PurposeJustification Statement, which shows the relationship between the standards and your assessment system.

30 Second Stretch Break

Importance of Assessment Tool

Assessment Tool

Mapping

Instructions

Marking GuideDevelop

instrumentsExternal Validation

Other Reference Material

Developing Assessment Tools

When developing assessment tools there are three main steps:

1. Planning

2. Design and Development

3. Quality Checks.

1. Planning

Clarify the evidence requirements

Review the components of the training package or accredited course and identify all of the requirements a learner needs to show to demonstrate competency.

This may mean that multiple and varied assessment methods are required.

Consider how a learner will:

• demonstrate the task;• know what they need to do to complete the task and why; and• demonstrate they have the ability to perform the tasks in different contexts and environments.

Importance of Assessment Tool

Activity

What role does industry

consultation have in clarifying

requirements?

Determine Assessment Methods

Some things to consider:

• Who is the learner cohort?

• Who will collect the evidence?

• Where will the assessment

be conducted?

17

• When will it be conducted?

2. Design and Development- five considerations

Content and conditions of assessment.

Task to be administered to the candidate.

An outline of the evidence to be gathered from the candidate.

Evidence criteria used to judge quality of performance

Administration, recording and

reporting requirements.

Context and conditions

The context and conditions of the assessment clarify the target group and the purpose of the tool and is recorded in instructions for the assessor, the learner and any contributing third party.

The instructions should be appropriate for the reader and can be included with the assessment instrument or attached as a separate document.

ActivityList some considerations for context and conditions in assessment.

Training package requirements and industry consultation may identify conditions to be considered when conducting assessment such as:

• equipment or material requirements• contingencies• specifications• physical conditions• relationships with team members and supervisors• relationships with clients/customers• timeframes for completion.

Tasks to be administered

Tasks to be administered

Do

SayWrite

Create

The instructions you provide to the student should outline the task(s) through which a learner can demonstrate competency.

Administration, recording and reporting

35

Securely retain

Sufficient data

Assessors and learners need

to be informed

Retain actual piece of work

(where possible)

Assessor feedback

3. Quality Checks

Quality Checks – Trialling, Reviewing and Refining

To ensure that your assessment tools are consistent with the requirements of the training package and that they maintain their currency, sufficiency and effectiveness, it is important that they are trialled, reviewed and refined before use.

Question: What could be involved in these quality checks prior to final implementation of the assessment tool?

Benefits of Trialling, Reviewing and Refining…

Consultation with industry can help to confirm:

• _______ accuracy;

• ________ to workplace; and

• _______________ of language.

Content

Relevant

Appropriateness

Benefits of Trialling, Reviewing and Refining…

• Address all the _____________ of Training Packages/Accredited Courses;

• Enable ________ collection of evidence; and

• Provide _____instructions which can easily be understood by learners, assessors and any relevant third party.

Requirements

Effective

Clear

Review with trainers and assessors can help to ensure assessment tools:

The Assessment Experience

Questions?

Next Session in Quality SeriesQuality in Engagement with Stakeholders

Thanks for joining us today!

T 1800 287 246E [email protected] www.mrwed.edu.au

Follow me on twitter: @MRWED_CEO