Embed Size (px)
Citation preview
The Design and Development of an Assessment System
Claire Werner
Introductions
• Facilitator
• Participants’ objectives
• References and resources
References and Resources• The Standards for RTOs 2015 Compilation No. 1 2017
• The TAC Users’ Guide for the Standards (Version 1.2)
• Assessment TAC Fact Sheet
• Assessment Validation TAC Fact Sheet
• Industry Engagement TAC Fact Sheet
• Amount of Training TAC Fact Sheet
• Vocational Competence and Industry Currency TAC Fact Sheet
• Identifying and Meeting Individual Needs TAC Fact Sheet
What is a system?
A system is a regularly interacting or interdependent group of items forming a unified whole. Every system is delineated by its spatial
and temporal boundaries, surrounded and influenced by its environment, described by its
structure and purpose and expressed in its functioning.
Wikipedia
What is an assessment system?
An assessment system is a coordinated set of documented policies and procedures (including
assessment materials and tools) that ensure assessments are consistent and are based on
the Principles of Assessment contained in Table 1.8-1 and the Rules of Evidence contained in
Table 1.8-2.
Standards for RTOs 2015, Glossary, p8
Why do we need an assessment system?
The core business of an RTO is the certification of the industry-relevant competencies of individual candidates
This certification must be based upon a judgement of competency made by a qualified assessor
This judgement must be valid, reliable, fair and flexible
This judgement must be based upon evidence that is valid, sufficient, current and authentic
The RTO and the assessor are accountable for the accuracy of these judgements
Clause 1.8: Assessment
The RTO implements an assessment system that ensures that assessment (including recognition of prior learning):• complies with the assessment requirements of the
relevant Training Package or VET accredited course; and
• is conducted in accordance with the Principles of Assessment and the Rules of Evidence.
The TAC AssessmentWorkshop Series
Part 1• The design and development of an
assessment system
Part 2• Designing assessment tools
Part 3• Assessment in practice
Topics for this workshop
• Mandatory requirements for assessment• Influences on assessment choices• Planning assessment systems and strategies• Documenting the assessment system• Validating the assessment system
Mandatory requirements for assessment
Non-negotiable and set in stone
• Units of competency• Competency-based assessment• Standards for RTOs
The Concept of Competency
Competency
Competency means the consistent application of knowledge and skill to the standard of
performance required in the workplace. It embodies the ability to transfer and apply skills
and knowledge to new situations and environments.
Standards for RTOs 2015, Glossary, p8.
Unit of Competency
Mandatory unit requirements include:
• Pre-requisite units (if any)• Elements of competency and their performance criteria• Foundation Skills (If any)• Performance Evidence• Knowledge Evidence• Assessment Conditions
Competency-Based Assessment
How do we know if someoneis competent?
We look for evidence that reflects their knowledge and skills.
Evidence of knowledge can be found in the answers to questions.
Evidence of skills can be seen in the performance of tasks.
1
2
3
Competency-based assessment
The gathering of evidence
that can be used to
make judgements
about the achievement of
national competency standards.
The Standards for RTOs
Compilation No. 1 July 2017
What do the Standards say about our assessment system?
• Unit requirements (1.4, 1.8a)• Rules of evidence (1.8b)• Principles of assessment (1.8b)• Candidate needs (1.1, 1.7)• RTO resources (1.2,1.3)• Assessors (1.3, 1.13 – 1.20)• Industry relevance (1.5, 1.6)• Assessment validation (1.8b, 1.9 – 1.11)• RPL (1.8, 1.12)
But wait … there’s more!• Quality assurance (2.1, 2.2)• Third-party assessment (2.3, 2.4)• Certification (3.1)• Information (4, 5.1, 5.2)• Appeals (6.2 – 6.5)• Glossary
• Assessment• Assessment system• Assessors• Competency and Unit of competency• Recognition of Prior Learning (RPL)• Validation
Our assessment system must ensure that our judgements are …
(The Principles of Assessment in Clause 1.8b)
Fair Flexible Valid Reliable
Mandatory unit requirements
Our assessment system must ensure that evidence is …
(The Rules of Evidence in Clause 1.8b)
Valid Sufficient
Authentic Current
Who can be assessors?
The Standards for RTOs are quite precise about who
can (and cannot) be an assessor.
(Clauses 1.13 – 1.20)
Assessor requirements
Assessor skillsTAEASS401 Plan assessment activities and processes;TAEASS402 Assess competence;TAEASS403 Participate in assessment validation; andTAEASS502 Design and develop assessment tools.
Vocationally Competent
Industry Skilled
VET skills & knowledge
The roles of assessorsand evidence-gatherers
The Assessor
• Develops the assessment mapping
• Designs the assessment tools
• Manages the evidence gathering process
The Evidence-Gather
• Gathers the evidence• Reports to the
assessor• Participates in
assessment validation
The Assessor
• Collates the evidence• Makes the
assessment judgement
• Reports the assessment outcomes
• Participates in assessment validation
Influences on assessment choices
Aspects of your assessment system that can be tailored to fit
• Industry relevance• RTO resources• Candidate characteristics
Activity 1For one of the influences (industry, RTO or candidate) indicate for each dot point:1. How you would find out about it;2. How it could impact on assessments;3. How you could evaluate its impact; and4. How you could design your assessment system to
promote quality.
Be prepared to report your observations to the workshop
Industry relevance
• The range of applications of the competency in workplaces … how is the competency used to achieve productive outcomes?
• The range of industries using the competency … where is the competency used?
• National and local industry expectations• Regulations
RTO resources
• Facilities• Equipment and materials• Evidence-gathering processes & tools• Candidate support services• Industry work sites and personnel• Trainers and assessors
Candidate characteristics
• Language, literacy and numeracy• Disability• Current employment• Previous experience and/or training• Location• Access to technology
Planning Assessment Systems & Strategies
From Unit to CertificateUnit of Competency The focus is on the mandatory requirements: the elements of competency and their performance criteria,
knowledge evidence, and performance evidence.
Mapping of unit andevidence-gathering tools
This is a critical step as it is the means to ensure that all unit requirements are identified and are sufficiently and validly addressed through the evidence-gathering tools. Typically there would be one knowledge test (Q/A) and two observation tools based on practical tasks.
Evidence-gathering tools Designing these tools requires vocational competence and current industry skills.These tools may relate to more than one unit of competency if delivered through a cluster.
Evidence The evidence-gathering tools trigger the production of evidence of individual performance that needs to be recorded and collated. Evidence must meet the rules of evidence.
Mapping of evidence ontounit requirements
This is also a critical step as it is the point of interpretation of the evidence in the context of the requirements of the unit, converting tasks into competencies.
Assessment judgement The assessment judgement is a straightforward process of verifying that all unit requirements have (or have not) been demonstrated. Judgement must meet the principles of assessment.
Certification Certification on the Record of Achievement for a qualification or a Statement of Attainment is safe as the process of judgement is safe.
Documenting your Assessment System
Documents that reflect your assessment system
• Qualification Training and Assessment Strategies• Unit Delivery and Assessment Plans• Evidence gathering tools & mappings• Judgement tools & reporting processes• Information for candidates• Information for evidence-gatherers• Appeals processes• Validation processes• Assessor credentials• Assessment policies and procedures
Activity 2
What would you include in an assessment system policy document?
Draft a list of headings and sub-headings that would provide a comprehensive overview of an RTO’s assessment system policies and procedures.
Validating your Assessment System
Validation of assessments and the assessment system
Reflecting the unit requirementsMeeting the Rules of EvidenceMeeting the Principles of Assessment
Complying with the Standards for RTOsMeeting the expectations of industryMeeting the needs of candidatesMaking best use of RTO resources
Safeguards for quality assessment in VET
VET assessment stands upon the four pillars of quality:
Registered Training Organisations
• Standards for RTOs
National Certification• Australian Qualifications
Framework (AQF)
Professional Assessors• TAE Assessor Skill Set, • Vocational Competency• Industry Skills
Industry standards• Units of Competency in
Training Packages & Accredited Courses
Next TAC assessment workshop
TAC Assessment Workshop SeriesPart 2
Designing Assessment Tools
Contact usTraining Accreditation CouncilLocked Bag 16OSBORNE PARK DC WA 6916Telephone: (08) 9224 6510Email: [email protected]: www.tac.wa.gov.au
Acknowledgement: Some icons designed by Freepik
