Standard is at Ion Guidance for Providers June 10

8/2/2019 Standard is at Ion Guidance for Providers June 10

1/21

Standardisation

Information and Guidance forOCN North East Region Centres

Version 1 June 2010


2/21

CONTENTS

OVERVIEW AND BACKGROUND ............................................................................ 2

Levels of Standardisation ...................................................................................................2

AIMS AND PURPOSE OF STANDARDISATION ..................................................... 3

Purpose .................................................................................................................................3

Aims ......................................................................................................................................3

Outcomes ..............................................................................................................................4

NOCN REQUIREMENTS FOR RECOGNISED CENTRES AT THE DIFFERENT

LEVELS OF STANDARDISATION ............................................................................ 5

Centre (internal) Standardisation ........................................................................................5

Regional Standardisation ....................................................................................................5

National Standardisation .....................................................................................................6

CENTRE PRACTITIONER FORUMS ........................................................................ 7

RETENTION AND COLLECTION OF EVIDENCE FOR STANDARDISATION .........8

Collection and storage of samples for standardisation ...................................................8

What the sample should include .........................................................................................8

PLANNING AND CONDUCTING A CENTRE STANDARDISATION EVENT ......... 10

Who should attend a standardisation event? ..................................................................10

Documents required for the meeting ................................................................................11

APPENDIX 1 .......................................................................................................... 14

RETENTION OF LEARNER EVIDENCE AND

NOCN STANDARDISATION REQUIREMENTS .....................................................14

APPENDIX 2 .......................................................................................................... 17

1


3/21

PARTICIPANT FEEDBACK FORM ......................................................................... 15

APPENDIX 3 .......................................................................................................... 20

FACILITATOR FEEDBACK FORM ......................................................................... 18...........................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................

Overview and Background

The process of Standardisation, in this context, is to ensure that any and all of the judgmentsabout assessed work which are made by Tutors, Internal Verifiers and Quality Reviewers orExternal Verifiers are both consistent and are evidenced. The aim of this process istherefore to improve overall consistency by agreeing the specific standards which are to bemet and identifying benchmark (see below) tasks and evidence. This process must occurinternally within individual centres own processes and will also be provided for centres byNOCN and OCN North East Region.

It is important to note that:

1. Within this context the term benchmark means a point of reference by which allstandards can be referenced

and

2. Standardisation is not about re-assessing the samples that are provided for discussionbut about measuring them against the agreed examples (benchmarks).

Therefore, whilst the format and focus of standardisation events may vary, the purpose is todraw out and agree the standards that individuals are applying when assessing andmonitoring any assessed work.

In other words the process should clearly explain:

what is expected to be seen in particular pieces of assessed work = the standards

when this work is considered to be good enough and when it is not = that is when itdoes or does not meet standards (the benchmarks)

This overarching question is therefore equally applicable to all units, regardless of their level,credit value or curriculum area. The samples which are provided at standardisation eventsare simply a means of providing examples for discussion of those standards.

Levels of Standardisation

2


4/21

There are 3 levels or tiers of standardisation:

Centre (sometimes called internal)

Regional (OCN North East Region)

National (NOCN)

The standardisation activities for each of the 3 levels will be related and should bothinfluence and be influenced by, the outcomes of the others.

All N/OCN recognised centres are required to carry out appropriate centre standardisationand also to contribute to regional and national standardisation, as requested, as part of theirCentre Recognition compliance.

This document outlines what is required by OCN North East Region centres for all levels ofstandardisation and offers specific guidance on the implementation of centre standardisationfor individual centres.

Aims and Purpose of Standardisation

Purpose

The overall purpose of standardisation at all levels is:

To ensure consistency in the application of level and credit across N/OCN provision

To promote and achieve consistency of practice in assessment and verification

To inform the quality improvement cycle which will include training and developmentissues

To ensure that a full range of assessment activities allow for the generation ofappropriate assessment evidence

To share good practice

To identify, develop and use national benchmarks and to achieve processes for those tobe applied and reviewed

Aims

The aims of any standardisation event at any level will include some or all of the following:-

To provide an opportunity to ensure the consistency of the award of credit to learnersacross different assessors/verifiers/centres and to agree the standards to be achieved

To compare the different assessment strategies used across a unit/s and to ensure that:o The assessment strategy, including any benchmarked tasks, allow for the

generation of sufficient/appropriate/authentic evidence to be producedo The assessment strategy and the assignment tasks which are used prevent any

unintended barriers to achievement for a particular learner and pay due respectto equality and diversity issues

To ensure that the assessment tasks are written in language that is appropriate to the

level and is free from bias

3


5/21

To ensure consistency in the assessment judgements that are being made, based on theavailable evidence

To ensure the adequacy of the feedback provided to learners

To ensure the adequacy of the feedback provided to assessors and the robustness ofthe internal verification of the assessment judgements

To review the appropriateness and currency of the units and their fitness for purpose inthe current context and make any necessary recommendations

To identify and share best practice

Outcomes

The outcomes of the standardisation process should be used to:

Improve the assessment practice of tutor/assessors within centres and bring aboutconsistency of assessment decisions to safeguard the integrity of the award of credit

Improve consistency in the judgements of verifiers Influence and improve the qualification or course design and any prescribed assessment

tasks within the qualification. This would normally be done at national level but will beinfluenced by feedback from the standardisation activities at other points. At centre levelthis process can be used to consider the appropriateness of the current courses beingdelivered and therefore make any changes.

4


6/21

NOCN Requirements for recognised centres at the differentlevels of standardisation

Centre (internal) Standardisation

In any centre which is recognised to deliver N/OCN courses, it is essential that the internalverification process includes an opportunity for the standardisation of their practice in relationto assessment judgements. This should happen in all cases where assessment decisionsand recommendations for the award of credit to learners are made. This will be determinedby the number of tutors/assessors and the courses which are being delivered in the centre.It is usual that the Internal Verifier for the course/s has the responsibility for arranging andfacilitating these standardisation events. The guidelines contained within this booklet havebeen designed for use when organising these internal standardisation events to meet thespecifics of individual centres.

These activities and events will be monitored by the Quality Reviewer or any person withAuthorised Internal Verifier Status (AIVS) where that is appropriate and will be included inQuality Reviewer reports, including any quality improvement actions required to develop theprocesses.

Regional Standardisation

OCN North East Region organises regional standardisation events, which coverqualifications and qualification units within specific sectors, within an annual cycle. Individualcentres will be informed of the dates of these events at the beginning of September in eachyear and informed when/if they are required to supply samples of work for particular events.This will be done in sufficient time for this to be included in the planning processes. Furtherinformation about requirements can be gained from the Quality Reviewer.

Centres will be asked to participate in these events by contributing samples of evidence(where appropriate), and through the attendance of individuals who have Approved InternalVerifier status, where this is appropriate, especially if they are approved for a particularsector area involved.

How will this be done?

When samples are required from a centre the Quality Reviewer is responsible for agreeingwhat samples will be required and when they will be collected. The samples should ofcourse have been through the centres own internal standardisation processes so theseevents should be planned accordingly.

This process of identifying and collecting samples will therefore normally be included withinthe Quality Assurance planning and agreed visits. Samples may be requested at other timesbut Quality Reviewers will arrange how these will be collected (see section on sampleselection).Please note therefore that centres are not required to attend the OCNs regionalstandardisation events except where there is an appropriate AIVS individual. However it is

particularly important that those people with Approved Internal Verifiers status participate inthese regional standardisation events. (We will provide certificates of attendance for CPD

5


7/21

evidence if required.) Invitations will be made, when appropriate, but please contact us forfurther information. However in addition centre practitioner forums for identified sectors orqualifications will be held, where appropriate (see below).

Feedback from both National and Regional standardisation events will be available for allcentres following each event.

National Standardisation

The National Open College Network (NOCN) organises standardisation events for all itsqualifications by sector on a three year cycle. This programme will therefore inform OCNNorth East Regions standardisation programme including the regional events, as above,and then any subsequent information that is provided for centres.

Samples from those collected for, and discussed within, the regional events will be selectedto send to the National Standardisation events as OCN North East Region examples. OCNNorth East Region Quality Staff, including Quality Reviewers with a specialism in the sectorarea, attend these national events.

Feedback from these events will be distributed to OCN North East Region centres followingall national events and will often determine the need for any centre practitioner forums.

6


8/21

Centre Practitioner Forums

Centre Practitioner forums, such as the one currently held for the NOCN Languagesqualification, form part of the overall OCN North East Region standardisation strategy. The

purpose of these events is to offer the opportunity for centres to get together to share goodpractice, to ensure any specific requirements are met and to consider possible developmentwork in relation to the qualification or curriculum or sector area.

These events also serve an as opportunity to distribute and discuss any outcomes from theother levels of standardisation.

Centres will be informed of any planned practitioner forums along with the regionalstandardisation schedule. Centres can make suggestions for a topic or curriculum areawhich could be covered within these events by discussing this with the Quality Reviewer.

7


9/21

Retention and collection of evidence for standardisation

The NOCN retention policy is attached as Appendix 1. This policy sets out the requirementsfor retaining learner details along with the samples of evidence which are discussed within

this guidance and should be read in conjunction with this document. This will have beenexplained within the centre recognition process and will be discussed and monitored as partof the Quality Reviewers visits.

Collection and storage of samples for standardisation

All samples should be taken from the centres current learner evidence and the QualityReviewer will explain what format the samples should take. These can be supplied asphotocopies and all original copies will be returned. All samples are stored electronically atOCN North East Region. As well as providing samples for national standardisation events,

this will also allow us to build up a range of samples which can be used to comparestandards over time and to create benchmark samples which can then be used as guidancefor centres. These samples will be anonymised.

For further information or guidance about retention of learners work and details please askthe Quality Reviewer or Quality Accreditation Manager.

What the sample should include

At all levels of standardisation it is important that in order to be effective, the sample

provided should be as complete as possible. This is to ensure that informed judgements canbe made about all of the evidence to support the purpose of the standardisation processwhich is explained in the overviewsection.

It is good practice within all standardisation activities but it is a requirement for thosesupplied for OCN North East Region that the sample should support the evidence ofachievement for a whole unit of assessment and should include:

A Sample Cover Sheet on each unit indicating the rationale for selecting the sample

A copy of the unit descriptor including the unit code

The whole assessment strategy for the unit being standardised including the tasks/assignment briefs /benchmarks

All of the evidence generated by a learner/s against all of the assessment criteria forthe unit/s

Clear record of the assessment decision including feedback to the learner in relationto the achievement /non achievement of the assessment criteria

Internal verification records including feedback to the assessor and the internalverifiers judgements on the security of the award of credit

8


10/21

Evidence where possible of subsequent monitoring of any actions identified by theinternal verification process

A centre can develop their own paperwork for internal events but the Quality Reviewer willconfirm that any paperwork is appropriate and explain what is required when asked to supply

samples for OCN North East Region.

9


11/21

Planning and conducting a centre standardisation event

The following guidance aims to support centres in implementing standardisation activitieswithin their own programmes.

In order to facilitate an effective standardisation meeting it is important to undertake somepreparatory work prior to the meeting.

Who should attend a standardisation event?

This will depend on the size of your centre. You should agree who will facilitate the eventand invite tutors and internal verifiers who are currently or may be involved, in the planningand delivery of your courses. This might be specifically useful if you offer separate courseswithin different sector areas at the same level. Feedback to tutors who cannot attend willform part of the actions following standardisation.

The facilitator should be prepared to compile a report of the event with discussions,agreements and actions.

Sample selectionYou should give clear instructions about what the sample selection should include (asabove).Unit selectionYou should select the units which are to be standardised and ensure that over time all units,courses and levels being delivered are examined through the standardisation process. Theaim is to ensure that all units are reviewed at some time. This will be individual to you as a

centre and will of course depend on the length of your courses, the different coursesincluding the different levels and the overall number of units which you deliver. This mayalso depend on what has been requested from you by OCN North East Region. At regionaland national level, standardisation events are normally organised by sector and thereforespecific units of qualification which you may be approved to deliver will be requested.

Sample sizeThe number of samples to be scrutinised should be small and manageable. It is usuallymore productive to have a smaller rather than larger number of units for examination but it isimportant that in all cases you should make sure that a cover sheet for the sample iscomplete.

The purpose of this cover sheet is to indicate a rationale for why the sample has beenchosen. So for example, does the sample represent one or more of the following factors:

Strong evidence of achievement

Weak evidence of achievement or a possible borderline case

Evidence which is sufficient to ensure achievement of all of the assessment criteria atthe specified level

Evidence which is not entirely appropriate for the level

Evidence which is not sufficient to demonstrate achievement of all the assessmentcriteria

The use of an innovative assessment strategy

An example of good and constructive feedback to a learner

An example of good and constructive feedback from the verifier to the assessor

10


12/21

Example of Non achievement

Any other valid reasons for the selection

Within a centre the sample should include evidence assessed by each of the assessorsinvolved.

Within a centre the sample should include evidence verified by each of the internal verifiers.

Documents required for the meeting

Sample of work selectedYou should provide copies of the samples so that all participants in the standardisationevent are able to scrutinise each one. You may wish to make these anonymous.However if you are required to provide samples for regional standardisation then namesof the learners will be required.

Participant Feedback FormAppendix 2

Facilitator Feedback FormAppendix 3

The following documents will also be a useful source of reference for participants and areavailable for download from OCN North East Region website:

NOCN Assessment Definitions

Assessment Guidelines

Qualification GuideFor standardisation of units of NOCN qualifications, you will need the appropriatequalification guide

Standard agendaThe following is an example of a possible suitable agenda for a standardisation meeting:

Standardisation Meeting

Curriculum area/s:

Date and Venue:

Agenda:

1. Overview and expected outcomes

2. Standardisation consideration of the samples provided and completion ofparticipant form.

3. Verbal feedback agreeing the standard/adequacy of evidence and supporting

documentation/best practice this information may be used to complete an overallreport.

11
http://www.ocnner.org.uk/documents/NOCNAssessmentDefinitions.dochttp://www.ocnner.org.uk/documents/assessment-guideline.pdfhttp://www.nocn.org.uk/qualificationshttp://www.ocnner.org.uk/documents/NOCNAssessmentDefinitions.dochttp://www.ocnner.org.uk/documents/assessment-guideline.pdfhttp://www.nocn.org.uk/qualifications


13/21

4. Selection of sample - to be used for regional standardisation if this is required.Completion of sample cover sheet for retained samples if required. This can be donein conjunction with your Quality Reviewer.

Conducting the event

1. Overview and expected outcomes

At the beginning of the meeting the facilitator should ensure that participants areclear about the purpose of the standardisation event and what their role is. Thisshould also include how the participant feedback form should be completed andexplain how that information will be used in producing the facilitators report.Reference should be made to the guidance documents above and how they can beused by the participants during their consideration of the samples.

2. Consideration of samples

Each participant should examine each sample and record their responses to thequestions on the participant feedback sheet i.e. all participants should consider alland the same samples. This is likely to take some time which should be set aside forthe activity.

3. Verbal feedback: agreeing standards and the adequacy of supportingdocumentation

Once all the samples have been scrutinised and a participant report has beencompleted, the facilitator should lead a discussion of the findings. This will probablybest be achieved by considering each sample and sharing the participants views. It

is important to remember that the main outcome of this discussion should focus onagreeing and defining the acceptable standards including the rationale for thosedecisions.

The facilitator should record the outcomes of this discussion and produce a summaryreport of the findings.

4. Selection of sample to be used for the next level of standardisation (if required)

The outcomes of the discussion should enable the group to agree on an appropriatesample to be retained and used at the next level of standardisation if this is required.In this case the facilitator should then complete a sample cover sheet for the chosensamples that clearly identifies the rationale for the choice and how it helps tocontribute to a consistency in agreeing standard statements/benchmarked tasks/ordissemination of best practice. If these arent required for regional events then thecentre may retain them for their own purposes.

Reporting the Outcomes

Participant Feedback Form (Appendix 2): this can be done in groups

All participants should complete a Participant Feedback Form to record their findings foreach unit scrutinised

Facilitator Feedback Form (Appendix 3)

12


14/21

The facilitator should take feedback against the participants findings unit by unit. TheParticipant Feedback Forms can be retained by the facilitator. The facilitator should thencomplete the Facilitator Feedback Form to summarise the findings of the meeting andrecord recommendations/good practice identified to go forward to the next level ofstandardisation if required. The sample to go forward to the next level of standardisationshould be selected to reflect the issues identified in this report

Sample cover sheet

The appropriate sample cover sheet should be attached to the sample selected to goforward to the next level of standardisation. This should clearly record the rationale forselection.

Training on conducting a standardisation event is one session on OCN North East Regionsprovidertraining programme. For further details please see ourwebsite

13
http://www.ocnner.org.uk/training-sessions.asphttp://www.ocnner.org.uk/training-sessions.asp


15/21

Appendix 1

Retention of Learner Evidence andNOCN Standardisation Requirements

This information supplements the requirements set out in the NOCN Centre Handbook and the OCNNorth East Region Standardisation Guidance document.

Centre EvidenceCentres must keep complete and accurate records, for at least three years from the end of year towhich they relate, for all qualifications and make these available to NOCN or OCN North East Regionon request as part of their centre recognition agreement. Centres are required to retain the followingrecords:

Name of learner, date of birth and contact address

Title and accreditation number of each qualification and unit studied

Name(s) of assessor(s)

Assessment records, including assessment decision and reason for decision

Name(s) of internal verifier(s)

Internal Verification reports

Evidence for Standardisation

All Centres should hold internal standardisation events as part of their quality assurance practice and

covering their full range of provision (for example a minimum of three pieces of evidence from everytutor/ assessor). These should include:

The Unit

Learners Work

Assessment Task

Tutor Feedback

Centres offering specific qualifications may be requested subsequently to provide evidence for regionalstandardisation events. Identified centres will be supplied with full information on the type and amountof evidence and the date when they will need to submit this, directly from OCN North East Region.Quality Reviewers will be responsible for identifying and collecting this specific evidence from Centres.

OCN North East Region will forward a selection of these samples to NOCN for national standardisationevents and retain these and other samples for its own use. Feedback from these events will beavailable.

Summary

When the requirements of regional standardisation have been met, centres are no longer required toretain samples of learner work. It is recommended however that centres do retain some samples fortheir own quality assurance purposes as part of centre standardisation.

For further advice and support please contact your Quality Accreditation Manager, Quality Reviewer orOCN NORTH EAST REGION Quality Development Manager.

Provider training sessions covering standardisation are available ~ for further details pleasecontact helen.smith@OCN North East Region.org.uk

14
mailto:[email protected]:[email protected]


16/21

Appendix 2

Participant Feedback Form

Qualification/Course title

Unit Title

Level

Credit

1. Which learning outcomes do you think are being addressed by the evidencepresented?

2. Is the assignment/task for the unit set at the correct level?

Yes or No

3. Do the tasks give the learner the opportunity to fully meet the assessment criteria?

4. Is the assignment/task set in an appropriate format for the learners?

15


17/21

Appendix 2

Yes or No

5. Is the language set in a way that prevents any unintentional barriers?

6. Has the learner achieved the appropriate standard with acceptable evidence for thelearning outcomes?

Yes or No

7. Is there sufficient evidence to cover the learning outcomes?

8. How is this related to the different levels?

9. Is the feedback to the learner adequate and constructive?

16


18/21

Appendix 2

10. Any other issues?

Signed:

Print Name:

Date:

17


19/21

Appendix 3

Facilitator Feedback Form

Event Title

Date

Facilitator

Title of the units being standardised

Unit Title Unit code Credit

Value

Credit

Level

Summary of findings

1. Standards

Did the scrutiny of the samples highlight any areas of concern about the consistency ofstandards being demonstrated?

Was there a clear distinction between the evidence of achievement demonstrated at differentlevels?

Are the expected requirements at each level identifiable?

2. Appropriateness of assessment tasks

18


20/21

Appendix 3

Do the tasks provide learners with an opportunity to meet all of the assessment criteria?Consider reasonable adjustments.

3. Evidence of Achievement

Issues identified relating to the:

Validity?

Sufficiency?

Reliability?

Authenticity?

Other?

4. Tutor Records and Feedback

5. Internal Verification Records

19


21/21

Appendix 3

6. Curriculum plan - areas for development

7. Good Practice

Please give clear details of any good practice identified in any of the samples:

Signed:

Print Name:

Date: