Cross Country Analysis on the Use of Indicators for Quality in VET Peer learning visit Helsinki, 13-15 December 2006 Erwin Seyfried on behalf of CEDEFOP

Cross Country Analysis on theCross Country Analysis on theUse of Indicators for Quality in Use of Indicators for Quality in

VETVET

Peer learning visitPeer learning visitHelsinki, 13-15 December 2006Helsinki, 13-15 December 2006

Erwin SeyfriedErwin Seyfried

on behalf of CEDEFOPon behalf of CEDEFOP

Version 12-01-2007Version 12-01-2007

Responses to QuestionnaireResponses to Questionnaire

Participating countriesParticipating countries• host country + 16 peer countries = 17host country + 16 peer countries = 17

Positive responses fromPositive responses from• 13 countries: FIN; AT, CZ, DK, EE (only IVET), 13 countries: FIN; AT, CZ, DK, EE (only IVET),

ES, IT, LT, NL, NO, PT, RO, SW (only CVT);ES, IT, LT, NL, NO, PT, RO, SW (only CVT);• + 1 previously delivered paper from UK+ 1 previously delivered paper from UK

Responses missing fromResponses missing from• 2 countries: DE, SK2 countries: DE, SK

ReminderReminder: The coherent set of indicators: The coherent set of indicators

Indicator 1: VET-providers applying QA-systemsIndicator 1: VET-providers applying QA-systems

Indicator 2: investment in training of trainersIndicator 2: investment in training of trainers

Indicator 3: unemployment acc. to groupsIndicator 3: unemployment acc. to groups

Indicator 4: prevalence of vulnerable groupsIndicator 4: prevalence of vulnerable groups

Indicator 5: participation in trainingIndicator 5: participation in training

Indicator 6: completion of trainingIndicator 6: completion of training

Indicator 7: destination after trainingIndicator 7: destination after training

Indicator 8: utilisation of acquired skillsIndicator 8: utilisation of acquired skills

Indicator 9: responsiveness of VET-systemsIndicator 9: responsiveness of VET-systems

Indicator 10: promotion of better access to VETIndicator 10: promotion of better access to VET

Which indicators are used?Which indicators are used?

YESYES NONO RemarksRemarks

Indicator 1Indicator 1QA-systems appliedQA-systems applied

CZ, DK, ES, IT, CZ, DK, ES, IT, FIN, NL, PT, RO FIN, NL, PT, RO (pilots in CVT), (pilots in CVT), SW, UKSW, UK

AT, EE (not AT, EE (not considered considered relevant), LT, relevant), LT, NO (not seen as NO (not seen as indicator)indicator)

Required by law: Required by law: DK, ES, IT (some DK, ES, IT (some regions) NL, NO, regions) NL, NO, PT, RO (for IVET), PT, RO (for IVET), SW, UKSW, UK

Indicator 2Indicator 2Investment in training Investment in training of trainersof trainers

CZ, DK, ES, CZ, DK, ES, FIN, IT, LT, RO, FIN, IT, LT, RO, UK; partly: AT, UK; partly: AT, PTPT

NL, NO, SWNL, NO, SW (Sub-) indicators (Sub-) indicators used: AT, EE, FIN; used: AT, EE, FIN; IT (teachers in IT (teachers in schools), RO (QA-schools), RO (QA-managers)managers)

Indicator 3Indicator 3unemploymentunemployment

AT, DK, ES, AT, DK, ES, FIN, IT, LT, NL, FIN, IT, LT, NL, PT, RO, SWPT, RO, SW

EE, NO, UKEE, NO, UK Planned: CZPlanned: CZ

……. indicators used?. indicators used?


Indicator 4Indicator 4vulnerable groupsvulnerable groups

AT, CZ, EE, FIN, AT, CZ, EE, FIN, IT, LT, PT, NL, IT, LT, PT, NL, RO, SWRO, SW

NONO DK: DK: data on gender, data on gender, age, ethnic and age, ethnic and educational background educational background available but not usedavailable but not used

Indicator 5Indicator 5participationparticipation

AT, CZ, DK, ES, AT, CZ, DK, ES, FIN, IT, LT, NL FIN, IT, LT, NL (for LLL), NO, (for LLL), NO, PT (partially), PT (partially), RO, SW RO, SW

EE EE

Indicator 6Indicator 6completioncompletion

AT, CZ, DK, ES, AT, CZ, DK, ES, EE, FIN, IT, LT, EE, FIN, IT, LT, NL, NO, RO, NL, NO, RO, SW,SW,

……. indicators used?. indicators used?


Indicator 7Indicator 7destinationdestination

CZ, DK, EE, ES, CZ, DK, EE, ES, FIN, IT, LT, NL, FIN, IT, LT, NL, NO, RO, SW, UKNO, RO, SW, UK

AT, PTAT, PT RO for RO for unemployedunemployed

Indicator 8Indicator 8utilisationutilisation

CZ, DK, ES, LT CZ, DK, ES, LT and UK: in and UK: in sectors, NL, SWsectors, NL, SW

AT, EE, IT, NO, AT, EE, IT, NO, PT, PT,

Pilots: DK, FIN, Pilots: DK, FIN, RO, plans: IT, UKRO, plans: IT, UK

Indicator 9Indicator 9responsivenessresponsiveness

AT (goal), CZ AT (goal), CZ (planned), ES, (planned), ES, FIN, LT (in FIN, LT (in sectors), NL, ROsectors), NL, RO

EE, IT, NO, PT, EE, IT, NO, PT, SWSW

Plans: IT, UKPlans: IT, UK

Indicator 10Indicator 10accessaccess

AT (goal), CZ, AT (goal), CZ, ES, NL, ROES, NL, RO

DK, EE, FIN, IT, DK, EE, FIN, IT, LT, NO, PT, SWLT, NO, PT, SW

Plans: UKPlans: UK

Conclusion: Use of indicatorsConclusion: Use of indicators

Usage of indicators 4, 5, 6 and 7 is most Usage of indicators 4, 5, 6 and 7 is most widespreadwidespread

Indicators 8, 9 and 10 difficult to implementIndicators 8, 9 and 10 difficult to implement

Indicator 1 – big differences in implementation / in Indicator 1 – big differences in implementation / in several countries required by lawseveral countries required by law

Indicator 2 – different approaches; several sub-Indicator 2 – different approaches; several sub-indicatorsindicators

Linkage of indicators to QA crucial but not obviousLinkage of indicators to QA crucial but not obvious

Whole set of EU indicators is used rarely (except Whole set of EU indicators is used rarely (except FIN)FIN)

Purposes / AimsPurposes / Aims

Four main purposes which are linked to the Four main purposes which are linked to the relevant steps of CQAF:relevant steps of CQAF:

Policy planning and target settingPolicy planning and target setting

Steering / monitoring and supervisionSteering / monitoring and supervision

Measurement of effectiveness and efficiencyMeasurement of effectiveness and efficiency

Decision making and performance-based Decision making and performance-based fundingfunding

Overall purposes / aimsOverall purposes / aims

Other, overall purposes/aims in using Other, overall purposes/aims in using indicators:indicators:• Motivation of providers and staffMotivation of providers and staff

• Continuous improvement of training deliveryContinuous improvement of training delivery

• Stimulation of excellence and innovation in Stimulation of excellence and innovation in VETVET

Purposes in using indicatorsPurposes in using indicators

Planning Planning Target Target setting setting (budgetary)(budgetary)

Steering Steering MonitoringMonitoring

Measure Measure Effective-Effective-ness / ness / EfficiencyEfficiency

Pf.-based Pf.-based fundingfunding

Decision Decision MakingMaking

Indic 1Indic 1QA-system appliedQA-system applied

AT, CZ, DK, AT, CZ, DK, ES, FIN, IT, ES, FIN, IT, NL, NO, PT, NL, NO, PT, RO, SWRO, SW

NL, RO, NL, RO,

Indic 2 Indic 2 investment in investment in training of trainerstraining of trainers

CZ, EE, DK, CZ, EE, DK, ESES

AT, CZ, DK, AT, CZ, DK, FIN, IT; LT, FIN, IT; LT, NO, RO, NO, RO,

FIN, ROFIN, RO FINFIN

Indic 3Indic 3unemploymentunemployment

AT, ES, AT, ES, FIN, IT, LT, FIN, IT, LT, NL, NO, PT, NL, NO, PT, RO, SWRO, SW

ES, FIN, IT, ES, FIN, IT, LT, NL, PT, LT, NL, PT, RORO

RORO

Purposes in using indicatorsPurposes in using indicatorsPlanning Planning Target Target setting setting (budgetary)(budgetary)





Indic 4Indic 4vulnerable groupsvulnerable groups

AT, ES, AT, ES, FIN, IT, LT, FIN, IT, LT, NL, PT, NL, PT, RORO

CZ, ES, FIN, CZ, ES, FIN, IT, LT, NL, IT, LT, NL, NO, PT, RO, NO, PT, RO, SWSW

NL, RONL, RO

Indic 5Indic 5participationparticipation

AT, DK, AT, DK, ES, FIN, ES, FIN, IT, LT, NL, IT, LT, NL, RO, RO,

AT, CZ, DK, AT, CZ, DK, ES, FIN, IT, ES, FIN, IT, LT, NL, NO, LT, NL, NO, RO, SWRO, SW

Indic 6Indic 6completioncompletion

AT, FIN, AT, FIN, IT, LT, RO, IT, LT, RO, SWSW

AT, CZ, DK, AT, CZ, DK, ES, FIN, IT, ES, FIN, IT, LT, NL, NO, LT, NL, NO, RO, SWRO, SW

EE, FIN, NL, EE, FIN, NL, DK, FIN, NL, DK, FIN, NL, RO, SWRO, SW

Purposes in using indicatorsPurposes in using indicators

Planning Planning Target Target setting setting (budgetary)(budgetary)





Indic 7Indic 7destinationdestination

FIN, IT, LT, FIN, IT, LT, RO, RO,

CZ, DK, ES, CZ, DK, ES, FIN, IT, LT, FIN, IT, LT, NL, NO, RO, NL, NO, RO,

EE, FIN, IT, EE, FIN, IT, LT, SWLT, SW

ES, FIN, RO, ES, FIN, RO, SWSW

Indic 8Indic 8utilizationutilization

DK, ES, IT, DK, ES, IT, NLNL

CZ, DK, ES, CZ, DK, ES, IT, NL, NO, IT, NL, NO,

IT, SWIT, SW RO, SWRO, SW

Indic 9Indic 9responsivenessresponsiveness

ES, ROES, RO AT, NL, SWAT, NL, SW RO, SWRO, SW NO, RONO, RO

Indic 10Indic 10accessaccess

AT, CZ, ESAT, CZ, ES CZ, ES, NL, CZ, ES, NL, RORO

Conclusion: Purposes and aimsConclusion: Purposes and aims

Usage of indicators for (budgetary) target Usage of indicators for (budgetary) target setting and monitoring is most widespreadsetting and monitoring is most widespread

Indicators 3, 4, 5 most often used for Indicators 3, 4, 5 most often used for planning and target settingplanning and target setting

Most often mentioned as being important: Most often mentioned as being important: indicators 6 and 7indicators 6 and 7

Measurement of effectiveness / efficiency Measurement of effectiveness / efficiency and usage for performance-based funding and usage for performance-based funding is rare.is rare.

(Problems with) Definitions(Problems with) Definitions

Indicator 1Indicator 1• DK: descriptive use in IVET; obligatory use for evaluation of DK: descriptive use in IVET; obligatory use for evaluation of

training courses in CVETtraining courses in CVET• IT: Share of VET-providers having a quality certification (ISO IT: Share of VET-providers having a quality certification (ISO

class, EFQM, etc.)class, EFQM, etc.)• RO: Capacity of a provider to offer VET programmes according RO: Capacity of a provider to offer VET programmes according

to customers requirements and quality standardsto customers requirements and quality standards

Indicator 2Indicator 2• a) financial definition: amount of funds invested in training of a) financial definition: amount of funds invested in training of

teachers and trainers (AT, ES, FIN, IT); financial target: EEteachers and trainers (AT, ES, FIN, IT); financial target: EE• b) human resource definition: share of teachers and trainers b) human resource definition: share of teachers and trainers

completing further training (AT, EE, IT, NOR); amount of days completing further training (AT, EE, IT, NOR); amount of days (DK) or hours (IT) spent in training per capita and year(DK) or hours (IT) spent in training per capita and year

• c) formal qualification: share of pedag. staff fulfilling formal c) formal qualification: share of pedag. staff fulfilling formal qualification requirements (EE)qualification requirements (EE)

( Problems with) Definitions( Problems with) Definitions

Indicator 3Indicator 3• Available in all countries through EUROSTAT; often even more detailed Available in all countries through EUROSTAT; often even more detailed

information on national level often availableinformation on national level often available• Used mainly as background information onlyUsed mainly as background information only

Indicator 4Indicator 4• Different vulnerable groups mentioned: gender, early school leavers, young Different vulnerable groups mentioned: gender, early school leavers, young

unemployed people, long-term unemployed people, older people, handicapped unemployed people, long-term unemployed people, older people, handicapped persons, roma people (RO), level of education (IT), persons, roma people (RO), level of education (IT),

• Most often mentioned: Most often mentioned: migrantsmigrants

Indicator 5Indicator 5• Number of (individual) participants in IVT (AT, DK, ES, FIN, IT, LT, NL NO, RO)Number of (individual) participants in IVT (AT, DK, ES, FIN, IT, LT, NL NO, RO)• Rates of population involved in CVT (AT, FIN, IT, LT, NL, RO)Rates of population involved in CVT (AT, FIN, IT, LT, NL, RO)• Number of training programmes (CZ)Number of training programmes (CZ)


Indicator 6Indicator 6• Not standardised, not homogenous (AT)Not standardised, not homogenous (AT)• Number of (annual) graduates / examinates (ES, IT, LT, NL, NO, SW), Number of (annual) graduates / examinates (ES, IT, LT, NL, NO, SW),

according to achieved marks (DK)according to achieved marks (DK)• Completion within normative duration (FIN, RO)Completion within normative duration (FIN, RO)• Number of graduates according to (vulnerable) groups (CZ)Number of graduates according to (vulnerable) groups (CZ)• Three indicators used: share of fulfilled training places; share of Three indicators used: share of fulfilled training places; share of

graduates; drop-out rate (EE)graduates; drop-out rate (EE)

Indicator 7Indicator 7• Employment after 2-4 months (EE), six months (EE, IT NO), 3/12/24 Employment after 2-4 months (EE), six months (EE, IT NO), 3/12/24

months (DK), 12 months (LT, NO, SW), 6/18 months (NL), 3,5 years months (DK), 12 months (LT, NO, SW), 6/18 months (NL), 3,5 years (FIN), 6m/5 years (NO)(FIN), 6m/5 years (NO)

• Number of entries in further /higher education (CZ, DK, EE)Number of entries in further /higher education (CZ, DK, EE)


Indicator 8Indicator 8• CZ: number of partners cooperating with VET-schoolCZ: number of partners cooperating with VET-school• DK: opinion polls on usability from former studentsDK: opinion polls on usability from former students• DK, UK: opinion polls on usability from employersDK, UK: opinion polls on usability from employers• SW: utilisation from perspective of former studentsSW: utilisation from perspective of former students

Indicator 9 - Indicator 9 - (descriptive information)(descriptive information)

• AT-proposal: minimal period to install new training programmes (till first AT-proposal: minimal period to install new training programmes (till first graduation)graduation)

• NL, NO: system for (tripartite) social dialogue with stake-holdersNL, NO: system for (tripartite) social dialogue with stake-holders• NL: satisfaction of stake-holdersNL: satisfaction of stake-holders• UK: VET-providers demonstrate evidence of customised programmes meeting UK: VET-providers demonstrate evidence of customised programmes meeting

employers‘ needsemployers‘ needs

Indicator 10 - Indicator 10 - (descriptive information)(descriptive information)

• NL: efforts of VET-providers to increase accessability for vulnerable groupsNL: efforts of VET-providers to increase accessability for vulnerable groups

Conclusion: DefinitionsConclusion: Definitions

Indicator 1: Big variations on provider level; Indicator 1: Big variations on provider level; information often descriptiveinformation often descriptive

Common European core – but big national Common European core – but big national variations (for example for: Indicators 3, 5, 7, 8)variations (for example for: Indicators 3, 5, 7, 8)

Limited possibilites for comparison of data on Limited possibilites for comparison of data on EU-levelEU-level

Only soft definitions for indicators 8, 9, 10Only soft definitions for indicators 8, 9, 10

Collection of dataCollection of data

Statistical Statistical records /records /

Education Education data basesdata bases

SurveysSurveys Provider Provider reportsreports

InspectionInspection

Indicator 1Indicator 1QA-system appliedQA-system applied

CZ, ITCZ, IT DK DK (2006)(2006), , ES, FIN, IT, ES, FIN, IT, RORO

DK, NL, DK, NL, PTPT

SWSW

Indicator 2Indicator 2Investment in training Investment in training of trainersof trainers

AT, CZ, EE AT, CZ, EE IT IT (teachers),(teachers),

FIN, DK FIN, DK (2005/06)(2005/06), ES, , ES, IT IT (trainers)(trainers)

LT LT (financial (financial

reports)reports), , NONO


AT, DK, EE, AT, DK, EE, ES, FIN, IT, ES, FIN, IT, LT, NO, PT, LT, NO, PT, RO, UKRO, UK

FIN FIN (providers),(providers),

RO RO (providers),(providers),

NLNL





InspectioInspectionn

Indicator 4Indicator 4vulnerable vulnerable groupsgroups

AT, ES, EE, AT, ES, EE, FIN, IT, LT, FIN, IT, LT, PT, RO, SW, PT, RO, SW, UKUK

FIN FIN (prov.),(prov.), SW SW (prov.)(prov.)

LT, NLLT, NL NLNL


AT, IT, FIN, AT, IT, FIN, NO, UK NO, UK – all – all

for IVTfor IVT; EE, LT; EE, LT

Fin, IT, NL Fin, IT, NL NO, SW – NO, SW – all for CVTall for CVT, , RORO

DK DK (common (common

ICT-system)ICT-system) LT, LT, NL NL for IVTfor IVT, PT , PT some providerssome providers


AT, ES, EE, AT, ES, EE, FIN, LT, NO, FIN, LT, NO, SW, UKSW, UK

IT IT regional regional sources and sources and

LFSLFS, RO, RO

LT, NL, SWLT, NL, SW RORO





InspectionInspection


DK, EE, FIN, DK, EE, FIN, LT, NOLT, NO

IT IT aggregation of aggregation of

reg. sourcesreg. sources, NL, , NL, RO, SW, UKRO, SW, UK

EE, LT, EE, LT, UKUK

Indicator 8Indicator 8utilizationutilization

ES, FIN, NO ES, FIN, NO only background only background infoinfo

AT AT rarerare,, DK, ES DK, ES regionsregions, NL, UK , NL, UK employer employer

satisfactionsatisfaction, , LT LT sectoral studiessectoral studies


RO, LT RO, LT sectoral sectoral studiesstudies

UKUK NL, NO, SW, NL, NO, SW, UKUK

Indicator 10Indicator 10accessaccess

UKUK NLNL

Conclusion: Collection of dataConclusion: Collection of data

Strong role of statistical records esp. for Strong role of statistical records esp. for contextual information and output data contextual information and output data (indicators 3, 4, 5, 6) – operational relevance for (indicators 3, 4, 5, 6) – operational relevance for QA on provider level?QA on provider level?

Provider reports often used as additional Provider reports often used as additional sources – reliability ? / comparability with other sources – reliability ? / comparability with other national (statistical) sources?national (statistical) sources?

Difficulties with implementation of indicator 7Difficulties with implementation of indicator 7

Several research attempts to analyse data for Several research attempts to analyse data for indicator 8indicator 8

Availability of data by level Availability of data by level (nat./reg./prov.) and time(nat./reg./prov.) and time

NationalNational ProviderProvider TimeTime

Indicator 1Indicator 1QA-system appliedQA-system applied

AT, CZ, DK, ES, AT, CZ, DK, ES, FIN, IT FIN, IT reg.,reg., NL, NL, NO NO reg.,reg., RO, SW RO, SW

AT AT not regularnot regular, , ES ES an.,an., FIN FIN bi-annual,bi-annual, NLNL an.,an.,

RO RO periodicalperiodical

Indicator 2Indicator 2Investment in training of Investment in training of trainerstrainers

AT, CZ, DK, ES, AT, CZ, DK, ES, FIN, IT FIN, IT nat. + reg.,nat. + reg., LT, NL, NO, RO LT, NL, NO, RO IVTIVT

AT AT partlypartly, , EE, FIN, EE, FIN, IT, LT, NL, NO, IT, LT, NL, NO, RO RO IVTIVT

AT AT regular; annual:regular; annual: DK, ES, FIN, EE, DK, ES, FIN, EE, NL, NONL, NO


AT, DK, EE, ES, AT, DK, EE, ES, FIN, IT, LT, NL, FIN, IT, LT, NL, NO, RO, SW, NO, RO, SW, UKUK

AT AT rarely,rarely, FIN, NL, FIN, NL, RORO

monthly, quarterly, monthly, quarterly, yearlyyearly

Indicator 4Indicator 4vulnerable groupsvulnerable groups

AT, CZ, EE, FIN, AT, CZ, EE, FIN, IT, LT, NL, RO, IT, LT, NL, RO, SW, UKSW, UK

AT AT rarelyrarely, EE, FIN , EE, FIN partly,partly, LT LT partly,partly, NL, NO, SWNL, NO, SW

annual:annual: CZ, ES, LT, CZ, ES, LT, NLNL




AT, CZ, DK, EE, AT, CZ, DK, EE, ES, FIN, IT ES, FIN, IT nat.+ nat.+

reg.,reg., LT, NL, NO, LT, NL, NO, RO, SW, UKRO, SW, UK

IT, FIN, LT, NL IT, FIN, LT, NL IVTIVT, , NO NO regional for regional for

IVTIVT,, SW SW

annual:annual: CZ, EE, ES, CZ, EE, ES, LT, FIN LT, FIN IVT, difficult IVT, difficult

for CVT, for CVT, DK DK quarterlyquarterly


AT, CZ, DK, EE, AT, CZ, DK, EE, ES, FIN, IT ES, FIN, IT nat. + nat. +

reg.,reg., LT, NL, NO, LT, NL, NO, RO, SW, UKRO, SW, UK

AT, EE, FIN, LT, AT, EE, FIN, LT, NL, NO, RO, NL, NO, RO, SWSW

annual:annual: CZ, DK, CZ, DK, EE, ES, IT, FIN, EE, ES, IT, FIN, LT, NO, SWLT, NO, SW


DK, EE, ES, DK, EE, ES, FIN, IT FIN, IT reg.,reg., LT, LT, NL, NO, RO NL, NO, RO reg.,reg., SW, UKSW, UK

EE EE employment,employment, FIN, LT, NL, FIN, LT, NL, NO, RO, SWNO, RO, SW

annual:annual: CZ, DK, CZ, DK, ES, FIN, IT, LT, ES, FIN, IT, LT, NL, NO, SWNL, NO, SW



Indicator 8Indicator 8utilizationutilization

DK DK CVTCVT, ES, IT, , ES, IT, NL, NO, SW, NL, NO, SW, UKUK

DK DK CVT,CVT, NL, NO, NL, NO, RO RO somesome, SW, SW

DK DK not systematic, not systematic,

annual:annual: CZ, ES, NL, CZ, ES, NL, NO, SWNO, SW


Descript. informationDescript. information

AT, ES, NL, NO, AT, ES, NL, NO, RORO

NL, NO, RO, NL, NO, RO, SW, UKSW, UK

Indicator 10Indicator 10AccessAccess

Descript. informationDescript. information

AT, ES, NL, NO, AT, ES, NL, NO, RORO

NL, NO, RONL, NO, RO

Conclusion: Availability of dataConclusion: Availability of data

More information available on national / More information available on national / regional level then on provider levelregional level then on provider level

Relationship between data on national, Relationship between data on national, regional and provider level seems to be regional and provider level seems to be difficult - limited possibilities for difficult - limited possibilities for comparisoncomparison

Information for IVT much better than for Information for IVT much better than for CVTCVT

Big variations in terms of timely availabilityBig variations in terms of timely availability

Relevance of indicatorsRelevance of indicators

Indicator 1Indicator 1• Mostly seen as relevantMostly seen as relevant

• Used for improvement of governance and accountability (NL)Used for improvement of governance and accountability (NL)

• Not primarely for assessment of qualityNot primarely for assessment of quality

• Many VET-providers use recognised QM-systems like EFQM, Many VET-providers use recognised QM-systems like EFQM, ISO etcISO etc

Indicator 2Indicator 2• Often classified as relevant, butOften classified as relevant, but

• Difficult to arrive at comparable dataDifficult to arrive at comparable data

• Linkage to other indicators seems to be difficultLinkage to other indicators seems to be difficult

• Restricted usabilityRestricted usability


Indicator 3Indicator 3• Used mainly as background informationUsed mainly as background information• Relevant for better matching and shaping educational policiesRelevant for better matching and shaping educational policies• Rarely applied on provider level although big (regional) differencesRarely applied on provider level although big (regional) differences• Used for social dialogue Used for social dialogue

Indicator 4Indicator 4• Consideration of migrants classified as very importantConsideration of migrants classified as very important• Indicator mainly used as contextual information for policy development on Indicator mainly used as contextual information for policy development on

national levelnational level• Partly the indicator is used to analyse participation and completion rates in Partly the indicator is used to analyse participation and completion rates in

relation to prevalence (FIN)relation to prevalence (FIN)• In some countries VET-schools receive addtional funding when serving In some countries VET-schools receive addtional funding when serving

vulnerable groups (FIN, NL)vulnerable groups (FIN, NL)


IndicatorIndicator 5 5

• Funding of VET-providers often depending on number of participantsFunding of VET-providers often depending on number of participants

Indicator 6Indicator 6• Generally classified as very importantGenerally classified as very important• The only indicator which is (rarely enough) used for efficiency issuesThe only indicator which is (rarely enough) used for efficiency issues• Relevant also for financing (NL)Relevant also for financing (NL)• Completion rate needs to be desaggregated according to different (vulnerable) Completion rate needs to be desaggregated according to different (vulnerable)

groupsgroups

Indicator 7Indicator 7• Seen as very relevant for the matching issueSeen as very relevant for the matching issue• Used as basis for performance-based funding (FIN, SW) Used as basis for performance-based funding (FIN, SW) • Some countries rely on highly sophistaced national data collection systemsSome countries rely on highly sophistaced national data collection systems• In other countries availability of data often depends on schools „handwork“In other countries availability of data often depends on schools „handwork“• Production of reliable data needs better coordinationProduction of reliable data needs better coordination


Indicator 8Indicator 8• Partly assessed within sectoral research (LT)Partly assessed within sectoral research (LT)• Very relevant for quality assurance and quality improvementVery relevant for quality assurance and quality improvement

Indicator 9Indicator 9• Partly assessed within sectoral research (LT)Partly assessed within sectoral research (LT)• Growing number of research on anticipation of skills needsGrowing number of research on anticipation of skills needs• Many references to consultation with social partners and dialogue with Many references to consultation with social partners and dialogue with

other stake-holdersother stake-holders

Indicator 10Indicator 10

Conclusion: Relevance of indicatorsConclusion: Relevance of indicators

All indicators of the European set of indicators are All indicators of the European set of indicators are classified as being (very) importantclassified as being (very) important

Many of them are implemented in connection with Many of them are implemented in connection with educational reform or development strategies (CZ, EE, educational reform or development strategies (CZ, EE, LT)LT)

Clear indications to move sytems steering towards Clear indications to move sytems steering towards output and outcome indicators, giving high importance to output and outcome indicators, giving high importance to indicators 6, 7 and 8)indicators 6, 7 and 8)

In particular indicators 5, 6 and 7 are used for funding of In particular indicators 5, 6 and 7 are used for funding of VET-providersVET-providers

Additional remarksAdditional remarks

In many countries much research, development In many countries much research, development and data analysis is undertaken to develop and and data analysis is undertaken to develop and implement the European and/or other indicatorsimplement the European and/or other indicators

Special research emphasis towards indicator 6 Special research emphasis towards indicator 6 (completion), indicator 7 (destination), and (completion), indicator 7 (destination), and indicator 8 (responsiveness)indicator 8 (responsiveness)

Usage of indicators to be seen as part of an Usage of indicators to be seen as part of an external (supervision) framework to improve external (supervision) framework to improve quality of VET-providersquality of VET-providers

Further national indicators Further national indicators

Number of trainees per trainer (EE)Number of trainees per trainer (EE)

Availability of ICT: number of PCs per trainee Availability of ICT: number of PCs per trainee (EE)(EE)

Sustainable development (EE)Sustainable development (EE)

Student mobilityStudent mobility

Drop-out rate Drop-out rate (in the European set of indicators included implicitly as relation (in the European set of indicators included implicitly as relation

between participation and successful completion)between participation and successful completion)

Participation of young people in skills Participation of young people in skills competions (RO)competions (RO)

Challenges for the European set of Challenges for the European set of indicatorsindicators

Promote usage of the whole EU set of indicatorsPromote usage of the whole EU set of indicators

Consider inclusion of additional indicators Consider inclusion of additional indicators addressingaddressing equity issues (esp. for migrants)equity issues (esp. for migrants)

the efficieny of VET provisionthe efficieny of VET provision

Start discussionsStart discussions on reliable methods of data-collectionon reliable methods of data-collection

how to make use of indicators in an external system how to make use of indicators in an external system for verification of quality?for verification of quality?

how to make use of indicators on European level?how to make use of indicators on European level?

Documents

Cross Country Analysis on the Use of Indicators for Quality in VET Peer learning visit Helsinki, 13-15 December 2006 Erwin Seyfried on behalf of CEDEFOP