24
Roles, Responsibilities and Code of Conduct for Reviewers and Evaluators www.QQI.ie

Reviewers and Evaluators Responsibilities & Code of Cond… · 3.12 Process-specific Responsibilities of Reviewers and Evaluators 10 4 Principles of Effective Practice 11 4.1 General

  • Upload
    others

  • View
    1

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Reviewers and Evaluators Responsibilities & Code of Cond… · 3.12 Process-specific Responsibilities of Reviewers and Evaluators 10 4 Principles of Effective Practice 11 4.1 General

Roles, Responsibilities and Code of Conduct for

Reviewers and Evaluators

www.QQI.ie

Page 2: Reviewers and Evaluators Responsibilities & Code of Cond… · 3.12 Process-specific Responsibilities of Reviewers and Evaluators 10 4 Principles of Effective Practice 11 4.1 General

| 2

ROLES, RESPONSIBILITIES AND CODE OF CONDUCT FOR

REVIEWERS AND EVALUATORS

CONTENTS1 Introduction 32 Key Points – Engagement of Reviewers/Evaluators 4 2.1 Competence 5 2.2 Independence:AvoidingConflictsofInterest 53 General Responsibilities 6 3.1 Values 6 3.2 ConfidentialityandRecordRetention 6 3.3 Data Protection 7 3.4 Freedom of Information 8 3.5 Accountability 8 3.6 Withdrawal of a Reviewer or Evaluator from a Review or Evaluation 8 3.7 Reporting Misconduct 9 3.8 Fees 9 3.9 Travel and Subsistence Claims 9 3.10 Resolving Problems and Contacting QQI 9 3.11 Training for Reviewers and Evaluators 10 3.12Process-specificResponsibilitiesofReviewersandEvaluators 104 Principles of Effective Practice 11 4.1 General 11 4.2 Panels 11 4.2.1 All Panel Members 12 4.2.2 Panel Chairperson 12 4.2.3 Report Writer 13 4.2.4 Learner 13 4.2.5 Employer/SectoralRepresentative 13 4.2.6 Evidence 13 4.2.7 Findings 14 4.2.8 Observers of Reviews and Evaluations 14 4.2.9 Site Visit 14 4.2.10 Reporting 145 Becoming a Reviewer or Evaluator 15 5.1 Initial Approach to a Prospective Reviewer or Evaluator 15 5.2 Non-transferability,PrivacyandConfidentiality 15 5.3 Register of Experts 15Appendix A Reviewer Competence and Independence 17 1 Competence 17 1.1 General Competences 17 1.2 Programmes of Education and Training 18 1.3 QualityAssuranceoftheProvisionofEducationandTraining 19 1.4 CorporateGovernanceandFinancialStability 19 1.5 Panel Chairperson 20 1.6 ReportWriterandRecordingSecretary 20 2 Independence 20 2.1 Consulting 21 2.2 QQI Personnel 22Appendix B QQI Contact Details 22

Page 3: Reviewers and Evaluators Responsibilities & Code of Cond… · 3.12 Process-specific Responsibilities of Reviewers and Evaluators 10 4 Principles of Effective Practice 11 4.1 General

3 |

ROLES, RESPONSIBILITIES AND CODE OF CONDUCT FOR

REVIEWERS AND EVALUATORS

1. INTRODUCTIONThe intended audience for this document comprises reviewers and evaluators acting on behalf of QQI initsqualityassuranceprocesses.QQI1isprivilegedtohavetheopportunitytoworkwitharangeofexternalindividuals,who–asexpertsintheirareas–participateasreviewers/evaluatorsinQQI’squalityassuranceprocesses.

Unlessotherwisespecified,QQI-appointedreviewersandevaluatorsareexpectedtoreviewandevaluatealldocumentationthatisdisseminatedtothembyQQI,discusstheirimpressionswiththeirfellowreviewers/evaluatorsand,basedontheirevaluationsanddiscussions,arriveatarecommendationfordecisionbyQQIastotheoutcomeofthereview/evaluationprocess.

Theworkofreviewers/evaluatorsandthepanelstheycompriseinforms,forexample,QQI’sdeterminations of applications for the validation of programmes of education and training and its reviewsoftheeffectivenessofproviders’qualityassuranceprocedures.

Reviewers/evaluatorscomefromdiversebackgrounds,bothnationalandinternational,including,butnotlimitedto:learners(e.g.studentsandapprentices),employers,staffmembersofprovidersofprogrammes of education and training, professional regulators, and professional practitioners.

This document is intended for persons engaged by QQI for the: • evaluationofnewproviderqualityassuranceprocedures(initialaccess);

• evaluationofexistingproviderqualityassuranceproceduresforthepurposeofapproval(reengagement);

• validationorrevalidationofataughtprogrammeofeducationandtraining;

• validationorrevalidationofaresearchdegreeprogramme;

• review(standardorfocussed)ofvalidation;

• cyclicalreviewofaninstitutionofhighereducationoraprovideroffurthereducationandtraining;

• focussedreviewoftheimplementationandeffectivenessofproviders’qualityassuranceprocedures;

• evaluationofarequestfordelegatedauthoritytomakeawards;

• reviewofdelegatedauthority;

• monitoringtheimplementationofqualityassurancepoliciesandprocedures;

• reviewofproceduresforaccess,transferandprogression;or

• anyotherkindofqualityrelatedevaluationorreviewthatQQImayundertake.

QQIqualityassuranceprocessesapplyinthecontextsoffurthereducationandtraining,highereducation (both of which categories include apprenticeship programmes) and English language education.

QQI’squalityassuranceprocessesalwaysinvolveaproviderorprovidersofprogrammesofeducationand training (shortened to provider or providers). The scope of processes varies. An example of a narrow angleofviewistheevaluationofanapplicationbytheprovidertoQQIforthevalidationofoneofitsprogrammes.AnexampleofabroadangleofviewisthecyclicalreviewbyQQIoftheeffectivenessofaprovider’squalityassurance(QA)procedures.

Page 4: Reviewers and Evaluators Responsibilities & Code of Cond… · 3.12 Process-specific Responsibilities of Reviewers and Evaluators 10 4 Principles of Effective Practice 11 4.1 General

| 4

ROLES, RESPONSIBILITIES AND CODE OF CONDUCT FOR

REVIEWERS AND EVALUATORS

ItisessentialthatQQI,thepublic,andtheeducationandtrainingcommunitycanbeconfidentthatreviewsandevaluationsareconductedbycompetentpersonswhocanofferanobjectiveandinformedopiniononthequalityofeducationandtraining,researchandrelatedservices,activitiesandprocessesbeingevaluatedorreviewedandwhoundertaketheirtaskprofessionally.

QQI’sreviewers/evaluatorsarecarefullyselected.Theprincipalcriteriafortheirselectionarecompetence(havingtheexpertisenecessarytoperformtherelevantfunction)andindependence(fromtheproviderconcerned).QQI’sreviewers/evaluatorsaresupportedbyappropriatetraining/briefing(see3.11 below).

The remainder of this document elaborates on how QQI establishes that a reviewer or evaluator is competent and independent and sets down a code of conduct for reviewers and evaluators.

2 KEY POINTS – ENGAGEMENT OF REVIEWERS/EVALUATORS

Thefollowinghighlightssomekeypointstotakefromthisdocument:

• Tobeengagedasareviewerorevaluatoryouneedtobecompetenttoperformthetaskandindependent of the provider concerned.

• YouareobligedtodeclareanyintereststhatmightbeperceivedtoconflictwiththeindependenceandintegrityoftheQQIprocess.(SeeAppendixA,Section2,forexamplesofrelationshipsthatmayconstituteaconflictofinterest).

• Yourdeclaration(orthefactthatyoumadenodeclaration,ifapplicable)maybepublishedbyQQI.

• Youshouldnotacceptanengagementifyoufeelthatyoulacktheexpertisenecessarytoperformyourfunction.

• YouareobligedtonotifyQQIifyoudiscover,followingengagement,thatyoulacktheexpertisenecessarytoperformyourfunction.

• Youmustconfirmthatyouhavereadandunderstoodthisdocumentinadvanceofyourengagementasareviewer/evaluatorforQQI.

• YoumustcomplyinfullwithyourobligationsundertheGeneralDataProtectionRegulation(GDPR).QQIwillensurethatpersonaldataisnotcollectedunnecessarilyforthepurposesofitsreview/evaluationprocesses.Intheeventthatyouneedtorequestadditionalinformationfromaproviderorinstitutionatasitevisit,youmustconfirmwiththeproviderthatanydocumentationprovidedisGDPR-compliant.

• Youareexpectedtoactwithintegrity,diligence,objectivity,andprofessionalismandtorespectdiversity.

• Your contact at all times during the process will be a designated QQI contact. With the exception of thesitevisit(s),youshouldnotatanytimecommunicateordiscussanyaspectsofoutcomesofthereviewdirectlywiththeprovider.

Page 5: Reviewers and Evaluators Responsibilities & Code of Cond… · 3.12 Process-specific Responsibilities of Reviewers and Evaluators 10 4 Principles of Effective Practice 11 4.1 General

5 |

ROLES, RESPONSIBILITIES AND CODE OF CONDUCT FOR

REVIEWERS AND EVALUATORS

• UnlessotherwiseagreedwithQQI,youareresponsibleformakingyourowntransportarrangements,aswellasforprovidingyourownmeansofrecordingyourimpressionsduringthedeskreviewinadvanceofandduringthesitevisit,andwhencompilingtheresultingreport(e.g.laptop)andmeansofcommunication(e.g.mobilephone).QQIwillprovideyouwiththedocumentation for evaluation and appropriate report template, expenses claim form, fee claim form(whereapplicable),andanyotherdocumentationnecessarytodischargeyourduties.

• TheoutputofeachrevieworevaluationinwhichyouparticipateisawrittenreportcontributedtobyyouandapprovedthroughQQI’sgovernanceprocesses.

• QQIwillpublishapprovedreportsandreviewersarenamedinreportstowhichtheycontributed.

• Otherthanthepublishedreportthecontentofthereview/evaluationisconfidentialtothereviewers/evaluatorsandQQI.(See3.2forfurtherdetailsoftheconfidentialityrequirementswithwhichreviewersandevaluatorsareexpectedtocomply.)

• IfyoubecomeawareofanymisconductconcerningtherevieworevaluationyouareobligedtoreportthisinwritingtoQQIwithoutdelay.(See3.7forfurtherdetails.)

• The remainder of this document elaborates on the above points.

2.1 COMPETENCE

QQIwillexerciseitsjudgmentastothecompetencesrequiredofareviewerorevaluatorconsideringtheintendedroleandresponsibility(inthecontextofagroup,whereapplicable)andtherelevantQQIstandards,guidelines,codes,criteriaandpolicies.DifferentQQIqualityassuranceprocesseshavedifferent competence needs.

Further details are provided in Appendix A.

2.2 INDEPENDENCE: AVOIDING CONFLICTS OF INTEREST

Reviewersandevaluatorsmustactwithstrictimpartialityandobjectivity.

StakeholdersmusthaveconfidencethatQQIreviewsandevaluationsareobjectivelyvalidandreliable.Itisinproviders’interest,andthatofthepublic,thatreviewsandevaluationsareconductedtransparentlybypersonswhoareindependentoftheproviderconcerned(i.e.freeofconflictinginterests).

QQIhasafirmpolicyofnotappointingpersonsinanycasewherethereisanyforeseenpossibilityof(realorapparent)conflictbetweenthatperson’sinterestsandtheindependenceandintegrityoftheprocess.Eventheappearanceofconflictofinterest,wherenoneexists,candamagethecredibilityofthepersonselectedandthereview/evaluationprocessasawhole.

Prospectivereviewers/evaluatorsareexpectedtoconfirminadvanceoftheirengagementthatthereisnoconflictofinterestinrespectoftheirparticipationintheprocessinquestion.

Further details are provided in Appendix A, Section 2.

Page 6: Reviewers and Evaluators Responsibilities & Code of Cond… · 3.12 Process-specific Responsibilities of Reviewers and Evaluators 10 4 Principles of Effective Practice 11 4.1 General

| 6

ROLES, RESPONSIBILITIES AND CODE OF CONDUCT FOR

REVIEWERS AND EVALUATORS

3 GENERAL RESPONSIBILITIES

3.1 VALUES

QQI’svaluesareasfollows:

• We believe we have a shared responsibility with others to ensure confidence in and continuous improvement of the quality of education and training.

• We believe that the attainment of our goals and objectives is best pursued collaboratively and constructively with our diverse set of partners and providers. We value collaborative effort for mutual benefit.

• We are committed to working with objectivity and transparency. This underpins our decision-making and our policies, procedures and activities. These are evidence-based, informed by national and international good practice, and conducted in a manner which is openly transparent and engenders trust.

• We are committed to making a difference to our partners, providers and our people. We value achievement and impact - the successful pursuit of goals and objectives which culminate in impacting positively and substantively on our operating environment.

• We are committed to learning and innovation in our organisation to continuously improve our services.

QQIexpectsreviewersandevaluatorstocarryouttheirresponsibilitiesinthespiritofthesevalues.QQIexpectsthatallreviewersandevaluatorswillbehonest,objective,learner-centred,professional,courteous, respectful, conscientious, and diligent in the performance of their functions.

Reviewers/evaluatorsmustnotdiscriminateonthebasisofrace,colour,religion,gender,genderexpression,age,nationalorigin,disability,civilorfamilystatus,sexualorientation,ormembershipofthetravellingcommunity,inanyoftheiractivitiesordealings.

3.2 CONFIDENTIALITY AND RECORD RETENTION

Reviewersandevaluatorsinvolvedinreviewsorevaluationsareboundbystrictconfidentiality.ThereportthatispublishedbyQQIisownedbyQQIandisthesolepublicoutcomeofsuchprocesses.

ReviewersandevaluatorsarerequiredtosafeguardandpreservetheconfidentialityofanyinformationobtainedwhilecarryingouttheroleandtoshareitonlywithQQIforthepurposesoftherevieworevaluation.Thisobligationshallcontinueindefinitely.Whentheprocesshasbeenfinalised,theinformation(andanycopiesmade)mustbedestroyedorreturnedtoQQIfordestruction.

Materialsdistributedtoreviewersorevaluatorsareprovidedforreview/evaluationpurposesonlyandmustnotbedistributedorusedforotherpurposes.Thisappliesequallytoanycopiesmadeforreview/evaluationorback-uppurposes.Reviewers/evaluatorsmusttakeallnecessaryprecautionstoensurethatsoftorhardcopiesofdocumentationsupplieddonotaccidentlyorunintentionallybecomeavailable to others (such as when using public transport or using shared devices).

Page 7: Reviewers and Evaluators Responsibilities & Code of Cond… · 3.12 Process-specific Responsibilities of Reviewers and Evaluators 10 4 Principles of Effective Practice 11 4.1 General

7 |

ROLES, RESPONSIBILITIES AND CODE OF CONDUCT FOR

REVIEWERS AND EVALUATORS

Confidentialityappliestoallinformationwithoutexception.Thestakesareparticularlyhighforpersonalinformation,valuableintellectualpropertyandfinancialdatathatarenotinthepublicdomain.Confidentialinformationshouldberetainednolongerthannecessary.DifferentQQIprocessesmayhaveadditionalconfidentialityandretentionrequirementsbeyondthis.Reviewers/evaluatorsmustconfirmtoQQIdestructionofanydataheld.

Sensitive information should not be transmitted over unsecure channels (e.g. if sending sensitive text, reviewersandevaluatorsmustusethesecureSharePointfilesharingsiteprovidedbyQQI):Reviewers/evaluatorsshouldadvisetheirQQIcontactofanytechnicalissuestheyexperiencewithSharePointtoensurethattheseareresolvedexpediently...

Reviewersandevaluatorsmaydiscussthereview/evaluationonlywithrepresentativesofQQIand–whereapplicable–withotherreviewers/evaluatorsandrepresentativesofproviders.Iftheneedarises,informationmaybedisclosedtopersonsotherthanthoseoutlinedaboveifQQIhasgivenwrittenpermissiontodoso.TheQQIreportistheonlyproperchannelforthepublicationofinformationaboutthe review or evaluation.

3.3 DATA PROTECTION

Incarryingouttheirrole,reviewersandevaluatorsmayhandlepersonaldata,whichisanyinformationrelatingtoanidentifiedoridentifiableperson.Thiscouldbeinformationaboutlearners,stafforotherparties.Inhandlingsuchdata,evaluatorsandreviewersareobligedtocomplyinfullwiththeGeneralData Protection Regulation, and to ensure that:

• onlypersonaldatanecessaryfortherevieworevaluationarecollected;

• theconsentofthedatasubjecthasbeenobtained;

• theinformationiskeptsecureandonlyusedforthepurposeoftherevieworevaluation;

• itisnotshared,eitherdeliberatelyoraccidentally,withthirdparties;and

• it is deleted once the review or evaluation has been completed.

Assetoutabove,QQIwillensurethatpersonaldataisnotcollectedunnecessarilyforthepurposesofitsreview/evaluationprocesses.Intheeventthatreviewers/evaluatorsneedtorequestadditionalinformationfromaprovideratasitevisit,theymuststipulatetotheproviderthatnopersonaldatabeincludedinanydocumentsrequested,orthatanypersonaldataberedactedfromthedocuments.

Incaseswheretheinformationforreview/evaluationdoescontainpersonaldata,anysuchdatamustbeprotectedbykeepingitsecureandusingitonlyforthepurposeforwhichitwascollected.Furthermore,suchdatamustbedeletedassoonasitisnolongernecessary.

Onceinformationthatincludesanypersonaldatahasbeencollectedfromaprovider,thereviewerorevaluatorshouldensurethatthefilesanddocumentscontainingthepersonaldataarestoredsecurely,forexampleonlaptopsthataresubjecttoencryptionandpassword-protected,orincloudstoragethatcomplieswiththeGDPR.Assetoutabove,filescontainingpersonaldatashouldnotbesentbyemail.Hardcopiesoffilesshouldbestoredandtransportedsecurely.Datashouldbetreatedwithabsoluteconfidence.

In the event of a data breach, the reviewer or evaluator must report the breach to the QQI Data ProtectionOfficerimmediately(seeAppendixBforalistofQQIcontactdetails)andmustcomplywithalldirectionsfromtheDataProtectionOfficertoaddress,mitigateandremedythebreach.

Page 8: Reviewers and Evaluators Responsibilities & Code of Cond… · 3.12 Process-specific Responsibilities of Reviewers and Evaluators 10 4 Principles of Effective Practice 11 4.1 General

| 8

ROLES, RESPONSIBILITIES AND CODE OF CONDUCT FOR

REVIEWERS AND EVALUATORS

On completion of a review or evaluation, reviewers and evaluators are required to return all information obtainedduringthatrevieworevaluationtoQQI,includinganyinformationheldinhardcopy.Areviewerorevaluatormay,alternatively,berequestedtoshreditortoreturnittoaprovider.(Insuchcases,thereviewer/evaluatormustconfirmtotheirQQIcontactpersonthattheyhavedoneso.)Reviewersand evaluators must at the same time also delete all existing copies of information obtained for the purposesofthatrevieworevaluation,specificallypersonaldata,fromalldevicesandemailsystems.

Given the importance of compliance with GDPR, reviewers and evaluators are required to allow QQI tomonitorandauditGDPRcompliance,forexampletomakeavailableonrequestallinformationnecessarytodemonstratetheircompliancewiththeirobligationsunderArticle28oftheGDPR,andtoallowforGDPRauditsbyQQIorbyanotherauditormandatedbyQQI.

InordertoensurethatQQIandthereviewer/evaluatorcomplywiththeirobligationsundertheGDPR,itisaconditionofengagementasareviewer/evaluatoronaspecificrevieworevaluationthataGDPRController/ProcessorAgreementgoverningthatrevieworevaluationisenteredinto.ThisformisavailableseparatelyfromQQI.

3.4 FREEDOM OF INFORMATION

QQIissubjecttoFreedomofInformationlegislation,andthisextendstoanyrecordsoftheprocesstakenbyreviewersandevaluators.

ReviewersandevaluatorsarerequiredtoreturnanyrelevantnotestoQQIoncompletionofthereview/evaluationprocessinwhichtheywereinvolved;alternatively,reviewers/evaluatorsmustdestroyanyrelevantnotesandrecordsthemselvesandadvisetheirQQIcontactthattheyhavedoneso.

3.5 ACCOUNTABILITY

Reviewers and evaluators are accountable to QQI for their conduct in the context of a review or evaluation.QQIreservestherighttodisengagereviewers/evaluatorsifnecessary.

3.6 WITHDRAWAL OF A REVIEWER OR EVALUATOR FROM A REVIEW OR EVALUATION

Reviewersandevaluatorswillfrequentlybeinvolvedinprocessesthathavehighstakesforproviders.Ifareviewer/evaluatorwithdrawsfromareview/evaluationprocesswithoutnoticeaftertheyhavebeenconfirmedbyQQI,theprocesscanbecompromisedandmayhavetobedelayedatsignificantcostandinconveniencetoboththeproviderandtoQQI.Itisimportantthereforethatthereviewer/evaluatorinquestion informs their QQI contact person as soon as the prospect of having to withdraw arises. In such cases,wherefeasible,QQIwillendeavourtofindapersonwithasimilarbackgroundandexpertisetotaketheplaceofthereviewer/evaluatorwhohaswithdrawnfromtheprocess.

Page 9: Reviewers and Evaluators Responsibilities & Code of Cond… · 3.12 Process-specific Responsibilities of Reviewers and Evaluators 10 4 Principles of Effective Practice 11 4.1 General

9 |

ROLES, RESPONSIBILITIES AND CODE OF CONDUCT FOR

REVIEWERS AND EVALUATORS

3.7 REPORTING MISCONDUCT

Ifareviewer/evaluatorisofferedagift,benefit,rewardorunduehospitalityfromtheorganisationwherethereview/evaluationisbeingconductedthisshouldbedisclosedinwritingtoQQIwithoutdelay.Ifsuchanofferismadewithinthreeyearsoftheconclusionoftheprocess,thisshouldalsobedisclosedtoQQIthrough the relevant QQI contact person.

Ifareviewer/evaluatorfeelsthattheinterestsofanotherreviewer/evaluatorconflictwiththoseoftheQQIprocesstheyshouldbringthistoQQI’sattention.(SeeAppendixA,Section2,formoreinformationonconflictsofinterest.)

Ifareviewer/evaluatorobservesanykindofmisconduct(byanyparty)inthecontextoftherevieworevaluationtheyshouldalertQQIassoonasispracticable.

If the misconduct involves a member or members of QQI staff, it should be brought to the attention of QQI’sChiefExecutive(seeAppendixBforalistofQQIcontactdetails).

3.8 FEES

QQInoteswithgratitudethatmanyreviewersandevaluatorsworkonaprobonobasis.Thereareprocessesforwhichreviewersandevaluatorsmayreceiveremuneration;therateofremunerationdependsontheprocess.DetailsareavailableseparatelyfromQQI.

3.9 TRAVEL AND SUBSISTENCE CLAIMS

ReviewersandevaluatorsarerequiredtoadherestrictlytoQQIregulationsconcerningclaimsforreimbursement (or partial reimbursement as applicable) of travel and subsistence expenses and tomakeoptimaleconomicuseofresources.Reimbursementofexpensesisneverautomatic,andreviewers and evaluators must obtain explicit QQI approval in advance as required. Details are available separatelyfromQQI.

3.10 RESOLVING PROBLEMS AND CONTACTING QQI

Asabove,intheeventofadatabreach,thereviewer/evaluatorshouldcontactQQI’sDataProtectionOfficerimmediately(seeAppendixBforalistofQQIcontactdetails).

Where a reviewer or evaluator encounters a problem, they should aim to solve it as follows: Ifareviewerorevaluatorisactingonapanelandhasaconcernrelatingtoitsoperation,theyshould,inthefirstinstance,speakwiththepanel’schairpersonexplainingthematterofconcernandseekingaresolution. Should the chairperson be unable or unwilling to solve the problem, or if the concern relates to the chairperson, the reviewer or evaluator should raise the matter with their QQI contact person or the relevantQQIHeadofFunction(reviewersandevaluatorswillbeinformedofwhothisiswhenengaged),orifunavailable,QQI’sDirectorofQualityAssurance.

Reviewersandevaluatorswhoarenotpanelmembers(e.g.reportwriters)shouldfirstraisethematterwiththeirQQIcontactpersonortherelevantQQIHeadofFunction,orifunavailable,QQI’sDirectorofQualityAssurance.

Page 10: Reviewers and Evaluators Responsibilities & Code of Cond… · 3.12 Process-specific Responsibilities of Reviewers and Evaluators 10 4 Principles of Effective Practice 11 4.1 General

| 10

ROLES, RESPONSIBILITIES AND CODE OF CONDUCT FOR

REVIEWERS AND EVALUATORS

If,havingtakenthestepsabove,themattercannotberesolved,thereviewerorevaluatorshouldbringthemattertotheattentionofQQI’sChiefExecutive(seeAppendixBforalistofQQIcontactdetails).Wherethereisnospecificproceduretodealwiththeissueinquestion,eachincidentwillbedealtwithonacase-by-casebasis.

WhenreportinganyotherissuestoQQIinwriting,thereviewerorevaluatorshouldsendanemailtotheirQQIcontactpersonortherelevantHeadofFunction.

3.11 TRAINING FOR REVIEWERS AND EVALUATORS

QQIhasapolicyofprovidinginductionforallpanelmembers.Trainingeventswillbeorganisedfromtimetotime.Prospectivereviewersandevaluatorsmayberequiredtoundertaketrainingbeforetheyact.Ingeneral,QQIdoesnotremunerateorreimburseexpensestoevaluatorsorreviewersforanytraininginwhichtheyparticipate;however,therearecaseswhereexpensesfortravelandsubsistencemaybereimbursed.DetailsareavailableseparatelyfromQQI.

PanelmembersareencouragedtodiscusstheirlearningneedswithQQI.Theywillbebriefedontheirroleandonthecontextwithinwhichtheywillbeoperating.

3.12 PROCESS-SPECIFIC RESPONSIBILITIES OF REVIEWERS AND EVALUATORS

QQIconductsmultiplekindsofreviewsandevaluations.Thepreciseresponsibilitiesofareviewerorevaluatorareprocessspecific.Typically,thesewillbesetoutintherelevantQQIpolicydocument(ortermsofreferenceorsuchlike)providedtothereviewerorevaluatorwhenengaged.

Reviewers/evaluatorswillreceiveaprocess-specificletterofengagement/deploymentletter(thismaybesentelectronically).

Page 11: Reviewers and Evaluators Responsibilities & Code of Cond… · 3.12 Process-specific Responsibilities of Reviewers and Evaluators 10 4 Principles of Effective Practice 11 4.1 General

11 |

ROLES, RESPONSIBILITIES AND CODE OF CONDUCT FOR

REVIEWERS AND EVALUATORS

4 PRINCIPLES OF EFFECTIVE PRACTICE

4.1 GENERAL

Reviewers and evaluators are expected to:

• Acceptanengagementonlyifcompetentandfreeofintereststhatconflict,ormaybeperceivedtoconflict,withtheindependenceandintegrityoftheprocess.Iftheydiscoverthattheirinterestsconflictwiththeprocess,orthattheydon’thavetherequiredexpertise,theyarerequiredtonotifyQQIinwriting(andthepanelchairpersonifapplicable)withoutdelaysothatremedialactioncanbetaken.

• Investtimeinpreparation.Generally,reviewandevaluationinvolvetheperusalof(i)documentationpreparedbytheproviderconcernedand(ii)QQIdocumentation.Reviewersandevaluatorsareexpectedtoreadandcriticallyassessalldocumentationprovided,unlessinstructedtofocusonlyonpartofit.

• Participate in all relevant activities.

• Questionfindingsandevidenceandtrytocross-checkorcorroborate.

• Conductthemselvesprofessionallyandcompetentlyalways.

• Betolerantandcourteousinengagementswithothers.

• Respectthediverseculturesandbackgroundsofothers(seeabove,3.1).

• Possess the requisite competence in the English language to be able to discharge their duties.

4.2 PANELS

Eachrevieworevaluationisessentiallyuniqueandrequiresauniquemixofcompetences.Frequentlythiswillrequiretheuseofagroupofreviewers/evaluators,typicallyreferredtoasapanelorateam(‘panel’hereafterforeaseofreference).Panelsizewillvary,dependingontherevieworevaluationprocess.Eachreviewerorevaluatorinapanelmaybeassignedaspecialisedfunctionwithinthepanel.Nopanelmemberisexpectedtohaveallthecompetencesrequiredofthepanel.Examplesofthetypesofrolesthatmightbeinvolvedinvariousreviews/evaluationsareincludedbelow(see4.2.1–4.2.5).Notethatdifferentprocesses will require different panel compositions.

QQIaimstoensurethatthereisatleast40%ofeachgenderrepresentedonanypanel.Whileeveryeffort will be made to achieve appropriate gender balance in the composition of panels, achieving an appropriateblendofexpertiseistheprimaryconsideration.Inhighereducation(andallcyclicalreviews),panelswillalsogenerallyincludealearner(butnotoneenrolledbytheproviderconcerned;see4.2.4).Whereappropriate,QQIwillalsoincluderepresentativesfromtheworldofwork(seeemployer/sectoralrepresentative;4.2.5).

Panelsoperateasateamundertheleadershipofachairperson.Acollegialenvironmentisnecessaryfortheproperfunctioningofthepanel.Panelmembersmaycontributetoanyaspectordimensionofthedialoguethatmayoccurduringtherevieworevaluation.Whendoingso,itisimportantthatpanelmembersemployedby,orenrolledwith,otherprovidersrecognisethattheproviderbeingreviewed/evaluatedmayemployapproachesotherthanthosethatareusedinthepanelmembers’owninstitutionandthatsuchapproachesmaybeequallyvalid.

Page 12: Reviewers and Evaluators Responsibilities & Code of Cond… · 3.12 Process-specific Responsibilities of Reviewers and Evaluators 10 4 Principles of Effective Practice 11 4.1 General

| 12

ROLES, RESPONSIBILITIES AND CODE OF CONDUCT FOR

REVIEWERS AND EVALUATORS

4.2.1 All Panel MembersAllpanelmembers’functionsinclude

• Reportingpreliminaryfindingsandinitialimpressionsofthedocumentationsubmittedbytheprovider to the chairperson in advance of the panel meeting and site visit.

• Askingquestionsduringmeetingsinafair,constructivemannerwhileremainingindependentlycritical.

• Formulating clear questions.

• Resolvinganydisagreementswithotherpanelmembersduringprivatemeetingsofthepanelandavoiding debating with other panel members during meetings with the provider.

• Contributing,afterthesitevisit,totheproductionofthereport,andtothepanel’sresponsetotheprovider’sresponsetothereport.Ingeneral,thisrequirespanelmemberstobecontactablebyemailandtelephoneduringanagreedperiodandtorespondpromptlywhenrequested.

For information on the general competences required of panel members, see Appendix A, 1.1.

4.2.2 Panel ChairpersonThe panel chairperson is a member of the panel. Their role is to provide tactical leadership and to ensure thattheworkofthepanelisconductedinaprofessional,impartialandfairmanner,andincompliancewithQQIrequirements(asexpressedbyitspolicies,criteria,codes,standards,guidelines,valuesandprocedures).

Thepanelchairperson’sfunctionsinclude

• Briefingthepanelontheobjectivesandmethodof,andcontextfor,therevieworevaluation.

• Leading the conduct of the review or evaluation and ensuring that proceedings remain focussed in linewiththeagreedschedule/timeframe.

• Coordinatingtheworkofreviewersandevaluators(sothat,forexample,individuals’leadinglinesofenquiryareidentifiedinadvanceofmeetingswiththeproviderconcerned).

• Ensuringthatmeetingsareconductedefficientlyandeffectively.

• Ensuringimpartialityandpropriety.

• Diffusingdisagreementandconflictwhenitarises.

• Establishingapositivedynamicamongthepanelandinengagementsbetweenthepanelandtheprovider.Thisincludesensuringthatinteractionsareconstructiveandnon-adversarial;thattheviewsofallparticipantsarevaluedandconsidered;andfosteringopenexchangesofopinions.

• Politelycurtailingevasiveorcircuitousresponses.

• Ensuringthatanyquestionsaskedorinformationrequestedofaproviderareclearandsufficientlyfocussed.

• Summarising, at the end of each meeting, the main topics covered in the discussion to ensure that all necessarymattershavebeenaddressed.

• Ensuringthattherevieworevaluationtasksarecompletedandthattherearenounresolvedmattersbefore the end of the process.

• Facilitatingtheemergenceofevidence-basedpaneldecisions(ideallybasedonconsensus).

• Contributingtoandoverseeingtheproductionofthepanelreport(whichmayincludewritingthereport).

• RepresentingthepanelviewstoQQI(e.g.endorsingthepanelreport(oranyamendmentsoraddendums) on behalf of the panel).

• Ensure that the panel report is produced within a reasonable timeline, which will be agreed in advance with QQI.

Page 13: Reviewers and Evaluators Responsibilities & Code of Cond… · 3.12 Process-specific Responsibilities of Reviewers and Evaluators 10 4 Principles of Effective Practice 11 4.1 General

13 |

ROLES, RESPONSIBILITIES AND CODE OF CONDUCT FOR

REVIEWERS AND EVALUATORS

• Ensurethatallresponsesbythepanelofreviewers/evaluatorstoQQIandtotheproviderareissuedpromptlyandwithinareasonabletimeline,whichwillbeagreedinadvancewithQQI.

Thepanelchairpersonmustalwaysexercisetheirauthorityinafairandresponsiblemanner. For information on the competences required of panel chairpersons, see Appendix A, 1.5.

4.2.3 Report Writer Thereportwriter’sroleistocapturethepanel’sdeliberationsanddecisionsduringtheproceedingsandhelpexpressthemclearlyandaccuratelyinthepanelreport.Itisvitalthatthereportwriterensuresthatsufficientevidenceisprovidedinthereporttosupportthepanel’srecommendation.

Thereportwriterwillnormallybeamemberofthepanel.Iftheyarenotapanelmember,theyarestillsubjecttothesameconfidentialityandindependencerequirementsthatapplytoreviewersandevaluators;however,theyshouldnotaskquestionsoftheprovideratthesitevisit,orseektoinfluencethepanel’sdecision-making.Anyindividualemployedby,orotherwiseconnectedwith,theproviderconcernedinareview/evaluationmaynotbeareportwriter.

The role of the report writer includes

• Reflectingtheviewsofthepanelinthereportalongwithevidencesupportingthoseviews.

• Articulatingthefindings,promptly,fairlyandcomprehensivelyinaclear,straightforwardandeasilyunderstoodmannerthataccordswithQQI’srequirements.

• Drafting the report in consultation with the panel members and under the direction of the panel chairperson within a reasonable timeline, which will be agreed in advance with QQI.

Forinformationonthecompetencesrequiredofthereportwriter,seeAppendixA,1.6.Incyclicalreviewprocesses,thecoordinatingreviewerfulfillsasimilarroletothereportwriter.Formoredetailsontheroleofthecoordinatingreviewer,refertothehandbookfortheprocessinquestion.

4.2.4 Learner Wherethepanelincludesalearner,theyareafullpanelmemberandshouldadheretothefunctionssetoutforallpanelmembersat4.2.1.However,thelearnerhasanumberofadditionalfunctionsonthepanel:

• Reviewing and evaluating documentation from a learner perspective.

• Questioning the provider from a learner perspective.

• Ensuring that the learner voice forms an integral part of the review or evaluation.

4.2.5 Employer/Sectoral RepresentativeTheemployerrepresentativemustadheretothefunctionssetoutforallpanelmembersat4.2.1,inaddition to the following:

• Reviewingandevaluatingdocumentationfromanemployer/sectoralperspective.

• Questioningtheproviderfromanemployer/sectoralperspective.

• Ensuringthattheemployer/sectoralvoiceformsanintegralpartoftherevieworevaluation.

4.2.6 EvidenceTherationaleforgroupdecisionsmustbestatedinthereportandtheymustbebasedonpositiveevidence.Itisnotsufficienttoacceptapropositiononthebasisthatthereisnoevidencetothecontrary.Assumptionsaregenerallyunwarranted.Wherethereisuncertaintythegroupmustdoitsbesttoresolveitbefore reaching its decision.

Page 14: Reviewers and Evaluators Responsibilities & Code of Cond… · 3.12 Process-specific Responsibilities of Reviewers and Evaluators 10 4 Principles of Effective Practice 11 4.1 General

| 14

ROLES, RESPONSIBILITIES AND CODE OF CONDUCT FOR

REVIEWERS AND EVALUATORS

4.2.7 FindingsWhererelevant,panels’findingsshouldbebasedoncriteria.Itispreferredthatfindingsarebasedontheconsensusofthepanel,butwherethisisnotpossibleamajoritydecisionmaybereportedalongwithanoutline of the dissenting views.

4.2.8 Observers of Reviews and EvaluationsSubjecttotheagreementofQQI,theorganisationunderrevieworevaluation,and(whereappropriate)thepanelchairperson,anobservermayattendarevieworevaluationprocess.AprospectiveobservermustprovidearationaleforattendinganddeclareanyrelevantintereststoQQIinwriting.Thereisnofeeortravel/subsistencereimbursementpayabletoobservers.

Observers have no input in the review or evaluation and do not contribute to panel discussions and deliberations,nordotheyparticipateinthedecision-makingprocess.Theextentoftheirattendancemayvary.Insomeinstances,itmaybeappropriatethatobserversattendtheentireprocess.TheextentoftheirinvolvementmaybemodifiedbyQQIduringarevieworevaluation.

Observersaresubjecttothesameconfidentialityandconflict-of-interestrequirementsthatapplytoreviewersandevaluators.Theymustalsocommittoensuringthatanyobservationsmade,andanymaterialsaccessed,aspartoftheprocesswillbetreatedinthestrictestconfidenceandwillnotbeusedoutside the process without the written consent of QQI, the panel chairperson and the provider.

4.2.9 Site VisitReviewsandevaluationsalwaysinvolvetheperusalofdocumentation(writtenmaterial)andfrequentlyinvolvea‘sitevisit’.Thesitevisitisprimarilyanopportunityforthereviewersorevaluatorstomeetpeoplewhocanfieldquestionsabouttheprogrammeorproviderunderrevieworevaluation(therebyresolvinganyuncertaintiesfromthedocumentation).Italsoprovidesanopportunityformembersoftherevieworevaluationpaneltoworktogetherasateaminaface-to-facesetting.

Itisexpectedthatareviewerorevaluatorwillarriveatthesitevisitwithalistofspecifictopicsthattheywouldliketopursuethroughquestioning,havingreadalltherelevantdocumentationthoroughly.Itisnever acceptable for them to arrive at the site visit without having read the documentation.

4.2.10 ReportingQQI reviews and evaluations culminate in the production of a report that is published and includes the names,rolesandaffiliationsofreviewers/evaluators,aswellasanystatementsofinterestthattheyhavedeclared.Listsofpersonswhohaveparticipatedasreviewers/evaluatorsinQQIprocessesmaybepublishedinQQI’sannualreports.

Iftherevieworevaluationinvolvesasitevisit,thereportwillnormallybedraftedbythepanelofreviewersorevaluatorssubsequenttothesitevisit.Thechairofthepanelisresponsibleforfinalisingthe reporting timeline.

Reviewersandevaluatorsmustbecontactablebythepanelchairandsecretary,andbyQQI,whilethereportisbeingdrafted.Generally,theproviderconcernedwillhaveanopportunitytocorrectanyfactualinaccuraciesinthereportandformallyrespondtothereport,andreviewersandevaluatorswillneedtobeavailable to respond in turn.

Page 15: Reviewers and Evaluators Responsibilities & Code of Cond… · 3.12 Process-specific Responsibilities of Reviewers and Evaluators 10 4 Principles of Effective Practice 11 4.1 General

15 |

ROLES, RESPONSIBILITIES AND CODE OF CONDUCT FOR

REVIEWERS AND EVALUATORS

5 BECOMING A REVIEWER OR EVALUATOR

5.1 INITIAL APPROACH TO A PROSPECTIVE REVIEWER OR EVALUATOR

Somereviewersandevaluatorsareselectedthroughopencalls,othersareidentifiedthroughQQIsearchesorthroughrecommendationsbythirdparties.QQIcommunicateswithlargenumbersofprospectivereviewers and evaluators.

BeforeareviewerorevaluatorisengagedtoundertakeeachtaskQQImustsatisfyitselfthattheyarewellmatchedtothattask.ThismayrequirethatQQIsharesomeinformationabouttherelevantproviderorprogrammetoenabletheprospectivereviewerorevaluatortodeterminewhethertheyhaveboththenecessarycompetenceandindependence.AnysuchdisclosuresbyQQIarelimitedtowhatQQIconsidersnecessarytoensurearigorousandrobustreview/evaluation.Asoutlinedat3.2,alldisclosuresbyQQItoreviewers/evaluatorsarestrictlyconfidentialtothepersonconcerned.

Prospective reviewers/evaluators must undertake in writing to keep the disclosed information confidential before receiving it.

5.2 NON-TRANSFERABILITY, PRIVACY AND CONFIDENTIALITY

Typically,reviewersandevaluatorsareindividuals.WhenQQIengagesanindividualasareviewerorevaluatortheengagementisstrictlynon-transferrable,andallcommunicationsareprivateandconfidentialtothepersonconcerned.

WhereQQIengagesacompanytoundertakearevieworevaluationfunctionthiswillbemadeexplicitinwriting(i.e.therewillbeacontractualagreementbetweenQQIandthecompanyinquestion).Itmustneverbe assumed.

5.3 REGISTER OF EXPERTS

Persons who act as a reviewer or evaluator (and some who have expressed an interest) are invited to be included in the QQI Register of Experts. The Register enables QQI to allocate reviewers and evaluators to processes that match their particular experience and expertise. At present, the Register is not accessible bythegeneralpublic.

It is important to note that inclusion on the Register, or selection for a particular review, does not guarantee selection to conduct a further review or an evaluation.

QQIoccasionallycontactspersonsincludedintheRegistertochecktheaccuracyofdataintheRegister.Reviewers/evaluatorsarealsoentitledtoaccessand–whereapplicable–amendanypersonaldataretainedinrespectofthembyQQI.ThiscanbedonebycontactingQQIatQQIQA@qqi.ie.PersonsmayelecttoberemovedfromtheRegisteratanytime.Arecordwillberemovedinfullifthereviewer/evaluatorconcernedhasrequestedthattheirdetailsberemovedfromtheRegister,and/orifthereviewer/evaluatornolongersatisfiesQQIcriteriaforinclusionintheRegister

Page 16: Reviewers and Evaluators Responsibilities & Code of Cond… · 3.12 Process-specific Responsibilities of Reviewers and Evaluators 10 4 Principles of Effective Practice 11 4.1 General

| 16

ROLES, RESPONSIBILITIES AND CODE OF CONDUCT FOR

REVIEWERS AND EVALUATORS

Allcommunicationsbetweenreviewers/evaluatorsandQQIareprivateandconfidentialtoQQIbutrecordsmaybesubjecttorequeststoQQIundertheFreedomofInformationlegislation.Allinformationprovidedbyprospectivereviewers/evaluatorsinthecompletedrecordwillberetainedbyQQI.Thisinformationisonlyusedforthepurposesof:

• assigning reviewers and evaluators to suitable panels for

• validation-related processes including programme review and revalidation, and initial access to validation,

• reengagementandapprovalofqualityassuranceprocedures,

• evaluationsandreviewsinrespectofdelegatedauthority

• cyclicalreviewofaninstitutionofhighereducationoraprovideroffurthereducationandtrainingorcontactingreviewers/evaluatorsinconnectionwiththeseprocesses,

• contactingreviewers/evaluatorsinconnectionwiththeupdatingoftheRegister;

• monitoringandanalysingtheprofilesofpanels(e.g.panelmakeupintermsofgenderbalance,reviewerevaluatorbackground,andsoon)and,forexample,thefrequencyofuseofindividualreviewers/evaluators;

• contactingreviewersandevaluatorsinrelationtoQQIprocessevaluation;and

• contacting reviewers and evaluators in relation to external reviews of QQI activities.

Onlyinformationrequiredfortheaforementionedpurposesiscollected.QQI’sExpertDetailsFormisavailableseparatelyfromQQI.

REFERENCE

This code of conduct draws from:

“ENQA Code of Conduct for reviewers”2,publishedonline,EuropeanAssociationforQualityAssuranceinHigherEducation(ENQA),(retrievedMarch2020).

“ACompetencyFrameworkforGovernance.Theknowledge,skillsandbehavioursneededforeffectivegovernanceinmaintainedschools,academiesandmulti-academytrusts”3, Department for Education, Manchester,England,DFE-00021-2017,January2017

“CompetencyModelforProgramEvaluators”4publishedonline,AccreditationBoardforEngineeringandTechnology,Inc.(ABET),(retrievedMarch2020).

2 http://www.enqa.eu/wp-content/uploads/2016/09/ENQA-Agency-Reviews_Code-of-Conduct.pdfretrieved21/07/2017 3 https://assets.publishing.service.gov.uk/government/uploads/system/uploads/attachment_data/file/583733/Competency_framework_for_governance_.pdf

4 http://www.abet.org/competency-model-for-program-evaluators/retrieved25/07/2017

Page 17: Reviewers and Evaluators Responsibilities & Code of Cond… · 3.12 Process-specific Responsibilities of Reviewers and Evaluators 10 4 Principles of Effective Practice 11 4.1 General

17 |

ROLES, RESPONSIBILITIES AND CODE OF CONDUCT FOR

REVIEWERS AND EVALUATORS

APPENDIX A

REVIEWER COMPETENCE AND INDEPENDENCE

1 COMPETENCEIngeneral,competencemaybedemonstratedthroughthefollowing:

• Current occupation.

• Curriculum vitae.

• Professionalhistoryortrackrecord.

• Trackrecordasareviewerorevaluatorifapplicable.

• Experience:normally(learnersexcepted)apersonshouldbeinarelevantroleforatleastthreeyearstohavesufficientexperienceinthatroleforthepurposesofparticipatingasareviewerorevaluator.Recentexperienceinarelevantareaisgenerallyalsonecessary—distantexperiencemaynotbesufficienttomeetrequirements.

• Publications.

• Reputation (e.g. citations).

QQIwilltypicallycollectandretainthiskindofinformationaboutreviewersandevaluators.

1.1 GENERAL COMPETENCES

Thefollowingcorecompetencesarerequiredbyallreviewersandevaluatorswithoutexception:

• Effective at communicating.

• Interpersonallyskilled.

• Team-oriented.

• Professional.

• Technicallycurrent.

Thefollowingcompetencesarerelevanttomanykindsofactivities.Areviewerorevaluatorislikelytohavecompetences(includingcomprehensiveknowledge)inatleastoneofthefollowinggeneralareas:

• Leadership in the provision of education and training services.

• Teaching, learning and assessment theories and practice.

• Targetingandprovidinglearnersupports(e.g.forstudentswithdisabilitiesandotherswhomayhave special educational or training needs).

• Supporting international students (e.g. English language education, pastoral care).

• Programme (i.e. course) development, review or evaluation.

• Programme management and implementation.

• Provision of collaborative programmes.

Page 18: Reviewers and Evaluators Responsibilities & Code of Cond… · 3.12 Process-specific Responsibilities of Reviewers and Evaluators 10 4 Principles of Effective Practice 11 4.1 General

| 18

ROLES, RESPONSIBILITIES AND CODE OF CONDUCT FOR

REVIEWERS AND EVALUATORS

• Provision of transnational (cross-border) programmes.

• Technology-enhancedlearning,teachingandassessment.

• Operation and management of education and training services.

• Corporategovernanceand/orfinancialmanagementand/orinternalaudit.

• Educationandtrainingsystemsinaninternationalcontext.

• Qualificationssystems(includingaccess,transferandprogressionfactors)innationalandinternational contexts.

• Industry,economic,social,orculturaleducationandtrainingneedsconcerningaparticularfieldoflearning.

• Academicorprofessionalperspectivesconcerningaparticularfieldoflearningoroccupation.

• Academicorindustrialresearchperspectivesconcerningaparticularfieldoflearning.

• Learner(e.g.student,apprenticeortrainee)perspectivesconcerningaparticularfieldoflearning.

1.2 PROGRAMMES OF EDUCATION AND TRAINING

Areviewerorevaluatorfocussingonprogrammesislikelytohaveatleastoneofthefollowinggeneralcompetences.

• One or more of the general competences indicated in 1.1

• PracticalunderstandingofQQI’svalidationpolicyandcriteria(thismaybeacquiredduringpreparation for the review or evaluation).

• PracticalunderstandingofQQI’sawardsstandardsattherelevantNationalFrameworkQualifications(NFQ)levelandintherelevantfieldoflearning.

• AbilitytomakenationalandinternationalcomparisonswithsimilarkindsofprogrammesatapproximatelythesameNFQlevel(orequivalent)inasimilarfieldoflearning.

• Practical understanding of the context for the programme and the relevant education sector (e.g. furthereducationandtraining(FET),highereducation(HE)andEnglishlanguageeducation(ELE))and sub-sector.

Thefollowingkindsofindividualsarelikelytoparticipateinvalidationpanels(thislistisnotexhaustive:notallpanelswillincludeall,andsomeindividualsmaymeetmultipledescriptors).

• Anexperiencedteacher,lecturer,trainerorworkplacementorinvolvedinaprogrammeleadingtoan award at a relevant NFQ level (or equivalent) and in a relevant discipline.

• An instructional designer.

• A practitioner in a relevant profession or occupation.

• Anemployer(ortheirrepresentative)ofpersonswithqualificationsatarelevantNFQlevel(orequivalent) and in a relevant discipline.

• Anemployer(ortheirrepresentative)ofapprenticesortraineesoraproviderofinternships(orequivalent).

• A programme director or equivalent.

• A person with experience in the regulation of a relevant occupation.

• Arepresentativeofpractitionersinarelevantoccupation(e.g.anemployeeofaprofessionalbody).

• Aninternationallyrecognisedresearcher(doctoralprogrammevalidation).

Page 19: Reviewers and Evaluators Responsibilities & Code of Cond… · 3.12 Process-specific Responsibilities of Reviewers and Evaluators 10 4 Principles of Effective Practice 11 4.1 General

19 |

ROLES, RESPONSIBILITIES AND CODE OF CONDUCT FOR

REVIEWERS AND EVALUATORS

• A learner (e.g. student, apprentice, or trainee).

• Aqualityassurancemanager.

• Persons holding leadership positions in the provision of education or training services in Ireland or outside Ireland.

1.3 QUALITY ASSURANCE OF THE PROVISION OF EDUCATION AND TRAINING

Areviewerorevaluatorislikelytohaveatleastoneofthefollowinggeneralcompetences.

• One or more of the general competences indicated in1.1

• Comprehensiveknowledgeofthenationaland/orinternationalcontextforqualityassuranceinarelevanteducationalsector(e.g.HE,FETandELE)orsub-sector.

• ComprehensiveknowledgeoftheapplicableQQIpolicycontext(thismaybeacquiredduringpreparation for the review or evaluation).

• AbilitytomakenationalandinternationalcomparisonswithprovidersoperatingatsimilarNFQlevels(orequivalent)insimilarfieldsoflearninginsimilarsectors.

Thefollowingkindsofindividualsarelikelytoparticipateinqualityassurancerelatedreviews.

• A person holding a leadership position in the provision of education or training services in Ireland or outside Ireland

• Apersonholding,orwhohasheld,aleadershiproleinqualityassuranceinarelevanteducationortrainingcontextwithinthelastthreeyears.

• Apersonwithexperienceregulatingand/orqualityassuringeducationortrainingservices.

• Apersonwithexperienceparticipatinginevaluativequalityassuranceprocessesineducationandtraining contexts.

• A learner (e.g. student, apprentice, or trainee).

• Anemployerrepresentative.

1.4 CORPORATE GOVERNANCE AND FINANCIAL STABILITY

Areviewerorevaluatorislikelytohaveatleastoneofthefollowinggeneralcompetences.

• One or more of the competences listed in 1.1

• Corporate governance in the context of education and training provision

• Financial management in the context of education and training provision

• Riskestimationinthecontextofeducationandtrainingprovision

Thefollowingkindsofindividualsarelikelytoparticipateinqualityassurancerelatedreviews.

• Apersonholdingorwhohasheldarolerelatedtocorporategovernanceand/orfinancialmanagementand/orinternalauditinthelastthreeyears.

Page 20: Reviewers and Evaluators Responsibilities & Code of Cond… · 3.12 Process-specific Responsibilities of Reviewers and Evaluators 10 4 Principles of Effective Practice 11 4.1 General

| 20

ROLES, RESPONSIBILITIES AND CODE OF CONDUCT FOR

REVIEWERS AND EVALUATORS

1.5 PANEL CHAIRPERSON

Reviewsandevaluationsareoftenconductedbygroupsreferredtoaspanels.Panelsareledbyachairperson.Thechairpersonneedstounderstandthebroadernationalcontextofthesubjectoftherevieworevaluation.TheymustunderstandtherelevantQQIpolicies,criteria,codes,standards,guidelines, values and procedures.

A chairperson must be able to provide strategic leadership to a team of reviewers or evaluators.

1.6 REPORT WRITER

Theroleoftherecordingsecretaryistomakearecordofthesitevisitproceedings.Thepreciseskillsrequired to do this will depend on the nature of the review or evaluation.

Thereportwriter’sroleistocoordinatethedraftingofthepanelreportsothatitreflectstheviewsofthepanelandmeetsQQI’sreportingrequirements.TheymustunderstandtherelevantQQIpolicies,criteria,codes, standards, guidelines, values and procedures.

Report writers must be capable of writing clear, succinct, accurate, reasoned and publishable reports thatmeetQQI’sspecificrequirementsandcanbeunderstoodbythemultipleintendedaudiences.

2 INDEPENDENCEInordertoensurethatthepanel’sindependenceismaintained,incircumstancesoutsideofthesitevisit,reviewers/evaluatorsshouldcommunicatewiththeprovideronlythroughtheirQQIcontact.

Theprimaryresponsibilityfordisclosingintereststhatmayconflictorleadtoconflictrestsontheprospectivereviewer/evaluator.Prospectivereviewersandevaluatorsareaskedtodeclareinwritinganyrelevantinterestsandpotentialconflictsofinterestpriortoengagement.Declarations,includingnulldeclarations,willgenerallybepublishedbyQQI;thismaybeinthereportthatarisesfromtheprocessinquestion.

Further, prior to the engagement of a panel for a particular process, the provider concerned will be notifiedinadvanceoftheidentitiesofprospectivereviewers/evaluatorsandaskedtodeclareanypotentialconflictsofinterest.Notethatthisisnotanopportunityfortheprovidertoobjecttopanelcompositiononanygroundsotherthantheexistenceofaconflictofinterestinrelationtoamember(ormembers)ofthepanel–thetaskofestablishingapanelofreviewers/evaluatorsisQQI’salone.

Whereapotentialconflictofinterestisdiscoveredaftertheengagementofareviewerorevaluator,theyshould disclose this in writing, in consultation with the panel chairperson (if participating in a panel), to the nominated QQI contact.

Ifthediscoveryisbysomebodyotherthanthereviewerorevaluator,thatpersonwillbeexpectedtodisclose the information, in consultation with the panel chairperson if applicable, to QQI.

Normally,areviewerorevaluatorshouldtakenofurtherpartintherevieworevaluationonceaconflictofinteresthasbeendiscovered.TheQQIexecutivewillruleonthecontinuingeligibilityofthereviewerorevaluatorfollowingdiscoveryofanapparentconflictofinterest.

Page 21: Reviewers and Evaluators Responsibilities & Code of Cond… · 3.12 Process-specific Responsibilities of Reviewers and Evaluators 10 4 Principles of Effective Practice 11 4.1 General

21 |

ROLES, RESPONSIBILITIES AND CODE OF CONDUCT FOR

REVIEWERS AND EVALUATORS

Thefollowingoutlinerequirementsareindicative.Different,moredetailed,requirementsapplyinrespectofsomeprocesses,e.g.validation,andthesewillbecommunicatedseparately.

Independence could be compromised, or perceived to be compromised, in the following scenarios. The scenarios are indicative and are not an exhaustive set:

• Personsholding,orwhohaveheld,anappointmentintheorganisationwherethereview/evaluationisbeingconducted(e.g.employees,consultants,guestlecturers,externalexaminerduties,researchsupervision,etc.),includingpersonswhoretiredfromtheiremploymentwiththeproviderconcerned. Normally, former employees, governors, directors, consultants and graduates (except for learner representatives) of a provider are not eligible to serve as members of a review/evaluation group for that provider, but if a period of five years has elapsed since the prospective reviewer/evaluator’s relationship with the provider has ended, an exception may be made.

• Personswhohavehadlong-standingservice,orwhoareretiredfromemploymentwiththeproviderconcerned. Such individuals should not normally be engaged as reviewers or evaluators.

• Personswhoparticipate,orhaveparticipated,injointprojectsincludingresearchinitiativeswiththe provider concerned. Such individuals should not normally be engaged as reviewers or evaluators. Such individuals should inform QQI prior to involvement in the review or evaluation process of that provider. QQI will determine whether the person can be involved.

• Personswithfamilyorotherrelationshipswithanymembersemployedbyorattendingtheproviderconcerned. Such individuals should inform QQI prior to involvement in the review or evaluation process of that provider. QQI will determine whether the person can be involved.

• Personswithadirectfinancialinterestofanysortintheproviderconcerned,includingtheholdingofsharesinacompanyassociatedwiththeproviderconcerned.Such individuals should not normally be engaged as reviewers or evaluators.

• Persons who are direct competitors with the provider concerned. Such individuals are not automatically excluded but must be capable of functioning objectively.

• Personswhohaveaccepted,orplanorexpecttoaccept,agift,benefit,rewardorunduehospitalityfrom the provider concerned. Such individuals should not normally be engaged as reviewers or evaluators.

ExceptionalcircumstancesshouldbebroughttoQQI’sattentionforadjudicationonaperson’ssuitability.

2.1 CONSULTING

Asamatterofpolicy,QQIrecommendsthatpersonsappointedtoanassessment,revieworevaluationpanelonbehalfofQQIshouldnotnormallyserveasconsultantstotheproviderconcernedforagraceperiodofatleastoneyearafterthecompletionoftherelevantassessment.Anyproposedorappointedpersonwhoenvisages such a relationship with the provider developing within that timescale should inform QQI of this relationship before becoming involved in the review or evaluation process.

Forsomeprocesses,follow-upbeyondthereview/evaluationreportmayberequired.Insuchcases,anyreviewers/evaluatorsinvolvedshouldinformQQIiftheyintendtoactasaconsultanttotheproviderorhaveanyotherworkingrelationshipwiththeprovider.

Page 22: Reviewers and Evaluators Responsibilities & Code of Cond… · 3.12 Process-specific Responsibilities of Reviewers and Evaluators 10 4 Principles of Effective Practice 11 4.1 General

| 22

ROLES, RESPONSIBILITIES AND CODE OF CONDUCT FOR

REVIEWERS AND EVALUATORS

2.2 QQI PERSONNEL

MembersoftheQQIBoardoranyofitscommitteesarenotappointedasreviewersorevaluatorsonthebasisthattheymayhaveaseparateroleinthedeterminationoftheoutcome.

MembersoftheQQIexecutivemayarrangetoattendanyrevieworevaluation.

APPENDIX B

QQI CONTACT DETAILSPerson/Department Contact Details

ChiefExecutiveOfficer [email protected]

DataProtectionOfficer [email protected]

EducationandTrainingBoardReviews [email protected]

HigherEducationReviews [email protected]

QualityAssurance-QQIAwards [email protected]

Page 23: Reviewers and Evaluators Responsibilities & Code of Cond… · 3.12 Process-specific Responsibilities of Reviewers and Evaluators 10 4 Principles of Effective Practice 11 4.1 General

23 |

ROLES, RESPONSIBILITIES AND CODE OF CONDUCT FOR

REVIEWERS AND EVALUATORS

Page 24: Reviewers and Evaluators Responsibilities & Code of Cond… · 3.12 Process-specific Responsibilities of Reviewers and Evaluators 10 4 Principles of Effective Practice 11 4.1 General

www.QQI.ie