RADA Regional Language RADA Regional Language Proficiency Training and Proficiency Training and Assessment ProgrammeAssessment Programme

Special ICAO Workshop on LP for the States from the Eastern Part of the ICAO EUR Region

Baku, Azerbaijan, 7-9 December, 2005

Dr. Olena Petrashchuk, Co-Head of the RADA EL Work Group,

Director of AEROLINGUA Training Center

RADA – Regional Air RADA – Regional Air Navigation Services Navigation Services Development AssociationDevelopment Association

Armenia, Azerbaijan, Armenia, Azerbaijan, Georgia, Moldova, UkraineGeorgia, Moldova, Ukraine

Proceeding from the objectives and powers of Proceeding from the objectives and powers of RADA set forth in the Agreement on the co-RADA set forth in the Agreement on the co-

operation between ANS Providers of Armenia, operation between ANS Providers of Armenia, Azerbaijan, Georgia, Moldova and Ukraine, the Azerbaijan, Georgia, Moldova and Ukraine, the

RADA Council approved (April, 2004) the RADA Council approved (April, 2004) the establishment of the establishment of the

RADARADA English Language Working English Language Working (REL-WG)(REL-WG)

Mission: The improvement of Air Navigation Services, safety

performance and system’s efficiency at the regional level with specific reference to language training and proficiency assessment in accordance with ICAO SARPs.

CompositionComposition

• Two co-Heads (English and Russian native Two co-Heads (English and Russian native speakers)speakers)

• A Chairperson elected for each meetingA Chairperson elected for each meeting• Representatives of the RADA Member States /2 Representatives of the RADA Member States /2

from each/from each/• Representatives of the RADA associated membersRepresentatives of the RADA associated members• Representatives of international aviation Representatives of international aviation

organisations, ANS providers, entities and organisations, ANS providers, entities and agencies, experts (by invitation of the Executive agencies, experts (by invitation of the Executive Committee of RADA) Committee of RADA)

Objectives:Objectives:

• To define a regional English Language To define a regional English Language Development and Testing PlanDevelopment and Testing Plan

• To harmonise regional language training To harmonise regional language training through the provision of a language through the provision of a language training frameworktraining framework

• To harmonise regional language testing To harmonise regional language testing • To harmonise regional standards for To harmonise regional standards for

language instructors, test developers and language instructors, test developers and test raters test raters

• To implement an integrated system of To implement an integrated system of project co-ordination and communication project co-ordination and communication

TasksTasks

• discuss issues relevant to the discuss issues relevant to the development of a regional approach to development of a regional approach to language training and assessment; language training and assessment;

• prepare proposals concerning the prepare proposals concerning the development of a regional approach to development of a regional approach to language training and assessment; language training and assessment;

• submit its proposals to the RADA submit its proposals to the RADA Council. Council.

Working ArrangementsWorking Arrangements

Regular meetings twice a year /a Regular meetings twice a year /a minimum/minimum/

2005/03/14-162005/03/14-16 KievKiev

2005/11/9-112005/11/9-11 KievKiev

Main agenda of the 1-st Main agenda of the 1-st meetingmeeting

Development and agreement of the REL WG Development and agreement of the REL WG Terms of Terms of ReferenceReference

Design and discussion of the Design and discussion of the Regional Concept for Regional Concept for Language Training Development and AssessmentLanguage Training Development and Assessment

DevelopmentDevelopment of Action Plan of Action Plan Development of Development of a Proposal (forwarded by a Proposal (forwarded by UkSATSEUkSATSE and and

the the RADA CouncilRADA Council) for a combined trial training ) for a combined trial training programme:programme: twotwo personnel from each RADA Member personnel from each RADA Member State to be trained together for a three week period at a State to be trained together for a three week period at a location (in the Crimea, Ukrainelocation (in the Crimea, Ukraine ))

The EL proficiency assessment of all the operational The EL proficiency assessment of all the operational ATCOs in the RADA Member States according to a ATCOs in the RADA Member States according to a common language proficiency placement test produced by common language proficiency placement test produced by AerolinguaAerolingua and the collation of the results of the and the collation of the results of the assessmentsassessments

GENERAL PROVISIONSGENERAL PROVISIONS

The Concept for the English The Concept for the English language training of our RADA language training of our RADA experts constitutes a system of experts constitutes a system of views on the organizational views on the organizational principles for the training of principles for the training of RADA staff in general and RADA staff in general and professionally oriented English.professionally oriented English.

CONCEPTON THE EL TRAINING FOR

PROFESSIONAL STAFF OF RADA MEMBER STATES

CONTENT:CONTENT:General provisionsGeneral provisions

The objective of the ConceptThe objective of the Concept

The training requirementThe training requirement

The training objectiveThe training objective

The specialisation of training according to three areas of professional The specialisation of training according to three areas of professional activityactivity

The organization of general and professionally oriented English trainingThe organization of general and professionally oriented English training

The assessment of English language proficiency levelsThe assessment of English language proficiency levels

The introduction of amendments and supplements to job descriptionsThe introduction of amendments and supplements to job descriptions

The criteria for the selection of contractors for the provision of trainingThe criteria for the selection of contractors for the provision of training

Measures for the realisation of the ConceptMeasures for the realisation of the Concept

ConclusionsConclusions

AnnexesAnnexes

Main agenda of the 2-nd Main agenda of the 2-nd meetingmeeting

Discussion on the Regional Approach to Testing and Discussion on the Regional Approach to Testing and Examiners/Raters training and certification to meet the ICAO and Examiners/Raters training and certification to meet the ICAO and RADA requirementsRADA requirements

Developing a regional test development, test Developing a regional test development, test administration and language certification administration and language certification procedure to meet ICAO and RADA requirementsprocedure to meet ICAO and RADA requirements

Developing Certification best practice in testing Developing Certification best practice in testing towards a common regional approachtowards a common regional approach

Certification of RADA Member State Language Service ProvidersCertification of RADA Member State Language Service Providers

The 2006 ICAO Language Proficiency AuditThe 2006 ICAO Language Proficiency Audit

BenefitsBenefits

• To develop a mechanism/model of ICAO To develop a mechanism/model of ICAO requirements implementation in one country to requirements implementation in one country to be used by others be used by others

• To provide services in training and testing on a To provide services in training and testing on a shared baseshared base

• To identify best practices emerged individually to To identify best practices emerged individually to be applied on the regional levelbe applied on the regional level

• To set up regional mechanism/procedure of To set up regional mechanism/procedure of certification (training sets, tests, certification (training sets, tests, raters/examiners, services providers, etc.) and to raters/examiners, services providers, etc.) and to compensate the lack of the internationally compensate the lack of the internationally recommended recommended

• ??????

ChallengesChallenges

• Support of the REL WG Support of the REL WG • Lack of communication and information Lack of communication and information

sharingsharing

(beyond the meetings)(beyond the meetings)• Lack of motivationLack of motivation• Recommendations or products?Recommendations or products?• Practical tool for implementation Practical tool for implementation

regionallyregionally• ??????

Ukraine:Ukraine:

EXPERIENCEEXPERIENCE

Needs: about 2000 of personnelNeeds: about 2000 of personnel Scale: 22-24 cities and townsScale: 22-24 cities and towns

Development of strategic documents (Concept, Development of strategic documents (Concept, Rules of Attendance)Rules of Attendance)

Design and expertise of training and testing Design and expertise of training and testing materials materials

Consultancy support for trainers/testersConsultancy support for trainers/testers Management of training and testing on the Management of training and testing on the

work placeswork places

AEROLINGUA TC-UkSATSE model AEROLINGUA TC-UkSATSE model of of

implementation of ICAO implementation of ICAO requirementsrequirements1) Placement testing1) Placement testing

2) Forming groups 2) Forming groups 3) Design of the 3) Design of the

scheduleschedule4) Providing with TM 4) Providing with TM

available on the available on the marketmarket

5) Providing with TM 5) Providing with TM for SP of the for SP of the personnelpersonnel

6) Providing with TS 6) Providing with TS based on the strong based on the strong regulations of regulations of attendanceattendance

TC: Feb-March 2005 – TC: Feb-March 2005 – 625625 Sept-Oct 2005 – Sept-Oct 2005 – 197197TC+UkSATSE: 2005 -TC+UkSATSE: 2005 -9292TC+UkSATSE: 3 types (all TC+UkSATSE: 3 types (all

day)day)

TC+UkSATSE (Power TC+UkSATSE (Power Base,Base,

Cutting Edge)Cutting Edge)TC AE modules (UkSATSE TC AE modules (UkSATSE

expertise)expertise)TC+UkSATSE (Rules of TC+UkSATSE (Rules of

Attendance)Attendance)

AEROLINGUA-UkSATSE model of AEROLINGUA-UkSATSE model of implementation of ICAO implementation of ICAO

requirements (cont.)requirements (cont.)7) Progressive 7) Progressive

testingtesting

(within the course)(within the course)

8) Monitoring 8) Monitoring quality of trainingquality of training

9) Achievement 9) Achievement testing (end of testing (end of course)course)

10) Proficiency 10) Proficiency testingtesting

TCTC

TC+UkSATSE TC+UkSATSE (independently)(independently)

TCTC

UkSATSE+TC (expertise)UkSATSE+TC (expertise)

TASKFORCESTASKFORCES

AEROLINGUAAEROLINGUA

RADA EL WGRADA EL WG WG on developing of WG on developing of

TMTM WG on provision of WG on provision of

testing servicestesting services G of local LT G of local LT

providers on trialing providers on trialing TM/TeM in the field TM/TeM in the field

UkSATSEUkSATSE

For ICAO Rs For ICAO Rs implementation:implementation:

Deputy General directorDeputy General director

3 personnel responsible 3 personnel responsible for training and testing for training and testing

of 3 categories of of 3 categories of professionalsprofessionals

Group of examiners/Group of examiners/

examining board on LP examining board on LP assessmentassessment

Testing SystemTesting System in in AEROLINGUA ESP Course AEROLINGUA ESP Course

for AT controllers, Managers, Engineersfor AT controllers, Managers, Engineers

PlacementTest

GE/AE course

Achievement Tests(end of module)

Proficiency Tests for

ATCOs

M&Enpersonnel

HOW?HOW?Draft model of ICAO requirements Draft model of ICAO requirements

implementationimplementationTraining services

through intensive/standard courses

TOT

Accredited country testing services provider

Testing servicesfor training/benchmarking

purposes

TM development

Testing servicesfor licensing

purposes

TeM development

Test provider/ICAO supervision/maintenance

High-stake test adopted

by the State

Sample Format for Sample Format for Placement TestPlacement Test

• This is a pencil-end-paper testThis is a pencil-end-paper test• The total number of items – 130The total number of items – 130• The total time – 1 hour 40 minThe total time – 1 hour 40 min

Sample Format for Sample Format for Placement TestPlacement Test

• Part 1Part 1 - - Listening ComprehensionListening Comprehension: short : short exchanges /10 items: multiple choice/, exchanges /10 items: multiple choice/, longer dialogue /5 items: open longer dialogue /5 items: open completion/ - 15 min.completion/ - 15 min.

• Part 2Part 2 - - Vocabulary and GrammarVocabulary and Grammar: : multiple choice, open completion /60 multiple choice, open completion /60 items/ - 60 min.items/ - 60 min.

• Part 3Part 3 – – ReadingReading: two texts (1800 and : two texts (1800 and 2600 prints) of different levels of 2600 prints) of different levels of difficulty /10 items, 5 for each text: difficulty /10 items, 5 for each text: labeling paragraph, true-false/ - 20 minlabeling paragraph, true-false/ - 20 min

Sample Scheme Sample Scheme of the training courseof the training course

According toAccording to

Placement/AchievementPlacement/Achievement

Test resultsTest results

Pre-elementaryPre-elementary

ElementaryElementary

Pre-intermediatePre-intermediate

GENERAL ENGLISHGENERAL ENGLISH

GENERAL BUSINESSGENERAL BUSINESS

ENGLISH with elements ENGLISH with elements of Aviation/Technical of Aviation/Technical EnglishEnglish

Sample Scheme Sample Scheme of the training courseof the training course

According toAccording to

Placement/Placement/Achievement Achievement

Test resultsTest results

Intermediate Intermediate

Upper Upper IntermediateIntermediate

AVIATION ENGLISH AVIATION ENGLISH

FOR SPECIFIC FOR SPECIFIC PURPOSESPURPOSES

on the work place of on the work place of ATCOs,ATCOs,

management staff, management staff, engineersengineers

Sample Formats of Training Sample Formats of Training CourseCourse

• Intensive CourseIntensive Course (full time) (full time)

4 weeks – 30 h/wk, total 120 classroom hours 4 weeks – 30 h/wk, total 120 classroom hours • Standard CourseStandard Course (part time) (part time)

16 weeks – 6 h/wk, total 96 hours16 weeks – 6 h/wk, total 96 hours

Trial Arrangements depending on a trainee’s Trial Arrangements depending on a trainee’s

LP level: IC I + SC I + SC 2 + IC 2 or other LP level: IC I + SC I + SC 2 + IC 2 or other combinationscombinations

STRUCTURESTRUCTURE OF THE TRAINING OF THE TRAINING MODULE IN AVIATION ENGLISHMODULE IN AVIATION ENGLISH

MODULEMODULE

2-4 UNITS2-4 UNITS

A A UNITUNIT

(6 (6 hours)hours)

Warming up /3 points/Warming up /3 points/Initial Listening /2 tasks/Initial Listening /2 tasks/Listening and Vocabulary /3 tasks/Listening and Vocabulary /3 tasks/Drilling Vocabulary /3 tasks/Drilling Vocabulary /3 tasks/Follow up /2 tasks/Follow up /2 tasks/Grammar /1 task/Grammar /1 task/Grammar drilling /1 task/Grammar drilling /1 task/Grammar in Use /2 tasks/Grammar in Use /2 tasks/Listening for Grammar /1 task/Listening for Grammar /1 task/Pronunciation /1 task/Pronunciation /1 task/Listening and Speaking /1 task/Listening and Speaking /1 task/Reading and Speaking /3 tasks/Reading and Speaking /3 tasks/Listening and Speaking /2 tasks/Listening and Speaking /2 tasks/Home TaskHome Task /7 tasks/ /7 tasks/

SUPPLEMENTARY OPTIONSSUPPLEMENTARY OPTIONS

• Reading on AviationReading on Aviation• Listening Comprehension in Aviation Listening Comprehension in Aviation • Writing skills for Aviation managersWriting skills for Aviation managers• Interaction skills for Aviation Interaction skills for Aviation

personnelpersonnel

Consultancy support for Consultancy support for teachers/testersteachers/testers

• Instructors’ Guidelines for AE Instructors’ Guidelines for AE Training ModulesTraining Modules

• Workshop for teachers of AE (for Workshop for teachers of AE (for AEROLINGUA teachers and teachers AEROLINGUA teachers and teachers of its field partners in 22 cities of of its field partners in 22 cities of Ukraine) Ukraine)

• Workshop for examiners/interlocutors Workshop for examiners/interlocutors (for UkSATSE testing group)(for UkSATSE testing group)

PROFICIENCY TESTSPROFICIENCY TESTS• Proficiency test for AT controllers Proficiency test for AT controllers aims ataims at

getting a speech sample gradable against the getting a speech sample gradable against the ICAO descriptorsICAO descriptors

(not a phraseology test, test evolution)(not a phraseology test, test evolution)

• Format:Format:Tasks to assess Aural + Oral language Tasks to assess Aural + Oral language

proficiencyproficiencyTwo sections:Two sections:15 min (comprehension of recorded short 15 min (comprehension of recorded short

exchanges/short texts, completion of 10 items)exchanges/short texts, completion of 10 items)15 min (face-to-face/back structured interview, 15 min (face-to-face/back structured interview,

3 blocks of questions)3 blocks of questions)

PROFICIENCY TESTSPROFICIENCY TESTS

• Proficiency test for management and Proficiency test for management and engineering staff aims at getting a engineering staff aims at getting a speech sample gradable against the speech sample gradable against the UkSATSE language proficiency UkSATSE language proficiency levels scalelevels scale

• Format:Format:Tasks to assess language proficiency in 4 major Tasks to assess language proficiency in 4 major

skillsskills

Four traditional sectionsFour traditional sections