32

E-ATP 2009

Embed Size (px)

DESCRIPTION

E-ATP 2009 Conference Program Book

Citation preview

Page 1: E-ATP 2009
Page 2: E-ATP 2009

2

Hotel Metropole Floor Map

MEC Audi 1

Einstein

Langevin

MECSeminar

MECBoardroom

Desk

Level -1 Level 0 Level 1 Level 2 Change of floorMarie

Curie

Jardin Indien

MEC Audio 2

Excelsior

Ambassadeur

Exhibitor Bar

Reception

Concierge

Hall du Bar

Rubenstein

Restaurant

Entrance

Cyber Café

Page 3: E-ATP 2009

3

Wednesday, 30 September19:00 – 21:30

Thursday, 1 October08:00 – 17:30

Friday, 2 October08:00 – 15:15

Registration will be held in the lobby of the Hotel Metropole.

Hotel Metropole Floor Map . . . . . . . . . . . . . . . . . 2Schedule-at-a-Glance . . . . . . . . . . . . . . . . . . . . . 3Welcome Letter . . . . . . . . . . . . . . . . . . . . . . . . . . 5Keynote Speaker Profiles . . . . . . . . . . . . . . . 6 - 72009 Conference Sponsors . . . . . . . . . . . . . . 8 - 9

Wednesday Conference Programme . . . .11 - 14Thursday Conference Programme. . . . . 15 - 23Friday Conference Programme . . . . . . . 24 - 28Special Thanks . . . . . . . . . . . . . . . . . . . . . . . . . 31

WEDNESDAY, 30 September 2009

19:00 – 21:30 Registration Open Hotel Metropole Lobby 19:30 – 21:30 Pre-Conference Reception Arthur Rubinstein Room & Bar Le 19ième and Posters

THURSDAY, 1 October 2009

08:00 – 17:30 Registration Open Hotel Metropole Lobby 08:00 – 09:00 Breakfast with Hotel Le Jardin Indien 09:00 – 10:00 Opening Keynote Address Excelsior 10:00 – 11:30 Exhibits and Coffee Break Ambassadeur 10:00 – 11:30 Wim van der Linden Book Signing Ambassadeur (Sponsored by McGraw-Hill Education) 11:30 – 13:00 Workshops Various Rooms 13:00 – 14:00 Lunch and Exhibits Le Jardin Indien 14:00 – 15:00 CEO's Perspective Excelsior 15:00 – 15:45 Exhibits and Coffee Break Ambassadeur 15:45 – 16:45 Breakout Sessions Various Rooms 16:45 – 17:30 Exhibits Ambassadeur

FRIDAY, 2 October 2009

08:00 – 15:15 Registration Open Hotel Metropole Lobby 08:00 – 09:00 Breakfast with Hotel Le Jardin Indien 09:00 – 10:00 Closing Keynote Address Excelsior 10:00 – 11:30 Exhibits and Coffee Break Ambassadeur 11:30 – 12:30 Breakout Sessions Various Rooms 12:30 – 14:00 Lunch and Exhibits Le Jardin Indien 14:00 – 15:00 Star Sessions Various Rooms 15:00 – 15:15 Coffee Break Arthur Rubinstein Room 15:15 Close

Registration Hours

Schedule-at-a-Glance

Table of Contents

Page 4: E-ATP 2009

EXCEPTIONAL SERVICE. SUPERIOR TECHNOLOGY. SECURE TEST CENTRE NETWORK.

We are delighted to have the opportunity to be Gold sponsors at the first European ATPConference Growing Talent in Europe: GainingAdvantage through Assessment, in Brussels 30 Sept – 2 Oct 2009.

Pearson VUE’s experienced staff will be availablethroughout the exhibition and conference to answerany questions you might have about e-Assessmentand our testing solutions.

Pearson VUE is the global leader in computer-based testing. We provide a full suite ofservices from test development to datamanagement, and deliver exams through theworld's most comprehensive and secure network of test centres in 165 countries.

Delivering over 3.5 million electronic tests last year inthe UK alone, Pearson VUE is trusted by some ofthe world’s most respected organisations to delivertheir high stakes assessments.

If you would like to know more about

Pearson VUE or arrange a meeting, please

email [email protected]

www.pearsonvue.co.uk

Get results

Professional Testing:Peak Performance

Pearson_Vue_A5_Advert:Layout 1 30/7/09 11:09 Page 1

Page 5: E-ATP 2009

5

It gives me great pleasure to welcome you to the historic Metropole Hotel on this very historic occasion – our first conference devoted to Growing Talent in Europe and Gaining Advantage through Assessment!

The Association of Test Publishers (ATP) established its European Division (E-ATP) in 2006 to provide test publishers and providers of assessment tools and services in Europe with a collective voice. Their mission is to positively influence and educate the various communities of stakeholders in the testing industry, as well as those who set policies and guidelines.

This inaugural conference is the manifestation of words into action.

Here at the Hotel Metropole, we have gathered the foremost leaders in the European testing industry together with leading educators, developers and experts in the field of assessment to provide a rich and diverse programme. We hope that as delegates of our very first conference you will be able to relax a bit and enjoy all that the beautiful city of Brussels has to offer, while at the time benefiting from a high quality educational experience.

Our conference programme is designed around three important themes: Fundamentals of Assessment Explained; Standards and Regulation; and Innovation in Assessment. Within those three main themes you will find diverse content sessions as well as hands-on workshops. On Thursday, be sure to join us for a panel discussion by leading industry CEOs who are prepared to give us their viewpoints on the future of assessment in Europe. And on Friday, be sure to look for our star speaker sessions where invited experts will share their experiences and perspectives on our vibrant and diverse industry.

At the same time we hope you will enjoy an array of networking opportunities that will serve to enrich both your personal and professional lives as you make friends and contacts from the different areas of the interconnected assessment community.

And finally I’d like to acknowledge that this conference would not be possible without the financial support of our valued sponsors. I urge all delegates to please visit their exhibits and take some time to explore their many and varied offerings.

We are thrilled you have joined us for this historic event. And we wish you a productive conference, a relaxing educational experience, and the satisfaction of knowing you were integral in the launch of a new European tradition.

Sincerely,

William G. HarrisCEO, Association of Test Publishers

Dear Conference Attendees,

Page 6: E-ATP 2009

6

Keynote Speaker Profiles

Wim J. van der Linden holds degrees in Psychology and Mathematical Sociology from the Universities of Utrecht, and in Psychometric Theory from the University of Amsterdam. Currently, he is the chief research scientist at CTB/McGraw Hill. His research interests include test theory, computerised adaptive testing, large-scale educational assessments, optimal test assembly, and decision theory and its application to problems of educational decision-making. His publications have appeared in all major international testing and psychometrics journals.

Professor van der Linden has served on the editorial boards of Encyclopedia of Social Measurement, Testing Research, Applied Psychological Measurement, Journal of Educational Measurement, Psychometrika, European Review of Applied Psychology, Dutch Journal of Education, Dutch Journal of Educational Research, and International Journal of Testing, on numerous boards and committees of national and international professional organisations, and is a Past President and current member of the Board of Trustees of the Psychometric Society.

He is also an advisory member, Board, Japanese Institute of Educational Measurement, Tokyo, Japan. From 2001-2003 he served as member

of the Research Review Board of the National Board of Medical Examiners, Philadelphia, Pennsylvania. From 2001 to the present he serves as a member of the Research Advisory Committee of the American Institute of Certified Public Accountants (AICPA), Jersey City, New Jersey. From 1999-2004 he served as member of the Advisory Board for the Hong Kong Institute of Educational Research, Hong Kong. From 2004 to the present he serves as a member of the Board of Trustees of CITO, Arnheim, Netherlands.

Professor van der Linden has contributed significantly throughout his career to the science and applied practice of educational and licensure testing and psychometrics. He has provided unique and seminal contributions to the ATP Annual conference on Technology Based Testing as an invited speaker with sessions on “The Key to Developing Computer Based Tests: Automated Test Assembly” (2002), “Item Response Theory and Computerised Adaptive Testing” (2003), “Automating Item Generation and Test Assembly” (2004), “AICPA Case Study” (2004), and “Future of Item Response Theory and Computerised Adaptive Testing” (2005). He was also an invited keynote speaker for the International Test Commission’s International Conference on Computer Based Testing and the Internet (June, 2002, Winchester, England).

Wim J. van der LindenChief Research Scientist, CTB/McGraw Hill

Page 7: E-ATP 2009

7

With over 20 years of experience in consultancy and the financial services sector, John worked for 10 years with the global HR psychology consultancy SHL, eventually becoming global head of international projects based out of the Netherlands. He joined UBS AG in the Private Banking division as head of leadership and management development and then moved into a corporate role setting up and leading the UBS human capital function.

UBS’ human capital team is a small global team of 8 people split between the UK and Zurich with focus on performance appraisal both across the whole company and very specifically for senior teams; employee surveys with a special focus and expertise on engagement; selection and assessment testing and HR metrics. John holds a doctorate degree in psychology where his research interest was talent management models and in particular identifying and developing the high potential employee at all levels throughout the organisation. John’s interests inside work are in leadership succession and assessment, performance management and culture, employee engagement and talent identification. Outside of work he splits his time between the Pembrokeshire coastline and London and pursues his interest in contemporary ceramics.

John is a Chartered Occupational Psychologist, Chartered Scientist, Associate Fellow of the British Psychological Society and honorary researcher at the School of Psychology, University of East London.

Keynote Speaker Profiles

John Mahoney-PhillipsGlobal Head of Human Capital, UBS

Page 8: E-ATP 2009

8

www.cito.com Worldwide, Cito provides and evaluates good, fair tests. Cito’s measurement and monitoring method enables our clients to get an objective analysis of knowledge, skills and competences. This enables sound choices in the area of personal and professional development. Not only do we utilise our expertise to produce our own work, but also to offer advice, support and research to others.

www.hoganassessments.com Hogan Assessment Systems is the industry leader in employee selection, employee development, and talent management, providing comprehensive personality assessment solutions for a variety of organisations and positions. Hogan specialises in implementing selection systems to identify high fit candidates and leadership development tools to help emerging leaders realise their potential.

www.hogrefe.de Hogrefe is a leading European test publisher. The parent company, Hogrefe Verlag Göttingen, Germany, was founded in 1949, and has evolved over the decades to become the market leader in German-speaking areas. Over recent years the Hogrefe Group has expanded to many areas of Europe, with subsidiaries in 8 countries.

www.mheducation.comMcGraw-Hill Education, a division of The McGraw-Hill Companies, is a leading global provider of print and digital instructional, assessment solutions, and educational services that empower professionals and students of all ages. CTB/McGraw-Hill provides formative and summative assessments for PreK – 12, adult education and statewide testing programs.

Thank You to Our 2009 Sponsors

www.pearsonvue.co.uk Pearson VUE is the global leader in computer-based testing for information technology, academic, government and professional testing programmes around the world. Pearson VUE provides a full suite of services from test development to data management, and delivers exams through the world’s most comprehensive and secure network of test centres in 165 countries.

Gol

d

www.lamark.com Lamark manages the logistics process for high-stakes computer based testing in Test Centres. Flexible Examination offers candidates the opportunity to sit an exam at any time, at any place in our worldwide network of secure Test Centres.

www.cityandguilds.com City & Guilds is an expert and leading authority in vocational education and training - both in the UK and beyond. In operation for the last 130 years, City & Guilds is the UK’s leading awarding organisation for work-related qualifications. Twenty million people in the UK have City & Guilds qualifications.

Page 9: E-ATP 2009

9

www.rm.com/assessment RM Assessment is a leading supplier of assessment and data services to UK and international examination boards, professional awarding bodies and government departments. We provide technology-based products, services and online reporting tools to enhance the assessment process and to support the effective use of educational data at all levels.

www.LSAC.org The Law School Admission Council (LSAC) is a non-profit higher education services organisation that provides state-of-the-art admission products and services for law schools and their applicants. LSAC develops, administers, and scores the LSAT at hundreds of test centres throughout the world.

www.commsmultilingual.com Comms Multi-lingual is the leading translation solutions provider for psychometric tests, assessments and exams. We cover over 100 languages and offer not just test adaptation, but also Expert Review (by Clinical and I/O Psychologists), Cognitive Debriefing and Normative Data Collection. We also offer typesetting, voice-recording and subtitling.

www.enlightks.comEnlightKS is a leading provider of global solutions and consulting services for testing and transfer of critical knowledge. The solutions enable clients to assure that their employees, partners and customers have the knowledge they need to reach their key objectives. Our software and consultancy ensure that skills and learning are captured, distributed and measured efficiently.

www.gmac.com The Graduate Management Admission Council® (GMAC®) is the association of leading graduate business schools around the world. GMAC is the owner and administrator of the Graduate Management Admission Test (GMAT®) exam, the most widely used assessment for graduate management admissions and the most reliable predictor of academic success in graduate business studies.

Bro

nze

Thank You to Our 2009 SponsorsS

ilver www.questionmark.com

Questionmark provides technologies and services that enable organisations to measure knowledge, skills, and attitudes securely for certification, regulatory compliance and successful learning outcomes. Questionmark solutions enable reliable, valid and defensible assessments by empowering subject matter experts through collaborative authoring, accommodating participant needs with blended and multi-lingual delivery and informing stakeholders through timely reporting and meaningful analytics.

THE GRADUATE MANAGEMENT ADMISSION COUNCIL©

Page 10: E-ATP 2009

Cito | International

Cito, based in the Netherlands, is one of the world’s leading testing and assessment companies. We have been measuring and monitoring human potential since 1968. The company is committed, independent and highly expert. Cito’s testing tools offer pupils, students, teachers, employees and employers an objective picture of knowledge, skills and competencies. We provide and evaluate good and fair tests worldwide - we have worked with the examination and assessment centres of ministries in 30 different countries. Cito works for educational institutions, governments and companies, providing specialist assistance in the areas of learning performance and performance in the workplace. Our work, which builds on the latest developments in ICT and psychometric research, is gaining international recognition.

Core activities

More information | We cordially invite you to visit our booth

Appointment | Do you want to make a personal appointment, please contact our account management department:

www.cito.com

Good, Fair Testing

BD-E-ATP-Advertentie-2009_8x10inch.indd 1 1-7-2009 11:43:07

Page 11: E-ATP 2009

11

Pre-Conference Reception and Posters 19:30 - 21:30Automated Testing of Computer Skills - Developing a New Technology within the Automatic AssessmentRoom: Rubinstein Session Type: Poster

Working with tests measuring computer skills requires constant reviews as to how the tests are distributed and if the item formats will meet the needs for a perceived assessment of high quality. Our aim when we developed the new item format – in-application – was to distribute an assessment that could generate a “true” picture of a person’s “true” knowledge within the computer skills field.

During the development process this new technology generated a lot of questions.

• How could we conduct the scoring? • How could we give feedback to the students? • How stable is the technology? • Is the measurement distorted when the application can deliver online help, around the tasks?

The poster will cover a description as to the considerations that have to be taken from a test theoretical standpoint. It will also cover a

description as to how the technique works for a student, as well as how the test developer must work to deliver the assessment. The poster presentation will also describe the differences between the simulation item format that is common in automated testing of computer skills, and this new item format.

Speaker: Mona Åström, Test Consultant, Enlight AB

Culture Fair Testing of Intelligence Using State-of-the-Art Technology Room: Rubinstein Session Type: Poster Construction and validation of a culturally fair test for measuring general intelligence entitled Connector Ability, will be presented. Special features include: wholly IRT-based adaptive testing in a 24/7 online environment; spanning a broad range of intellectual ability; independent from differences in mother tongue or language competency; creating equal understanding of the test beforehand through extensive online practice tests; instantaneous online reporting delivered in an easy-to-understand format by the test administrator/candidate; an e-learning module to support proper use.

Extensive validation shows, as expected, no relevant differences between culturally different samples when measuring an estimated level of general intelligence. The extensive online

19:00 – 21:30 Registration Open Hotel Metropole Lobby 19:30 – 21:30 Pre-Conference Reception Arthur Rubinstein Room & Bar Le 19ième and Posters

Programme - Wednesday, 30 September 2009

Page 12: E-ATP 2009

12

practicing and reporting modules fulfilled their objectives as predicted. The empirical results will be presented on the posters and participants will be encouraged to actively engage with each other in discussion groups to talk about their own experiences, problems, difficulties and potential solutions to the conceptual and empirical issues raised in the aforementioned case study.

Speaker: Nico Smid, PiCompany

Helicon Opleidingen ExaminationRoom: Rubinstein Session Type: Poster

Helicon Opleidingen has built an organisation which develops, organises and evaluates examination of 78 studies on the European levels 1 to 4 for around 3,000 candidates yearly. This organisation is structured according to ISO. The board of directors has formulated the following goals: 1. Costs for the total organisation of examination is limited to 2.5 % of budget. 2. The yearly check by the governmental inspection has to result in an approval. 3. The actual set of SHL-described qualification dossiers for professional studies is implemented.

To reach these goals, the following choices are made: A. The assessment for each study is independent of the choice of the educational route. B. The assessments are suited for more locations on the job. C. Every role within the organisation is described, every person is trained (or certified).

Results: i. Each student knows what to expect and the majority is proud of their performance. ii. Standardisation is possible while creating acceptable solutions for each company involved.Speaker: Jan Jacobs, Helicon Opleidingen

Potential Gain in Applying an Assessment of Personality and GMA for General Job PerformanceRoom: Rubinstein Session Type: Poster

Job performance in an organisation depends upon the personnel working in the organisation. Predicting Job Performance, PJP, is a brief psychometric assessment measuring personality and General Mental Ability, GMA. This study focuses on the utility of using PJP in the selection process. The empirical evidence is based on a sample (n=170) from the retail industry and supervisory ratings of general job performance. The operational validity of PJP was estimated to .62. However, the value of a selection procedure is not determined by its validity, but by its financial benefit for the user.

This study gives a specific example of a company that has applied PJP for every applicant applying for a job in the Swedish retail organisation. The job in question pays € 20,000 per annum giving an SD of € 8,000; newcomers tend to stay 3 years. The company has, on average, 800 applicants when opening a new store and they select an average of 10 people. Adding the PJP to the existing selection process, CV and unstructured interview, will gain approximately € 176,000 when opening a new store.

Speaker: Anders Sjoberg, Manager of Test Development, Assessio International

Wednesday, 30 September 2009 ∙ 19:00 - 21:30

Page 13: E-ATP 2009

T H E S C I E N C E O F P E R S O N A L I T Y

personalityscience

advancingofth

e

Hogan pioneered the use of personality testing to predict job performance

more than three decades ago. In the years since, our research has set the

global standard, ensuring that our products and services are second to

none. There simply is no more reliable and useful source than Hogan for

excellence in employee selection, development and leadership practices.

®

®

W W W . H O G A N A S S E S S M E N T S . C O M

H O G A N I S P R O U D T O S P O N S O R E A T P 2 0 0 9

Page 14: E-ATP 2009

14

PROFILE:MATCH® - Evolutionary Personality PsychometricsRoom: Rubinstein Session Type: Poster

PROFILE:MATCH® is an innovative online expert system, driven by FFM psychometrics but delivering personality assessment tailored for specific jobs and expressing results as competency ratings. The user experience, from selection of competencies to be assessed, through to report content, is presented exclusively in the language of competencies. This approach dovetails into other evaluation processes that are also competency-based, such as assessment centres, interviews and appraisals.

Tailoring assessment by targeting specific competencies also has the advantage that it eliminates potentially distracting information – everything reported is pertinent.

Following the analogy of FFM as the ‘primary colours of personality’, PROFILE:MATCH® captures complexity of personality robustly by combining (mixing) scales, rather than by fragmentation into elements supported by few items. Using algorithmic equations (Competency Metrics) to blend scores from two or more personality scales, PROFILE:MATCH® generates finely incremented competency ratings with strong measurement characteristics – effectively T scores.

This presentation discusses the origins, development and technical features of PROFILE:MATCH® and 10 pragmatic benefits of managing personality assessment in this way.

Speaker: Geoff Trickey, Managing Director, Psychological Consultancy Limited

Scientific Proof: Does Frequent Writing Improve One’s Writing Skills?Room: Rubinstein Session Type: Poster

“Frequent writing improves one’s writing skills” is a hypothesis that has long been accepted as truth without any solid evidence. But is it true? Has any teacher or student kept track of all their writing works with grades? What affects one’s writing skills? What kind of role do factors such as gender, language fluency, ethnicity, and other demographic data play in writing improvement? No one has ever been able to answer these questions due to a variety of reasons.

The most compelling reason was the difficulty of collecting writings from people with a sufficiently diverse demographic background whilst ensuring that the objectivity of the scoring standards is maintained so that it is as if all of them had been graded by one expert scorer. This paper illustrates the effect of frequent writing practices on the overall quality of writing using the unique tool called MyAccess. MyAccess is an instructional writing tool that can grade any student’s essays in a couple of seconds and return the total and five different domain scores as well as specific feedback on how a student can improve his/her essay. The massive amount of data from students in multiple grades and English proficiency levels with different genders and ethnic background has been collected and analysed to test the long-time unchallenged hypothesis.

Speaker: Matt Daneker, Product Manager, Vantage Learning

Wednesday, 30 September 2009 ∙ 19:00 - 21:30

Page 15: E-ATP 2009

15

08:00 – 17:30 Registration Open Hotel Metropole Lobby 08:00 – 09:00 Breakfast with Hotel Le Jardin Indien 09:00 – 10:00 Opening Keynote Address Excelsior 10:00 – 11:30 Exhibits and Coffee Break Ambassadeur 10:00 – 11:30 Wim van der Linden Book Signing Ambassadeur (Sponsored by McGraw-Hill Education) 11:30 – 13:00 Workshops Various Rooms 13:00 – 14:00 Lunch and Exhibits LeJardin Indien 14:00 – 15:00 CEO's Perspective Excelsior 15:00 – 15:45 Exhibits and Coffee Break Ambassadeur 15:45 – 16:45 Breakout Sessions Various Rooms 16:45 – 17:30 Exhibits Ambassadeur

Programme - Thursday, 1 October 2009

Opening Keynote9:00 - 10:00 Reflections on Testing Traditions on Two Different ContinentsRoom: Excelsior Session Type: Keynote

Standardized testing was reinvented by the pioneering work of Binet and Spearman in Europe at the beginning of the 20th century. It was further developed and became massively applied in the middle of the 20th century in North America, whereupon it was re-imported in Europe. In spite of this interaction, the current traditions of testing on the two continents show some notable differences. In this presentation, we focus primarily on the traditions of educational testing, and try to relate them to developments in their educational systems.

Speaker: Wim J. van der Linden, Chief Research Scientist, CTB/McGraw Hill

Workshops11:30 - 13:00Computerised Classification Testing Using Measurement Decision TheoryRoom: MEC Seminar Session Type: Workshop

It can be argued that the goal of any testing programme is the accurate classification of candidates. At its simplest this is a binary classification into passed/failed, certified/non-certified, selected/not selected, whilst more complex categorisation schemes such as; not competent, minimally competent, competent and mastery, are not uncommon. Measurement Decision Theory allows for the classification of candidates based on their item response patterns. Some of the advantages of Measurement Decision Theory are, as research shows; good classification accuracy, shorter tests, and that fewer candidates are required for calibration, compared to sample sizes needed for IRT methods.

Page 16: E-ATP 2009

16

Thursday, 1 October 2009 ∙ 11:30 - 13:00 This interactive workshop will present an overview of the theoretical foundations of Measurement Decision Theory. Using an example of a mastery test it will be demonstrated how, from a small-scale pilot test, the proportion of masters/non-masters in the population can be estimated and conditional probabilities that masters/non-masters will respond correctly to each item on a test. Given this information from the pilot test, a demonstration of calculating the probability of a candidate being either a master or non-master from their examination results, will be provided.

Speaker: Stefan Bondorowicz, Psychometrician, Pearson VUE

Decreasing Assessment Costs by Increasing Quality AssessmentRoom: Bourgmestres Session Type: Workshop

Assessments are great tools to grow talent when they are valid and of high quality. One aspect of creating quality assessments is minimising the costs that result from correcting defects. Testing programmes often overlook these costs – called “costs of poor quality.” The costs of poor quality can be as much as 40 per cent of the costs of operating a testing programme – raising expenses to a point that can diminish the value of the assessment to the user. The purpose of this workshop is to explain the concepts of costs of poor quality and provide participants the opportunity to apply those concepts to the testing industry. Participants will work through a case study of a certification body and identify both internal costs of poor quality and external costs of poor quality. The case study will cover registration, test design, test delivery, scoring, score reporting, and re-certification. Participants will identify costs of poor quality at each step. Process design, prevention and quality control will be discussed as methods for addressing the risks and reducing quality costs.

Speakers: Rohit Ramaswamy, President, Service Design Solutions Cheryl Wild, President, Wild & Associates, Inc.

If You Can’t Measure It, You Can’t Manage It: How to Win the War for TalentRoom: Langevin Session Type: Invited Workshop

Recession or no recession, forward-looking organisations are not giving up on the war for talent. For smart companies, the market for talent remains as competitive as the market for customers. Business forecasters predict that those organisations most likely to come out on top of the current economic downturn will be those that keep their focus on talent management initiatives. More than ever before, the pressure is on to identify the talent that will meet current and future needs in order to better target investment. How can we identify the individuals who will make a disproportionate contribution to organisational performance, while embracing diversity and inclusiveness at the same time? What is the best way to measure potential talent in individuals with no track record of success, and how does the nature of that challenge vary across the hierarchy? This session will begin with a review of the positioning of talent management in the current economic climate and the place of objective metrics in talent management initiatives. Through the use of case studies and interactive exercises, participants will get a feel for integrating objective measurement techniques into processes for the selection and development of talent and the ‘real life’ benefits that result from so doing.

Speaker: Wendy Lord, Chief Psychologist, Hogrefe Ltd

Page 17: E-ATP 2009

17

Innovative Items – Measuring Something More or DifferentRoom: MEC Audi 2 Session Type: Workshop

The rapidly expanding use of Computer-Based Testing (CBT) has brought with it an increasing interest in the potential of a computer-based system to provide improvements in areas other than test administration. One such area involves the development of innovative item types which incorporate features and functions that are not possible with conventional test administration methods. Technology now allows us to incorporate video, sound, increased interactivity and simulation into the items that are developed for examinations.

The use of innovative items holds the promise of allowing us to improve our measurement of the skills that our examinations are attempting to tap into. Innovative item types could allow us to measure the same things better than we could previously, or allow us to measure something more, or different, than we were previously able to. This factor is becoming increasingly important as technological advancements lead to ever more complex working environments. Innovative item types hold the promise of allowing us to, more directly measure cognitive skills that are vitally important for the tasks we are asking people to carry out. Participants in the workshop will be able to view and manipulate a variety of different item types.

Speakers: Ivan Coutinho, Business Development Executive, Pearson VUE John H.A.L. de Jong, VP, Test Development, Pearson Language Tests

New Developments in Assessment Standards and Review Systems Room: MEC Audi 1 Session Type: Workshop

In a world where testing has an important role, there is a need to evaluate the quality of the assessment. This relates to the quality of the assessment instrument, and to the quality of

the use of this instrument. As a result, a number of guidelines, standards, and review systems have been developed. This ranges from a list of general ideas about good test practices to very strict rules that apply to reviewed instruments. These criteria may differ over different types of test or test systems such as traditional test types, computerised testing, competence assessment, and the evaluation of larger systems of evaluation such as complete certification programmes.

In this workshop, during which you will work in teams, we would like to discuss the latest developments in assessment standards and review systems and how to adapt these to everyday practice. We will deliberate on issues such as the quality of the tests, the quality of the test procedure and the role of ATP in the evaluation practice of these qualities.

Speakers: Bas Hemker, Senior Research Scientist, Cito Saskia Wools, Research Scientist, Cito

Preserving the Integrity of the Currency for Talent®: Using Double Factor Authentication to Prevent Counterfeiting Room: Marie Curie Session Type: Workshop

Imposters taking high-stakes exams remains an issue. The different types of double authentication to be explored will be; username/password/authentication key, and Data Forensics Biometrics.

For each we will: • Present the problem. • Present an example of the solution. • Provide a brief (15-minute) exercise showing participants how the solution can work in practice and getting them to solve a scenario-based problem.

Speaker: Denis Saunders, MBA, BSc (Hons), Calibrand

Thursday, 1 October 2009 ∙ 11:30 - 13:00

Page 18: E-ATP 2009

McGraw-Hill Education

Where the World Learns to Succeed

McGraw-Hill Education is a leading global provider of print and digital instructional,

assessment, and reference solutions that empower professionals and students of all

ages. A division of The McGraw-Hill Companies, MHE serves customers looking for

comprehensive offerings that meet their needs across the education value chain

including educational services, curriculum design, blended online and offline content,

assessment, reporting, teacher professional development, and vocational training.

CTB/McGraw-Hill, the nation’s leading publisher of standardized and standards-

based achievement tests for PreK–adult, offers a comprehensive range of formative

and summative assessments, instructional programs, software and services that are built on a tradition of research, innovation, and technical quality that benefit learners of all ages.

Founded in 1926 to “Help the Teacher Help the Child”, CTB/McGraw-Hill provides full-service assessment solutions for PreK–12, adult education, and statewide testing programs. CTB serves more than 18 million students annually, and supports schools, districts, dioceses, states, private industry, nationally and internationally through programs and tools that meet the needs of the global education community.

Additional information is available at MHEducation.com and CTB.com

Copyright © 2009 by The McGraw-Hill Companies, Inc. All rights reserved.

EATP ad.indd 1 8/10/09 12:50:19 PM

Page 19: E-ATP 2009

19

14:00 - 15:00CEO’s Perspective Room: Excelsior Session Type: CEO’s Perspective

We have invited a group of CEOs from the world’s leading assessment organisations to participate in a panel session entitled The CEO’s Perspective. We have tasked each CEO to prepare a brief opinion piece about the Future of Assessment in Europe.

Moderator: Eugene Burke, Science and Innovation Director, SHL Group Limited

Speakers: Robert Hogan, President, Hogan Assessment Systems Simon Lebus, Group Chief Executive, Cambridge Assessment Jurgen Hogrefe, CEO, Hogrefe Marten Roorda, CEO, Cito Eric Shepherd, CEO, Questionmark Robert Whelan, President, Pearson VUE

Thursday, 1 October 2009 ∙ 14:00 - 15:00

Robert Hogan Simon Lebus

Jurgen Hogrefe Marten Roorda

Eric Shepherd Robert WhelanEugene Burke

Page 20: E-ATP 2009

20

Thursday, 1 October 2009 ∙ 15:45 - 16:45 15:45 - 16:45Co-operating in Setting and Monitoring Standards for Language Assessment: The ALTE ApproachRoom: MEC Audi 2 Session Type: Invited Breakout

Early philosophical treatises advocated cooperation as part of the ethical and social fabric governing relationships among individuals and institutions. Today, in the 21st century, collaboration continues to be perceived as an intellectual choice. This paper shares the experience of examination institutions in Europe who took the initiative to cooperate in setting and monitoring standards for language assessment in order to ensure the provision of quality assessment tools and to justify the use of these assessments to stakeholders.

The institutions referred to here are those which form the Association of Language Testers in Europe (ALTE). The paper will start by describing the ALTE context. It will discuss how in achieving ALTE’s aim of establishing common professional standards for all stages of the language testing process, the partners worked together to create a code of practice and a quality management system which have been adopted and are in use by the 31 members of ALTE. The paper will describe the different aspects of the quality management system demonstrating its applicability in a trans-national context. It will focus, however, on a recent collaborative project, i.e., the set-up and implementation of audits.

Speaker: Nick Saville, Director, Research & Validation, University of Cambridge ESOL Examinations

Driving Safely in OtherlandRoom: Marie Curie Session Type: Invited Breakout

Against a background of increased emphasis on driver safety, it is important to assess critical driver competencies and to support driver training across a broad range of competencies. Digital testing is very efficient: it gives you strong evidence at low costs, a minimal investment of time, resources and people, and you minimise the risks for the candidate or other drivers. During the session you will experience some examples of multimedia testing; different ways of testing perception and danger detection, and also a unique filtering system with which it is possible to offer drivers the exact amount of training to improve their driving skills. In another new development, CITO has found TNO as a partner in simulator-based testing. Simulators allow skills and competencies to be assessed objectively and uniformly under near realistic conditions. They even allow critical and hazardous test scenarios to be safely presented to the candidate.

Current research focuses on the way simulator-performance data relates to low- and high-order skills. TNO and CITO aim to further explore this relationship in this session.

Speakers: Bart Kappe, TNO Human Factors Aranka Krechting, Account Manager, Cito

Sponsored by:

Thursday, 10:00 – 11:30

Wim J. van der Linden Book SigningRoom: Ambassadeur

Page 21: E-ATP 2009

www.hogrefe.com

International Assessment Tools –available in multiple languages

Revised NEO Personality Inventory· English · German · French· Dutch · Danish · Czech · Swedish

Golden Profiler of Personality· German · Czech · English · French · Danish*

d2 Test of Attention· English · German · French· Danish · Czech · Croatian

· Spanish · Portuguese · Polish · Dutch

· Hungarian* · Romanian*

SON-R Non-verbal Intelligence Test for Children· English · German · Dutch· French · Czech · Slovak · Danish/Swedish/Norwegian* · Romanian*

Intelligence Structure Test

· German · Czech · Italian · Lithuanian · Bulgarian

· Slovak · English · French* · Dutch* · Danish · Hungarian*

Personality Poker· English · German

· Danish · Czech · Spanish · Finnish

Leadership Judgement Indicator

· English · German* · French* · Danish* · Czech*

*(in

pre

ss)

Business-Focused Inventory of Personality· English · German · Czech · Spanish · Portuguese · French · Dutch · Danish · Slovak* · Hungarian*· Croatian*

HTS International

The Hogrefe TestSystem (HTS)the leading multi lingual platform for computer- and web-based test ing: flexible, secure, with tests in multiple languages , extensive tools for analysis and reports. www.hogrefe-testsystem.com

For complete cataloguevisit our Websites

www.hogrefe.dewww.hogrefe.co.ukwww.hogrefe.comwww.hogrefe.frwww.hogrefe.czwww.hogrefe.nlwww.dpf.dkwww.hogrefe.chwww.hogrefe.atwww.hogrefe.se

Cattell – Culture Fair Intelligence Test· English · German · Italian · Spanish · Croatian · Filipino* · Czech* · Danish* · Swedish* · French* · Dutch* · Polish*

Page 22: E-ATP 2009

22

Expanding the Cultural Reach of Your CertificationRoom: Bourgmestres Session Type: Breakout

Translating, localising and expanding the reach of your certification to other cultures and global geographies represent a key growth opportunity for many assessment bodies as well as a significant challenge. The rapid expansion of the internet and globalisation of the world economy means that cultural and diversity-related boundaries are shifting and falling away. The faces of many professions have already begun to change – how can the opportunity for purposeful globalisation of bodies of knowledge best be seized?

It is extremely important to translate and localise materials correctly, so that they are meaningful, legal and culturally correct in the target languages. There are also strategic and process issues for the organisation that are critical to success. This session will discuss principles and practices for expanding assessment programmes on an international scale and in different languages through the lens of recent case studies. It will also cover key considerations for assessing how well a current body of knowledge addresses multi-cultural needs of a local candidate pool.

Speakers: Sue Orchard, Managing Director, Comms Multi-lingual Ltd Christina Turner, Managing Director, Global Professional Skills

Flawed Leadership - Keeping the Advantage of High Potentials through AssessmentRoom: MEC Seminar Session Type: Breakout

Every Talent Manager is trained to recognise the positive attributes that identify a high-potential candidate. The challenge arises when we hire and then promote key talent without focusing on their potential derailers. As business landscapes become one of growing talent and leveraging our high performers into new and more challenging roles, a whole new side of the high potential begins to emerge. This session will explore current trends in proactively identifying candidate derailers, best practices to minimise their effect on performance, and preventing derailment by focusing on correct placement and promotion strategy. Throughout the session we will interweave the best practice concepts found within the Key Talent programmes at DELL.

We will provide best practice strategies for implementing and leveraging assessments into worldwide key talent development programmes. With the shrinking talent pool, expanded responsibilities of leaders, and the intense pressure being placed on leaders, the impact of flawed leadership attributes has become a central focus across organisations. With that in mind, we will answer the question: Flawed Leadership, is it pressure or personality, and what can we do to avoid it?

Speakers: Brandy Agnew, Global Talent Management, DELL Ryan Ross, Director, Alliance and Partners, Hogan Assessment Systems

Thursday, 1 October 2009 ∙ 15:45 - 16:45

Page 23: E-ATP 2009

23

How Does CBT Add Value to High School Exams?Room: MEC Audi 1 Session Type: Breakout

National high school exams in the Netherlands have been paper-based for decades and are well regarded and respected. In 1999, computers were used for the first time in art exams. More competencies could be tested, using sound and video. This added value to the exam. The years following, exams of other topics moved from paper to (partly) computer-based, again for the same reason, adding value. For instance, in a computer-based biology exam questions about animal behaviour can be added by using a video clip.

Value is also added when an exam has more automatically-scored items. It saves marking time and can be re-used with ease. Re-using exams has given schools the possibility to move away from fixed exam dates and make their own schedule. In 2010 over 600 (out of 1300) high schools will deliver their exams on a computer. Has this process been easy? Well, there are challenges. Schools need to invest more time and effort to organise computer-based exams rather than paper-based exams. They need to be convinced of the added value. Schools (and parents) are also concerned whether computer-based testing is as fail-safe as paper-based testing. This session focuses on the details of this transition in the Netherlands, its successes, challenges, future plans and more.

Speaker: Nynke de Boer, Manager, Computer Based Exams, Ministry of Education, Netherlands

The Paradox of Digital Assessment: The Challenges and the Solutions of Delivering High- Stakes AssessmentsRoom: Langevin Session Type: Breakout

GL Assessment has been providing digital versions of high-stakes tests to the UK and, increasingly, the international schools market, for the past five years. Delivering high-stakes assessments into schools in a way that yields real benefits, engages rather than alienates teachers and, most significantly, excites rather than frustrates students, is a complex challenge. At the heart of this challenge is a central paradox: a high-stakes digital assessment may be one of the most mission critical, significant events in the school year. Yet the background in which this is attempted is often one of poor quality technical infrastructure, uncertainty about support and overworked teachers with perhaps no specialist technical knowledge or enthusiasm. GL Assessment has slowly worked its way through these kinds of issues and has gradually found solutions to many of them. This presentation will talk about the paradox, some of the missteps that were taken along the way, and the subsequent solutions that have enabled GL Assessment to offer digital assessments into the poorest of technical environments – consistently and successfully.

Speaker: David Vincent, Sales Director, GL Assessment

Thursday, 1 October 2009 ∙ 15:45 - 16:45

Page 24: E-ATP 2009

24

08:00 – 15:15 Registration Open Hotel Metropole Lobby 08:00 – 09:00 Breakfast with Hotel Le Jardin Indien 09:00 – 10:00 Closing Keynote Address Excelsior 10:00 – 11:30 Exhibits and Coffee Break Ambassadeur 11:30 – 12:30 Breakout Sessions Various Rooms 12:30 – 14:00 Lunch and Exhibits Le Jardin Indien 14:00 – 15:00 Star Sessions Various Rooms 15:00 – 15:15 Coffee Break Arthur Rubinstein Room 15:15 Close

Closing Keynote 09:00 - 10:00Banking on Talent: Innovations and Real Applications Within a Global Financial FirmRoom: Excelsior Session Type: Keynote

This session will review the application of global on-line assessment dealing with over 60,000 multi-language assessments embedded within an applicant tracking system, as well as a costed ROI for online testing.

In addition, this session will also focus on profiling an innovative assessment of leadership potential using a unique, behaviourally focused managerial evaluation tool, as well as a developmental 360o assessment that is fully integrated into an award- winning development programme.

This session will be of interest to any multi-national, global organisation, and in particular, organisations wanting to focus on the early identification of Leadership Potential.

Speaker: John Mahoney-Phillips, Global Head of Human Capital, UBS

Breakout Sessions 11:30 - 12:30Aligning Examinations to the Common European Framework of Reference: Issues & PracticeRoom: Bourgmestres Session Type: Invited Breakout

Today, the Common European Framework of Reference (CEFR) plays a central role in language education and policy not only within Europe but worldwide. It has a growing relevance for language testers and examination boards, helping to define language proficiency levels and interpret language qualifications. For many language testers, test book publishers and curriculum developers, it has become imperative to make the case that their products are aligned to the CEFR. The Council of Europe has attempted to facilitate this by providing a toolkit of resources, including a manual for relating language examinations to the CEFR and a technical reference supplement. In this paper we will discuss an examination board’s experience in linking its examinations to the CEFR and reporting its scores in terms of

Programme - Friday, 2 October 2009

Page 25: E-ATP 2009

25

the CEFR scale. The discussion will address challenges faced and solutions sought. We will share case studies from Cambridge ESOL’s Suite of General English Examinations and Business English Examinations.

Speaker: Hanan Khalifa, University of Cambridge ESOL Assessments

Are Human and Computer-Delivered Interviews Comparable?Room: MEC Seminar Session Type: Breakout

As the demand for employment testing increases, organisations will increasingly turn to technology-based assessment solutions. Because employment testing is high-stakes, the use of technology to conduct such testing needs to be thoroughly evaluated. This applies to assessments administered in an interview format as well as paper-and-pencil tests. LTI proposes to present an independent field study that examined the comparability of language proficiency interviews administered by humans versus computers (i.e. embodied agents).

The study indicates human- and computer-administered interviews evaluated by multiple raters and exhibited comparable levels of reliability. The interview modality did not appear to affect examinees’ language proficiency rating. Given the importance of an increase in standardised language proficiency assessment in the United States and in Europe with the adoption of the Common European Framework for Languages (CEFR), this is good news in that it will improve the efficiency of the testing process (e.g. reducing scheduling complexity and decrease costs) without compromising the measurement properties and effectiveness of the process.

Speaker: Helen Hamlyn, VP, Language Testing International

European Test Publishers in a Flatter World: Impacts on Talent AssessmentRoom: MEC Audi 2 Session Type: Breakout

European test publishers will thrive in a flatter world by making tests readily accessible to an increasingly mobile, multi-national and multi-lingual workforce. They will broaden their reach and maximise business opportunities by improving their ability to deliver tests more widely to a diverse audience. Growing talent in a flatter world will require:

• Giving subject matter experts multi-lingual, web-based tools for easy content harvesting. • Efficiently translating assessments into multiple languages. • Centralizing management and control of content. • Giving participants tools for easy assessment access and navigation • Accommodating visually impaired test takers. • Delivering tests to more people on a wide variety of electronic devices. • Providing delivery options for high-speed, low-speed and intermittently connected devices around the world.

This session will discuss the opportunities and challenges brought to us by changes taking place globally and the increasing demand for accessibility and inclusivity. It will show how publishers can utilize the latest technologies to provide comprehensive assessment management for multi-cultural, multi-lingual and multi-national workers.

Speaker: Eric Shepherd, CEO, Questionmark

Friday, 2 October 2009 ∙ 11:30 - 12:30

Page 26: E-ATP 2009

26

Innovations in Assessment: The Impact of Online Marking on Examiner’s BehaviourRoom: Marie Curie Session Type: Invited Breakout

Cambridge Assessment and Research Machines (RM) have jointly developed a new system of online marking to mark the examination of writing scripts. This session reports on a number of marking issues in the new format. Issues such as usability of on-screen marking, comparability of paper-based marking with on-screen marking, examiner behaviour in the two modes, and the training of the examiners in the use the new marking system will be discussed. We will particularly address the following questions:

1. Are marks given to candidates in the two scenarios comparable? 2. Does the format of the marking impact on examiners’ marking in the two different modes? 3. What are the measures of leniency in the two ways of marking? 4. What impact do the different modes have on the reliability of the examiners’ marking? 5. Would examiners use the full length of the scale in the two different modes of marking?

The session will also explore whether markers attend to the same features of writing performance in paper-based and computer-based marking.

Speaker: Ardeshir Geranpayeh, Assistant Director, Research & Validation, University of Cambridge ESOL Examinations

Moving Beyond the Ropes Course: Using Assessments to Maximise Team Performance and DevelopmentRoom: MEC Audi 1 Session Type: Breakout

Prior to engaging in team development activities, practitioners frequently use personality-based assessments to gather individual and group-level data. Professionals can find a profusion of literature that addresses teamwork in organisational settings. However, there are very few, well-grounded, pieces of guidance for practitioners in using assessment data to create and implement meaningful team-based development programmes. Team-based development is critical to the continued growth of talent and performance within organisations. With the growing trend of globally-based work teams, the key way to gain advantage of their diverse capabilities is by maximising their awareness of each other’s strengths and development needs with regard to key business objectives.

The purpose of this session is to (a) capitalize on the experiences of practitioners who have successfully used assessments to enhance the team development process, and (b) work toward the establishment of best practices with regard to use, privacy, and consulting practices. This will be accomplished with a moderated panel of 4 industry experts (and a separate moderator) who use various assessments for developing leadership talent within a team environment.

Speakers: Rostislav Benák, Managing Director, Assessment Systems Richard Brady, Managing Director, Mentis Consulting Rainer Neubauer, Managing Director, Metaberatung

Friday, 2 October 2009 ∙ 11:30 - 12:30

Page 27: E-ATP 2009

World class assessment technology from the UK’s leader in educational IT

[email protected]

Technology can transform assessment. Visit the RM stand to find out how we can help make the vision a reality.

On-screen marking services Test authoring & test delivery services

Data services & solutions

www.rm.com/assessment

Page 28: E-ATP 2009

28

Personality and the Fate of OrganisationsRoom: Langevin Session Type: Breakout

Many organisations expect to develop leadership and manage change effectively, especially in these tumultuous economic times. Organisations engage in the use of various assessment tools and techniques which focus on workforce behaviour. Academics and self-appointed business gurus have proposed numerous models of leadership and ‘executive success’, however, few have addressed the fundamentals – the psychology behind the topic of leadership.

This presentation focuses on three key topics. First, leadership is a real and consequential phenomenon – perhaps the single most important issue in the human sciences; second, leadership is about the performance of teams, groups, and organisations; and third personality predicts leadership. Who we are determines how we lead; and this information can be used to select future leaders or improve the performance of current incumbents.

Speaker: Robert Hogan, President, Hogan Assessment Systems

14:00 - 15:00Assessing Pupils' Progress, The Need For Improvement. The Turkish Approach and Its Impact on Educational PracticesRoom: MEC Seminar Session Type: Star In terms of curriculum context, assessing pupils’ learning has an important impact on (1) definition

of objectives in the new primary school curricula, and (2) monitoring pupil progress across grade levels in Turkey. This presentation will basically focus on empirical findings obtained over 40,000 students in the primary school level through the Turkish Pupil Monitoring System (TPMS). The impact of TPMS on curriculum will be exemplified in terms of how curriculum objectives and materials are assessed and interpreted within TPMS framework.

With the emphasis given to technical aspects of the TPMS instruments and their contribution to testing practices in Turkey, the impact of the monitoring process will be explained in line with the cognitive development of the students across different subject matter areas and grade levels. Cognitive development of students and its relation to student, school and parent-related variables will also be presented.

Speaker: Giray Berberoglu, Middle East Technical University, Cito Türkiye

Bridging the Industry-Academia Gap: Driving Employability through AssessmentsRoom: Bourgmestres Session Type: Star 2.5 million students graduate from Indian colleges every year, distinguishing India as one of the largest talent pools in the world. However, differentiating between sheer output and employable talent, a research by MeritTrac indicates that only around 15-25% of all graduates are employable. This highlights the fact that the proportion of industry-ready candidates in the abundant talent pool is alarmingly low – posing a huge challenge to the growth of India.

It is imperative to segregate the talent pool into employable and trainable categories through

Star Sessions

Friday, 2 October 2009 ∙ 11:30 - 12:30

Page 29: E-ATP 2009

29

structured, industry-endorsed assessments. MeritTrac has built successful experiments in India on issues of selection, employability and structured feedback to bridge gaps. In one such approach to bridge the industry-academia gap, MeritTrac has partnered with NASSCOM – the premier trade body for the IT/BPO industry in India and devised a certification programme called NAC-Tech (NASSCOM’s Assessment of Competence-Technology) for addressing the issue of employability of engineering graduates by actively involving the industry, academia and students.

This presentation delves into the process involved in building such collaborative programmes, scientifically designing the assessments and finally achieving the objective of increasing employability.

Speakers: Madan Padaki, Co-Founder & CEO of MeritTrac Services Pvt. Ltd. Lawrence Rudner, VP, R&D, GMAC

Challenges and Rewards of Managing a Truly Global Certification ProgrammeRoom: MEC Audi 1 Session Type: Star At the end of 2006, SAP reviewed its certification programme, which had been running since 1996 and had certified more than 120,000 consultants around the world. The review identified some major transformation steps which were needed to position the programme as a significant business factor for SAP, its customers and its partners in the challenges of today’s global economy. Since then SAP, which is also the world’s largest IT training business, has teamed up with partners, such as Questionmark and Pearson VUE, to drive that transformation – not without a few interesting challenges along the way! Sue will outline the background for SAP’s change, the steps taken and lessons learned and will invite the delegates to participate in a discussion on

the way forward into the 21st century, addressing the challenges of standardisation, international regulations and some of the cultural challenges of IP protection.

Speaker: Sue Martin, Global Certification Portfolio Manager, SAP

Going Online with Assessing for Talent - Delivering Value and Securing Validity in the Search for TalentRoom: Langevin Session Type: Star In an online world where businesses increasingly use the software as a service (SAS) model and where most of us network and search for jobs online, it is inevitable that assessment must go online. The argument goes that we cannot trust online assessments because the cheats and pirates will compromise them, so therefore only sifting and some form of applicant capture and tracking should be the limit of putting assessments online. That argument may reflect the concerns of professionals and psychometricians but holds less and less conviction for the end user whose budgets are under ever increasing pressure, and who is looking for methods that help to manage the value they can extract from recruitment, development and succession processes.

This presentation will look to why we, in the testing industry, will have to work through the barriers, real or imaginary, to going online with assessment as well as some of the challenges that the online world will pose to us in the design and delivery of assessments. In line with the main theme of this conference, the talk will show why going online with assessment is so fundamental to identifying talent that organisations can grow, and how online assessment can provide an edge is the search and acquisition of talent in the

Star Sessions

Page 30: E-ATP 2009

30

multi-geographical, multi-lingual and multi-cultural context of Europe.

Speaker: Jim Sharf, Sharf and Associates, Employment Risk Advisors, Inc.

Going Online with Employment Testing: Lessons from the Front LineRoom: MEC Audi 2 Session Type: Star This is intended as an experience sharing session for those considering going online with employment testing whether that is for the acquisition, development or succession of talent in their organisations. The contributors have been selected as they are early adopters of online processes in Europe and their talent acquisition programmes are multi-national, multi-lingual and have to address a number of stakeholder issues. The session will offer short summaries of experience, issues addressed and lessons learned, and will conclude with a question and answer opportunity for members of the audience to delve further into the experience of these large scale programmes.

Speakers: Eugene Burke, Director, Science and Innovation, SHL Group Limited Kate Downey, HSBC Stefan Herman Meyer, European Personnel Selection Office

Promoting High Standards in Assessment in EuropeRoom: Marie Curie Session Type: Star

The Association for Educational Assessment – Europe (AEA-Europe) is a professional association for assessment organisations and individuals. Its general goal is to act as a platform for discussion of developments in educational

assessment in Europe, fostering cooperation and facilitating liaison between organisations and persons active in educational assessment across the whole of Europe. Within this, there is a commitment to professional development as a means to raising standards in the production and use of assessments. The Association has several initiatives to achieve this aim.

First, there is an accreditation scheme for people involved in assessment, recognising the achievements of members and providing a framework for professional development. This requires applicants to provide evidence that they have met criteria, which are referenced to the European Qualifications Framework.

Second, the Association is actively developing a set of standards for assessments and their development which are appropriate for the European context. The structure, benefits and issues of both the accreditation scheme and the standards development will be described.

AEA-Europe has an established membership across all of Europe and is helping to improve communication among European organisations and institutions interested in educational assessment through sharing of professional expertise, exchange of knowledge and collaboration between members through our conferences, publications and professional activities.

Speaker: Chris Whetton, President, AEA-Europe

Star Sessions

Page 31: E-ATP 2009

31

Special ThanksWilliam G. Harris, CEO, ATP

2009 President and Chair of ATP

Casey Marks, COO, NCSBN

2010 President and Chair of ATP

Marten Roorda, CEO, Cito

E-ATP Executive Committee

E-ATP Division Chair – Paul Howarth, Managing Director, Pearson VUE (EMEA)

E-ATP Division Vice Chair – Eugene Burke, Science and Innovation Director, SHL Group Limited

E-ATP Divison Secretary – Erwin van Schaffelaar, Business Developer, Cito

E-ATP Event Manager – Nicola Pope, Corporate Marketing Executive, Pearson VUE

Tim Oates, Group Director of Assessment Research, Cambridge Assessment

Programme Committee

Programme Chair – Cor Sluijter, Director,Vocational, Adult and Higher Education, Cito

Programme Vice Chair – Ardeshir Geranpayeh, Assistant Director of Research and Validation, University of Cambridge ESOL Examination

Lise-Lotte Appelgren, Test Consultant, Enlight AB

Ryan Ross, Director Alliance and Partners, Hogan Assessment Systems

Wim van de Brug, CEO, Lamark BV

Marketing Committee

Marketing Chair – Aranka Krechting, Account Manager, Cito

Nicola Pope, Corporate Marketing Executive, Pearson VUE

Sponsorship Committee

Sponsor Co-Chair – William G. Harris, CEO, ATP

Sponsor Co-Chair – Lauren Scheib, Administrator, ATP

Cathy Donath, Vice President, Client Services, The Donath Group, Inc.

Page 32: E-ATP 2009

For membership information call 1-866-240-7909 or visit: TestPublishers.org

Train on best practices and intelligent test use

Educate policy makers and the public on merits of testing

Safeguard the intellectual property of test publishers

Trade insights and share experiences within the testing community

Your Voice in The Testing Community

Leading publishers and assessment service providers in today’s testing industry.

Find your voice today!