Effective E-Assessment:Making IT happen

E-Assessment in Practice – Nov 2009

Overview

Definition

Building Blocks

Checklists

Conclusions

A Definition – effective assessment

1.adequate to accomplish a purpose; producing the intended or expected result:

2.actually in operation or in force; functioning: prepared and available for service.

Although there are many definitions of assessment, central to all definitions is the making of judgments against defined, usually external, criteria.

The Building Blocks(e-Strategy - Harnessing Technology: DfES 2005)

Infrastructure

SkillsContent

Skills and confidence

Students • Readiness to use technology• Awareness of e-assessment

Staff (internal)• The shock of the new – roles & process

Staff (external)• The ‘hidden team’ partnership• Guidelines and rules

Senior management• Strength and commitment of chain of command

Skills – internal and external

2009@1949

Senior Management/Assessors/Authors?

Teachers/Staff/Assessors/Authors?

Graduates/Workforce of tomorrow

FE/Secondary student

Primary pupil

Infrastructure

Scope of deployment • Single-site/multi-site• Local, regional, national, international

Access and reach• Platform dependence• Capacity and scalability

Resilience vs security• Web-based vs local install• Approval and ‘dummy test’ procedures

Technical support• Tiered roles – first line, second line• Local/remote – hours of service

INTERNATIONALNATIONALLOCAL

Infrastructure:Capacity & Standardisation

Content – does it fit?

One size does not fit all• Subject variance – domain concepts• Level variance – Bloom’s taxonomy

Mind the gap• Transfer, translate, transform• Authoring skills and assessment models

Drivers - education• Reliability and quality assurance• Validity and innovation

Drivers - business• Service improvements, flexibility/availability• Cost savings, efficiency, transferability

Convergent Assessment

Divergent Assessment

Performance Evidence

Skill Tests

What and where?

Success Checklist

CATEGORY

Staff – internal vs external

Senior Management commitment

Single-site vs multi site

Web-based vs local install

Technical support model

Approval and training options

Fit to subject and level

Transfer or Transform

Educational benefits

Business benefits

TOTAL

Conclusions Credibility - foundation

• Reliability + validity + trusted service Skills - confidence

• Training, guidelines and rules Infrastructure - capability

• Market intelligence Content - fit for purpose

• Better by design Control – command or cajole

• Circle of influence

Questions