EQO Workshop – University of Piraeus, 26 November 2004 SEEQUEL S ustainable E nvironment for E valuation of QU ality in E-L earning Dr Nikitas Kastis Lambrakis

EQO Workshop – University of Piraeus, 26 November 2004

SEEQUELSEEQUEL

SSustainable ustainable EEnvironment fornvironment for

EEvaluation of valuation of QUQUality in ality in E-LE-Learningearning

Dr Nikitas KastisDr Nikitas Kastis

Lambrakis Research Foundation – MENON Lambrakis Research Foundation – MENON NetworkNetwork


ObjectivesObjectives

To define a Conceptual Framework for Analysis, corresponding to a holistic approach to Quality in e-learning, to serve as a basis for a productive long-term dialogue and consensus building between the stakeholders in Europe.

To establish the European eLearning Quality Forum, with representation from all relevant bodies, organizations and authorities in Europe, as a sustainable forum for dialogue, consensus building and policy support in the field

To develop a set of eLearning Quality Tools


PartnershipPartnership

MENON Network EEIG (Coordinator): Scienter, Lambrakis Research Foundation, FIM - New Learning, HUT Dipoli eLearning Industry Group (eLIG): Accenture, Sanoma WSOY, SAP, SUN Microsystems CEDEFOP (European Centre for Vocational Education & Training) EIfeL (European Institute for e-Learning) EDEN (European Distance & E-Learning Network) EUROPACE ESIB – European Students Association University of Reading & University of Edinburgh


1. 1. Mapping of approaches to qualityMapping of approaches to quality

Stakeholders typology

Industry providing e-Learning

Industry as users (HR departments, etc.)

Government (EU / national / regional)

K12 (providers, learners, parents and proxies, teachers)

Higher education (providers, learners, teachers)

Initial VET (providers, learners, teachers)

Informal learning (providers, learners, trainers?)

Continuous Professional Development (providers,

learners, trainers)


SR V

Perception

Stakeholder

Object

LE

LS LP LC

Quality of Learning experience

2. Conceptual Framework2. Conceptual Framework


Value features The World of Inspiration Singularity, difference,

innovation, originality, irrationality, imaginary, spirituality, unconscious, chance

The Domestic World Confidence, responsibility, merit, respectability, convention, dignity, tradition, hierarchy, rank; parents, children, generation; rules and confidence, principles; harmony; the "natural"; the duty

The World of Opinion Image, reputation, fame, success, honour, acknowledgement, visibility, audience, credibility, identification

Visions of the World Visions of the World (adapted from (adapted from Boltanski and Thévenot)Boltanski and Thévenot)

1/21/2


Value features The Civic World The general will, the common

interest, generosity, self-abnegation, sacrifice, pride, the group, collective action, collective entities (ideas, values, symbols and institutions).

The Merchant World Wealth, money, luxury; business, fair deals, good deals, bargain; interest, attentions to others; contract; competition, rivalry, opportunism, freedom,

The Industrial World Progress, future, functionality, efficiency, optimality, performance, productivity, professionality, reliability, far-sightedness, system

Visions of the World Visions of the World (adapted from (adapted from Boltanski and Thévenot)Boltanski and Thévenot)

2/22/2


Learning experienceLearning experience

Learning Sources• Teachers CV/

Qualification• Learn. Materials• Reference

Materials• Components

Core learning processes• Guidance/

Recruitment/TNA/ Planning

• Design (Guidance Principle)

• Delivery (T&L)

• Evaluation

Learningcontext

• Institutional setting

• Centralised/ Decentralised curriculum

• Culture (nat., org.,prof., gen.)

• Learn. Environm.

• Legislation• Financial• Values

system


Learning Sources• Teachers

CV/Qualification• Learn. Materials• Reference

Materials• Components

Example of area specific criteria• Pedagogical Quality• Content updating potential/reliability• Technical Quality• Portability (techn.)• Integration potential (context/org)• Adaptability (context/indiv.)• Aestethics Quality – Attractiveness -

Empathy• IPR conformance



Core Learning Process• Guide - Recruitment• Design (Guidance principle)• Delivery (T&L)• Evaluation

Example of area specific criteria• Tracking progress• Interaction• Learning Motivation• Open endedness• Collaboration• Production of change• Effectiveness (Pedag.)• Efficiency (Econ.)



L. context• Institutional setting• Centralised/

decentralised curriculum

• Culture (nat., org., prof., gen.)

• Equipment and connectivity

• Learn. Environm.• Legislation• Financial rules• Values system

Examples of area specific criteria• Supportiveness (climate + service)• Open-mindedness• Tolerance to mistakes• Valorisation of learning results• Encouraging implementation



SEEQUEL on the webSEEQUEL on the web


3. European Quality Forum3. European Quality Forum


European Quality ForumEuropean Quality Forum

1.1. What can you find there?What can you find there?

Desk researchDesk research results results

More than 800 registered usersMore than 800 registered users

Analysis of different approaches, methods, criteriaAnalysis of different approaches, methods, criteria

Ongoing documentationOngoing documentation

SEEQUEL consortium discussionSEEQUEL consortium discussion

Workshops: presentation, discussion, findingsWorkshops: presentation, discussion, findings

Documents: revision of initial analysis, integrating the Documents: revision of initial analysis, integrating the

“Communities” views“Communities” views


• Identifies needs for Quality Tools• Checks availability at international level• Proposes new Tools or

improvements/adaptations• Gives mandate to Working Groups for progress• Evaluate progress and results

4. SEEQUEL Quality Lab4. SEEQUEL Quality Lab

The Quality Lab uses Forum’ s input to produce Tools


Goals of the Quality LaboratoryGoals of the Quality Laboratory

a) facilitate long-term discussion, exchange of ideas, experiences, “good practice” and knowledge consolidation as a policy support mechanism at the European level

b) provide a highly reliable and value-added environment offering a consistent approach for the testing and certification of “Quality Assurance Frameworks”, addressing the practical requirements for the effective development of learning technologies and learning services

It is an experts environment to validate quality assurance schemes for e-learning content and practice and to disseminate “good practice” to both the industry and the Education and Training users.


The CF-Forum-Laboratory LinkThe CF-Forum-Laboratory Link

Position / identity (stakeholder‘ s identity)

Consider objects and weight criteria

Choose approach to quality

Implement

Report / share

Compare

Improve your approach


5. The SEEQUEL Working Groups5. The SEEQUEL Working Groups

WP1Review of

supply/industry approach

to quality

WP4

eLearning

Quality

Forum

WP4

eLearning

Quality

Forum

WP2Review of

demand/E&T approach to

quality

WP6Tools development

for industry

WP7Tools development

for E&T Community

WP9 – Project Management and Evaluation

WP8Forum Web support and

dissemination

WG2

WG4WG

5WG…

WG1

WG3

WP3Developmen

t of conceptual framework

WP5 ELearning Quality

Laboratory


5. The SEEQUEL Working Groups5. The SEEQUEL Working Groups

WG 1 Coordination of the Quality Lab

WG 2 Core Quality Framework

WG 3 User guide

WG 4 Informal learning

WG 5 Industry

WG 6 Self positioning path - accompanying the user

through the process

WG 7 External Coordination


6. The SEEQUEL Tools6. The SEEQUEL Tools

Core Quality Framework

&

eLearning Quality Guide for the User (Learner)

(e-)Learner’ s Bill of Rights

Reaching eLearning Quality in Informal Learning

Quality Analysis Tool (for the industry)


What is next?What is next?

SEEQUEL Self positioning

pathQuality

Forum

Approaches repository

EQO SEEL

REC

REC

REC

REC

Quality

Lab

SEEQUEL Self positioning

pathQuality

Forum

Approaches repository

EQO SEEL

REC

REC

REC

REC

Quality

Lab


Contacts-Information- Contacts-Information- Contribution to the discussionContribution to the discussion

www.education-observatories.net/seequelwww.education-observatories.net/seequel

[email protected]