Certification of ICT skills: a bridge between Universities and Industries N.Scarabottolo – AICA – Italy [email protected] UNICTRY ’07 Genzano

Certification of ICT skills:Certification of ICT skills:a bridge between a bridge between

Universities and IndustriesUniversities and Industries

N.Scarabottolo – AICA – ItalyN.Scarabottolo – AICA – [email protected]@unimi.it

UNIUNICTRY ’07CTRY ’07Genzano di Roma – May 26Genzano di Roma – May 26thth 2007 2007

Genzano di Roma, May 26th 2007 slide 2 of 23

SummarySummary

• IntroductionIntroduction• Italian University System after Italian University System after

Bologna pan-European agreement Bologna pan-European agreement (1999)(1999)

• The CampusThe CampusOneOne project: ECDL in project: ECDL in Italian UniversitiesItalian Universities

• The IT4PS project: problem oriented The IT4PS project: problem oriented usage of ICT toolsusage of ICT tools

• The EUCIP4The EUCIP4UU project: certification for project: certification for ICT professionalsICT professionals


ICT certificationsICT certifications

• Based on Based on ex anteex ante definition of definition of competence syllabus:competence syllabus: Universities and Industries involved.Universities and Industries involved.

• Clear separation between training and Clear separation between training and (third part) assessment.(third part) assessment.

• No self-referentiality riskNo self-referentiality risk butbut

no evidence of training differences.no evidence of training differences.• Suitable for:Suitable for:

instrumental competences (English, ICT instrumental competences (English, ICT skills);skills);

vendor-dependent ICT products.vendor-dependent ICT products.


SummarySummary

IntroductionIntroduction• Italian University System after Italian University System after






Universities in ItalyUniversities in Italy

• From 2001/02, curricula restructured From 2001/02, curricula restructured according to Bologna pan-European according to Bologna pan-European agreement:agreement: 3 + 2 + 3 years degree scheme;3 + 2 + 3 years degree scheme; ECTS accounting based on 60 CFUs per ECTS accounting based on 60 CFUs per

year;year; course names defined by single course names defined by single

universities;universities; each course must belong to a each course must belong to a classclass;; horizontal topics (English, ICT basic skills) horizontal topics (English, ICT basic skills)

compulsory for all courses.compulsory for all courses.


SummarySummary

IntroductionIntroduction Italian University System after Italian University System after






The CampusThe CampusOneOne project project

• Launched in 2001-2004 by Conference Launched in 2001-2004 by Conference of Italian Universities Rectors (CRUI).of Italian Universities Rectors (CRUI).

• Particular attention to basic skills in Particular attention to basic skills in computer usage.computer usage.

• Focusing and funding on Focusing and funding on certificationcertification of basic skills to:of basic skills to: avoid self-referencing in assessment of avoid self-referencing in assessment of

horizontal capabilities;horizontal capabilities; encourage mobility of students.encourage mobility of students.

• Initially, support to the ECDL scheme.Initially, support to the ECDL scheme.


ECDL in universitiesECDL in universities

TOTALTOTAL Inside Inside UniversitiesUniversities

Universities Universities vs. Totalvs. Total

ECDL exams ECDL exams passedpassed 641,884641,884 98,84998,849 15.4 %15.4 %

ECDL licensesECDL licenses 115,939115,939 18,78818,788 16.2 %16.2 %

ECDL START ECDL START licenseslicenses 12,95512,955 10,75910,759 83.0 %83.0 %

ECDL FULL ECDL FULL licenseslicenses 102,984102,984 8,0298,029 7.8 %7.8 %

Dimensions of the ECDL programme in 2003Dimensions of the ECDL programme in 2003

University students University students slightly more focused slightly more focused to obtain a certification.to obtain a certification.

START license far START license far more interesting for more interesting for Universities than for Universities than for other peopleother people


ECDL growthECDL growth

Number of University licenses over the yearsNumber of University licenses over the years

3212

878 10759

8029

11842

8612

12191

11981

0

5000

10000

15000

20000

25000

2002 2003 2004 2005

ECDL START ECDL FULL

Sharp increase Sharp increase after the initial after the initial setup of the setup of the CampusCampusOneOne project.project.

Progressive Progressive shift towards shift towards FULL FULL certification.certification.


ECDL impactECDL impact

1.41%

6.11%6.53%

7.88%

0.00%

1.00%

2.00%

3.00%

4.00%

5.00%

6.00%

7.00%

8.00%

2002 2003 2004 2005

Percentages of certified freshmenPercentages of certified freshmen

At the end of At the end of the Campusthe CampusOneOne project, a project, a significant significant amount of new amount of new students students certified.certified.


SummarySummary



The CampusOne project: ECDL in The CampusOne project: ECDL in Italian UniversitiesItalian Universities




The IT4PS projectThe IT4PS project

• Advanced skills in usage of Advanced skills in usage of spreadsheets and databases.spreadsheets and databases.

• Aimed at enhancing problem solving Aimed at enhancing problem solving capabilities instead of package capabilities instead of package knowledge.knowledge.

• Three areas of application:Three areas of application: Economy;Economy; Medicine and pharmacy;Medicine and pharmacy; Statistics for social sciences.Statistics for social sciences.

• Teaching material and books produced.Teaching material and books produced.


The IT4PS certificationThe IT4PS certification

• 1 hour test for solving a real problem – 1 hour test for solving a real problem – in one of the application areas – with in one of the application areas – with advanced usage of spreadsheet or advanced usage of spreadsheet or database.database.

• Result-based vs. solution-based Result-based vs. solution-based evaluation.evaluation.

• Tested mid 2007 and launched as an Tested mid 2007 and launched as an Italian certification (AICA).Italian certification (AICA).

• Final goal: to export IT4PS at the Final goal: to export IT4PS at the European level through CEPIS.European level through CEPIS.


SummarySummary



The CampusOne project: ECDL in The CampusOne project: ECDL in Italian UniversitiesItalian Universities

The IT4PS project: problem oriented The IT4PS project: problem oriented usage of ICT toolsusage of ICT tools



EUCIP certificationEUCIP certification

• CEPIS EUropean Certification scheme CEPIS EUropean Certification scheme for Informatics Professionals.for Informatics Professionals.

• Two levels of certification:Two levels of certification: EUCIP EUCIP corecore (PLAN, BUILD, OPERATE) (PLAN, BUILD, OPERATE)

• basic knowledge in applied Informatics;basic knowledge in applied Informatics;• certification based on multiple choice tests.certification based on multiple choice tests.

EUCIP EUCIP electiveelective (professional profiles) (professional profiles)• specific profiles (e.g., network manager, specific profiles (e.g., network manager,

software developer);software developer);• tests based on competence portfolios.tests based on competence portfolios.

• Incorporates the IT administrator Incorporates the IT administrator certification.certification.


EUCIP schemeEUCIP scheme

PLANThe use and

management of information

systems

OPERATEOperations and

support of information systems

CORE LEVELTypically 400 hours

of study time

Compulsory for professional level

ELECTIVE MODULES

Typically 800 hoursof study time

Mix of vendor andvendor-

independentcourses and qualifications

BUILDAcquisition,

development and implementation of

information systems

VOCATIONALSTRUCTURE

Based on the needsof User industry andIT services industry

SPECIALIST LEVEL

IT Administrator Project Support Specialist

Call Centre Operator

PROFESSIONALLEVEL

ELECTIVE PROFILES IS

Man

ager

IS Q

uality

Aud

itor

Ente

rpris

e So

l.Con

s.Bu

sines

s An

alys

tLo

gist

ics &

Aut

om.C

.Sa

les

and

Appl

ic. C

.Cl

ient

Ser

vices

Mgr

IS P

roje

ct M

anag

erIT

Sys

tem

s Ar

chite

ctIS

Ana

lyst

Web

& M

ultim

edia

M.

Syst

ems

Int.&

Test

.E.

Softw

are

Deve

lope

rDa

taba

se M

anag

erX-

Syst

ems

Tech

n.TL

C En

gine

erNe

twor

k Ar

chite

ctSe

curit

y Ad

viser

Netw

ork

Man

ager

Conf

igur

atio

n M

grHe

lp D

esk

Engi

neer

IT T

rain

er

EUCIP EUCIP corecore. Needs 400 . Needs 400 study hours, typically part study hours, typically part of the curricula of computer of the curricula of computer engineers and scientists engineers and scientists during their 3-years during their 3-years University courses.University courses.

EUCIP EUCIP electiveelective. Up to June 2006:. Up to June 2006:– 22 profiles defined;22 profiles defined;– 8 profiles activated, with 8 profiles activated, with

complete specification complete specification document.document.

Competence portfolios – including Competence portfolios – including vendor-dependent certifications – vendor-dependent certifications – evaluated by a commission.evaluated by a commission.

800 study hours can be included in 800 study hours can be included in a master degree or +2 University a master degree or +2 University course.course.


The EUCIP4The EUCIP4UU project project

• Launched in 2004 by AICA, CRUI Launched in 2004 by AICA, CRUI Foundation and the Italian inter-Foundation and the Italian inter-University ICT Consortium CINI.University ICT Consortium CINI.

• Aimed at introducing EUCIP into Aimed at introducing EUCIP into Universities:Universities: starting with EUCIP starting with EUCIP corecore for computer for computer

engineers and scientists;engineers and scientists; involving in EUCIP involving in EUCIP corecore also economists also economists

and technical managers;and technical managers; evolving towards EUCIP evolving towards EUCIP electiveelective for for

computer engineers and scientists.computer engineers and scientists.


EUCIP4EUCIP4UU activities activities

• Mapping of EUCIP Mapping of EUCIP corecore syllabus into syllabus into University curricula.University curricula.

• Activation of University Competence Activation of University Competence Centers (CCUs) to deal with EUCIP Centers (CCUs) to deal with EUCIP tests.tests.

• Trials to evaluate actual coverage of Trials to evaluate actual coverage of EUCIP EUCIP corecore syllabus by students. syllabus by students.

• Production of e-learning courses for Production of e-learning courses for EUCIP EUCIP corecore..

• Real certification tests to disseminate Real certification tests to disseminate EUCIP.EUCIP.


Trials June 2004Trials June 2004

• 10 Universities, around 200 310 Universities, around 200 3rdrd-year -year students in computer engineering and students in computer engineering and sciences.sciences.

• Trials based on 45Trials based on 453 multiple-choice 3 multiple-choice questions. Success threshold 60 %.questions. Success threshold 60 %.

• Results:Results:

PLANPLAN BUILDBUILD OPERATEOPERATE

Succeeding studentsSucceeding students 35.7 %35.7 % 76.7 %76.7 % 79.5 %79.5 %

PLAN test resulted by far the PLAN test resulted by far the most difficult one:most difficult one:– business-style English business-style English

language not familiar for language not familiar for computer engineers and computer engineers and scientists;scientists;

– PLAN topics badly covered PLAN topics badly covered by University curricula.by University curricula.


Tests end 2004Tests end 2004

• Performed after specific teaching on PLAN Performed after specific teaching on PLAN topics.topics.

• Real certification tests:Real certification tests: 90 minutes for each module;90 minutes for each module; 45 multiple-choice questions for PLAN;45 multiple-choice questions for PLAN; 40 multiple-choice questions for BUILD & OPERATE;40 multiple-choice questions for BUILD & OPERATE; success threshold 60 %.success threshold 60 %.

• Results:Results: PLANPLAN BUILDBUILD OPERATEOPERATE

Examined studentsExamined students 166166 181181 179179

Succeeding studentsSucceeding students 52.4 %52.4 % 70.7 %70.7 % 65.4 %65.4 %

PLAN test still the PLAN test still the most difficult one.most difficult one.


Activities up to end 2006Activities up to end 2006

• Special offer tu students: €100 for e-learning Special offer tu students: €100 for e-learning course on PLAN and EUCIP course on PLAN and EUCIP corecore test. test.

• 7 e-learning courses on PLAN followed by 7 e-learning courses on PLAN followed by about 700 students.about 700 students.

• Results of the final tests:Results of the final tests:

PLANPLAN BUILDBUILD OPERATEOPERATE

yearyear Stud.Stud. SuccessSuccess Stud.Stud. SuccessSuccess Stud.Stud. SuccessSuccess

20042004 166166 52.4 %52.4 % 181181 70.7 %70.7 % 179179 65.4 %65.4 %

20052005 166166 57.8 %57.8 % 139139 63.3 %63.3 % 139139 61.2 %61.2 %

20062006 238238 60.9 %60.9 % 213213 68.5 %68.5 % 200200 67.0 %67.0 %

TOTALTOTAL 570570 57.5 %57.5 % 533533 67.9 %67.9 % 518518 64.9 %64.9 %

Increasing percentage Increasing percentage of students passing of students passing PLAN, but…PLAN, but…

… … still around 1/3 of still around 1/3 of computer engineering computer engineering and sciences students and sciences students not passing EUCIP tests.not passing EUCIP tests.


EUCIP4EUCIP4UU lesson lesson

• Tuning between University curricula Tuning between University curricula and EUCIP syllabus required.and EUCIP syllabus required.

• Poor knowledge of non-technical Poor knowledge of non-technical English.English.

• EUCIP EUCIP corecore cannot be the final cannot be the final certification for computer engineers certification for computer engineers and scientists: need of and scientists: need of electiveelective profiles.profiles.

• Students feedback shows the Students feedback shows the importance of recognition of EUCIP by importance of recognition of EUCIP by the job market (i.e., ICT Industries) !the job market (i.e., ICT Industries) !

ExtremeExtreme


Thanks a lot Thanks a lot for your for your

attention !!!attention !!!

Documents

Certification of ICT skills: a bridge between Universities and Industries N.Scarabottolo – AICA – Italy [email protected] UNICTRY ’07 Genzano