29
Guidelines on data reusability for eQuATIC eQuATIC Conference – 08/12/2016 Paul Leys – Ghent University

Guidelines on data reusability for eQuATIC · Higher Education Statistics Agency Hogeschool Gent Howest University College West Flanders ... Erasmus+ participant report, own student

  • Upload
    others

  • View
    2

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Guidelines on data reusability for eQuATIC · Higher Education Statistics Agency Hogeschool Gent Howest University College West Flanders ... Erasmus+ participant report, own student

Guidelines on data reusability for eQuATIC

eQuATIC Conference – 08/12/2016Paul Leys – Ghent University

Page 2: Guidelines on data reusability for eQuATIC · Higher Education Statistics Agency Hogeschool Gent Howest University College West Flanders ... Erasmus+ participant report, own student

Outline of the presentation

• Digging through the data

• Data reusability

• Data for eQuATIC

Digging through the data Data reusability Data for eQuATIC

Page 3: Guidelines on data reusability for eQuATIC · Higher Education Statistics Agency Hogeschool Gent Howest University College West Flanders ... Erasmus+ participant report, own student

Digging through the data Data reusability Data for eQuATIC

• Quantitative analysis: percentage of mobile master graduates

0 10 20 30 40 50 60 70 80 90 100

Political and Social Sciences

Pharmaceutical Sciences

Bioscience Engineering

Psychology and Educational Sciences

Veterinary Medicine

Economics and Business Administration

Engineering and Architecture

Medicine and Health Sciences

Sciences

Law

Arts and Philosophy

Ghent University

Credit mobility

Mobility joint masters

Page 4: Guidelines on data reusability for eQuATIC · Higher Education Statistics Agency Hogeschool Gent Howest University College West Flanders ... Erasmus+ participant report, own student

• Quantitative analysis: number of exchange students

0

250

500

750

1000

1250

1500

10-11 11-12 12-13 13-14 14-15 15-16

Incoming students

Outgoing students

Digging through the data Data reusability Data for eQuATIC

Page 5: Guidelines on data reusability for eQuATIC · Higher Education Statistics Agency Hogeschool Gent Howest University College West Flanders ... Erasmus+ participant report, own student

• Quantitative analysis: international students

0

20

40

60

80

100

120

140

160

180

Exchange

Degree

Phd

Digging through the data Data reusability Data for eQuATIC

Page 6: Guidelines on data reusability for eQuATIC · Higher Education Statistics Agency Hogeschool Gent Howest University College West Flanders ... Erasmus+ participant report, own student

• Participation on agreements student mobility

0

10

20

30

40

50

60

70

80

90

100

% Outgoing

% Incoming

% Total

Digging through the data Data reusability Data for eQuATIC

Page 7: Guidelines on data reusability for eQuATIC · Higher Education Statistics Agency Hogeschool Gent Howest University College West Flanders ... Erasmus+ participant report, own student

• Quantitative analysis: exchange balance

0

100

200

300

400

500

600

Outgoing students

Incoming students

Digging through the data Data reusability Data for eQuATIC

Page 8: Guidelines on data reusability for eQuATIC · Higher Education Statistics Agency Hogeschool Gent Howest University College West Flanders ... Erasmus+ participant report, own student

Country Average credits/day*Average

study success**Reference group

Denmark 0,17 94% 12

Germany 0,15 78,18% 100

Finland 0,15 70,7% 34

France 0,17 74,11% 81

Italy 0,15 58,82% 174

Lithuania 0,16 87,85% 39

Norway 0,16 73,5% 6

Austria 0,16 65,83% 11

Poland 0,16 77,45% 117

Portugal 0,18 71,14% 50

Spain 0,16 78,91% 354

*30 credits/sem =+/- 0,2 credits/day

**UGent average = 80%Exchange average = 70%

• Qualitative analysis: Study success

Digging through the data Data reusability Data for eQuATIC

Page 9: Guidelines on data reusability for eQuATIC · Higher Education Statistics Agency Hogeschool Gent Howest University College West Flanders ... Erasmus+ participant report, own student

• Qualitative analysis: Erasmus Student Survey

0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%

How satisfied are you with your Erasmus+mobility experience in general?

How satisfied were you with the support provided by your sending institution

Strongly agree Rather agree Neither disagree nor agree

Rather disagree Stronly disagree

Digging through the data Data reusability Data for eQuATIC

Page 10: Guidelines on data reusability for eQuATIC · Higher Education Statistics Agency Hogeschool Gent Howest University College West Flanders ... Erasmus+ participant report, own student

• Qualitative analysis: Internal Quality Assessment Survey

Digging through the data Data reusability Data for eQuATIC

0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%

How satisfied were you with the support provided by yoursending institution?: Support from student

initiatives/organisations

How satisfied were you with the support provided by yoursending institution?: Academic mentoring

How satisfied were you with the support provided by yoursending institution?: Administrative support arrangement

How satisfied were you with the support arrangements provided by your receiving institution

Strongly agree Rather agree Neither disagree nor agree Rather disagree Stronly disagree

Page 11: Guidelines on data reusability for eQuATIC · Higher Education Statistics Agency Hogeschool Gent Howest University College West Flanders ... Erasmus+ participant report, own student

Data reusability

• Registering doesn’t imply data is useable

Digging through the data Data reusability Data for eQuATIC

Page 12: Guidelines on data reusability for eQuATIC · Higher Education Statistics Agency Hogeschool Gent Howest University College West Flanders ... Erasmus+ participant report, own student

Digging through the data Data reusability Data for eQuATIC

Page 13: Guidelines on data reusability for eQuATIC · Higher Education Statistics Agency Hogeschool Gent Howest University College West Flanders ... Erasmus+ participant report, own student

Data reusability

• Registering doesn’t imply data is useable

• Data cleaning often required

• Need for definitions/standards

• Incentive for registration

• Structural modification in data repositories

Digging through the data Data reusability Data for eQuATIC

Page 14: Guidelines on data reusability for eQuATIC · Higher Education Statistics Agency Hogeschool Gent Howest University College West Flanders ... Erasmus+ participant report, own student

Standardisation of institutions

AHOVOSArtesis Plantijn Hogeschool AntwerpenArteveldehogeschoolDep O&VErasmus University RotterdamErasmushogeschool BrusselFlanders Knowledge AreaFreie Universität BerlinGerman Rectors' Conference (HRK)Georg-August-Universität GöttingenGhent UniversityHelsinki Metropolia University of Applied SciencesHigher Education Statistics AgencyHogeschool GentHowest University College West FlandersHowest, de hogeschool West-Vlaanderen

Karel de Grote University CollegeMetropolia University of Applied SciencesNational Research University Higher School of EconomicsNHTV Breda University of Applied SciencesOdisee vzwRadboud UniversityRotterdam University of Applied SciencesSP-aThomas MoreUC LeuvenUC Leuven Limburg vzwUC Leuven-LimburgUCLLUniversidade do MinhoUniversiteit AntwerpenUniversiteit Gent

Universiteit HasseltUniversity College (HoGent)University of Central LancashireUniversity of CyprusUniversity of GroningenUniversity of KentUniversity of LiègeUniversity of MinhoUniversity of PrimorskaUppsala UniversityVrije Universiteit BrusselWindesheim University of Applied Sciences

Digging through the data Data reusability Data for eQuATIC

Page 15: Guidelines on data reusability for eQuATIC · Higher Education Statistics Agency Hogeschool Gent Howest University College West Flanders ... Erasmus+ participant report, own student

Standardisation of institutions

• Erasmuscode: less or more stable - only Erasmus-countries high availability

• PIC: less stable than Erasmuscode – also non-Erasmus availability?

• Name instiution: not stable at all high availability

Digging through the data Data reusability Data for eQuATIC

Page 16: Guidelines on data reusability for eQuATIC · Higher Education Statistics Agency Hogeschool Gent Howest University College West Flanders ... Erasmus+ participant report, own student

eQuATIC

available comparable easy to readdata scores information

Digging through the data Data reusability Data for eQuATIC

Page 17: Guidelines on data reusability for eQuATIC · Higher Education Statistics Agency Hogeschool Gent Howest University College West Flanders ... Erasmus+ participant report, own student

Data behind indicators

• Performance of incoming/outgoing students

• Data on student mobility: institution; start & end date; ISCED

• Data on credits: #credits taken; #credits successfully completed

Sources: SIS, mobility software, other(?)

• Support and facilities

• Student satisfaction on support arrangements and facilities

Source: Erasmus+ participant report, own student survey (non-Erasmus)

Digging through the data Data reusability Data for eQuATIC

Page 18: Guidelines on data reusability for eQuATIC · Higher Education Statistics Agency Hogeschool Gent Howest University College West Flanders ... Erasmus+ participant report, own student

Data behind indicators

• Academic quality

• Student satisfaction on teaching and learning

Source: Erasmus+ participant report, own student survey (non-Erasmus)

• Rankings

• Ranking in ARWU, THE, QS

Yearly uploaded by super admin

• Course catalogue information

• Student feedback on completeness course catalogue

Source: Erasmus+ participant report, own student survey (non-Erasmus)

Digging through the data Data reusability Data for eQuATIC

Page 19: Guidelines on data reusability for eQuATIC · Higher Education Statistics Agency Hogeschool Gent Howest University College West Flanders ... Erasmus+ participant report, own student

Data behind indicators

• Exchange of mobility documents

• Student feedback on signing learning agreement and receiving transcript of records on time

• Availability of grading table in Egracons

Source: Erasmus+ participant report, own student survey (non-Erasmus)

Grading tables yearly updated by superadmin

• Mobility rate

• Data on mobility (student & staff): institution; start & end date; ISCED

Sources: SIS, mobility software, other(?)

Digging through the data Data reusability Data for eQuATIC

Page 20: Guidelines on data reusability for eQuATIC · Higher Education Statistics Agency Hogeschool Gent Howest University College West Flanders ... Erasmus+ participant report, own student

Data behind indicators

• Involvement

• Data on institutional agreements: institution, ISCED

Source: SIS, mobility software

• Mobility rate

• Data on mobility (student & staff): institution; start & end date; ISCED

Sources: SIS, mobility software, other(?)

Digging through the data Data reusability Data for eQuATIC

Page 21: Guidelines on data reusability for eQuATIC · Higher Education Statistics Agency Hogeschool Gent Howest University College West Flanders ... Erasmus+ participant report, own student

Data behind indicators

• Educational collaboration

• Data on projects funded by Educational budgets (e.g. Erasmus+)

• Data on joint programmes + graduates

Sources: SIS, mobility software, other(?)

• Research collaboration

• Data on projects funded by Research budgets (e.g. Horizon 2020)

• Data on joint-PhD’s

• Data on joint publications

Sources: SIS, mobility software, research database

Digging through the data Data reusability Data for eQuATIC

Page 22: Guidelines on data reusability for eQuATIC · Higher Education Statistics Agency Hogeschool Gent Howest University College West Flanders ... Erasmus+ participant report, own student

Data uploads

Digging through the data Data reusability Data for eQuATIC

Page 23: Guidelines on data reusability for eQuATIC · Higher Education Statistics Agency Hogeschool Gent Howest University College West Flanders ... Erasmus+ participant report, own student

Field of education

• Optional in all uploads

• Crucial for analysis at ‘faculty/department/programme level’

• ISCED2013 (data dictionary mobility tool)

Digging through the data Data reusability Data for eQuATIC

Page 24: Guidelines on data reusability for eQuATIC · Higher Education Statistics Agency Hogeschool Gent Howest University College West Flanders ... Erasmus+ participant report, own student

Data templates

• Reuse existing templates

• Participant report Erasmus+

• Reporting template Erasmus+ (+ credit information)

• Consistency in naming

• All column headers should be present

• Only relevant information

• One upload different for indicators (if all information is available)

Digging through the data Data reusability Data for eQuATIC

Page 26: Guidelines on data reusability for eQuATIC · Higher Education Statistics Agency Hogeschool Gent Howest University College West Flanders ... Erasmus+ participant report, own student

Data templates

• Field name schould exactly match

• Mandatory if * field is mandatory

• Possible value expected format (not for all columns)

• Data definition explanation

• Indicator indicators that use data upload

Digging through the data Data reusability Data for eQuATIC

Page 27: Guidelines on data reusability for eQuATIC · Higher Education Statistics Agency Hogeschool Gent Howest University College West Flanders ... Erasmus+ participant report, own student

Preparing data sets

• What if certain data is lacking?

• Data cleaning required

• Test with limited data set

Digging through the data Data reusability Data for eQuATIC

Page 28: Guidelines on data reusability for eQuATIC · Higher Education Statistics Agency Hogeschool Gent Howest University College West Flanders ... Erasmus+ participant report, own student

Standardisation of institutions

• If institution is not in eQuATIC database: “institution not found” notification

• Should be added by ‘super admin’

Data should be linked to correct institution (internal consistency)

Analysis over institutions: need to capture the right institution (externel consistency)

Some indicators based on general data upload

Digging through the data Data reusability Data for eQuATIC

Page 29: Guidelines on data reusability for eQuATIC · Higher Education Statistics Agency Hogeschool Gent Howest University College West Flanders ... Erasmus+ participant report, own student

Contact

Paul Leys

Project leader eQuATIC - [email protected]

Digging through the data Data reusability Data for eQuATIC