Embed Size (px)
Citation preview
IT-solutions for education in Estonia
Anastassia VoroninaFoundation Innove Examination [email protected]
1,3 mln people ca 70% Estonians ca 25% Russians ca 5% other45,2 k km2
Background
• Estonia is an e-country:• e-banking, e-parking, e-voting, e-taxes, ID-cards, ID-
tickets, digi-signature
• Free Wifi:• parks, squares, pubs, cafés, airports,
bus stations, busses, trains, beach, forest
• Skype was invented in Estonia
IT-solutions for education…
• foster communication between interest groups• provide fast control and access to information
about student performance• expand learning opportunities• facilitate data processing
Most significant solutions for education in Estonia
• Variety of eSchool systems (schools can choose between different providers)
• Estonian Education Information System (EHIS)• Electronic assessment bank (EIS)
eSchool (eKool)
Electronic grade book service with • communication tools allowing to plan lessons
and curricula;• sharing and distribution of learning
information between user groups in school environment;
• statistical reports for authorized individuals or organizations;
• web-based student learning information system;• event promotion, registration tools, client support.
Estonian Education Information System (EHIS)
Curriculum dataSchool dataTeacher dataStudent data
School
Estonian Education
Information System
Social benefit systemMinistry of Education and
ResearchCommercial banks
PoliceStatistics Estonia
Qualification system
Functionality
Pupils/students• National examination results, institutions contacts
and related data, curriculum (description, duration, accreditation information and the expiration dates), social insurance – student social payments, health insurance and student loan.
School leaders• Education license of institution, curriculum;
statistics about teachers, students and pupils, data input, capture and systematization; student data, information about teachers and vacancies.
Functionality
Teachers:• Vacancies, related data, general education school
indicators, student certificates and mark sheets – input and print.
Local authorities:• General education school indicators, statistics
about teachers, students and schoolars, student data of the related institutions , information about teachers and vacancies.
Businesses:• Expiration dates of certificates – possibility to
control employee’s qualification, curriculum review – information for trainers.
Electronic assessment bank (EIS)
What is EIS?
• EIS is an electronic system which provides an opportunity to authorise e-items and perform e-tests.
• EIS is financed by ESF and ÕKVA 23.09.2008- 31.12.2012
Main goals of EIS
• to supply high-quality items and tests in all subjects and provide wider access for usage;
• to encourage usage of e-tools in the learning process;
• to modernise and update existing testing tools;
• to raise the interest to different forms of assessment.
EIS system possibilities
• 22+ item types• Description of item parameters• Flexible item layout
– Instruments for translation and edition – HTML, JavaScript
• Different levels of security• High-quality media• Different tools (calculator,
Periodic table etc.)
EIS system possibilities
• E-test consists of items from Electronic Item Bank• Reporting system and statistics • Linked to Estonian Central Education Info system (EHIS)
and national digital infrastructure• Secure login (password, ID-card)• Different roles (teacher, students, parents, experts etc.)• Responses can be linked (student is not punished for
repeated mistakes)• Responses are saved on the server therefore technical
problems do not affect test results
System delivery
• Students can use their own computer (for unsecure delivery) or school computer (for secure delivery)
• unsecure delivery via browsers using ID-card or password
• secure delivery via USB– Using central server (good internet connection)– Using local server (no internet or poor internet connection)
• Schools reboot computers using USB with modified Mozilla FireFox version (based on Linux)– „internet allowed“ and „internet not allowed“ mode
• Computer registration (to provide extra security)• Both cable and wireless connections are OK for
unsecure delivery, cable only for secure delivery
Requirements for schools to use EIS
• Computer (or students can bring their own device)– Tablets are not fully compatible to EIS, but we work on it
• Latest browser version (we prefer FF)• Headphones to play audio and video files• Paper (just in case student wants to take notes)
Problems
• Possible connectivity issues• Possible technical problems• Creation of items is quite complicated due to large
amount of parameters in matrixies• Not compatible to tablets yet• Possible system capacity problems
Advantages
• No careless mistakes• No illegible handwriting• No distracting activities• No human-factor in assessment• Fast feedback • Less time needed to make an exam• Reduced costs in exam administration• Environment friendly• Possibility to monitor how students take the test• Hints of possible cheating
How do we use EIS?
2011 - …
• E-items and e-tests– in all subjects – different levels– different purposes
E-tests 2012-2013
• Pilot exam in Chemistry for 9th grade – Sample: 400 students in e-test and 450 in p-test– Aim: to compare student performance on paper and
on computer
Some conclusions
• Students answer to MC questions much more willingly than to open-ended questions. – There are ca 10 times less not responded MC questions than
not responded open-ended questions. – Using MC questions it should be considered that student can
get positive score occasionally. In the same time it is very possible near PPT as well.
• Students answer to MC questions in CBT much more willingly than to MC questions in PPT.– There are ca 5 times less not responded MC questions in CBT
than THE SAME not responded questions in PPT.
• p-item subquestion
• e-item subquestion
correct wrong missed
E-test e p e p e p P-test
MCQ 47.4 37.5 49.1 43.0 3.4 19.5 OE MCQ
MCQ 53.3 39.0 42.5 39.9 4.2 21.1 OE MCQ
MCQ 58.2 46.8 38.6 33.3 3.2 20.0 OE MCQ
MCQ 46.2 43.5 50.9 37.7 2.9 18.8 OE MCQ
MCQ 37.9 31.3 59.7 51.7 2.4 17.1 OE MCQ
MCQ 29.1 24.6 68.7 56.8 2.2 18.6 OE MCQ
MCQ 38.9 28.2 58.4 50.8 2.7 21.1 OE MCQ
MCQ 59.2 48.1 37.7 32.6 3.2 19.3 OE MCQ
E-tests 2014
• Standardized tests for 6th grade (not compulsory)– Estonian (for native speakers, sample 651)– Maths (Russian and Estonian version, sample 1035) – Russian (for native speakers, sample 221)
• Final tests for 9th grade– Chemistry and Biology (same level as classical final
examinations for 9th grade, Estonian and Russian versions)
– History and Social Studies tests (very similar to final test for 9th grade, Estonian version only)
• Institute of Political Science and Governance (Tallinn University) admission exams
Plans for the future
• National summative assessments – 3rd and 6th grade compulsory standardised tests– 9th grade final exams – 12th grade national exams
• University and upper-secondary school admission exams
Video
• Summative Chemistry test 2014 (9th grade)
• p-item subquestion• e-item subquestion
correct wrong missed E-test e p e p e p P-testMCQ 28.4 28.2 69.4 62.5 2.2 9.3 MCQMCQ 25.2 13.5 73.4 65.0 1.5 21.5 MCQOEQ 60.6 68.1 29.3 16.0 10.0 16.0 OEQOEQ 49.4 46.3 29.8 26.8 20.8 26.8 OEQ
MCQ 18.3 14.4 80.4 76.1 1.2 9.5 MCQ
MCQ 25.4 22.0 71.4 59.4 3.2 18.6 MCQOEQ 14.2 15.1 39.1 30.8 46.7 54.1 OEQ
E-item writing in EIS
vv
• vv
Functionality
