Embed Size (px)
Citation preview
Self-assessment in mathematicsUse of online quizzes in an entry-level mathematics module
Dr Tim LoweDept of Mathematics and Statistics,The Open University
MU123:Discovering Mathematics
• 30 credit introductory module (0.25 year)I Introduces algebra
• Launched February 2010• Two presentations a year• ∼2000 students per presentation
MU123: Module DesignBlended open learning
• Print based, guided by VLE (Moodle) calendar• Supported by a tutor
I online activities (Graphplotter, animations, screencasts)I forums & Elluminate roomsI quizzes (iCMAs: interactive Computer Marked Assignments)
MU123: Module DesignBlended open learning
• Print based, guided by VLE (Moodle) calendar• Supported by a tutor
I online activities (Graphplotter, animations, screencasts)
I forums & Elluminate roomsI quizzes (iCMAs: interactive Computer Marked Assignments)
MU123: Module DesignBlended open learning
• Print based, guided by VLE (Moodle) calendar• Supported by a tutor
I online activities (Graphplotter, animations, screencasts)
I forums & Elluminate roomsI quizzes (iCMAs: interactive Computer Marked Assignments)
MU123: Module DesignBlended open learning
• Print based, guided by VLE (Moodle) calendar• Supported by a tutor
I online activities (Graphplotter, animations, screencasts)I forums & Elluminate rooms
I quizzes (iCMAs: interactive Computer Marked Assignments)
MU123: Module DesignBlended open learning
• Print based, guided by VLE (Moodle) calendar• Supported by a tutor
I online activities (Graphplotter, animations, screencasts)I forums & Elluminate roomsI quizzes (iCMAs: interactive Computer Marked Assignments)
Quizzes• Practice Quizzes (PQ)
I FormativeI Immediate feedbackI Three tries per questionI Worked solutionsI Can repeat: question variantsI ≈ 12 questions per unit
• iCMAsI SummativeI Delayed feedbackI Single attemptI 6 questions per unitI At least 5 question variantsI 12% of module grade
Unit 1 PQ 1 iCMA 41Unit 2 PQ 2Unit 3 PQ 3 iCMA 42Unit 4 PQ 4Unit 5 PQ 5Unit 6 PQ 6 iCMA 43Unit 7 PQ 7Unit 8 PQ 8Unit 9 PQ 9 iCMA 44Unit 10 PQ 10Unit 11 PQ 11Unit 12 PQ 12 iCMA 45Unit 13 PQ 13Unit 14 PQ 14Are you ready for MST121?
(Also 5 Tutor MarkedAssignments.)
Questions• All questions randomised
I Generated offline, uploaded as Moodle XMLI Moodle selects random question from “bucket”I At least 5 versions of iCMA questionsI Typically 10 versions of PQ questionsI Approx 2400 question-variants
• Question types:I NumericalI Multiple choice (single correct option)I OU Multiple response (several correct options)I Matching (choose from drop-down menu)I Drag and dropI OpenMark
Question:• Are the online activities worthwhile?
I Do the students use them?I Do the students learn from them?I How do the students engage with them?
MU123: The first presentation• February 2010 – October 2010• 1561 students
• Retention: 78%I Corresponding predecessor module: 66%
• Z-score: 9.84I 9.84 standard deviations more students passing the module
than expected
• 92.2% students asked agreed “The computer-basedactivities supported my learning.”
Student Quotes• The practice quizzes are a great way to build up knowledge.
• It’s a great way to consolidate.
• I already submitted my iCMA 41,I found that the practice quizhelped a lot.
• I like the practice quizzes, you can do lots of them until (hopefully)the lights come on.
• When I’ve finished a Unit I do the Practice Quiz over and overagain until I get a really high score.
Student Quotes• The practise quizzes are great - just wish I could do them when
I’m sat under a tree in the forest waiting for my little girl to finishschool.
• I don’t enjoy the icma’s at all and always do much better on thetma’s. . . . I just think that they account for such a small percentageof your final mark that they really aren’t worth worrying about
Tutor
• I think the feedback they are getting from the practice quizzes,etc. is proving to be very useful and appreciated by the students.I’m certainly finding a generally higher level of enthusiasm for thismodule than for MU120.
Quiz usage
iCMAs and TMAs
Grades
PQ usage relative to study unit
Summary• Students seemed to like the quizzes
• iCMAs correlate well to TMA scores
• PQ scores generally improve with attemptsI but not all questions answered in later attempts
• Were quizzes used only by those needing them?I ..the extra who passed the module?
