Upload
abner-stanley
View
213
Download
0
Tags:
Embed Size (px)
Citation preview
Digital Assessments in Flipped Classrooms Workshop
George SzantoDocent Marketing [email protected] @hippity7Fontys Toetsconferencie 2014
2Voettekst
• 14:55 – 15:05 Introduction of workshop participants
• 15:05 – 15:20 Introduction to my flipped classroom; case & dilemmas
• 15:20 – 15:30 work on dilemmas in pairs
• 15:30 – 15:50 discuss answers to dilemmas as group
• 15:50 – 16:10 Review of George’s efforts & dilemmas: quantitative & qualitative testing
• 16:10 – 16:15 Wrap-up , Q & A.
Agenda
3Voettekst
• Name• Institute or Fontys Service• Classes/Subjects that you teach• Yes/No Digital testing experience• Yes/No Flipped class teaching experience
BRIEF Participant Introductions
History of IBMS Sem. 6 eMarketing Strategy class 2011 - 2014
Classical Teaching Flipped Classroom Teaching
Fall 2011
Spring 2011
Fall 2012
Spring 2013
Fall 2013
Spring 2014
Fall 2014
Live Lectures 4 4 4 2
Recorded Lectures 6 26 26 27
Live Workshops 1 2 2 5 5 6 6
Group Presentation in Class 1
Individual Presentation in Class or Video Recording
Indiv
20%Indiv
%30% Indiv In pairs50%
In pairs60%
Extra Group Assignment (20%) 20% 20% 20% 20%
Main Group Assignment Report (80%) 80% 80%
Sit down individual final exam (50 - 80%) 60% 50% 80% 5/6 Individual Open Book/Notes In Class
Quizzes 40 % 40 %
Online discussion board / class participation 20% 10% Peer Grading
Digital On Demand SaaS Quizzes
€ 45 per year € 350 per year / 200 students / 1 Lecturer
~ € 2000 per year
14
10 – 14 Minute Executive Level Emarketing Stratety Pitch
15
Introducing the digital testing dilemmas for this workshop
1. BYOD or Fontys Computers?
2. Wifi/Computer Network down – now what?
3. Asynchronous testing & cheating
4. Participation in formative quizzes < 20%
5. Archiving test results for accreditation
6. Technical issues for a few students/quiz
7. Online quizzes – full use of Internet/open resources or not?
8. How to handle students with learning disabilities ?
9. Summative quizzes do not help raise final score of project – now what?
10. Can student take summative quiz outside of workshop?
16
Digital Testing Dilemmas
• For the next 5 minutes, please work in pairs discussing solution(s) to your assigned dilemma
19Voettekst
• Do digital quizzes improve the performance and quality of the final eMarketing Strategy Plan submitted by students in a flipped classroom?
• What kind of positive and negative feedback is given about the digital quizzes by students who have taken the class?
Key Questions of my Research
Voettekst 20
Dependent & Independent Variables
Final Projec
t Grade
Quiz Scores
Quantity Quality Videos
In-class participatio
n
Student Motivation
Past student
knowledge
# of hrs. studied outside class
Assigned Case
Results Final Exam Spring 2013 (no formative quizzes) N=48
1 1.5 2 2.5 3 3.5 4 4.5 5 5.5 6 6.5 7 7.5 8 8.5 9 9.5 100
2
4
6
8
10
12
Histogram of Grades Using 2 Grading Methods Spring 2013
5.5 Linear Cutoff
Average Grading (Ave - 3/4 One Std. Dev.)
GRADE (Average Grade = 46; Std = 12 )
Num
ber o
f Stu
dent
s
Spring 2013Linear = 23 failures
Average = 11 Failures
22
Results Fall 2013 (where 70% of final grade is from the exam; +formative quizzes)
0 5 10 15 20 25 30 35 40 45 50 55 60 65 70 75 80 85 90 95 100 105 1100
1
2
3
4
5
6
7
Final Exam Scores - Fall 2013 (N=30)
partial creditNo partial credit
Exam Score in Points
Num
ber
of
Stu
dents
No partial credit 24 fail
With partial credit 4 fail
Spring & Fall 2014 Summative Quizzes
40.00 50.00 60.00 70.00 80.00 90.00 100.000
2
4
6
8
10
12
f(x) = NaN x + NaNR² = 0 Video Pitch Final Grade vs Quiz Grades (N=67)
Total Quiz Grades (5 or 6 quizzes; maximum total score 100 pts)
Fina
l Vid
eo P
itch
Gra
de
30Voettekst
• Digital summative quizzes don’t seem to help produce quality video pitches
• Student feedback:– Positive, force students to keep up in class– Test deeper understanding of theoretical
concepts• Considering reducing time limits; and
introducing harder questions.
Conclusions
31Voettekst
• SURF website – see:• https://
www.surf.nl/kennis-en-innovatie/kennisbank/onderwerp/leren-en-toetsen/onderwerp/digitaal-toetsen
Additional Resources