Cognitive Stuffing Quiz
Acknowledgement
Marcel D’Eon, BSc (Hons), MEd, PhDUniversity of Saskatchewan
Some studies of medical students’ long-term recall of simple knowledge in the basic sciences have shown that they retain about __% by the end of school, forgetting ___% within 2 weeks. Retain: a. 20% b. 30% c. 40% d. 50% e. 60% Forget a. 5% b. 15% c. 25% d. 35% e. 45%
• Basic science, medical school• Custers EJFM, ten Cate OTJ. Very long-term retention of basic science
knowledge in doctors after graduation. Med Educ 2011. 45:422-430.
– Lost 25% within 2 weeks (down to 75%)– Retain 40% at end of school
– Retain 25-30% until ~25 years
A study at the UMN CVM gave students the same exam 15 months after taking the urinary systems exam. The mean knowledge loss on those questions wasA. 5%B. 10%C. 20%D. 30%E. 35%
• 30% loss for routine lectures• 18% loss for team-based learning class
– Malone E, Speith A. Team-based learning in a subsection of a veterinary course as compared to standard lectures. J SoTL 2012. 12(3):88-107
A study evaluating methods of teaching veterinary dermatology at Oregon State. Initial test scores (immediately after lecture) were ~80%. After 1-2 months, student scores wereA. 45% B. 55%C. 65%D. 75%E. NSD
• 54-55%– No difference with or without clickers– Students more focused on the test right after class
vs the use of clickers– Plant JD. Incorporating an audience response system into veterinary
dermatology lectures: Effect on student knowledge retention and satisfaction. JVME 2007. 34(5):674-677.
What we put in doesn’t stay
teach immediate 2 weeks 1 year 4 years post grad later0
10
20
30
40
50
60
70
80
90
100
knowledge
Amou
nt o
f mat
eria
l
Do they remember the important stuff?
Which subject usually suffers the most knowledge loss in medical students?A. ImmunologyB. NeuroanatomyC. Physiology
Knowledge loss after 1 yearImmunology – 17.6% Neuroanatomy – 52%Physiology- 19.4%Overall -25%
Not related to performance on first examLimited review and spaced practice?
One study evaluated graduating medical students knowledge of neuroanatomy. They took the same test as they did first year. As first years, the average score was 82%. What was it in their final year?A. 33%B. 46%C. 58%D. 70%
• 33%• Only 2 students would have passed the test• No correlation between course satisfaction
and retention• Mateen FJ, D’Eon MF. Neuroanatomy: a single institution study of
knowledge loss. Med Teach 2008. 30:537-539.
A study of anatomical knowledge 21 months later :Unreinforced information questions changed from 69% accuracy to ___ accuracy? A. 39% B. 49% C. 59 %D. 79%
A study of anatomical knowledge 21 months later :Reinforced clinical questions changed from 50% accuracy to ___ % accuracy?A. 46% B. 56% C. 66%D. 76%
• 12 mo -> 21 mo• Unreinforced information– 69% -> 59%
• Reinforced (clinical) information– 50% -> 56%– Blunt MJ, Blizard PJ. Recall and retrieval of anatomical knowledge. Br J
Med Educ 1975 9:255-263.
1. Knowledge doesn’t stick without repetition
Based upon a classic study, assimilation of lecture information by students begins to diminish after how many minutes? A. 10 B. 15C. 20D. 25E. 30
Stuart J, Rutherford RJDMedical student concentration during lecturesThe Lancet, 1978
While teachers are lecturing, students are paying attention what percentage of the time?A. 30B. 40C. 50D. 60E. >75
50%
(1984 study) Students recorded items in their notes concerning ___% of material given in a 15-minute lecture, a 30-minute lecture, and in a 45-minute lecture. A. 41, 25, 20B. 50, 39, 31 C. 75, 52, 40 D. 82, 60, 50 E. 89, 74, 60
• J McLeish, 1960’s study• Reported in Penner, 1984. Why Many
College Teachers Cannot Lecture
Wrote notes on 41% of material if first 15 min25% of material in a 30 min set20% of material in a 45 min set
In today’s social media environment, the assimilation curve is shifted: A. to the left (assimilation diminishes earlier) B. minimally C. to the right (assimilation diminishes later)
5 10 15 20 25 30 35 40 45 50 550
0.1
0.2
0.3
0.4
0.5
0.6
Use of Technological Distractions During an Average Lecture
Time Point (minutes)
% o
f Qua
dran
ts
5 10 15 20 25 30 35 40 45 50 550
0.1
0.2
0.3
0.4
0.5
0.6
0.7
0.8
0.9
% o
f qua
dran
ts
Not distracted by technology
2. Attention spans are limited
Need to get their attention
Repeat the important stuff
To learn all the terms and relationships expected of medical students in a 1st year physiology course in 2000, how many had to be learned per hour of contact time?A. 3B. 6C. 9 D. 12 E. 15
To learn all the terms and concepts expected of medical students in a cardiovascular systems course in 2000, how many needed to be learned per hour of contact time?A. 3B. 6C. 9D. 12E. 15
• D’Eon – test data, averaged over 3 years– 15 topics/basic sci on test– 12 topics/clinical on test
• Lectures – Estimated 24 concepts/hour preclinical courses– Estimated 13 concepts/hour clinical courses– 1984
• Russell IJ, Hendricson WD, Herbert RJ. Effects of lecture information density on medical student achievement. J Med Educ 1984. 59: 881-889.
A recommended rate of learning of new facts or concepts per hour at university level is: A. 3B. 6C. 9D. 12E. 15
• 4 items +/- 1– Cowan N. The magical number 4 in short –term memory: a
reconsideration of mental storage capacity. Behav Brain Sci 2000. 24:87-185.
• 2 seconds of verbal information• Can focus on 1 item at a time
A medical school study looked at material from different time points in the class to determine what type of learning inhibition was likely present. They found that students did best on the material from which part of class?A. First 15 minB. Second 15 minC. Third 15 minD. Final 15 min
• Final 15 min– “retroactive inhibition”– Later material displaced earlier material– Russell IJ, Hendricson, WD, Herbert RJ. Effects of lecture information
density on medical student achievement. J Med Educ 1984. 59: 881-889.
We have to let go of some stuff!
3. Presentation order and summaries are important
One study of knowledge growth in medical students found that pretest items marked “Don’t Know” were correctly answered 65% of the time on the posttest. What percent of pretest items marked incorrectly were answered correctly on the posttest? A. 10%B. 20%C. 35%D. 50%E. 70%
• “Don’t know”– Incorrect pretest -> 65% correct posttest
• “I think I know”– Incorrect pretest -> 35% correct posttest
4. Previous knowledge gets in the way
Summary
1. Repetition is necessary
Summary
2. Plan on a limited attention span
Summary
3. 3-5 main points– Important stuff at the end!
Summary
• 4. Uncover misconceptions