Upload
others
View
4
Download
0
Embed Size (px)
Citation preview
3/05/2016
1
The Research behind
Cogmed
2
Working memory:
The ability to simultaneously hold and manipulate information in the mind
Cogmed Coach Conference 05/09/14 Dr Izabela Walters
58724
3
Short term memory & working memory
Short term memory – the ability to hold information over a period of secondse.g.: repeat a sequence of digits or blocks
Working memory – the ability to hold and manipulate information
Short term memory capacity limits working memory performance: you need to be able to hold information before you can manipulate it
Cogmed Coach Conference 05/09/14 4
Executive function and working memory
Executive functionThe ability to:• start and stop behaviour
• Inhibit inappropriate behaviour• Change behaviour
• Plan and organise behaviour• Adjust behaviour in response to the environment
• Use feedback• Control attention (direct, ignore, shift)• Behave in a socially appropriate manner
Working memory is needed for some executive functions, e.g. planning, controlling attention
Cogmed Coach Conference 05/09/14
3/05/2016
2
5
Impulsivity and working memory
ImpulsivityReacting to stimuli without forethought.
Can be the result of executive dysfunction (inability to control attention), and be present without working memory dysfunction
Can co-exist with working memory impairment• controlled/top-down attention and working memory areas
overlap in the brain• Impulsive behaviour can result from the
inability/unwillingness to exert cognitive effort (working memory tasks are effortful)
Cogmed Coach Conference 05/09/14
Fluid intelligence and working memory
Fluid intelligence:Capacity to reason and solve problems in novel situations
Intelligence:• ‘What the intelligence tests measure’• it is correlated with academic capacity and the ability to solve
problems.
Consists of fluid intelligence, crystallised intelligence (fund of acquired knowledge), working memory, and speed of information processing.
• Working memory is related to intelligence – it is a part of it• Working memory can help with fluid intelligence tasks (bigger
space for reasoning), but it is not the same thing
6
7
What it is not:
”..working memory capacity is the same as central executivecapability, controlled attentionand general fluid intelligence”
(Engle, Kane, Tuholski, 1999)
If you define working memory as all of the above, you lose the ability to clearly describe it, to assess it and to selectively treat it. Working memory is related to all these functions, but it is NOT these functions.
Cogmed Coach Conference 05/09/14 Dr Izabela Walters
Newer Views of WM• Modality specific views of WM are beginning to change - There may
not be different WM functions for visual or verbal stimuli
• Capacity size and time dependent views of WM are changing…It is not about “size of WM space”, nor “decay of memory traces”
• Cognitive control mechanisms are the new keys to WM – ability to overcome interference from distracting stimuli and successfully complete the steps of the reasoning process, monitor their own performance, backtrack from wrong paths, etc. • This suggests that individuals with low WM may be able to
compensate through sustained effort • Must refresh and retrace their steps in the reasoning process
more frequently)• Requires “drive to task mastery”, and persistence or “grit”.
8
3/05/2016
3
Working memory is limited
Working memory can be improved with focused, specific and intensive training
9
Not all computerised wmtraining programs are the sameMany programsCogmed (Klingberg et al 2005)Jungle Memory (Alloway 2012)CogniFit (2008)N‐back training (Jaeggi et al 2008)Complex span training (Chein & Morrison 2010)
12 September 2014
Not all computerised wmtraining programs are the same
Many reviews:
A working memory training program can improve performance on non‐trained working memory tasksSystematic reviews: Chacko et al 2013, Melby‐Lervåg & Hulme 2013Narrative reviews: Morrison & Chein 2011, von Bastian & Oberauer 2013Meta‐analysis on Cogmed and inattention, Spencer‐Smith et al 2015Review in Science Diamond & Lee 2011, Interventions shown to aid executive function development in children 4 to 12
Understanding the ResearchCogmed (vs. everything else)
What sets Cogmed apart?• Solely simple and complex WM span tasks
o vs. mixed bag, unfocused training• Defined, sustained, and intense training protocol
o vs. train as you like• Coach driven methodology/professional support
o vs. poor or undocumented compliance and motivation
Melby-Lervåg & Hulme (2012) conducted a meta-analysis about WM training –just 8 out of 30 group comparisons were from Cogmed studies.
Measure Effect Size (d)
Mean VS WM 0.52
Cogmed VS WM 0.86
Mean Verbal WM 0.79
Cogmed Verbal WM 1.18
3/05/2016
4
13
Bacon Causes Cancer? Sort of. Not Really. Ish.
http://www.wired.com/author/sarahzhang/
Key questions1. What does it mean to be “evidence-based”?
2. Does training improve working memory?
3. Does the training generalise beyond trained tasks to non-trained tasks?
4. Are the gains sustained?
5. Can working memory training improve literacy and numeracy outcomes?
• Based on a scientific discovery
• Validated by independent researchers
• Data presented worldwide at conferences
• Studies published in peer-reviewed journals
• Validated by use in clinical (real world) setting
Embracing the term: What do we mean by evidence-based cognitive training?
Cogmed and the world of academic research: An important relationship
Original idea, prototype and funding from Karolinska Institute• Company founded by research team: Klingberg, Westerberg and developers
Company was funded by Karolinska Development AB (2001- 6/28/2010)• A fund investing only in products stemming from academic research
Klingberg independent of Pearson• Professor of Cognitive Neuroscience at Karolinska
The research published to date generates much interest• Cogmed gets research proposals from around the world
Research collaborations are a key part of strategy• Simple relationship: no payments from Cogmed, publishing freely
3/05/2016
5
How Cogmed is different to other “brain training” programs that claim to be evidence-based
• Cogmed is very careful about aligning claims with evidence
• The cognitive effects associated with Cogmed training have been demonstrated in 80+ peer reviewed published studies by many independent research groups from around the world
• Those studies all involve testing the efficacy of Cogmed – the same program used by clinicians and schools
• NOT: quote from a single scientist, “developed by neuroscientists”, based in findings from a single study, based on proprietary in-house studies
17
General quality of research
For a study to be considered to be of sufficient quality to contribute to a claim, the criteria listed below must be met
• Reliable and valid outcome measures• Design that supports the hypothesis• Statistical methods that support the question being investigated• Study on recommended population according to Cogmed training
manual - exclusions• Implementation with high fidelity to Cogmed recommendations
regarding coaching method, study population, and high quality of training
What does Cogmed Claim?1) CWMT leads to sustained improvements in working memory, from childhood to
adulthood
2) CWMT leads to sustained improvements in attention seen in both subjective and
objective measures of attention
3) Improvements in working memory following CWMT are associated with changes in
functional brain activity related to working memory and functional connectivity at rest
4) Learning outcomes in reading and math improves for many students following CWMT
5) In clinical trials, CWMT has been shown to improve attentional problems in many with
ADHD
6) Research studies of CWMT report improved cognitive functioning in daily life 7) Adults
with acquired brain injury report reductions of symptoms after CWMT in clinical trials
8) Improvements on measures of cognitive control have been demonstrated in studies
after CWMT
How do you measure the efficacy of an evidence-based program?
Performance on the training tasks
Performance on tasks similar to the training tasks
Performance on tasks that rely on skills trained
Performance in daily life
3/05/2016
6
Key questions1. What does it mean to be “evidence-based”?
2. Does training improve working memory?
3. Does the training generalise beyond trained tasks to non-trained tasks?
4. Are the gains sustained?
5. Can working memory training improve literacy and numeracy outcomes?
Research discovers working memory can be improved
Led by neuroscientist T.Klingberg, MD, PhD
The findings challenged for the first time the long-held assumption that working memory is a fixed characteristic, unable to be changed.
ReplicationKlingberg replicates first study in placebo controlled,
multicenter trial - drawing attention to WM training(Klingberg et al., 2005)
3/05/2016
7
Population: N = 53 children with ADHD (combined & inattentive), ages 7 -12 years,
no stimulant medication
n = 24 in adaptive Cogmed training group n = 26 in non-adaptive (placebo) Cogmed training groupn = 3 withdrew
Design: Multi-site, randomized, placebo controlled, double-blinded, test-retest
T1= Baseline, T2 = Post-test, T3 = 3 month follow up
Results:
Treatment group improved significantly over active control on outcomes measures:1) Non practiced visuo-spatial WM task (Span Board; WAIS-RNI)2) Non practiced verbal WM task (Digit Span; WISC-III)
Computerized training of working memory in children with ADHD: a randomized, controlled trial
Klingberg et al., 2005
Computerized training of working memory in children with ADHD: a randomized, controlled trial
Klingberg et al., 2005
“…This study shows that WM can be improved by training. In addition, we saw effects on reasoning, response inhibition, and a
decrease in parent-rated symptoms of ADHD.…”
1. Expands on Klingberg et al.,2002 – replication
2. Placebo condition (low dose training)
3. Multi-site, Randomized, Double -blinded, Placebo controlled
4. Published in leading peer-reviewed journal (JAACAP)
5. Shows results remain after 3 months
6. Shows effects on parent ratings (blinded)
7. Shows effects on neuropsychological tests (attention and impulse control)
8. Shows improvement on complex problem solving
9. Does not show significant effects on teacher ratings or head movement
SummaryKlingberg et al., 2005
Other Studies showing generalised effects of CWMT
3/05/2016
8
Does training improve working memory?
• ’’ . . . results of individual studies encourage optimism regarding the value of WM training as a tool for general cognitive enhancement’’ (Morrison & Chein, 2011, p. 46).
• Diamond and Lee (2011) specifically described Cogmed as both the most researched approach of computerized training and ‘‘one repeatedly found to be successful’’ and concluded that Cogmed improves WM and executive functions.
• ‘‘WM training programs produced reliable short-term improvements in both verbal and visuospatial WM skills’’ (Melby-Lervag & Hulme, 2013, p. 270).
Key questions1. What does it mean to be “evidence-based”?
2. Does training improve working memory?
3. Does the training generalise beyond trained tasks to non-trained tasks?
4. Are the gains sustained?
5. Can working memory training improve literacy and numeracy outcomes?
How do we monitor progress? Questionnaire
Sources:- 4-17yo: DSM-IV ADHD (attention) scale- Intrinsic Motivation Inventory (IMI)
Pre: Prior to Day 1 CPI and Training, during Start-Up Session with CoachPost: Available to complete after 80% of training has been completed
Captures users perspective of their Attention in everyday life
Expectations for CWMT, Areas they would like to improve
Training Details
3/05/2016
9
Cogmed Progress Indicator (CPI)
• Protocol– Math, Working memory, Instructions tasks– Embedded in program, PRIOR to training– Math challenge (auto/manual removal)– CPI has cognitive load– Best performance out of Days 1 and 2 used as
Baseline Measure – Occurs on 6 sessions (occurrence depends on
training protocol selected)
• Purpose– Provides quantitative measure of training effect– Assess with non-trained working memory tasks– Track cognitive change as it occurs
Day 1 & 2 10 15 2520
Children improve math, attention and instruction-following up to six months after Cogmed
Holmes et al., 2009
Forty-two children screened for working memory deficits were randomly assigned to high or low intensity training conditions.
Holmes, J., Gathercole, S.E., & Dunning, D.L. (2009). Adaptive training leads to sustained enhancement of poor working memory inchildren. Developmental Science, 12(4), F9 -F15. doi: 10.1111/j.1467-7687.2009.00848x
• 42 children, aged 8-11 years, with low working memory – Identified via routine screening of 345 children on two verbal wm tasks (Listening
Recall and Backward Digit Recall) as per Gathercole et al., 2006– Scores <86 on both tasks (bottom 15th centile)
• Controlled– Adaptive, standard version of training program
• training at maximum span level– Non-adaptive, control condition
• training at fixed span level of two
• Assessments: Pre- and post-training– Working Memory (AWMA; Alloway, 2007), – IQ (WASI; Wechsler, 1999), – basic reading ( WORD; Wechsler, 1993), – mathematical reasoning (WOND; Wechsler, 1996), – following instructions task (Gathercole et al., in press)
Adaptive training leads to sustained enhancement of poor WM in childrenHolmes et al., 2009
Enhancing poor WM in children with low WM Developmental Science Holmes et al., 2009
Instruction task (Gathercole et al.): practical, real world assessment of WM capacity in classroom setting
Child placed in front of an array of props (rulers, pencils, etc.) in a range of colors and asked to follow set of instructions
Instructions designed to mimic span method with increasing number of instructions until child cannot perform task accurately.
Take home: Cogmed improves WM capacity, attention, instruction following and math ability in school children with low WM.
3/05/2016
10
Restricted Academic Situations Task (RAST)
• 5 categories of behavior associated with ADHD scored at 30 sec intervals
• Given toys to play with for 5 minutes; examiner puts toys to the side , participants asked to complete easy math packet for 15 minutes while videotaped
• Good indicator of behavioral responses to ADHD stimulant medication
• Consistent with externalizing teacher ratings and actometer measures of ADHD
• Objective measure and sensitive to moment-to-moment changes in “off-task” behavior
Will working memory training generalize to improve off-task behavior in children with Attention-Deficit/
Hyperactivity Disorder?Green et al. 2012
Green et al 2012Publication: Neurotherapeutics Institution: University of California, Davis Investigator(s): Chloe T. Green, Debra L. Long, David Green, Ana-Maria Iosif, J. Faye Dixon, Meghan R. Miller, Catherine Fassbender, Julie B. Schweitzer
• Randomized, placebo controlled, double-blinded study of 26 children with ADHD first known research to demonstrate the impact of WM training on an ecologically valid measure of observable ADHD-associated behaviours - RAST
• Children who trained with the standard Cogmed program (adaptive WM training) improved significantly over children in the placebo group (non-adaptive WM training) on non-trained, widely used, standardized measures of WM (Digit Span and Letter-Number Sequencing; WISC) and on measures of the Restricted Academic Setting Task (RAST) that related to attention.
Reciprocal Relationship between WM, Anxiety and Learning
• 5% of children and young people experience clinical levels of anxiety
• Negative emotional states are associated with lowered performance
• Strong association between anxiety and executive functions (i.e. inhibition, set-shifting and updating information in working memory)
• Negative affect and academic performance in school is mediated or moderated by WM functioning or attentionalprocessing
>> Increasing academic performance via improvements in WM may reduce feelings of negative affect
The impact of working memory training in young people with social, emotional and behavioural difficulties L. Roughan, J.A. Hadwin / Learning and Individual Differences 21 (2011)
This study examined the impact of working memory training in 65 typically developing 4-5 year-old children.
3/05/2016
11
Training and transfer effects of executive functions in preschool children Thorell et al., 2009
Population: N =65 typical children, ages 4-5 years
n = 16 children in Cogmed training group(Cogmed JM – visuo-spatial only)
n = 17 children in inhibition training group
n = 13 children in active control group(commercial video game)
n = 16 children in passive control group
* 3 children excluded
Design: Random assignment by school, active controlled, double-blinded, test-retest
Compare training methods (all 5 days/week, 15 min/day, 5 weeks)
T1 = baseline, T2 = post-test
Go/No-Go:
Inhibition of a prepotent motor
responseStop-Signal:
Stopping of an ongoing response
Flanker: Interference control
Training and transfer effects of executive functions
in preschool children (II)
Thorell et al., 2009
Cogmed training group improved significantly over the control groups on:
1) Trained and non-trained visuo-spatial WM tasks (Span Board (ES = .89) ; WAIS-R-NI )
2) Trained and non-trained verbal WM task (Word Span (ES = 1.15))
3) Attention (Go/No Go – omission (ES = .74) & Auditory CPT – omission (ES = .52))
No significant difference between Cogmed and control groups on problem solving, inhibition or response speed
Training and transfer effects of executive functions in preschool children (III)
Thorell et al., 2009
3/05/2016
12
12 September 2014
A systematic review and meta-analysis of the benefits of Cogmed for inattention in daily life
Megan Spencer-Smith & Torkel Klingberg
Identified studies
12 September 2014
Study Participants Risk of bias Control group
Training site
Time of testing post‐training
Outcome measures
Age in years
Status Recruitment source Design Blindinga) Rater b) Tester
Immediate
Delayed Inattention in daily life (rater)
Visuospatial WM Verbal WM
Bjorkdahl2013+*
22‐63 Brain Injury + impaired WM
Outpatient rehabilitation clinic
RCT a) NRb) NR
Passive NR 1 week 3 months Working memory questionnaire (self)
none WAIS‐III Digit span backward
Beck 2010* 7‐17 ADHDb Private school for students with ADHD and/or LD
RCT a) pre trainingb) NR
Wait‐list Home 1 month 4 months DSM‐IV Inattention (parent)
none none
Brehmer2012
a) 20‐30b) 60‐70
Healthy Newspaper advertisement RCT a) yes b) yes
Active and non‐adaptive
Home NR 3 months CFQ (self) WAIS‐R Span board backward
WAIS‐R Digit span backward
Chacko 2013a 7‐11 ADHD Newspaper advertisements
RCT a) yesb) yes
Active and non‐adaptive
Home 3 weeks none DBD Inattention (parent)
AWMA Spatial recall AWMA Listening recall
Egeland 2013 10‐12 ADHDb Outpatient clinics at two hospitals
RCT a) NRb) Yes
Wait‐list School NR 8 months DuPaul Inattention (parent)
none none
Green 2012 7‐14 ADHDb, c Advertising, psychologists, psychiatrists, institute tracking
RCT a) yesb) Yes
Active and non‐adaptive
Home NR none Connors ADHD (parent)
none none
Gropper 2013 19‐52 LD/ADHDb Student Disability services at 3 post‐secondary institutions
RCT a) NRb) NR
Wait‐list Home 3 weeks 2 months CFQ (self) CANTAB Spatial WM (errors)
WISC‐IV Digit span
Grunewaldt 2013
5‐6 VLBW Admission records of a hospital NICU
RCT a) NRb) Yes
Wait‐list Home 1 month none DuPaul Inattention (parent)
Spatial span backwarda
Digit span backwarda
Hardy 2013 8‐16 Cancer Patients of the hospital Division of Pediatric Hematology‐Oncology
RCT a) yesd
b) YesActive and non‐adaptive
Home NR 3 months Connors Inattention (parent)
WRAML Symbolic WM
WRAML Verbal WM
Klingberg 2005
7‐12 ADHD Referrals from pediatricians, psychiatrists, special school teachers
RCT a) yesb) yes
Active and non‐adaptive
Home or school
NR 3 months DSM‐IV Inattention (parent)
WAIS‐R Span board WAIS‐R Digit span
Roughen 2011
15‐17 SEB Schools RCT a) nob) NR
Passive School 3 weeks 3 months DuPaul AttentionalControl (teacher)
none none
Westerberg 2007
34‐65 Stroke Stroke Rehabilitation Unit RCT a) pre training b) pre training
Passive Home NR none CFQ (self) WAIS‐R Span board WAIS‐R Digit span
Benefits of a Working Memory TrainingProgram for Inattention in Daily Life: ASystematic Review and Meta-Analysis
"Benefits of a WM training program generalise to improvements in everyday functioning. Initial evidence shows that the Cogmed method has significant benefits for inattention in daily life with a clinically relevant effect size"
Megan Spencer-Smith, Torkel Klingberg. PLoS ONE 10(3): e0119522
• Efficacious method with meaningful results: not all WMT approaches/programs are the same.
• The Gold Standard of Research: clear information about the inclusion criteria for the study. Analyses summarizing the effects from 12 randomized controlled trials, studying the effects related to Cogmed working memory training.
• Relevant size: Cogmed WMT has a significant (i.e. moderate) effect on inattention in daily life, an important piece of far transfer. Effects were in the moderate range (0.40-0.66), considered relevant in the education domain .
• Sustained effects: Effects on everyday attention are shown to be largely sustained.
• Cogmed is good for all: (not just ADHD)
3/05/2016
13
Key questions1. What does it mean to be “evidence-based”?
2. Does training improve working memory?
3. Does the training generalise beyond trained tasks to non-trained tasks?
4. Are the gains sustained?
5. Can working memory training improve literacy and numeracy outcomes?
Children improve math, attention and instruction-following up to six months after CogmedHolmes et al., 2009
Forty-two children screened for working memory deficits were randomly assigned to high or low intensity training conditions.
Holmes, J., Gathercole, S.E., & Dunning, D.L. (2009). Adaptive training leads to sustained enhancement of poor working memory inchildren. Developmental Science, 12(4), F9 -F15. doi: 10.1111/j.1467-7687.2009.00848x
Pre- training WM scores for non-adaptive (placebo) group
Holmes et al., 2009
60.00
70.00
80.00
90.00
100.00
110.00
120.00
Verbal STM Visuo-spatial STM Verbal WM Visuo-spatial WM
Pre- Post-
Slide courtesy of Dr. Joni Holmes
60.00
70.00
80.00
90.00
100.00
110.00
120.00
Verbal STM Visuo-spatialSTM
Verbal WM Visuo-spatialWM
Pre- Post-
**
Slide courtesy of Dr. Joni Holmes
Pre- training to post-training WM scores for non-adaptive (placebo) group
Holmes et al., 2009
3/05/2016
14
60.00
70.00
80.00
90.00
100.00
110.00
120.00
Verbal STM Visuo-spatial STM Verbal WM Visuo-spatial WM
Pre-Post-
Slide courtesy of Dr. Joni Holmes
Pre-training WM scores for adaptive (treatment) group
Holmes et al., 2009
60.00
70.00
80.00
90.00
100.00
110.00
120.00
Verbal STM Visuo-spatialSTM
Verbal WM Visuo-spatialWM
Pre-Post-Follow-up
**
**
Slide courtesy of Dr. Joni Holmes
Pre- training to post-training WM scores for adaptive (treatment) group
Holmes et al., 2009
60.00
70.00
80.00
90.00
100.00
110.00
120.00
Verbal STM Visuo-spatialSTM
Verbal WM Visuo-spatialWM
Pre-
Post-
Follow-up*
** *
Slides courtesy of Dr. Joni Holmes
Pre- training to follow up WM scores for adaptive (treatment) group
Holmes et al., 2009
Children with low WM improve attention and math up to six months after training
Holmes et al., 2009
“…This study provides the first demonstration that these commonplace deficits and
associated learning difficulties can be ameliorated, and
possibly even overcome, by intensive adaptive training
over a relatively short period: just 6 weeks, typically…”
3/05/2016
15
Are the gains sustained? Is it realistic to expect that gains are sustained beyond 6-12 months?Compare to • Medication• CBT• ExericiseYou do use your working memory all the timeFocus on how you make the best of that opportunity
“Cogmed 'creates an opportunity for change' but the ultimate benefit depends on how that opportunity is used - e.g. to build literacy, social skills, lifestyle habits, resilience and so on. The extent to which it works cannot be separated from the support, the rewards, the matching content that the school and/or coaching environment can provide”.
Key questions1. What does it mean to be “evidence-based”?
2. Does training improve working memory?
3. Does the training generalise beyond trained tasks to non-trained tasks?
4. Are the gains sustained?
5. Can working memory training improve literacy and numeracy outcomes?
WM is important for successful learning in individual classroom activities (Gathercole & Alloway, 2008):
WM loads of many classroom activities are too high, so children with poor WM: forget crucial information & fail to successfully complete tasks
This leads to frequent lost learning opportunities and consequently slow rates of learning
Why study WM in children? Joni Holmes Ph.D
3/05/2016
16
Improving Working Memory – Supporting Student learning – Tracy Packiam Alloway 2011
Interconnected Systems Supporting Learning
Knowledge base (LTM)
*largely mediated by language
Performance‐based factors
*working memory
Immediate and delayed effects
In recent years, academic performance has been measured in an increasing number of studies following CWMT. • Some studies have shown significant academic improvements
directly following CWMT (13, 35, 43)
• while others have not seen any effects (7) or not shown statistical significance of the effects (32, 33), compared to a non-adaptive WM training group.
However, for those studies including follow up measures, there seems to be a pattern emerging showing delayed effects on learning outcomes following CWMT• RCT by Dunning et al (33), the effect size on reading rate went
from non-existent (d= 0.04) directly following training, to medium (d = 0.66) at the follow up one year later, compared to controls.
[Far transfer] Skill/behaviour
[Near transfer]Affects
Executive functions
Rate of learning Remembering directions
Attention/Concentration
Working memory Planning
Reading comprehension Maths skills On-task
behaviour
Initiate
Manipulating information
Task monitoring Organise
Language development
Working memory training acts on underlying levels
3/05/2016
17
Psychological Processes associated with academic learning (Dehn 2012)
Interactive Effects of Educational & Cognitive Deficits
Presentation Title runs here l 00/00/0066
• A synergistic model of cognitive information processing suggests that impairments which interfere with the rapid processing of information may burden the person’s working memory structures, and reduce his or her capacity for comprehension and new learning.
• These students fatigue easily, do not study long, and avoid stressful learning environments.
• This reduces access to the curriculum, and leads to falling further behind
[Dr Larry Weiss WISC-5 Handbook 2016]
Population: N =57 children w/ special needs, ages 9 – 12 years (grades 3 - 5)
n = 42 in adaptive Cogmed training groupn = 15 in passive control group [special needs class]*n = 25 w/ ADHD in non-adaptive Cogmed training group**
*Comparison of special needs students in adaptive Cogmed training group to passive control group of special needs students on literacy measures
** Comparison of special needs students in adaptive Cogmed training group to non-adaptive Cogmed training group from Klingberg et al., 2005 on cognitive measures
Design: Randomized, controlled, blinded, test-retestT1 = baseline, T2 = post-test (5-6 week after), T3 = 6-7 month follow-up
3/05/2016
18
I. Adaptive Cogmed training group improved significantly over non-adaptiveCogmed training group from Klingberg et al., 2005 :
1) Visuo-spatial WM tasks (Span Board – backwards and forwards; WAIS –NI) (T2 & T3)
2) Verbal WM tasks (Digit Span – backwards and forwards; WISC-III) (T2)
3) Nonverbal reasoning task (Raven’s Coloured Progressive Matrices (RCPM)) (T2)
4) Cohen’s d ranging from 0.67 to 0.98 (T2)
II. Adaptive Cogmed training group improved significantly over passive controlgroup on reading comprehension (Reading narrative texts & answering questions) (T2& T3) (d = 0.88 and 0.99 respectively)
III. Adaptive Cogmed training group improved significantly over passive controlgroup on a measure of math (Basic Number Screening TEST (BNST) at T2 (d = 0.69)and for boys only, at T2 and T3 (d = 0.74 and 0.90 respectively)
Summary: Dahlin (2011) and Dahlin (2013) Few Effects of Far Transfer of Working Memory Training in ADHD: A Randomized Controlled Trial Jens Egeland , Anne Kristine Aarlien, Brit-Kari Saunes 2013
Objective• Studies have shown that children with ADHD profit from working memory
training, although few studies have investigated transfer effects comprehensively. The current Randomized Controlled Trial analyses transfer to other neuropsychological (NP) domains, academic performance and everyday functioning at home and school.
Method• Sixty-seven children with ADHD were randomized into a control group or
a training group. The training group underwent Cogmed’s program. All participants were assessed pre-training, immediately after and eight months later with a battery of NP tests, measures of mathematical and reading skills, as well as rating scales filled out by parents and teachers.
Results• There was a significant training effect in psychomotor speed, but not to
any other NP measures. Reading and mathematics were improved. There were no training induced changes in symptom rating scales either at home or at school. The increased reading scores remained significant eight months later.
Conclusion• The study is the most comprehensive study of transfer effects to date,
and with mixed results compared to previous research. More research is needed regarding how to improve the training program and the conditions and thresholds for successful training.
2014 Update: Taking Working Memory training from the laboratory into schoolsJoni Holmes and Susan Gathercole, Educational Psychology 2013
• Whole class groups of students completed training at school• Groups chosen for low working memory>>>> Both groups showed same gains in working memory as 2009 Lab studies
Training gains for BOTH groups transferred to improvements in National Curriculum assessments in English and Maths
>>>> Working Memory training has the potential to transfer to educationally relevant measures of academic ability. “Educational gains and cost-savings of using working memory training as an early intervention could be immense”
3/05/2016
19
Working Memory Training is Associated with Long Term Attainments in Math and ReadingStina Söderqvist* and Sissela Bergman Nutley
Followed the academic performance of two age-matched groups during 2 years. As part of the curriculum in grade 4 (age 9–10), all students in one classroom (n = 20) completed Cogmed Working Memory Training (CWMT) whereas children in the other classroom (n = 22) received education as usual. Performance on nationally standardized tests in math and reading was used as outcome measures at baseline and two years later.
At baseline both classes were normal/high performing according to national standards.
At grade 6, reading had improved to a significantly greater extent for the training group compared to the control group (medium effect size, Cohen’s d = 0.66, p = 0.045).
For math performance the same pattern was observed with a medium effect size (Cohen’s d = 0.58) reaching statistical trend levels (p = 0.091).
Moreover, the academic attainments were found to correlate with the degree of improvements during training (p < 0.053).
>> Results suggest improved working memory boosts student’s capacity to learn
Roberts study 2016
Roberts, G., Quach, J., Spencer Smith, M., Anderson, P., Gathercole, S., Gold, L., Sia, KL., Mensah, F., Rickards, F., Ainley, J. & Wake, M. (2016). Working memory intervention does not improve long-term academic outcomes: A school-based population randomised controlled trial. JAMA Pediatrics
Objective: to investigate whether 6 year-old children at risk for academic underachievement, for whom approximately 20-25 hours of formal teaching was substituted with Cogmed working memory training (CWMT), would outperform children receiving formal teaching as usual on measures of academic performance two years later.
Important highlights
• Method – good numbers and controls – we need more studies like this• Feasibility – population based assessment and training can be administered• Sustained effects on memory – yes to 12 months, not significant at 2 years• Academic outcomes – training group did not outperform control group on academic measure (WRAT4)• Importance of age – Is 6-7 a good age for training?
Limits to consider
• How school outcomes measured – strong conclusions? Based on one academic measure, variability of baseline at age 6 not measured but very important
• Intent is not to replace classroom learning• Screening - Academic performance was in the normal range, Was WM perhaps not the only bottleneck for
academic growth in a large portion of the sample?• Reported on completion of training vs quality and intensity of training – coaching and effort matters• Choice of product and protocol
Q1. Did students in this study, who trained with Cogmed at school, improve their working memory?Yes. Students that trained with Cogmed RM had significantly higher verbal WM visuo-spatial short term memory compared to the passive control at 6 months following training. Gains in visuospatial short term memory were also maintained at 12 months post-training but these improvements were no longer statistically significant 24 months post training.
Q2. If the students in this research did not experience improvements in maths or reading, does this mean Cogmed does not lead to gains in academic performance in general? This study does not answer that question. Neither does any single study. Results need to be replicated in order to be generalisable.
Further research will be done by this group to explore who training was successful for. 6 year olds may differ more in their early learning of reading and maths for other reasons (e.g. phonological awareness, vocabulary, number and letter knowledge etc.) than their different WM capacities.
Cogmed and academic change?
Factors that determine improvements on academic performance after training with Cogmed are yet not entirely understood • age at which the training is implemented • instruments used to assess the academic change
(school tests or ability tests) • the comparison condition (in this case the control group
received >20 hours more of formal education) • the degree to which working memory is taxed in those
particular tests • the maintenance of the improved working memory and
how it is utilized in learning post training
3/05/2016
20
Clinical and real world data counts too72% of schools who used Cogmed in ANZ in 2014 renewed in 2015
5/3/201678 Cogmed Coach Conference 19/07/13CogCon AUNZ 201378
Time Taken (Initial Review to Completion 8.2, 8.5)
Dr Jason McGowan, Child Development Centre
5/3/201679 Cogmed Coach Conference 19/07/13CogCon AUNZ 201379
Gain in Reading Age (20, 25 months)
Dr Jason McGowan, Child Development Centre 5/3/201680 Cogmed Coach Conference 19/07/13CogCon AUNZ 201380
Change in Reading Rate (2.6, 3.2 months / month)
80 Dr Jason McGowan, Child Development Centre
3/05/2016
21
+
Design: Randomized, Controlled, Test-Retest, 6 Month Follow Up
Sample: N = 245, 7th graders, at least 1 year behind in reading
Additional Data: SAT 10 (Reading), STAAR (Texas State Assessment), Demographics
T1April 2014
Intervention Phase I
T2 May 2014
T3 August 2014
InterventionPhase II
T4December 2014
CPI/CQBASC-2ParentBASC-2 TeacherBASC-2 StudentGRADE (Reading)
Cogmed CPI/CQBASC-2Student
CPI/CQBASC-2 ParentBASC-2TeacherBASC-2 StudentGRADE (Reading)
iLit CPI/CQBASC-2 ParentBASC-2TeacherBASC-2 StudentGRADE (Reading)
Passive iLit
Passive Passive
Cogmed Slide Library 2014
https://www.youtube.com/watch?v=8UXLSvXF8vQ
Future research – questions Do benefits persist?
Can the benefits be enhanced?e.g. Cogmed Plus
Can a reduced training schedule produce benefits?
What individual characteristics are important for benefits? Motivation (Martinussen et al 2005, Nymberg et al under review) ADHD comorbidity such as ODD (Chacko et al 2013) Age (Brehmer et al 2012)
12 September 2014
Implementing a Working Memory Program At Your School
Next webinar: Tuesday 21 June @ 12.30-1.30 (AEST)
See a recording of webinar at:www.pearsonclinical.com.au/archive