1
§ Clinical sites identified subjects for potential entry into the elenbecestat studies who they believed would meet criteria for early AD (MMSE≥24; CDR-GS=0.5; CDR Memory≥0.5). § Following consent, the ISLT immediate and delayed recall trials were administered, with the CBB being administered as a distractor between the ISLT immediate and delayed recall. § The ISLT requires 5 minutes to complete and yields two performance measures: total words correct for immediate recall and delayed recall. The ISLT has been validated in over 90 countries, and new cultures and language groups are continually added to the library of available languages. § The CBB requires 12-15 minutes to complete and includes measures of psychomotor function (Detection), attention (Identification), visual learning (One Card Learning) and working memory (One Back). § Normative data is available for both the ISLT and CBB, and the tests are scored automatically using Cogstate’s secure data processing sever. PREDICTING ABNORMAL MEMORY FROM ASSESSMENT OF COGNITION USING THE COGSTATE BRIEF BATTERY IN THE ELENBECESTAT MissionAD GLOBAL PHASE 3 PROGRAM A. Schembri 1 , B. Albala 2 , M. Gee 3 , P. Maruff 1 1 Cogstate Limited, Science, Melbourne, Australia. 2 Eisai Incorporated, Neurology Business Group, Woodcliff lake, USA. 3 Eisai Limited, Neurology Business Group, Hatfield, United Kingdom. Disclosures Bruce Albala and Michelle Gee are full-time employees of Eisai Incorporated and Eisai Limited respectively. Paul Maruff and Adrian Schembri are full-time employees of Cogstate Incorporated. References 1 Lim, Y. Y., Harrington, K., Ames, D., Ellis, K. A., Lachovitzki, R., Snyder, P. J., & Maruff, P. (2012). Short term stability of verbal memory impairment in mild cognitive impairment and Alzheimer's disease measured using the International Shopping List Test. Journal of Clinical and Experimental Neuropsychology, 34(8), 853-863. 2 Lim, Y. Y., Maruff, P., Pietrzak, R. H., Ames, D., Ellis, K. a, Harrington, K., … Rowe, C. C. (2014). Effect of amyloid on memory and non-memory decline from preclinical to clinical Alzheimer’s disease. Brain: A Journal of Neurology, 137(Pt 1), 221–31. doi:10.1093/brain/awt286 3 Maruff, P., Lim, Y. Y., Darby, D., Ellis, K. A., Pietrzak, R. H., Snyder P. J., Bush, A. I., Szoeke, C., Schembri, A., Ames, D., Masters, C. L., & the AIBL Research Group (2013) Clinical utility of the Cogstate brief battery in identifying cognitive impairment in mild cognitive impairment and Alzheimer’s disease. BMC Pharmacology & Toxicology, 1:30 4 Darby, D. G., Fredrickson, J., Pietrzak, R. H., Maruff, P., Woodward, M., & Brodtmann, A. (2014). Reliability and usability of an internet-based computerized cognitive testing battery in community- dwelling older people. Computers in Human Behavior, 30, 199–205. http://doi.org/10.1016/j.chb.2013.08.009 5 Koyama, A. K., Hagan, K. A., Okereke, O. I., Weisskopf, M. G., Rosner, B., & Grodstein, F. (2015). Evaluation of a Self-Administered Computerized Cognitive Battery in an Older Population. Neuroepidemiology, 264–272. http://doi.org/10.1159/000439592 Methods Presented at 14 th International Conference on Alzheimer’s & Parkinson’s Diseases (AD/PD 2019), March 26-31, 2019, Lisbon, Portugal. Abstract § The optimal CBB logistic regression equation in predicting impairment on immediate or delayed recall of the ISLT incorporated two measures of memory (One Card Learning and One Back) and a measure of attention (Identification). § Inspection of AUC statistics indicate high classification accuracy for the CBB in classifying impairment on the ISLT immediate of delayed recall when this algorithm is applied. § Findings suggest the CBB has potential as a prescreening tool for identifying impairment related to early AD. § The optimal CBB algorithm to predict ISLT impairment (immediate or delayed recall) for the elenbecestat sample included the Identification (attention), One Card Learning (visual learning) and One Back (working memory) tests. The final equation is provided below. Pr [ISLT Impairment] = 1 / [1+e -g ]……………………………………(1) where g = -1.89 + [2.18 * Identification] – [3.76 * One Card Learning] – [1.86 * One Back] + [0.03 * Age] Logistic Regression Analysis Figure 3. ROC curve for performance of impaired relative to unimpaired groups on the ISLT immediate and delayed recall tests for the CBB for the elenbecestat sample (N = 7985). Methods Introduction Methods Methods Conclusions Results § The Eisai elenbecestat MissionAD phase 3 studies assess the effects of BACE inhibitor elenbecestat on clinical and biomarker outcomes in subjects with early Alzheimer’s Disease (AD). § Entry into the elenbecestat studies requires subjects to show impairment on the immediate or delayed recall components of the International Shopping List Test (ISLT). § The ISLT is a supervisor administered three-trial verbal list learning test where individuals learn a shopping list of 12 food items. The ISLT has been validated in both mild cognitive impairment (MCI) and AD 1 . § Prescreening assessments have been considered for use in clinical trials to determine whether a subject is considered a good candidate for more comprehensive screening. § The Cogstate Brief Battery (CBB) is a cognitive screening assessment that has been described extensively within the literature, and has potential as a prescreening assessment tool. Cognitive impairment and progressive decline has been reported on the CBB in the context of preclinical and early AD 2,3 . § Several papers have been published on the utility of the CBB being administered in unsupervised or community contexts as an early indicator of cognitive impairment potentially associated with MCI or early AD 4,5 . § The aim of this study was to evaluate the CBB as a prescreening assessment to identify individuals with abnormal memory on the ISLT. Results § ROC analysis on the elenbecestat sample revealed an Area Under Curve (AUC) of .73 (95%CI 0.72, 0.74). § Sensitivity of the model was 94.9%, whilst specificity was 21.2%. § 77.1% of subjects were correctly classified by the CBB as impaired on the ISLT immediate or delayed recall, whilst 59.6% were correctly classified as not impaired. Receiver Operating Characteristics (ROC) Analysis Figure 4. ROC curve for performance of impaired relative to unimpaired groups on the ISLT immediate and delayed recall tests for the CBB for impaired subjects from the elenbecestat sample (N = 5861) and a normative sample (N = 4341). Figure 2. Example stimuli from the Cogstate Brief Battery (CBB). The example shown is the One Back working memory test. Figure 1. Example stimuli from the International Shopping List Test (ISLT). § The final sample comprised data for 7,985 consented study subjects (mean age = 70.12, SD = 8.07, range 42 to 86, 53.9% female). Sample Methods § Logistic regression analyses were used to determine the optimal CBB equation to predict ISLT impairment. Each of the four tests in the CBB, as well as Age, were entered as independent variables into the logistic regression model. The dependent variable was ISLT impairment, defined as z≤-1.00 on either the ISLT immediate or delayed recall. § Once identified, the logistic equation was entered into a series of Receiver Operating Characteristic (ROC) analyses on the elenbecestat sample to determine correct classification rates of the CBB in predicting ISLT impairment. § ROC analysis was then replicated on a combined sample of subjects in the elenbecestat studies (subjects impaired on the ISLT only) and normative controls (N = 4341, mean age = 70.99, SD = 4.69, range 64 to 86, 59.3% female). Data Analysis § AUC improved to .87 (95%CI 0.87, 0.88) when the ROC analysis included both the elenbecestat and normative sample (sensitivity = 81.4, specificity = 77.2). § In this second model, correct classification of impaired subjects increased to 82.8% and correct classification of not impaired subjects increased to 75.4%. § Given the elenbecestat sample had a high proportion of impaired subjects (>70%) on the ISLT, this second model more closely reflects a balanced sample of impaired and unimpaired subjects that is not affected by restricted distributional characteristics.

Predicting Abnormal Memory from CBB in Misison AD · 2019-04-02 · §Sensitivity of the model was 94.9%, whilst specificity was 21.2%. §77.1% of subjects were correctly classified

  • Upload
    others

  • View
    2

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Predicting Abnormal Memory from CBB in Misison AD · 2019-04-02 · §Sensitivity of the model was 94.9%, whilst specificity was 21.2%. §77.1% of subjects were correctly classified

§ Clinical sites identified subjects for potential entry into the elenbecestat studies who they believed would meet criteria for early AD (MMSE≥24; CDR-GS=0.5; CDR Memory≥0.5).

§ Following consent, the ISLT immediate and delayed recall trials were administered, with the CBB being administered as a distractor between the ISLT immediate and delayed recall.

§ The ISLT requires 5 minutes to complete and yields two performance measures: total words correct for immediate recall and delayed recall. The ISLT has been validated in over 90 countries, and new cultures and language groups are continually added to the library of available languages.

§ The CBB requires 12-15 minutes to complete and includes measures of psychomotor function (Detection), attention (Identification), visual learning (One Card Learning) and working memory (One Back).

§ Normative data is available for both the ISLT and CBB, and the tests are scored automatically using Cogstate’s secure data processing sever.

PREDICTING ABNORMAL MEMORY FROM ASSESSMENT OF COGNITION USING THE COGSTATE BRIEF BATTERY IN THE ELENBECESTAT MissionAD

GLOBAL PHASE 3 PROGRAMA. Schembri1, B. Albala2, M. Gee3, P. Maruff1

1 Cogstate Limited, Science, Melbourne, Australia.2 Eisai Incorporated, Neurology Business Group, Woodcliff lake, USA.3 Eisai Limited, Neurology Business Group, Hatfield, United Kingdom.

DisclosuresBruce Albala and Michelle Gee are full-time employees of Eisai Incorporated and Eisai Limited respectively. Paul Maruff and Adrian Schembri are full-time employees of Cogstate Incorporated.

References1 Lim, Y. Y., Harrington, K., Ames, D., Ellis, K. A., Lachovitzki, R., Snyder, P. J., & Maruff, P. (2012). Short term stability of verbal memory impairment in mild cognitive impairment and Alzheimer's disease measured using the International Shopping List Test. Journal of Clinical and Experimental Neuropsychology, 34(8), 853-863.

2 Lim, Y. Y., Maruff, P., Pietrzak, R. H., Ames, D., Ellis, K. a, Harrington, K., … Rowe, C. C. (2014). Effect of amyloid on memory and non-memory decline from preclinical to clinical Alzheimer’s disease. Brain: A Journal of Neurology, 137(Pt 1), 221–31. doi:10.1093/brain/awt286

3 Maruff, P., Lim, Y. Y., Darby, D., Ellis, K. A., Pietrzak, R. H., Snyder P. J., Bush, A. I., Szoeke, C., Schembri, A., Ames, D., Masters, C. L., & the AIBL Research Group (2013) Clinical utility of the Cogstate brief battery in identifying cognitive impairment in mild cognitive impairment and Alzheimer’s disease. BMC Pharmacology & Toxicology, 1:30

4 Darby, D. G., Fredrickson, J., Pietrzak, R. H., Maruff, P., Woodward, M., & Brodtmann, A. (2014). Reliability and usability of an internet-based computerized cognitive testing battery in community-dwelling older people. Computers in Human Behavior, 30, 199–205. http://doi.org/10.1016/j.chb.2013.08.009

5 Koyama, A. K., Hagan, K. A., Okereke, O. I., Weisskopf, M. G., Rosner, B., & Grodstein, F. (2015). Evaluation of a Self-Administered Computerized Cognitive Battery in an Older Population. Neuroepidemiology, 264–272. http://doi.org/10.1159/000439592

Methods

Presented at 14th International Conference on Alzheimer’s & Parkinson’s Diseases (AD/PD 2019), March 26-31, 2019, Lisbon, Portugal.

Abstract

§ The optimal CBB logistic regression equation in predicting impairment on immediate or delayed recall of the ISLT incorporated two measures of memory (One Card Learning and One Back) and a measure of attention (Identification).

§ Inspection of AUC statistics indicate high classification accuracy for the CBB in classifying impairment on the ISLT immediate of delayed recall when this algorithm is applied.

§ Findings suggest the CBB has potential as a prescreening tool for identifying impairment related to early AD.

§ The optimal CBB algorithm to predict ISLT impairment (immediate or delayed recall) for the elenbecestat sample included the Identification (attention), One Card Learning (visual learning) and One Back (working memory) tests. The final equation is provided below.

Pr [ISLT Impairment] = 1 / [1+e-g]……………………………………(1)

where g = -1.89 + [2.18 * Identification] – [3.76 * One Card Learning] – [1.86 * One Back] + [0.03 * Age]

Logistic Regression Analysis

Figure 3. ROC curve for performance of impaired relative to unimpaired groups on the ISLT immediate and delayed recall tests for the CBB for the elenbecestat sample (N = 7985).

Methods

Introduction

Methods

Methods

Conclusions

Results§ The Eisai elenbecestat MissionAD phase 3 studies assess the

effects of BACE inhibitor elenbecestat on clinical and biomarker outcomes in subjects with early Alzheimer’s Disease (AD).

§ Entry into the elenbecestat studies requires subjects to show impairment on the immediate or delayed recall components of the International Shopping List Test (ISLT).

§ The ISLT is a supervisor administered three-trial verbal list learning test where individuals learn a shopping list of 12 food items. The ISLT has been validated in both mild cognitive impairment (MCI) and AD1.

§ Prescreening assessments have been considered for use in clinical trials to determine whether a subject is considered a good candidate for more comprehensive screening.

§ The Cogstate Brief Battery (CBB) is a cognitive screening assessment that has been described extensively within the literature, and has potential as a prescreening assessment tool. Cognitive impairment and progressive decline has been reported on the CBB in the context of preclinical and early AD2,3.

§ Several papers have been published on the utility of the CBB being administered in unsupervised or community contexts as an early indicator of cognitive impairment potentially associated with MCI or early AD4,5.

§ The aim of this study was to evaluate the CBB as a prescreening assessment to identify individuals with abnormal memory on the ISLT.

Results

§ ROC analysis on the elenbecestat sample revealed an Area Under Curve (AUC) of .73 (95%CI 0.72, 0.74).

§ Sensitivity of the model was 94.9%, whilst specificity was 21.2%.

§ 77.1% of subjects were correctly classified by the CBB as impaired on the ISLT immediate or delayed recall, whilst 59.6% were correctly classified as not impaired.

Receiver Operating Characteristics (ROC) Analysis

Figure 4. ROC curve for performance of impaired relative to unimpaired groups on the ISLT immediate and delayed recall tests for the CBB for impaired subjects from the elenbecestat sample (N = 5861) and a normative sample (N = 4341).

Figure 2. Example stimuli from the Cogstate Brief Battery (CBB). The example shown is the One Back working memory test.

Figure 1. Example stimuli from the International Shopping List Test (ISLT).

§ The final sample comprised data for 7,985 consented study subjects (mean age = 70.12, SD = 8.07, range 42 to 86, 53.9% female).

Sample

Methods

§ Logistic regression analyses were used to determine the optimal CBB equation to predict ISLT impairment. Each of the four tests in the CBB, as well as Age, were entered as independent variables into the logistic regression model. The dependent variable was ISLT impairment, defined as z≤-1.00 on either the ISLT immediate or delayed recall.

§ Once identified, the logistic equation was entered into a series of Receiver Operating Characteristic (ROC) analyses on the elenbecestat sample to determine correct classification rates of the CBB in predicting ISLT impairment.

§ ROC analysis was then replicated on a combined sample of subjects in the elenbecestat studies (subjects impaired on the ISLT only) and normative controls (N = 4341, mean age = 70.99, SD = 4.69, range 64 to 86, 59.3% female).

Data Analysis § AUC improved to .87 (95%CI 0.87, 0.88) when the ROC analysis included both the elenbecestat and normative sample (sensitivity = 81.4, specificity = 77.2).

§ In this second model, correct classification of impaired subjects increased to 82.8% and correct classification of not impaired subjects increased to 75.4%.

§ Given the elenbecestat sample had a high proportion of impaired subjects (>70%) on the ISLT, this second model more closely reflects a balanced sample of impaired and unimpaired subjects that is not affected by restricted distributional characteristics.