- Research
- Open access
- Published:
Subjective cognitive decline predicts longitudinal neuropsychological test performance in an unsupervised online setting in the Brain Health Registry
Alzheimer's Research & Therapy volume 17, Article number: 10 (2025)
Abstract
Backgrounds
Digital, online assessments are efficient means to detect early cognitive decline, but few studies have investigated the relationship between remotely collected subjective cognitive change and cognitive decline. We hypothesized that the Everyday Cognition Scale (ECog), a subjective change measure, predicts longitudinal change in cognition in the Brain Health Registry (BHR), an online registry for neuroscience research.
Methods
This study included BHR participants aged 55 + who completed both the baseline ECog and repeated administrations of the CANTAB® Paired Associates Learning (PAL) visual learning and memory test. Both self-reported ECog (Self-ECog) and study partner-reported ECog (SP-ECog), and two PAL scores (first attempt memory score [FAMS] and total errors adjusted [TEA]) were assessed. We estimated associations between multiple ECog scoring outputs (ECog positive [same or above cut-off score], ECog consistent [report of consistent decline in any item], and total score) and longitudinal change in PAL. Additionally we assessed the ability of ECog to identify ‘decliners’, who exhibited the worst PAL progression slopes corresponding to the fifth percentile and below.
Results
Participants (n = 16,683) had an average age of 69.07 ± 7.34, 72.04% were female, and had an average of 16.66 ± 2.26 years of education. They were followed for an average of 2.52 ± 1.63 visits over a period of 11.49 ± 11.53 months. Both Self-ECog positive (estimate = -0.01, p < 0.001, R²m = 0.56) and Self-ECog consistent (estimate=-0.01, p = 0.002, R²m = 0.56) were associated with longitudinal change in PAL FAMS after adjusting demographics and clinical confounders. Those who were Self-ECog total (Odds ratio [95% confidence interval] = 1.390 [1.121–1.708]) and SP-ECog consistent (2.417 [1.591–3.655]) had higher probability of being decliners based on PAL FAMS.
Conclusion
In the BHR’s unsupervised online setting, baseline subjective change was feasible in predicting longitudinal decline in neuropsychological tests. Online, self-administered measures of subjective cognitive change might have a potential to predict objective subjective change and identify individuals with cognitive impairments.
Background
Alzheimer’s disease (AD) is characterized as amyloid plaques, tau tangles, and neurodegeneration, leading to cognitive decline and dementia [1]. AD can be diagnosed with biomarkers including amyloid positron emission tomography (PET) scans [2, 3], tau PET scans [4, 5], analysis of cerebrospinal fluid [6], and plasma testing [6, 7]. During the last year, Eisai’s monoclonal antibody called Leqembi has been approved by FDA and CMS in the USA [8]. The development of disease-modifying therapy emphasizes the need for cost-effective and scalable methods to identify individuals likely to have AD and benefit from AD drugs.
Online, self-administered, digital neuropsychological tests are one approach to identify individuals with cognitive impairments [9, 10]. Popular in-clinic tests such as the Clinical Dementia Rating, Montreal Cognitive Assessment, Cogstate Brief Battery, and Cambridge Neuropsychological Test Automated Battery (CANTAB®) have been developed as online versions [11,12,13,14,15]. These may be useful for early detection of cognitive decline in cognitively unimpaired (CU) adults [16], providing accessibility, efficiency, and diagnostic accuracy for dementia [9, 10, 17]. The CANTAB paired associates learning (PAL) neuropsychological test assesses visual learning and episodic memory, which are among the initial symptoms of AD [18]. Patients with mild cognitive impairment (MCI) and AD show poorer performance on PAL compared to CU adults [19,20,21,22]. PAL differentiates patients with MCI from age-matched CU individuals with a sensitivity of 0.83 and specificity of 0.82 [23]. PAL also has been shown to predict progression to dementia [19,20,21, 24] and correlates with AD biomarkers such as cerebrospinal fluid amyloid β and tau [25], hippocampal volume and activation [25, 26], and amyloid β positivity in PET scans [27]. The PAL online version showed comparable agreement with in clinic-based assessment [14]. A report from the Brain Health Registry (BHR), an online platform for aging and neuroscience research [28], showed that remotely collected PAL showed moderate feasibility and good construct validity [29].
Another approach is to identify individuals with subjective cognitive decline (SCD), such as self-reported memory problems in CU people [30]. The Everyday Cognition scale (ECog) is a well-established instrument which collects self-report and study partner-reported subjective information about cognitive change and instrumental activities of daily living which relate to cognitive function [31]. The ECog is especially effective in CU people [32, 33], and various cut-off points have been suggested for detecting MCI or AD in several older adult cohorts [33,34,35]. The BHR is utilizing ECog to detect SCD, with remotely collected ECog showing comparable scores to in-clinic assessments [36]. This measure is associated with cognitive function, probability of diagnosis of dementia, and AD biomarkers in cross-sectional studies [37, 38].
Subjective change measures are well known to be associated with cognitive decline and AD progression in in-clinic settings [39,40,41,42]. Remotely collected caregiver-reported SCD has been shown to be associated with future in-person assessed cognitive decline and dementia [43]. Despite the importance of subjective cognitive measures, however, there is relatively little information concerning the ability of subjective cognitive change to predict future cognitive decline in remote, online settings.
Therefore, the overall goal of this study was to investigate the association between SCD and longitudinal objective cognition in an unsupervised and online setting. Specifically, our aim was to investigate the association between subjective cognitive change and future cognitive decline in terms of both continuous change and determined dichotomized status. We hypothesized that ECog categorizations, previously established in in-clinic cohorts for detecting cognitive impairment, would predict changes in longitudinal PAL performance and identify older adults who were ‘cognitive decliners’, those who showed a significant declining slope (defined as lowest 5th percentile) in PAL scores, among our study participants in an online setting.
Methods
Participants
Participants were from the BHR database, which is an online neuroscience registry for developing cohorts focusing on cognitive aging. BHR participants provide electronic informed consent and complete self-report surveys and unsupervised online cognitive tests every six months [28, 44]. BHR launched in 2014 and the number of participants enrolled in BHR has reached 100,000 at March 2024. Additionally, caregivers or family members invited by participants can enroll separately into BHR as study partners and answer questionnaires about participants’ cognition every six months [45]. The BHR study is approved by the UCSF Institutional Review Board.
This study included participants meeting the following criteria: (i) completed PAL test one or more times; (ii) age at baseline PAL test ≥ 55; (iii) age at any longitudinal PAL tests ≤ 90; (iv) completed ECog questionnaire within six months of baseline PAL. According to the inclusion criteria, this study used data collected from March 2021, when PAL was newly implemented in BHR, to December 2023, the time of analysis.
Sociodemographic and clinical measures
Baseline demographic information included age, gender (male, female, other, and prefer not to say), and years of education. In terms of ethnocultural background, we categorized participants into the following groups: non-Latinx African American, Latinx, non-Latinx White, and all others.
We used participants’ self-report of medical history including the diagnosis of MCI, dementia, and AD (“Please indicate whether you currently have or have had any of the following conditions in the past.”), history of taking medication for dementia (“Are you currently taking any of the following medications?”; donepezil, rivastigmine, galantamine, and memantine), and family history of AD (“Do you have any biological parents, full siblings, or biological children who have been diagnosed with Alzheimer’s Disease?”). We also included participant scores on an online adaptation of the Geriatric Depression Scale-Short Form (GDS) [46]. The GDS item regarding memory problems (“Do you feel you have more problems with memory than most?”) was excluded in this study as it might confound the results. The total score of GDS in this study ranged from 0 to 14 with higher score meaning more depressive symptoms. We also collected the status of subjective memory concern, focusing on the worries about subjective cognitive change, assessed with a yes or no question: “Are you concerned that you have a memory problem?”
Everyday cognition scale
ECog scores at baseline were used in this study. ECog is a 39-item scale measuring subjective changes in instrumental activities of daily living compared to 10 years before [31]. Every item is rated on a 1–4 Likert scale (1 = no change or better; 2 = questionable or occasionally worse; 3 = consistently a little worse; 4 = consistently much worse) and the total score is the average of all responses ranging from 1 to 4 with a higher score meaning more decline. The original version of ECog, implemented in BHR, was analyzed in this study [31]. ECog ratings can be completed either by the individual themselves (self-reported ECog or Self-ECog) or by a study partner (study partner-reported ECog or SP-ECog). SP-ECog was used in this study when it was available.
In addition to the total ECog score, we also evaluated additional ECog scoring outcomes for predicting cognitive impairment [33,34,35]. We categorized ‘Self-ECog positive’ using cut-off score 1.31 or higher (impaired vs. normal) and ‘SP-ECog positive’ using cut-off score 1.36 or higher (impaired vs. normal) from studies by Rueda et al. [34]. and van Harten et al. [35]. We also categorized ‘ECog consistent’, defined as the respondent indicating any ECog item ≥ 3 (consistently worse) as shown in the study by van Harten et al. [35]. These categorizations have shown optimal performance in discriminating or predicting cognitive impairments in in-clinic cohorts.
Paired associates learning
All participants are invited to complete the PAL online test every six months. Longitudinal PAL scores starting from the same baseline as ECog were used in this study. The PAL task is one of the CANTAB assessments developed by the University of Cambridge [47].
In the version of PAL used in the BHR, participants in the registry have the chance to undergo five stages of assessment, wherein they are tasked with learning two, four, six, eight, or twelve pattern-location pairings. Initially, participants are presented with boxes in a randomized sequence, each revealing either a pattern or an empty space, which they must commit to memory. Subsequently, patterns are displayed one at a time in the center of the screen, and participants must identify the box where each pattern was originally located. In the event of an error, the boxes reopen, allowing the participant up to four attempts to correctly recall the pattern locations. Progression to a more difficult stage is contingent upon correctly recalling all patterns in the current stage. Failure to complete a stage after four attempts results in the termination of the task.
PAL outcome measures were the number of correct answers at the first attempt (first attempt memory score, FAMS) and the number of errors made by the participants plus the estimated number of errors the participants would have made in any trials not reached due to early termination (total errors adjusted, TEA). These two measures are independent of each other and the most reported measures in previous literature [47]. Data cleaning steps excluded only participants who were unable to begin the PAL test due to challenges in understanding the online instructions or navigating the digital platform.
Decliner
Additionally, we identified “decliner” groups based on separate evaluations of the PAL FAMS and PAL TEA scores. By examining individual slopes of PAL FAMS progression, participants with slopes equal to or lower than the fifth percentile, relative to the group’s average slope, were categorized as experiencing cognitive decline. Conversely, for PAL TEA, participants with slopes exceeding the 95th percentile, compared to the group’s slope, were deemed decliners. This analysis involved participants with at least two longitudinally assessed PAL scores available (n = 10,065). We followed a method used in previous studies for other computerized cognitive tests and unsupervised cognitive test batteries [48, 49], which involved inspecting slopes for longitudinal change to identify participants who were statistically abnormal, adjusting for the absence of any longitudinal change in performance or improvement as a learning effect [49, 50].
Statistical analysis
For descriptive statistics, we employed independent t-tests for continuous variables and chi-squared tests for dichotomous variables. We also conducted linear regression analysis between clinical and demographic variables and PAL scores at baseline.
First, we aimed at determining the predictive capacity of baseline ECog outcomes—ECog positive, ECog consistent, and ECog total score—on PAL score longitudinal changes. We examined time interactions to assess the relationship between baseline ECog outcomes and longitudinal PAL progression in a linear mixed effect model. PAL scores served as the dependent variables, while ECog*time (month) and baseline PAL score were fixed effect variables in model 1. Additional variables including age at each PAL test, gender, years of education, race, GDS, family history of AD, AD medication use, and self-reported any impairment were included as fixed-effect variables in model 2. As we used several ECog outcomes as the dependent variables, false discovery rate corrections were conducted using Benjamini-Hochberg method [51]. We also calculated marginal R-squared (R²m) to evaluate the explanatory power of fixed effects in the linear mixed model [52]. The linear mixed models were also re-analyzed in participants excluding those who self-reported any impairment.
Second, we aimed at predictive capacity of baseline ECog outcomes on the ‘cognitive decliners’ status. We conducted multivariate logistic regression analyses to estimate associations between baseline ECog outcomes and the status of ‘decliners’, individuals exhibiting PAL progression slopes corresponding to the fifth percentile and below. For each ECog variable, separate multivariable logistic regression models to predict decliners were conducted, with age, gender, years of education, race, and the baseline PAL score included as additional predictors. We also calculated the odds ratios (OR) for predicting PAL decliners based on subjective memory concern, GDS, AD medication use, and self-reported any impairment. OR and 95% confidence intervals (CI) were calculated based on the logistic regression models. Additionally, the logistic regression models were re-analyzed in participants excluding those who self-reported any impairment. We used R version 4.3.2 (R Core Team, 2023) and SAS 9.4 (SAS Institute, Cary NC) in all analyses.
Results
Participants
The total of 16,683 participants were included in this study. The flow chart illustrating the participant selection process based on the study’s inclusion and exclusion criteria is presented in Fig. 1. Baseline demographic and clinical characteristics of the participants are presented in Table 1. Among these participants, the mean age was 69.07 ± 7.34 years and the mean for years of education was 16.66 ± 2.26. The majority of the participants were non-Latinx white (88.8%) and female (72.0%). They were followed for an average of 2.52 ± 1.63 times (min 1, max 6) for 11.49 ± 11.53 (min 0, max 33) months, which provided 42,049 person-visits data in total.
Comparisons of clinical variables between ECog positive and negative groups
Participants were divided into Self-ECog positive (n = 7,378) and negative (n = 9,305) using the cut-point of Self-ECog total score 1.31 [34]. Compared to the Self-ECog negative group, the Self-ECog positive group had a higher percentage of individuals with subjective memory concerns, higher GDS scores (indicating more depressive symptoms), and higher percentages of a self-reported diagnosis of cognitive impairment (MCI, AD, and dementia), and AD medication use (Table 1). Self-ECog scores differed significantly between the two groups (1.76 ± 0.46 in the positive and 1.14 ± 0.10 in the negative group, t = -114.22, p < 0.001) and SP-ECog scores also differed (1.44 ± 0.50 in the positive and 1.20 ± 0.29 in the negative group, t = -16.22, p < 0.001). Baseline PAL scores were worse in Self-ECog positive group with lower score in PAL FAMS (t = 11.44, p < 0.001) and higher score in PAL TEA (t = -11.65, p < 0.001) (Table 1).
Baseline association between demographic and clinical variables and PAL scores
Demographic and clinical variables associated with PAL FAMS and TEA are presented in Table S1 in supplemental data. Demographic factors such as younger age (estimate = -0.164, p < 0.001), female gender (estimate = 0.771, p < 0.001), higher education (estimate = 0.098, p < 0.001), and non-Latinx white race were associated with better PAL FAMS. Clinical factors such as having subjective memory concern (estimate = -0.373, p < 0.001), higher GDS (estimate = -0.052, p < 0.001), AD medication use (estimate = -0.690, p = 0.014), and having self-reported cognitive impairment (estimate = -1.458, p < 0.001) were associated with worse PAL FAMS. However, Self-ECog positive was not associated with either baseline PAL score (FAMS: estimate = -0.067, p = 0.370; TEA: estimate = 0.533, p = 0.306). Standardized estimates were also calculated and presented in Table S1 in supplemental data.
Longitudinal PAL scores
The number of participants at each visit and the progression of mean PAL scores, stratified by Self-ECog positive status, are presented in Fig. 2.
Effect of baseline ECog outcomes on the longitudinal PAL scores
The results of linear mixed effect model with time interactions of the baseline ECog outcomes on the longitudinal PAL scores are presented in Table 2. Self-ECog positive and Self-ECog consistent showed significant associations with decline in PAL FAMS in model 1 adjusted for the baseline PAL score (Self-ECog positive: estimate = -0.010, p < 0.001; Self-ECog consistent: estimate = -0.008, p = 0.004) and model 2 adjusted for age, gender, years of education, race, GDS, family history of AD, AD medication use, self-reported any impairment, and baseline PAL score (Self-ECog positive: estimate = -0.011, p < 0.001; Self-ECog consistent: estimate = -0.009, p = 0.002). Self-ECog positive also predicted longitudinal change of PAL TEA score in both models (Model 1: estimate = 0.046, p = 0.005; Model 2: estimate = 0.046, p = 0.006). They all showed good model fit with large explanatory power of fixed effects (R²m 0.559–0.661). Predicted trajectories of both PAL scores by Self-ECog positive in model 2 are presented in Fig. 3. Neither Self-ECog total score nor any SP-ECog total scores were associated with longitudinal change in PAL scores after adjusting multiple comparisons. However, when the linear mixed model was applied to participants without self-reported any impairment, both the Self-ECog total and SP-ECog total scores showed significant time interactions with longitudinal PAL FAMS and PAL TEA scores, whereas the dichotomized ECog scores showed weaker effects (Table S2 and Figure S1).
Predicted trajectory of PAL scores in groups stratified by Self-ECog positive. Trajectory of PAL scores in groups stratified by Self-ECog positive (total score ≥ 1.31) status: The regression lines and the 95% confidence intervals for the predicted scores in linear mixed model adjusted for age, gender, years of education, race, GDS, family history of AD, AD medication use, self-reported any impairment, and baseline PAL score. PAL, paired associates learning; FAMS, first attempt memory score; TEA, total errors adjusted; ECog, Everyday cognition scale; GDS, geriatric depression scale; AD, Alzheimer’s disease
Effect of baseline ECog outcomes on PAL decliner status
Among the 10,065 participants who completed at least two PAL tests, 517 participants (5.1%) were identified as PAL decliners, showing the worst slope of PAL progression corresponding to the fifth percentile and below, based on PAL FAMS scores, and 505 participants (5.0%) were identified based on PAL TEA scores. The spaghetti plots of the decliners and non-decliners with groupwise regression lines and 95% CIs are presented in Fig. 4.
Predicted trajectory of PAL scores in decliner and non-decliner groups. Trajectory of PAL scores in decliner and non-decliner groups: Linear regression lines in each group are overlaid on individual spaghetti plots in groups stratified by decliner status. Decliners were identified based on PAL FAMS slopes over time at or below the fifth percentile relative to the group mean slope, while PAL TEA decliner was defined as 95th percentile or higher. The analysis was conducted using only participants who had at least two PAL scores available (n = 10,065). PAL, paired associates learning; FAMS, first attempt memory score; TEA, total errors adjusted; ECog, Everyday cognition scale; GDS, geriatric depression scale; AD, Alzheimer’s disease
ORs for identifying PAL decliner by ECog scores using logistic regression models are presented in Table 3. For PAL FAMS decliners, most Self- and SP-ECog outcomes showed significant associations with ORs ranging 1.173–2.417. For identifying PAL TEA decliners, three Self-ECog outcomes showed significant associations (OR 1.200–1.466). Additionally, baseline clinical variables including subjective memory concern, higher GDS scores, and self-reported any impairment were associated with higher probability of being a PAL decliner. In the analysis of participants without self-reported any impairment, SP-ECog variables showed the same significant results, whereas Self-ECog Positive and Self-ECog Consistent did not show significant associations with Decliner status on PAL FAMS (Table S3).
Discussion
The major findings of this study of older adults enrolled in the BHR were: First, subjective cognitive change positive status, defined using a previously established ECog cut-off or categorization for identifying those with cognitive impairment, was associated with longitudinal decline in performance on the PAL visual learning and memory test. Second, greater subjective decline, defined using both continuous and dichotomous ECog scoring outcomes, was associated with higher probability of being a PAL decliner (those with PAL progression slopes in the fifth percentile). These results support our hypothesis that online, self-administered measures of subjective cognitive change have the potential to identify older adults who are likely to have objective cognitive decline. Our findings demonstrate that this online assessment approach might be useful to identify older adults with or at risk for cognitive impairment and clinical progression.
The first major finding of this study is that greater self-report of subjective cognitive and functional decline, measured using ECog, was associated with greater future longitudinal decline in visual learning and memory, assessed using the PAL test. Specifically, Self-ECog positive and Self-ECog consistent were associated with greater decline in PAL. The continuous ECog total score, on the other hand, showed a stronger association with PAL progression than the dichotomized ECog in participants without self-reported any impairment. These results may highlight the utility of ECog dichotomization, which was previously established as an effective method for discriminating individuals with MCI or dementia from CU individuals. The fact that both dichotomized and continuous ECog scores from in-clinic cohorts were associated with PAL progression in an online registry suggests that a simple subjective cognitive change measure could be useful for predicting future objective cognitive decline in an online, unsupervised setting. This finding is different from the results of previous studies that investigated the predictive ability of ECog for diagnosis of MCI or AD [34, 35, 53], that investigated the association between the in-clinic and pen-and-paper ECog score and clinical diagnosis. Although online registries are efficient means to collect repeated measures pertaining to cognitive function, there have been few studies of longitudinal cognitive assessment in online setting. Banh et al. previously reported longitudinal Cogstate brief battery in association with self-reported MCI and subjective memory concern in BHR [48], and Stricker et al. reported longitudinal at-home Cogstate brief battery results in comparison with in-clinic results [54]. We analyzed longitudinal online PAL scores over an average duration of 11.49 months and found significant monthly changes in PAL scores in relation to ECog dichotomizations. While the large sample size may have contributed to the significance of the results, the initial differentiation with a good model fit suggests that these findings could become more pronounced in future longitudinal studies with longer follow-up periods.
However, SP-ECog scores were less associated with longitudinal PAL scores than Self-ECog scores in this study, which contrasts with previous studies that demonstrated better predictive power of SP-ECog for diagnosing MCI or AD compared to Self-ECog [34, 35]. Two aspects of our study design likely contribute to this finding. First, BHR has a selection bias for older adults who are CU or who have mild impairment with intact functional abilities. We believe that this is because more impaired people are less likely to have the ability and motivation to join BHR themselves, compared to CU people. In fact, the demographics of our sample, which is overwhelmingly composed of CU people, support this bias. In this unimpaired or mildly impaired group, it is likely that changes in cognition and function would be subtle, and not observable by study partners. Second, BHR does not require a minimum amount of contact of familiarity between participants and study partners for the study partner to qualify for the study. Therefore, the lack of signal for SP-ECog may be, in part, driven by lower levels of familiarity between participant and study partner than in other studies. Still, previous BHR studies have shown that SP-ECog is cross-sectionally associated with objective learning and memory as well as with self-report of a diagnosed cognitive impairment [45]. Therefore, the role of SP-ECog in identifying cognitive decline warrants further study in this sample.
The second major finding of this study is that greater subjective cognitive change was associated with greater odds of being a PAL ‘decliner’, defined as those who exhibited the worst PAL progression slopes corresponding to the fifth percentile and below. This is partly in line with the previous studies that showed significant association between ECog and diagnosis of MCI or AD. Although decliner status is not a diagnosis of cognitive impairment, definition by lowest fifth percentile was often used as an impaired status in online cognitive tests [48, 49] as well as traditional neuropsychological tests [55, 56]. Thus, this result supports the hypothesis that ECog may help identify those with cognitive impairment. However, there were differences between Self-ECog and SP-ECog in association with decliner status. Self-ECog outcomes demonstrated significant ORs for decliners based on both FAMS (memory scores) and TEA (error scores), whereas SP-ECog categorizations only showed significant OR for decliners based on FAMS, with higher OR values compared to Self-ECog outcomes. We believe this may be because individuals who exhibit decline based on memory score progressions are more likely to have impairments such as MCI or AD. These individuals might be more easily observed by study partners or may have impaired awareness of their illnesses [57].
This study also found that the ECog predicted cognitive decliner status as effectively as other clinical variables. Subjective memory concern, assessed with a simple yes/no question about worries regarding cognitive change, showed a strong association with decliner status, supporting previous findings that anxiety about SCD may be linked to future cognitive impairments [39, 58]. Similarly, self-reported MCI or dementia increased the odds of being classified as a cognitive decliner, highlighting the reliability of online-collected diagnostic information in predicting future cognitive decline [48]. Depressive symptoms, measured by the GDS, were also associated with cognitive decliner status, with a small but significant effect. This is consistent with the understanding that depressive symptoms can both be a risk factor and an early sign of neurodegenerative conditions like Alzheimer’s disease [59]. This study demonstrated that, similar to other clinical variables, the ECog scale was a strong predictor of cognitive decliner status. Specifically, subjective memory concern, self-reported MCI or dementia, and depressive symptoms all exhibited significant associations with decliner status, highlighting the ECog’s comparable predictive power in relation to established clinical measures.
An examination of ECog and PAL performance in our study supports the validity of the remote, online assessment approach, and also highlights important selection biases. Compared to other clinical samples used to study ECog, our participants are younger, have higher education levels, a higher proportion are female, and lacks sufficient ethnocultural diversity [34, 35, 53]. Additionally, our sample lacks traditional baseline cognitive assessments. However, the mean Self-ECog score in CU group in this study (1.36 ± 0.37) was comparable with CU individuals in previous in-clinic cohorts (1.37 ± 0.46 [33]; 1.34 ± 0.31 [34]; 1.2 (1.1–1.5) [35]; 1.46 ± 0.47 [53]). Self-ECog positivity also showed association with various clinical information such as subjective memory concern, depressive symptoms, and self-reported MCI, AD and dementia, and taking medications for AD in this study, which corresponds with previous in-clinic studies [34, 35, 53, 60]. These results further support the validity of unsupervised online ECog, as first addressed in a previous head-to-head comparison with in-clinic version [36].
In our study, longitudinal PAL tests showed an improvement in scores over time. The practice effect is a common phenomenon in repeated neuropsychological tests [50] and this was also found in online longitudinal cognitive assessments studies [48, 54]. The practice effect was prominent in the first two sessions [48] and lasted for three to four sessions [50] in previous studies. PAL test also showed practice effect even in cognitively impaired participants [61]. Our results are in line with these prior studies showing most improvement between first two sessions and begin to deteriorate from session six in PAL FAMS in Self-ECog positive group. Although caution is needed when interpreting the current online PAL scores in our sample, this study provides evidence of useful online measurement of cognitive change, in a large sample size (n = 16,638).
This study also has several limitations, with the most significant being selection biases resulting from the recruitment methods used in BHR. As a fully online study, participants are more likely to have higher internet literacy and heightened concerns about their cognitive health, which may not represent the broader population. Additionally, there is a skewed distribution in demographic factors, particularly race, ethnicity, and socioeconomic status, further limiting the generalizability of the findings. We have previously observed that certain groups, such as individuals from non-white racial backgrounds, Latino communities, and those with lower educational attainment, are more likely to drop out of follow-up assessments [62]. These patterns introduce additional bias and reduce the representativeness of the data. A second limitation is that the large sample size likely contributed to statistically significant associations. The third limitation is that this study relies on self-reported information and lacks clinical diagnosis or AD biomarker data, which prevents us from distinguishing between individuals with AD dementia, MCI due to AD, and other forms of cognitive impairment. A fourth limitation is that the PAL FAMS and PAL TEA scores were analyzed using raw scores without excluding data from participants with extremely poor performance. However, participants who were unable to start the PAL test due to digital literacy issues were excluded. Additional analyses, which were limited to individuals without self-reported any impairment, yielded similar results, supporting the robustness of our findings.
Conclusions
In the BHR’s unsupervised online setting, ECog demonstrated feasibility in predicting longitudinal decline in PAL scores, both in terms of continuous changes and when dichotomized as decliners versus non-decliners. These findings underscore the value of subjective cognitive change measures to identify those at risk for cognitive decline. Also, this study shows the utility of previously dichotomized ECog cut-off or categorizations in an online setting. Taken together, unsupervised, remotely collected SCD might have the potential to identify individuals with cognitive decline, who are likely to be at risk for or in the early stages of cognitive impairment.
Data availability
The datasets used and/or analysed during the current study are available from the corresponding author on reasonable request.
Abbreviations
- ECog:
-
Everyday Cognition Scale
- BHR:
-
Brain Health Registry
- CU:
-
Cognitively Unimpaired
- PAL:
-
Paired Associates Learning
- Self-ECog:
-
Self-reported ECog
- SP-ECog:
-
Study Partner-reported ECog
- FAMS:
-
First Attempt Memory Score
- TEA:
-
Total Errors Adjusted
- AD:
-
Alzheimer’s Disease
- PET:
-
Positron Emission Tomography
- CANTAB:
-
Cambridge Neuropsychological Test Automated Battery
- SCD:
-
Subjective Cognitive Decline
- MCI:
-
Mild Cognitive Impairment
- GDS:
-
Geriatric Depression Scale-Short Form
- R²m:
-
R-squared
- OR:
-
Odds Ratios
- CI:
-
Confidence Intervals
References
Jack CR Jr, Bennett DA, Blennow K, Carrillo MC, Dunn B, Haeberlein SB, et al. NIA-AA research framework: toward a biological definition of Alzheimer’s disease. Alzheimer’s Dement. 2018;14(4):535–62.
Nordberg A. PET imaging of amyloid in Alzheimer’s disease. Lancet Neurol. 2004;3(9):519–27.
Landau S, Thomas B, Thurfjell L, Schmidt M, Margolin R, Mintun M, et al. Amyloid PET imaging in Alzheimer’s disease: a comparison of three radiotracers. Eur J Nucl Med Mol Imaging. 2014;41:1398–407.
Saint-Aubert L, Lemoine L, Chiotis K, Leuzy A, Rodriguez-Vieitez E, Nordberg A. Tau PET imaging: present and future directions. Mol Neurodegeneration. 2017;12:1–21.
Bischof GN, Dodich A, Boccardi M, van Eimeren T, Festari C, Barthel H, et al. Clinical validity of second-generation tau PET tracers as biomarkers for Alzheimer’s disease in the context of a structured 5-phase development framework. Eur J Nucl Med Mol Imaging. 2021;48(7):2110–20.
Olsson B, Lautner R, Andreasson U, Öhrfelt A, Portelius E, Bjerke M, et al. CSF and blood biomarkers for the diagnosis of Alzheimer’s disease: a systematic review and meta-analysis. Lancet Neurol. 2016;15(7):673–84.
Hansson O, Blennow K, Zetterberg H, Dage J. Blood biomarkers for Alzheimer’s disease in clinical practice and trials. Nat Aging. 2023;3(5):506–19.
Cummings J. Anti-amyloid monoclonal antibodies are transformative treatments that redefine Alzheimer’s disease therapeutics. Drugs. 2023;83(7):569–76.
Chen L, Zhen W, Peng D. Research on digital tool in cognitive assessment: a bibliometric analysis. Front Psychiatry. 2023;14:1227261.
Watt JA, Lane NE, Veroniki AA, Vyas MV, Williams C, Ramkissoon N, et al. Diagnostic accuracy of virtual cognitive assessment and testing: systematic review and meta-analysis. J Am Geriatr Soc. 2021;69(6):1429–40.
Nosheny RL, Yen D, Howell T, Camacho M, Moulder K, Gummadi S, et al. Evaluation of the Electronic Clinical Dementia Rating for Dementia Screening. JAMA Netw Open. 2023;6(9):e2333786.
Snowdon A, Hussein A, Kent R, Pino L, Hachinski V. Comparison of an electronic and paper-based Montreal Cognitive Assessment Tool. Alzheimer Disease Assoc Disorders. 2015;29(4):325–9.
Cormack FK, Morris H, Barnett JH, Housden C, P1-504: CANTAB MOBILE: EXPERIENCE OF USE OF A DIGITAL MEMORY ASSESSMENT TOOL IN UK PRIMARY CARE. Alzheimer’s Dement. 2018;14(7SPart9):P522–3.
Backx R, Skirrow C, Dente P, Barnett JH, Cormack FK. Comparing web-based and lab-based cognitive assessment using the Cambridge Neuropsychological Test Automated Battery: a within-subjects counterbalanced study. J Med Internet Res. 2020;22(8):e16792.
Cromer JA, Harel BT, Yu K, Valadka JS, Brunwin JW, Crawford CD, et al. Comparison of cognitive performance on the Cogstate brief battery when taken in-clinic, in-group, and unsupervised. Clin Neuropsychol. 2015;29(4):542–58.
Koo BM, Vizer LM. Mobile Technology for Cognitive Assessment of older adults: a scoping review. Innov Aging. 2019;3(1).
Öhman F, Hassenstab J, Berron D, Schöll M, Papp KV. Current advances in digital cognitive assessment for preclinical Alzheimer’s disease. Alzheimer’s Dementia: Diagnosis Assess Disease Monit. 2021;13(1):e12217.
Aisen PS, Cummings J, Jack CR, Morris JC, Sperling R, Frölich L, et al. On the path to 2025: understanding the Alzheimer’s disease continuum. Alzheimers Res Ther. 2017;9(1):60.
Blackwell AD, Sahakian BJ, Vesey R, Semple JM, Robbins TW, Hodges JR. Detecting dementia: novel neuropsychological markers of preclinical Alzheimer’s disease. Dement Geriatr Cogn Disord. 2003;17(1–2):42–8.
Fowler KS, Saling MM, Conway EL, Semple JM, Louis WJ. Paired associate performance in the early detection of DAT. J Int Neuropsychol Soc. 2002;8(1):58–71.
Égerházi A, Berecz R, Bartók E, Degrell I. Automated neuropsychological test battery (CANTAB) in mild cognitive impairment and in Alzheimer’s disease. Prog Neuropsychopharmacol Biol Psychiatry. 2007;31(3):746–51.
Junkkila J, Oja S, Laine M, Karrasch M. Applicability of the CANTAB-PAL computerized memory test in identifying amnestic mild cognitive impairment and Alzheimer’s disease. Dement Geriatr Cogn Disord. 2012;34(2):83–9.
Chandler JM, Marsico M, Harper-Mozley L, Vogt R, Peng Y, Lesk V, et al. P3-111: cognitive assessment: discrimination of impairment and detection of decline in Alzheimer’s disease and mild cognitive impairment. Alzheimer’s Dement. 2008;4(4SPart17):T551–2.
Mitchell J, Arnold R, Dawson K, Nestor PJ, Hodges JR. Outcome in subgroups of mild cognitive impairment (MCI) is highly predictable using a simple algorithm. J Neurol. 2009;256(9):1500–9.
Nathan PJ, Lim YY, Abbott R, Galluzzi S, Marizzoni M, Babiloni C, et al. Association between CSF biomarkers, hippocampal volume and cognitive function in patients with amnestic mild cognitive impairment (MCI). Neurobiol Aging. 2017;53:1–10.
de Rover M, Pironti VA, McCabe JA, Acosta-Cabronero J, Arana FS, Morein-Zamir S, et al. Hippocampal dysfunction in patients with mild cognitive impairment: a functional neuroimaging study of a visuospatial paired associates learning task. Neuropsychologia. 2011;49(7):2060–70.
Pettigrew C, Soldan A, Brichko R, Zhu Y, Wang M-C, Kutten K et al. Computerized paired associate learning performance and imaging biomarkers in older adults without dementia. Brain Imaging Behav. 2022;16(2):921–9.
Weiner MW, Aaronson A, Eichenbaum J, Kwang W, Ashford MT, Gummadi S, et al. Brain health registry updates: an online longitudinal neuroscience platform. Alzheimer’s Dementia. 2023;19(11):4935–51.
Ashford MT, Aaronson A, Kwang W, Eichenbaum J, Gummadi S, Jin C, et al. Unsupervised online Paired associates Learning Task from the Cambridge Neuropsychological Test Automated Battery (CANTAB®) in the Brain Health Registry. J Prev Alzheimer’s Disease. 2024;11(2):514–24.
Jessen F, Amariglio RE, Buckley RF, van der Flier WM, Han Y, Molinuevo JL, et al. The characterisation of subjective cognitive decline. Lancet Neurol. 2020;19(3):271–8.
Farias ST, Mungas D, Reed BR, Cahn-Weiner D, Jagust W, Baynes K, et al. The measurement of everyday cognition (ECog): scale development and psychometric properties. Neuropsychology. 2008;22(4):531.
A Marshall G, Zoller S, E Kelly A, Amariglio KE, Locascio RJ, Johnson JA. Everyday cognition scale items that best discriminate between and predict progression from clinically normal to mild cognitive impairment. Curr Alzheimer Res. 2014;11(9):853–61.
Farias ST, Mungas D, Harvey DJ, Simmons A, Reed BR, DeCarli C. The measurement of everyday cognition: development and validation of a short form of the Everyday Cognition scales. Alzheimer’s Dement. 2011;7(6):593–601.
Rueda AD, Lau KM, Saito N, Harvey D, Risacher SL, Aisen PS, et al. Self-rated and informant-rated everyday function in comparison to objective markers of Alzheimer’s disease. Alzheimer’s Dement. 2015;11(9):1080–9.
van Harten AC, Mielke MM, Swenson-Dravis DM, Hagen CE, Edwards KK, Roberts RO, et al. Subjective cognitive decline and risk of MCI: the Mayo Clinic Study of Aging. Neurology. 2018;91(4):e300–12.
Howell T, Neuhaus J, Glymour MM, Weiner MW, Nosheny RL, Initiative ADN. Validity of online versus in-clinic self-reported everyday cognition scale. J Prev Alzheimer’s Disease. 2022;9(2):269–76.
Nosheny RL, Camacho MR, Jin C, Neuhaus J, Truran D, Flenniken D, et al. Validation of online functional measures in cognitively impaired older adults. Alzheimer’s Dement. 2020;16(10):1426–37.
Amariglio RE, Mormino EC, Pietras AC, Marshall GA, Vannini P, Johnson KA, et al. Subjective cognitive concerns, amyloid-β, and neurodegeneration in clinically normal elderly. Neurology. 2015;85(1):56–62.
Liew TM. Trajectories of subjective cognitive decline, and the risk of mild cognitive impairment and dementia. Alzheimers Res Ther. 2020;12(1):135.
Slot RE, Sikkes SA, Berkhof J, Brodaty H, Buckley R, Cavedo E, et al. Subjective cognitive decline and rates of incident Alzheimer’s disease and non–Alzheimer’s disease dementia. Alzheimer’s Dement. 2019;15(3):465–76.
Mondini S, Pucci V, Montemurro S, Rumiati RI. Protective factors for subjective cognitive decline individuals: trajectories and changes in a longitudinal study with Italian elderly. Eur J Neurol. 2022;29(3):691–7.
Koppara A, Wagner M, Lange C, Ernst A, Wiese B, König H-H, et al. Cognitive performance before and after the onset of subjective cognitive decline in old age. Alzheimer’s Dementia: Diagnosis Assess Disease Monit. 2015;1(2):194–205.
Nosheny RL, Jin C, Neuhaus J, Insel PS, Mackin RS, Weiner MW, et al. Study partner-reported decline identifies cognitive decline and dementia risk. Ann Clin Transl Neurol. 2019;6(12):2448–59.
Weiner MW, Nosheny R, Camacho M, Truran-Sacrey D, Mackin RS, Flenniken D, et al. The Brain Health Registry: an internet‐based platform for recruitment, assessment, and longitudinal monitoring of participants for neuroscience studies. Alzheimer’s Dement. 2018;14(8):1063–76.
Nosheny RL, Camacho MR, Insel PS, Flenniken D, Fockler J, Truran D et al. Online study partner-reported cognitive decline in the Brain Health Registry. Alzheimer’s & Dementia: Translational Research & Clinical Interventions. 2018;4:565 – 74.
Lesher EL, Berryhill JS. Validation of the geriatric depression scale-short form among inpatients. J Clin Psychol. 1994;50(2):256–60.
Barnett JH, Blackwell AD, Sahakian BJ, Robbins TW. The paired associates learning (PAL) test: 30 years of CANTAB translational neuroscience from laboratory to bedside in dementia research. Translational Neuropsychopharmacol. 2016;28:449–74.
Banh T, Jin C, Neuhaus J, Mackin R, Maruff P, Stricker N et al. Unsupervised performance of the CogState brief battery in the brain health registry: implications for detecting cognitive decline. J Prev Alzheimer’s disease. 2022;9(2):262–8.
Darby DG, Pietrzak RH, Fredrickson J, Woodward M, Moore L, Fredrickson A, et al. Intraindividual cognitive decline using a brief computerized cognitive screening test. Alzheimer’s Dement. 2012;8(2):95–104.
Beglinger LJ, Gaydos B, Tangphao-Daniels O, Duff K, Kareken DA, Crawford J, et al. Practice effects and the use of alternate forms in serial neuropsychological testing. Arch Clin Neuropsychol. 2005;20(4):517–29.
Benjamini Y, Hochberg Y. Controlling the false discovery rate: a practical and powerful approach to multiple testing. J Roy Stat Soc: Ser B (Methodol). 1995;57(1):289–300.
Nakagawa S, Schielzeth H. A general and simple method for obtaining R2 from generalized linear mixed-effects models. Methods Ecol Evol. 2013;4(2):133–42.
Farias ST, Lau K, Harvey D, Denny KG, Barba C, Mefford AN. Early functional limitations in cognitively normal older adults predict diagnostic conversion to mild cognitive impairment. J Am Geriatr Soc. 2017;65(6):1152–8.
Stricker NH, Lundt ES, Alden EC, Albertson SM, Machulda MM, Kremers WK, et al. Longitudinal comparison of in clinic and at home administration of the cogstate brief battery and demonstrated practice effects in the Mayo Clinic Study of Aging. J Prev Alzheimer’s Disease. 2020;7:21–8.
Schretlen DJ, Testa SM, Winicki JM, Pearlson GD, Gordon B. Frequency and bases of abnormal performance by healthy adults on neuropsychological testing. J Int Neuropsychol Soc. 2008;14(3):436–45.
Iverson GL, Brooks BL. Improving accuracy for identifying cognitive impairment. The little black book of neuropsychology: a syndrome-based approach. Springer; 2010. pp. 923–50.
Orfei MD, Blundo C, Celia E, Casini AR, Caltagirone C, Spalletta G, et al. Anosognosia in mild cognitive impairment and mild Alzheimer’s Disease: frequency and neuropsychological correlates. Am J Geriatric Psychiatry. 2010;18(12):1133–40.
Jessen F, Amariglio RE, van Boxtel M, Breteler M, Ceccaldi M, Chételat G, et al. A conceptual framework for research on subjective cognitive decline in preclinical Alzheimer’s disease. Alzheimers Dement. 2014;10(6):844–52.
Ownby RL, Crocco E, Acevedo A, John V, Loewenstein D. Depression and risk for Alzheimer disease: systematic review, meta-analysis, and metaregression analysis. Arch Gen Psychiatry. 2006;63(5):530–8.
Rog LA, Park LQ, Harvey DJ, Huang C-J, Mackin S, Farias ST. The independent contributions of cognitive impairment and neuropsychiatric symptoms to everyday function in older adults. Clin Neuropsychol. 2014;28(2):215–36.
Cacciamani F, Salvadori N, Eusebi P, Lisetti V, Luchetti E, Calabresi P, et al. Evidence of practice effect in CANTAB spatial working memory test in a cohort of patients with mild cognitive impairment. Appl Neuropsychology: Adult. 2018;25(3):237–48.
Ashford MT, Eichenbaum J, Williams T, Camacho MR, Fockler J, Ulbricht A, et al. Effects of sex, race, ethnicity, and education on online aging research participation. Alzheimers Dement (N Y). 2020;6(1):e12028.
Acknowledgements
We extend our heartfelt gratitude to all participants in the BHR study, as well as our study partners and Cambridge Cognition. We also express appreciation to both current and former BHR staff for their expert management of the registry.
Funding
Rachel L. Nosheny reports grants from NIA, during the conduct of the study. Michael W. Weiner reports grants from NIH/NIA, outside the submitted work; This work was supported by the Gachon University research fund of 2023 (GCU- 202309190001). The sponsors played no part in the study’s design, conduct, data collection, analysis, interpretation, manuscript preparation, or review and approval.
Author information
Authors and Affiliations
Contributions
JMK and RN conceived and designed the study, analysed the data, interpreted the study findings, and drafted the manuscript. JMK conceived and designed the study; defined exclusion criteria and exposure, outcome, and covariate categories; interpreted the study findings; and drafted the manuscript. MM interpreted the study findings and critically reviewed the manuscript. CJ, AD and MTA designed the study; defined exclusion criteria and exposure, outcome, and covariate categories; and interpreted the study findings. JE, ET, EW, KZ, FC, AA, RSM, RT, BL, EC, DT, and STF interpreted the study findings and critically reviewed the manuscript. MW and RN conceived and designed the study; interpreted the study findings; substantially revised the manuscript. All authors reviewed the manuscript and approved the submitted version. All authors have agreed both to be personally accountable for the author’s own contributions and to ensure that questions related to the accuracy or integrity of any part of the work.
Corresponding author
Ethics declarations
Ethics approval and consent to participate
The BHR was established by the University of California, San Francisco (UCSF) and is reviewed and approved by UCSF’s institutional review board. All participants provided online informed consent, and the research was conducted in accordance with the Declaration of Helsinki.
Consent for publication
Not applicable.
Competing interests
Manchumad Manjavong, Chengshi Jin, Adam Diaz, Miriam T. Ashford, Joseph Eichenbaum, Emily Thorp, Elizabeth Wragg, Kenton H. Zavitz, Francesca Cormack, Anna Aaronson, R. Scott Mackin, Rachana Tank, Bernard Landavazo, Erika Cavallone, Diana Truran, and Sarah Tomaszewski Farias have nothing to disclose. Jae Myeong Kang reports grants from Gachon University, during the conduct of the study. Rachel L. Nosheny reports grants from NIA, during the conduct of the study. Michael W. Weiner serves on Editorial Boards for Alzheimer’s & Dementia, and the Journal for Prevention of Alzheimer’s Disease (JPAD); He has served on Advisory Boards for Acumen Pharmaceutical, Alzheon, Inc., Amsterdam UMC; MIRIADE, Cerecin, Merck Sharp & Dohme Corp., NC Registry for Brain Health, and REGEnLIFE. He also serves on the USC ACTC grant which receives funding from Eisai; He has provided consulting to Boxer Capital, LLC, Cerecin, Inc., Clario, Dementia Society of Japan, Dolby Family Ventures, Eisai, Guidepoint, Health and Wellness Partners, Indiana University, LCN Consulting, MEDA Corp., Merck Sharp & Dohme Corp., NC Registry for Brain Health, Prova Education, T3D Therapeutics, University of Southern California (USC), and WebMD; He has acted as a speaker/lecturer for China Association for Alzheimer’s Disease (CAAD) and Taipei Medical University, as well as a speaker/lecturer with academic travel funding provided by: AD/PD Congress, Amsterdam UMC, Cleveland Clinic, CTAD Congress, Foundation of Learning; Health Society (Japan), Kenes, U. Penn, U. Toulouse, Japan Society for Dementia Research, Korean Dementia Society, Merck Sharp & Dohme Corp., National Center for Geriatrics and Gerontology (NCGG; Japan), University of Southern California (USC); He holds stock options with Alzeca, Alzheon, Inc., ALZPath, Inc., and Anven; He received support for his research from the following funding sources: National Institutes of Health (NIH)/NINDS/National Institute on Aging (NIA), Department of Defense (DOD), California Department of Public Health (CDPH), University of Michigan, Siemens, Biogen, Hillblom Foundation, Alzheimer’s Association, Johnson & Johnson, Kevin and Connie Shanahan, GE, VUmc, Australian Catholic University (HBI-BHR), The Stroke Foundation, and the Veterans Administration.
Additional information
Publisher’s note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Electronic supplementary material
Below is the link to the electronic supplementary material.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Kang, J.M., Manjavong, M., Jin, C. et al. Subjective cognitive decline predicts longitudinal neuropsychological test performance in an unsupervised online setting in the Brain Health Registry. Alz Res Therapy 17, 10 (2025). https://doiorg.publicaciones.saludcastillayleon.es/10.1186/s13195-024-01641-2
Received:
Accepted:
Published:
DOI: https://doiorg.publicaciones.saludcastillayleon.es/10.1186/s13195-024-01641-2