This paper is in the following e-collection/theme issue:

Symptom Checkers (31) Dementia and Cognitive Decline (481) Methods and New Tools in Mental Health Research (454) Machine Learning (1465) Supporting Informal Care and Caregivers (293) Interventions and Support for Informal Caregivers of People with Mental Illness (96)

Published on in Vol 24, No 1 (2022): January

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/29219, first published .
Patterns of Symptom Tracking by Caregivers and Patients With Dementia and Mild Cognitive Impairment: Cross-sectional Study

Patterns of Symptom Tracking by Caregivers and Patients With Dementia and Mild Cognitive Impairment: Cross-sectional Study

Patterns of Symptom Tracking by Caregivers and Patients With Dementia and Mild Cognitive Impairment: Cross-sectional Study

Authors of this article:

Taylor Dunn1 Author Orcid Image ;   Susan E Howlett1, 2, 3 Author Orcid Image ;   Sanja Stanojevic1, 4 Author Orcid Image ;   Aaqib Shehzad1 Author Orcid Image ;   Justin Stanley1 Author Orcid Image ;   Kenneth Rockwood1, 3, 5 Author Orcid Image
Article Authors Cited by (2) Tweetations (14) Metrics

    Original Paper

    1Ardea Outcomes, Halifax, NS, Canada

    2Department of Pharmacology, Dalhousie University, Halifax, NS, Canada

    3Division of Geriatric Medicine, Dalhousie University, Halifax, NS, Canada

    4Department of Community Health and Epidemiology, Dalhousie University, Halifax, NS, Canada

    5Geriatric Medicine Research Unit, Nova Scotia Health Authority, Halifax, NS, Canada

    Corresponding Author:

    Kenneth Rockwood, MD

    Geriatric Medicine Research Unit

    Nova Scotia Health Authority

    1421-5955 Veterans Memorial Lane

    Halifax, NS, B3H 2E1

    Canada

    Phone: 1 902 473 8687

    Email: research@ardeaoutcomes.com


    Background: Individuals with dementia and mild cognitive impairment (MCI) experience a wide variety of symptoms and challenges that trouble them. To address this heterogeneity, numerous standardized tests are used for diagnosis and prognosis. myGoalNav Dementia is a web-based tool that allows individuals with impairments and their caregivers to identify and track outcomes of greatest importance to them, which may be a less arbitrary and more sensitive way of capturing meaningful change.

    Objective: We aim to explore the most frequent and important symptoms and challenges reported by caregivers and people with dementia and MCI and how this varies according to disease severity.

    Methods: This cross-sectional study involved 3909 web-based myGoalNav users (mostly caregivers of people with dementia or MCI) who completed symptom profiles between 2006 and 2019. To make a symptom profile, users selected their most personally meaningful or troublesome dementia-related symptoms to track over time. Users were also asked to rank their chosen symptoms from least to most important, which we called the symptom potency. As the stage of disease for these web-based users was unknown, we applied a supervised staging algorithm, previously trained on clinician-derived data, to classify each profile into 1 of 4 stages: MCI and mild, moderate, and severe dementia. Across these stages, we compared symptom tracking frequency, symptom potency, and the relationship between frequency and potency.

    Results: Applying the staging algorithm to the 3909 user profiles resulted in 917 (23.46%) MCI, 1596 (40.83%) mild dementia, 514 (13.15%) moderate dementia, and 882 (22.56%) severe dementia profiles. We found that the most frequent symptoms in MCI and mild dementia profiles were similar and comprised early hallmarks of dementia (eg, recent memory and language difficulty). As the stage increased to moderate and severe, the most frequent symptoms were characteristic of loss of independent function (eg, incontinence) and behavioral problems (eg, aggression). The most potent symptoms were similar between stages and generally reflected disruptions in everyday life (eg, problems with hobbies or games, travel, and looking after grandchildren). Symptom frequency was negatively correlated with potency at all stages, and the strength of this relationship increased with increasing disease severity.

    Conclusions: Our results emphasize the importance of patient-centricity in MCI and dementia studies and illustrate the valuable real-world evidence that can be collected with digital tools. Here, the most frequent symptoms across the stages reflected our understanding of the typical disease progression. However, the symptoms that were ranked as most personally important by users were generally among the least frequently selected. Through individualization, patient-centered instruments such as myGoalNav can complement standardized measures by capturing these infrequent but potent outcomes.

    J Med Internet Res 2022;24(1):e29219

    doi:10.2196/29219

    Keywords

    dementia; mild cognitive impairment; real-world evidence; patient-centric outcomes; machine learning; dementia stage; Alzheimer disease; symptom tracking 


    Background

    It is proving difficult to understand what constitutes successfully treated late-life dementia. This reflects in part the evolving understanding of Alzheimer disease (AD). Contemporary thinking sees AD as a biological construct, defined by biomarkers that can be detected in vivo or during autopsy [1]. In this formulation, AD is distinguished from Alzheimer dementia, a clinical syndrome [2]. However, this separation is not clear. In contrast to the prior view that a definitive diagnosis of AD could only be made at autopsy [3], it is now recognized that many people who meet the neuropathological criteria for AD do not have dementia when alive [4]. Few people with late-life dementia have pure AD; in the great majority, it is present along with many other neuropathological features [5,6]. Furthermore, even a full suite of neuropathological markers cannot distinguish between people who had dementia when alive and those who did not; other factors such as history of delirium [7], prior hospitalization [8], and degree of frailty are each important [9]. Similarly, a range of factors, from the level of education [10] to stimulating psychosocial and lifestyle experiences [11], is seen as potentially protective, even if less well-studied. A further challenge to defining successful treatment is that standard outcome measures, notably including the commonly used AD Assessment Scale–Cognitive subscale (ADAS-Cog), can underestimate meaningful clinical changes [12,13].

    The new consensus on defining AD and the broader understanding of what gives rise to late-life dementia together have propelled a rethinking of which outcomes to measure in dementia and predementia clinical trials [14,15]. The Food and Drug Administration guidelines in 2018 [16] suggested that a single primary end point, which assesses both cognitive and functional effects (eg, the Clinical Dementia Rating [CDR] scale–Sum of Boxes [17,18]) may be used to evaluate treatment in early-stage patients with biomarker-defined AD. With this reevaluation, it may be useful to consider patient-reported impacts of treatment. This could be a less arbitrary means of understanding treatment efficacy compared with changes in biomarkers that tend to correlate poorly with clinical measures [19-24]. Along these lines, the lack of correlation between clinical manifestations of the disease and biomarker positivity has motivated the reconsideration of a purely biological definition of AD, suggesting that the disease designation be restricted to people who combine biomarker positivity with specific AD phenotypes [25].

    Patient-centric outcome measures, in which patient (and caregiver) preferences are directly incorporated and measured, have slowly gained traction in clinical trials and research communities [26], including an endorsement from the Food and Drug Administration [27]. By giving a voice to the patient, we can achieve more meaningful and interpretable measures of treatment benefit [28], as seen in some dementia research, including clinical trials of people with AD receiving donepezil [29] and galantamine [30], which used goal attainment scaling [31,32] as a primary outcome. Here, personalized outcomes offered highly sensitive measures of change that were viewed as clinically meaningful by patients and caregivers [13]. This approach also provided additional insights into what is most important to this population, for example, an unanticipated treatment benefit in the troubling symptom of verbal repetition [33,34]. Indeed, from mild cognitive impairment (MCI), which is the symptomatic predementia stage of AD [35], to the severe stage of dementia, patients are troubled by diverse sets of cognitive, functional, and behavioral symptoms. However, we lack a comprehensive inventory of symptoms across the disease spectrum and their susceptibility to treatment. Surveys of symptoms are few, in part as they are expensive. For this purpose, the web-based environment can be well-suited.

    Our group has shown that data on people living with MCI and dementia and their caregivers can be acquired with an internet-based tool called myGoalNav Dementia (previously SymptomGuide Dementia; developed by Ardea Outcomes). This symptom tracking platform provides a large library from which users can identify and track dementia symptoms that are most important to them [36]. Note the distinction between a symptom being present—as in a tick box survey of symptom prevalence—and one being important to individual patients and caregivers. Earlier, we had used myGoalNav to investigate construct validity with the Dependence Scale [37]; identify clusters of neuropsychiatric symptoms [38]; characterize the symptoms of verbal repetition [39], misplacing objects [40], and agitation [41]; and evaluate donepezil in a 6-month open-label study [42]. Here, we use myGoalNav Dementia to better understand the patterns of dementia symptom tracking with the severity of impairment, as staged by a machine learning algorithm.

    Objective

    The aims of this cross-sectional study are three-fold: (1) to compare symptom frequency by stage, (2) to compare symptom importance by stage, and (3) to examine the relationship between frequency and importance. In doing so, our overall goal is to demonstrate the usefulness and the types of insights gained from web-based symptom tracking in people with dementia and MCI.


    Data Collection

    The data are from the myGoalNav Dementia platform, previously called SymptomGuide Dementia. Launched as a website in 2007 for people with cognitive impairment and their caregivers, the key feature of the platform is a library (or menu) of common dementia-related symptoms and challenges. The library was developed over many years, beginning with a qualitative analysis of personalized treatment goals set by patients, caregivers, and clinicians in 2 clinical trials of anticholinesterase inhibitors [29,30] and from a memory clinic in Halifax, Nova Scotia. From this qualitative analysis, an expert geriatrician panel reviewed the first draft using the Delphi method [43] and arrived at a library of 60 symptoms [37,41]. In 2018, myGoalNav Dementia was redesigned as an iOS and Android mobile app, and based largely on user feedback, the library was expanded to 67 symptoms, each with 2 to 12 (median 9) plain language descriptors that provide an additional level of detail into symptom manifestation.

    In addition to providing users with educational information and management tips for each symptom, users have the option of choosing from the library any number of symptoms and relevant descriptors to track over time, which are important to them or the person for whom they care. If they wish for further personalization, users can log other symptoms and descriptors that do not appear in the library. The set of initial symptoms selected by a user is called their baseline symptom profile, which they may supplement with additional demographic information such as age, gender, and living arrangements. As an optional step, users are also asked to rank their chosen symptoms from most to least important or troublesome.

    myGoalNav Dementia is currently being retooled as a mobile-first web-based care app that better facilitates shared decision-making and improves the quantity and quality of touchpoints between the provider and patient. The transition to web-based technologies affords us flexibility in incorporating our dementia staging model within the app in the future. Currently, it is slated to undergo pilot testing with the collaboration of our health care provider partners and is no longer available as a community app.

    myGoalNav was not designed to be an inventory of every dementia-related problem that an individual might experience. Rather, the library facilitates the selection of those symptoms that are most meaningful to each participant. For this analysis, we excluded outlier profiles created by individuals who chose >22 symptoms (95th percentile).

    Staging Dementia

    In 2013, we developed an artificial neural network model to stage dementia, which was trained on data from 320 memory clinic patients [42]. That model was updated in 2020 using a support vector machine–supervised learning algorithm trained on 717 patients [44]. Data from these patients were captured with myGoalNav in a memory clinic, a long-term care study [45], and a dementia clinical trial [42]. Patients were staged by a clinician using either the Functional Assessment Staging Test or the Global Deterioration Scale into 1 of 4 stages: MCI or mild, moderate, or severe dementia. Patient age and their symptom profiles served as inputs to train the model to predict the dementia stage. Further details of the model, including algorithm choice and performance, can be found in the study by Shehzad et al [44].

    Statistical Analysis

    User characteristics and demographics were summarized, and the differences between stages were tested. Categorical variables were summarized as percentages of users and tested using the Pearson chi-square test. Continuous variables were summarized as means and SDs or medians (lower and upper quartiles) and tested using the Kruskal–Wallis H test.

    To compare symptom frequency by disease stage (objective 1), we first fit a logistic regression model with the number of profiles selecting each symptom in each stage as the dependent variable. Symptom name, stage, and the interaction between the 2 were included as independent variables. The estimates from this model were transformed to stage-specific symptom frequencies with 95% CIs.

    We investigated the frequency differences between the stages in 2 ways. First, we computed Pearson correlation coefficient r on frequencies between each pair of stages, where a higher r coefficient indicates greater similarity in symptom selection. Second, we quantified the degree to which a symptom was associated with increasing or decreasing disease severity. This was accomplished by modifying our logistic regression model so that the stage is treated as a monotonic predictor variable [46] rather than a categorical variable without ordering. The estimates from this model can be interpreted as the average difference in frequency (on the log-odds scale) between adjacent stages (Supplementary Methods section in Multimedia Appendix 1 [46-49]).

    To compare symptom importance by stage (objective 2), we began by defining relative symptom importance within a symptom profile as the weighted rank or potency:

    wij=rij/nj(1)

    where nj is the number of symptoms in profile j, and rij is the rank (out of nj) given to symptom I. Higher potency wij corresponds to the higher relative importance of symptom i to the user of profile j.

    Next, to model this proportion while accounting for the wide range in the number of tracked symptoms among myGoalNav users, we used logistic regression with wij as the dependent variable; nj as case weights; and categorical independent variables of symptom name, stage, and their interaction. As with the frequency analysis, we estimated pairwise similarity in stages by computing Pearson correlation coefficients between potency estimates.

    To investigate the relationship between symptom frequency and potency (objective 3), we visualized the relationship by plotting frequency against potency estimates. We quantified the strength of these relationships using Pearson correlation.

    No missing data were imputed for this study. As mentioned, we removed outlier profiles with >22 symptoms (95th percentile) but otherwise did not exclude users for missing or abnormal data. All analyses were performed in R version 4.0.2 (R Foundation for Statistical Computing) [50] using tidyverse packages [51].

    Ethics

    Clinic data were collected after having obtained written informed consent. Participants completed a form that allowed their anonymized data to be analyzed for research purposes. Data collection was approved by the research ethics committee of the Nova Scotia Health Authority. myGoalNav users consented to terms of use, which included allowing their data to be aggregated and used for research purposes. Users were assured that the research findings would be presented in a manner that would not disclose personally identifying information.

    Data Availability

    Aggregated data are presented in Table S1 (symptom frequency) and Table S2 (symptom potency) of Multimedia Appendix 1. For confidentiality reasons, user-level data cannot be made publicly available. Access to deidentified data may be provided upon reasonable request.


    The Sample

    To date, 12,347 users have signed up for myGoalNav, and of these, 4213 (34.12%) users created a symptom profile. Of the 4213 users, after removing the profiles tracking >22 symptoms, our final sample size was 3909 (92.78%) profiles, with creation dates ranging from May 15, 2006, to November 15, 2018.

    The great majority, 96.01% (3753/3909), of these symptom profiles were made on the web platform, with 3.99% (156/3909) from the later mobile app. Most profiles (3792/3909, 97.01%) were completed by caregivers, and the remaining (117/3909, 2.99%) were completed by participants (people with cognitive impairment) on their own behalf. The staging algorithm led to the following distribution of severity across the 3909 profiles: 917 (23.46%) MCI, 1596 (40.82%) mild dementia, 514 (13.15%) moderate dementia, and 882 (22.56%) severe dementia.

    Participant characteristics and demographics are summarized by stage in Table 1. With increasing severity from MCI to moderate dementia, participants tended to be older, less well-educated, more likely to identify as women, and less likely to live on their own. A minority of caregivers (1361/3792, 35.89% users) also provided information about themselves. Most caregivers were women (515/802, 64.2%), aged 46-55 years (184/583, 31.6%), and spouses or partners of the participant (156/524, 29.8%).

    Table 1. Baseline characteristics of the myGoalNav participants, stratified by stage (N=3909).
    CharacteristicaTotalMCIb (n=917)Mild (n=1596)Moderate (n=514)Severe (n=882)Test statisticc






    		P valueH test (df)Chi-square (df)
    Age (years; n=2473), mean (SD)75.4 (12.4)70.5 (13.2)74.5 (12.1)80.9 (8.7)78.2 (11.9)<.001192.8 (3)N/Ad
    Gender(n=3909), n (%).046N/A8.0 (3)

    		Man976 (37.7)e228 (40.9)f431 (39)g127 (33.7)h190 (34.7)i



    		Woman1611 (62.3)e329 (59.1)f674 (61)g250 (66.3)h358 (65.3)i


    Number of symptoms (n=2587), median (Q1-Q3)4 (2-7)2 (1-4)5 (3-8)7 (4-11)4 (2-7)<.001669.7 (3)N/A
    Education (n=1337), n (%).18N/A12.7 (9)

    		Secondary school or less625 (46.7)117 (40.8)j283 (45.7)k99 (52.1)l126 (52.3)m



    		Trade school71 (5.3)14 (4.9)j32 (5.2)k9 (4.7)l16 (6.6)m



    		Undergraduate439 (32.8)108 (37.6)j211 (34.1)k53 (27.9)l67 (27.8)m



    		Graduate202 (15.1)48 (16.7)j93 (15)k29 (15.3)l32 (13.3)m


    Living arrangement (n=2013), n (%)<.001N/A126.5 (12)

    		Alone290 (14.4)67 (14.9)n143 (15.8)o35 (12.2)p45 (12.1)q



    		Assisted living315 (15.6)39 (8.7)n102 (11.3)o71 (24.8)p103 (27.8)q



    		With caregiver335 (16.6)59 (13.1)n153 (16.9)o54 (18.9)p69 (18.6)q



    		With family or friend1038 (51.6)283 (62.9)n494 (54.5)o120 (42)p141 (38)q



    		With paid companion35 (1.7)2 (0.4)n14 (1.5)o6 (2.1)p13 (3.5)q


    aN is the number of users with nonmissing values.

    bMCI: mild cognitive impairment.

    cComparisons between stages: Pearson chi-square test and Kruskal–Wallis H test.

    dN/A: not applicable.

    eSample size, n=2587.

    fSample size, n=557.

    gSample size, n=1105.

    hSample size, n=377.

    iSample size, n=548.

    jSample size, n=287.

    kSample size, n=619.

    lSample size, n=190.

    mSample size, n=241.

    nSample size, n=450.

    oSample size, n=906.

    pSample size, n=286.

    qSample size, n=371.

    Symptom Frequency

    Figure 1 depicts the 10 most frequent symptoms in each stage. In MCI, mild dementia, and moderate dementia profiles, the most common symptom was memory of recent events: 33.41% (1306/3909), 36.71% (1435/3909), and 36.99% (1446/3909) of profiles, respectively. This early hallmark of dementia was tracked much less often at the severe stage, where 9.79% (383/3909) of profiles showed it being tracked. Other symptoms were tracked more often with greater severity. For example, sleep disturbance tracking increased from 6.7% (61/917) in MCI profiles to 15.47% (247/1596) in mild dementia profiles and to 25.5% (131/514) in moderate dementia profiles and was the most frequently tracked symptom in the severe dementia profiles (215/882, 24.4%).

    In addition to memory of recent events, MCI profiles were best characterized by repetitive questions or stories; no other symptom had a tracking frequency >20%. Those with mild and moderate dementia profiles showed more variety in symptom selection, with 6 and 8 symptoms >20% frequency, whereas those with severe dementia profiles were slightly more uniform, with 4 symptoms above that mark.

    How frequencies varied is also illustrated by changes in the correlations between pairs of symptoms drawn from adjacent stages (Figure 2). Using this metric, the most similar stages (ie, highest correlation coefficient) were MCI and mild dementia. Indeed, those with MCI and mild dementia profiles shared 80% (8/10) of their most frequent symptoms. To a lesser degree, individuals with moderate dementia profiles had symptom frequencies similar to MCI and mild dementia profiles. There were four symptoms shared among the top 10 of these three stages: attention or concentration, irritability or frustration, memory of recent events, and repetitive questions or stories. By a large margin, severe dementia profiles had the most distinct set of frequent symptoms, although the correlation increased with increasing severity: r=0.14, 0.25, and 0.48 in MCI, mild dementia, and moderate dementia profiles, respectively. The most frequent symptoms in severe dementia profiles were characteristic of loss of independent function (incontinence, mobility, eating, and personal care or hygiene) and more extreme behavioral problems (aggression, low mood, and delusions and paranoia).

    Model-estimated monotonicity of frequency with dementia severity is shown for each symptom in Figure 3. More symptoms exhibited positive monotonicity (36 symptoms with lower 95% CI >0) than negative (7 symptoms with upper 95% CI <0). The 6 symptoms with the highest positive and negative monotonicity are shown on the right in Figure 3.

    Overall frequency and frequency by stage for each symptom are summarized in Table S1 in Multimedia Appendix 1.

    ‎
    Figure 1. The 10 most frequent symptoms tracked by baseline myGoalNav profiles, stratified by stage. Data are presented as point estimates and 95% CIs from the logistic regression model. MCI: mild cognitive impairment.
    View this figure
    ‎
    Figure 2. Pairwise relationships of symptom frequency between stages. Pearson correlation coefficients (r) and lines of best fit (with 95% CIs) are displayed for each pair. MCI: mild cognitive impairment.
    View this figure
    ‎
    Figure 3. Estimated symptom monotonicity, where higher values indicate the increasing frequency with ordered stage. Data are presented as point estimates and 95% CIs from the logistic regression model, with stage as a monotonic predictor (left). Stage-specific frequencies for the 6 symptoms with the highest positive monotonicity and the 6 symptoms with the highest negative monotonicity (right). MCI: mild cognitive impairment.
    View this figure

    Symptom Potency

    As the ranking of symptoms is not compulsory on myGoalNav, the potency analysis involved 2874 symptom profiles (632, 21.99% MCI, 1207, 41.99% mild dementia, 402, 13.98% moderate dementia, and 632, 21.99% severe dementia). The model estimates of the 10 most potent symptoms by stage are shown in Figure 4, and the rest can be found in Table S2 in Multimedia Appendix 1. Of the 2874 symptoms, 2 (0.07%) symptoms stood out as important regardless of stage—travel and looking after grandchildren—which were among the top 3 most potent symptoms in each stage.

    Figure 5 shows the pairwise relationship of symptom potency between stages. The most similar pairs of stages were moderate dementia profiles with mild and severe dementia profiles. The greatest differences in potency were MCI profiles with moderate and severe dementia profiles.

    ‎
    Figure 4. The 10 most potent symptoms tracked by baseline myGoalNav profiles, stratified by stage. Data are presented as point estimates and 95% CIs from the logistic regression model. MCI: mild cognitive impairment.
    View this figure
    ‎
    Figure 5. Pairwise relationships of symptom potency between stages. Pearson correlation coefficients (r) and lines of best fit (with 95% CIs) are displayed for each pair. MCI: mild cognitive impairment.
    View this figure

    Frequency and Potency

    We discovered a clear discrepancy between symptoms that were most frequent (Figure 1) and those that were most potent (Figure 3). Only interest or initiative was both highly frequent (632/2874, 21.99%) and potent (potency 0.65, 95% CI 0.63-0.67) among the mild dementia symptom profiles. Symptom frequency was negatively correlated with potency regardless of severity (Figure 6). The degree of association varied by stage from weakly correlated in MCI profiles (r=−0.18) to moderately correlated in severe dementia profiles (r=−0.59). The patterns (or trajectories) of potency and frequency are visualized for selected symptoms in Figure S1 in Multimedia Appendix 1.

    ‎
    Figure 6. The relationship between symptom frequency and potency, stratified by stage. Pearson correlation coefficients (r) and lines of best fit (with 95% CIs) are displayed for each stage. MCI: mild cognitive impairment.
    View this figure

    Principal Findings

    This study used a machine learning algorithm, which was trained with clinician-staged data, to investigate how symptom tracking in web-based profiles differed by the severity of cognitive impairment (MCI and dementia). Our key finding was the large distinction between what is common and what is most important to people with cognitive impairment and their caregivers. This reinforces the importance of capturing the patients’ and caregivers’ voices when determining clinically meaningful changes in MCI and dementia trials. The fact that we were able to discover associations that were sensible and meaningful suggests that information collected on the web has the potential to yield useful insights into this population. As clinical treatments that focus on single-protein abnormalities understandably exclude people who do not conform to classic profiles consistent with those abnormalities, there is a need for data on real-world experiences of the larger constituency of people in whom dementia reflects a variety of disease processes.

    Symptom tracking frequency was similar across MCI and mild and moderate dementia profiles, with all pairwise correlations between frequencies r>0.5. Memory of recent events and repetitive questions or stories were notably among the top 3 symptoms for all 3 stages. However, neither of these symptoms appeared among the 10 most frequent symptoms in the severe dementia profiles, which differed appreciably from the other stages (all r<0.5). With severe impairment, the early hallmarks of dementia (such as impaired memory) are present but become secondary to more distressing symptoms. In particular, we found that increasing disease severity was most associated with loss of independent function (incontinence, eating, and mobility) and behavioral problems (aggression, restlessness, and hallucinations).

    The most potent (relatively important) symptoms were generally those related to disruptions in everyday life that, although less common, had great meaning when they occurred, for example, problems in looking after grandchildren, hobbies or games, and travel. Declining cognition may be a concern; however, the resulting changes to routine can be especially distressing to affected people and their families. Potency was most similar between stages of similar severity. For instance, the strongest relationships were between the adjacent pairs of MCI–mild dementia, mild-to-moderate dementia, and moderate-to-severe dementia, with all r≥0.6.

    As the large majority of our users (3792/3909, 97.01%) are caregivers, we see it reasonable to conceptualize symptom potency as an indicator of caregiver burden—the more distressing and burdensome symptoms are more likely to be ranked as highly potent by our users. In this context, we see in this study that impairment in instrumental activities of daily living (IADL; higher-order functions such as travel, meal preparation or cooking, shopping, and telephone use) place the most burden on caregivers, relative to basic activities of daily living and cognitive and behavioral symptoms. Our results are aligned with those of previous studies investigating symptoms and caregiving difficulties across the stages of the disease. A survey conducted by Alzheimer Europe [52] asked 1181 caregivers of patients with mild, moderate, or severe dementia about their current and most distressing symptoms. Problems with activities of daily living (including financial activities, shopping, cooking, and telephone use) were the most prevalent (reported by 96% of caregivers) and most problematic (68% of caregivers) symptoms, followed by behavioral symptoms (50%). In a multicenter study of 328 informal caregivers of patients who mostly experienced mild or moderate AD, IADL deficits were associated with more caregiver burden, as measured by the Zarit Burden Interview [53]. A prospective cohort study of 135 patients, ranging from those with MCI (CDR=0.5) to those with severe (CDR=3) dementia, found that depressive state in caregivers was independent of cognitive decline but was strongly associated with a decline in IADLs and delusional behavior [54].

    Across stages, symptom frequency was negatively correlated with potency, and the strength of this relationship generally increased with increasing severity. We believe this pattern reflects the nature of the disease course. Early on, and especially before diagnosis, gradual change in cognitive function will be both apparent and alarming to the person living with the problems and to their caregivers; this likely underlies why the typical symptoms are still fairly potent. As deterioration increases, so does the heterogeneity in its manifestation. The typical clinical presentation becomes the accepted norm (ie, still frequent but less potent), and the impact on quality of life becomes more potent.

    The contrast in symptom frequency and potency also has important implications for the measurement and interpretation of clinically meaningful changes. Outcome measures must be practical to use in that they do not overburden the informant with long interview times [55]. Including several items also has the risk of probing irrelevant information, which can affect an instrument’s sensitivity to change. Striking a balance between robustness and concision is a substantial challenge in outcomes development, especially in dementia, where patient priorities are highly variable, as shown in this study. A number of best practices [56] and statistical techniques [15] exist to tackle this heterogeneity using standardized outcome measures; however, we believe that an individualized approach guided by the patient and caregiver’s priorities for treatment is a simpler solution to a complex problem. By focusing on what matters most, we can guarantee that any changes measured are meaningful.

    Although there are too many symptoms to compare with the literature, we draw attention to a few, such as the following: repetitive questions or stories, sleep disturbance, and interest or initiative. The stage-specific frequencies and potencies of these symptoms are visualized in Figure S1 in Multimedia Appendix 1.

    We have explored the symptom of verbal repetition (here, repetitive questions or stories) in the Atlantic Canada AD Investigation of Expectations trial (open-label trial of donepezil in mild-to-moderate AD) [33] and the Video-Imaging Synthesis of Treating AD trial (randomized controlled trial of galantamine in mild-to-moderate AD) [34]. In both trials, where goal attainment scaling was the primary outcome, reduction of verbal repetition was identified as a goal of treatment in 46% and 44% of patients, respectively. This symptom notably improved more often in patients treated with galantamine than in those treated with a placebo. Our data were consistent with these secondary analyses and with a 2013 analysis of myGoalNav users [39], where verbal repetition was commonly tracked (26% overall), especially in the mild stage (35%). Hwang et al [57] also found verbal repetition to be an early sign of dementia that was troublesome to caregivers. When patients and caregivers are allowed a voice, we see that verbal repetition is important, common, and responsive, although it typically goes unmeasured by standard tests.

    We found the increasing frequency of sleep disturbances with severity to be compelling, especially as it was the most commonly tracked symptom in severe dementia profiles. Similarly, Moe et al [58] found sleep disturbances to increase with disease severity in a sample of 78 AD patients. Sleep disturbances are also important at earlier stages; its prevalence in patients with MCI was estimated to be 14% to 59% in a review of 15 studies [59]. Here, the frequency was 7% in myGoalNav MCI profiles, which is unsurprisingly lower than prevalence estimates but still ranked as the 12th most frequent MCI symptom among 60 symptoms. Growing evidence suggests that sleep disturbances are a risk factor for AD [60,61], which underlines the importance of further study during predementia stages.

    The symptom of interest or initiative describes a patient who is losing interest in everyday life and who has become disengaged from others and the world around them. It is common, distressing for caregivers [62], and a potential risk factor for progression from MCI to dementia [63]. In the Video-Imaging Synthesis of Treating AD trial, decreased initiation was a treatment goal for 71 of the 84 participants with mild-to-moderate AD (out of 130) who were described as having the symptom [64]. Unsurprisingly, it emerged as a noteworthy symptom in our analyses, particularly in mild dementia profiles, where it was among both the 10 most frequent and most potent symptoms. This symptom may also be important for its sensitivity to change. In a survey of caregiver and patient judgment on changes in symptoms, apathy was the neuropsychiatric symptom that improved the most in patients with MCI and AD treated with the nutritional intervention Fortasyn Connect [65].

    With no approved treatment for individuals with prodromal AD, some promise is seen in nonpharmacological interventions, especially those that combine multiple lifestyle modifications such as diet and exercise [66,67]. The Finnish Geriatric Intervention Study to Prevent Cognitive Impairment and Disability study showed that a multimodal intervention combining diet, exercise, cognitive training, and vascular risk monitoring might improve or maintain cognitive functioning among older individuals who are at risk of dementia [68]. Nutritional interventions are also being developed to tackle dietary deficiencies associated with AD pathology. A medical food (Fortasyn Connect) has been shown to improve memory in randomized controlled trials of patients with mild [69,70], but not mild-to-moderate [71], AD over 3 and 6 months of treatment. These trials were followed by the 24-month LipiDiDiet randomized controlled trial for individuals with prodromal AD [72]. There was no significant treatment effect on the neuropsychological test battery primary end point; however, there was evidence of cognitive and functional benefit, as assessed by the secondary CDR–Sum of Boxes end point, and this effect increased with better baseline cognition. In addition, results of the LipiDiDiet 36-month extension trial showed significant treatment effects on multiple measures of cognition, function, and disease progression [73]. Taken together, these studies highlight the potential for early interventions in dementia, notably with lifestyle modification, especially dietary lifestyle. With this comes a need for adequately sensitive outcomes to detect meaningful effects at early stages, for which individualized symptom tracking may be a solution [13].

    Limitations

    Our data must be interpreted with caution as it comprises observer-reported tracking data completed mostly by caregivers of people with dementia, who were not supervised in how they described or recorded the symptoms of the people for whom they were caring. There may have been a selection bias toward caregivers with higher functioning who can more easily locate and operate myGoalNav. Furthermore, as the myGoalNav is not a checklist of symptoms, the tracking frequencies presented here are distinct from symptom prevalence. There are also limitations in the development of the staging algorithm model, such as potential bias in the training data because of clinician facilitation [44].

    Conclusions

    Our results emphasize the importance of patient-centricity in evaluating interventions for MCI and dementia [74-76]. A personalized outcome, for example, of a grandparent being able to travel and look after their grandchild independently, will be more meaningful to the patient and their family compared with a 4-point change on the ADAS-Cog, which is considered as the main criterion for benefit. Asking patients about what is most important is sensitive to change and is inherently clinically meaningful [36,77,78]. This can be especially valuable in the predementia stages, where standard outcomes such as the ADAS-Cog and Mini Mental State Examination lack sensitivity [79,80]. Tools such as myGoalNav Dementia, and individualized outcome measures such as goal attainment scaling [81,82], are pragmatic ways of capturing the patient voice in real-world and clinical trial settings.

    Acknowledgments

    This study was jointly sponsored by Ardea Outcomes and Nutricia. Manuscript writing, study conceptualization, study design, data collection, and data analysis and interpretation were performed by Ardea Outcomes.

    Conflicts of Interest

    KR is the President, Chief Science Officer, and a shareholder of Ardea Outcomes. In the past 3 years, KR has also been a part of an advisory board for Roche and Genetech and has delivered 2 talks sponsored by Nutricia. TD, SEH, JS, AS, and SS are employees of Ardea Outcomes.

    ‎
    Multimedia Appendix 1

    Supplementary methods detailing the logistic regression model of symptom frequency with dementia stage as a monotonic predictor. Table S1 contains all symptom frequencies by stage and Table S2 contains all symptom potencies by stage. Figure S1 depicts the patterns of potency and frequency for selected symptoms.

    DOCX File , 164 KB
    1. Dubois B, Feldman HH, Jacova C, Dekosky ST, Barberger-Gateau P, Cummings J, et al. Research criteria for the diagnosis of Alzheimer's disease: revising the NINCDS-ADRDA criteria. Lancet Neurol 2007 Aug;6(8):734-746. [CrossRef] [Medline]
    2. McKhann GM, Knopman DS, Chertkow H, Hyman BT, Jack CR, Kawas CH, et al. The diagnosis of dementia due to Alzheimer's disease: recommendations from the National Institute on Aging-Alzheimer's Association workgroups on diagnostic guidelines for Alzheimer's disease. Alzheimers Dement 2011 May;7(3):263-269 [FREE Full text] [CrossRef] [Medline]
    3. McKhann G, Drachman D, Folstein M, Katzman R, Price D, Stadlan EM. Clinical diagnosis of Alzheimer's disease: report of the NINCDS-ADRDA Work Group under the auspices of Department of Health and Human Services Task Force on Alzheimer's Disease. Neurology 1984 Jul;34(7):939-944. [CrossRef] [Medline]
    4. Jack CR, Bennett DA, Blennow K, Carrillo MC, Dunn B, Haeberlein SB, Contributors. NIA-AA research framework: toward a biological definition of Alzheimer's disease. Alzheimers Dement 2018 Apr;14(4):535-562 [FREE Full text] [CrossRef] [Medline]
    5. Boyle PA, Yu L, Leurgans SE, Wilson RS, Brookmeyer R, Schneider JA, et al. Attributable risk of Alzheimer's dementia attributed to age-related neuropathologies. Ann Neurol 2019 Jan;85(1):114-124. [CrossRef] [Medline]
    6. Kapasi A, DeCarli C, Schneider JA. Impact of multiple pathologies on the threshold for clinically overt dementia. Acta Neuropathol 2017 Aug;134(2):171-186 [FREE Full text] [CrossRef] [Medline]
    7. Davis DH, Muniz Terrera G, Keage H, Rahkonen T, Oinas M, Matthews FE, et al. Delirium is a strong risk factor for dementia in the oldest-old: a population-based cohort study. Brain 2012 Sep;135(Pt 9):2809-2816 [FREE Full text] [CrossRef] [Medline]
    8. James BD, Wilson RS, Capuano AW, Boyle PA, Shah RC, Lamar M, et al. Hospitalization, Alzheimer's disease and related neuropathologies, and cognitive decline. Ann Neurol 2019 Dec;86(6):844-852 [FREE Full text] [CrossRef] [Medline]
    9. Wallace LM, Theou O, Godin J, Andrew MK, Bennett DA, Rockwood K. Investigation of frailty as a moderator of the relationship between neuropathology and dementia in Alzheimer's disease: a cross-sectional analysis of data from the Rush Memory and Aging Project. Lancet Neurol 2019 Feb;18(2):177-184. [CrossRef] [Medline]
    10. Wallace LM, Theou O, Darvesh S, Bennett DA, Buchman AS, Andrew MK, et al. Neuropathologic burden and the degree of frailty in relation to global cognition and dementia. Neurology 2020 Dec 15;95(24):e3269-e3279 [FREE Full text] [CrossRef] [Medline]
    11. Fratiglioni L, Marseglia A, Dekhtyar S. Ageing without dementia: can stimulating psychosocial and lifestyle experiences make a difference? Lancet Neurol 2020 Jun;19(6):533-543. [CrossRef] [Medline]
    12. Rockwood K, Fay S, Gorman M. The ADAS-cog and clinically meaningful change in the VISTA clinical trial of galantamine for Alzheimer's disease. Int J Geriatr Psychiatry 2010 Feb;25(2):191-201. [CrossRef] [Medline]
    13. Rockwood K, Howlett SE, Hoffman D, Schindler R, Mitnitski A. Clinical meaningfulness of Alzheimer's Disease Assessment Scale-Cognitive subscale change in relation to goal attainment in patients on cholinesterase inhibitors. Alzheimers Dement 2017 Oct;13(10):1098-1106. [CrossRef] [Medline]
    14. Sabbagh MN, Hendrix S, Harrison JE. FDA position statement "early Alzheimer's disease: developing drugs for treatment, guidance for industry". Alzheimers Dement (N Y) 2019;5:13-19 [FREE Full text] [CrossRef] [Medline]
    15. Posner H, Curiel R, Edgar C, Hendrix S, Liu E, Loewenstein DA, et al. Outcomes assessment in clinical trials of Alzheimer's disease and its precursors: readying for short-term and long-term clinical trial needs. Innov Clin Neurosci 2017;14(1-2):22-29 [FREE Full text] [Medline]
    16. Alzheimer’s disease: developing drugs for treatment guidance for industy. U.S. Department of Health and Human Services, Food and Drug Administration. 2018.   URL: https:/​/www.​fda.gov/​regulatory-information/​search-fda-guidance-documents/​alzheimers-disease-developing-drugs-treatment-guidance-industy [accessed 2022-01-11]
    17. Hughes CP, Berg L, Danziger WL, Coben LA, Martin RL. A new clinical scale for the staging of dementia. Br J Psychiatry 1982 Jun;140:566-572. [CrossRef] [Medline]
    18. Morris JC. The Clinical Dementia Rating (CDR): current version and scoring rules. Neurology 1993 Nov;43(11):2412-2414. [CrossRef] [Medline]
    19. Sperling RA, Aisen PS, Beckett LA, Bennett DA, Craft S, Fagan AM, et al. Toward defining the preclinical stages of Alzheimer's disease: recommendations from the National Institute on Aging-Alzheimer's Association workgroups on diagnostic guidelines for Alzheimer's disease. Alzheimers Dement 2011 May;7(3):280-292 [FREE Full text] [CrossRef] [Medline]
    20. Kozauer N, Katz R. Regulatory innovation and drug development for early-stage Alzheimer's disease. N Engl J Med 2013 Mar 28;368(13):1169-1171. [CrossRef] [Medline]
    21. Brys M, Pirraglia E, Rich K, Rolstad S, Mosconi L, Switalski R, et al. Prediction and longitudinal study of CSF biomarkers in mild cognitive impairment. Neurobiol Aging 2009 May;30(5):682-690 [FREE Full text] [CrossRef] [Medline]
    22. Fox NC, Black RS, Gilman S, Rossor MN, Griffith SG, Jenkins L, AN1792(QS-21)-201 Study. Effects of Abeta immunization (AN1792) on MRI measures of cerebral volume in Alzheimer disease. Neurology 2005 May 10;64(9):1563-1572. [CrossRef] [Medline]
    23. Rinne JO, Brooks DJ, Rossor MN, Fox NC, Bullock R, Klunk WE, et al. 11C-PiB PET assessment of change in fibrillar amyloid-beta load in patients with Alzheimer's disease treated with bapineuzumab: a phase 2, double-blind, placebo-controlled, ascending-dose study. Lancet Neurol 2010 Apr;9(4):363-372. [CrossRef] [Medline]
    24. Salloway S, Sperling R, Keren R, Porsteinsson AP, van Dyck CH, Tariot PN, ELND005-AD201 Investigators. A phase 2 randomized trial of ELND005, scyllo-inositol, in mild to moderate Alzheimer disease. Neurology 2011 Sep 27;77(13):1253-1262 [FREE Full text] [CrossRef] [Medline]
    25. Dubois B, Villain N, Frisoni GB, Rabinovici GD, Sabbagh M, Cappa S, et al. Clinical diagnosis of Alzheimer's disease: recommendations of the International Working Group. Lancet Neurol 2021 Jun;20(6):484-496. [CrossRef] [Medline]
    26. Bartlett SJ, Barnes T, McIvor RA. Integrating patients into meaningful real-world research. Ann Am Thorac Soc 2014 Feb;11 Suppl 2:S112-S117. [CrossRef] [Medline]
    27. Roadmap to patient-focused outcome measurement in clinical trials. U.S. Food and Drug Administration. 2015.   URL: https://www.fda.gov/media/87004/download [accessed 2022-01-11]
    28. Morel T, Cano SJ. Measuring what matters to rare disease patients - reflections on the work by the IRDiRC taskforce on patient-centered outcome measures. Orphanet J Rare Dis 2017 Nov 02;12(1):171 [FREE Full text] [CrossRef] [Medline]
    29. Rockwood K, Graham JE, Fay S, ACADIE Investigators. Goal setting and attainment in Alzheimer's disease patients treated with donepezil. J Neurol Neurosurg Psychiatry 2002 Nov;73(5):500-507 [FREE Full text] [CrossRef] [Medline]
    30. Rockwood K, Fay S, Song X, MacKnight C, Gorman M, Video-Imaging Synthesis of Treating Alzheimer's Disease (VISTA) Investigators. Attainment of treatment goals by people with Alzheimer's disease receiving galantamine: a randomized controlled trial. CMAJ 2006 Apr 11;174(8):1099-1105 [FREE Full text] [CrossRef] [Medline]
    31. Kiresuk TJ, Sherman RE. Goal attainment scaling: a general method for evaluating comprehensive community mental health programs. Community Ment Health J 1968 Dec;4(6):443-453. [CrossRef] [Medline]
    32. Bouwens SF, van Heugten CM, Verhey FR. Review of goal attainment scaling as a useful outcome measure in psychogeriatric patients with cognitive disorders. Dement Geriatr Cogn Disord 2008;26(6):528-540 [FREE Full text] [CrossRef] [Medline]
    33. Asp E, Cloutier F, Fay S, Cook C, Robertson ML, Fisk J, et al. Verbal repetition in patients with Alzheimer's disease who receive donepezil. Int J Geriatr Psychiatry 2006 May;21(5):426-431. [CrossRef] [Medline]
    34. Rockwood K, Fay S, Jarrett P, Asp E. Effect of galantamine on verbal repetition in AD: a secondary analysis of the VISTA trial. Neurology 2007 Apr 03;68(14):1116-1121. [CrossRef] [Medline]
    35. Albert MS, DeKosky ST, Dickson D, Dubois B, Feldman HH, Fox NC, et al. The diagnosis of mild cognitive impairment due to Alzheimer's disease: recommendations from the National Institute on Aging-Alzheimer's Association workgroups on diagnostic guidelines for Alzheimer's disease. Alzheimers Dement 2011 May;7(3):270-279 [FREE Full text] [CrossRef] [Medline]
    36. Rockwood K. An individualized approach to tracking and treating Alzheimer's disease. Clin Pharmacol Ther 2010 Oct;88(4):446-449. [CrossRef] [Medline]
    37. Rockwood K, Zeng A, Leibman C, Mucha L, Mitnitski A. Validation of an informant-reported web-based data collection to assess dementia symptoms. J Med Internet Res 2012 Mar 12;14(2):e42 [FREE Full text] [CrossRef] [Medline]
    38. Rockwood K, Mitnitski A, Richard M, Kurth M, Kesslak P, Abushakra S. Neuropsychiatric symptom clusters targeted for treatment at earlier versus later stages of dementia. Int J Geriatr Psychiatry 2015 Apr;30(4):357-367. [CrossRef] [Medline]
    39. Reeve E, Molin P, Hui A, Rockwood K. Exploration of verbal repetition in people with dementia using an online symptom-tracking tool. Int Psychogeriatr 2017 Jun;29(6):959-966 [FREE Full text] [CrossRef] [Medline]
    40. McGarrigle L, Howlett SE, Wong H, Stanley J, Rockwood K. Characterizing the symptom of misplacing objects in people with dementia: findings from an online tracking tool. Int Psychogeriatr 2019 Nov;31(11):1635-1641. [CrossRef] [Medline]
    41. Rockwood K, Stanley J, Dunn T, Howlett S. PIH2 development and validation of a patient centered outcome measure for use in dementia drug trials. Value Health 2019 May;22:S183. [CrossRef]
    42. Rockwood K, Richard M, Leibman C, Mucha L, Mitnitski A. Staging dementia from symptom profiles on a care partner website. J Med Internet Res 2013 Aug 07;15(8):e145 [FREE Full text] [CrossRef] [Medline]
    43. The Delphi Method: Techniques and Applications. Boston: Addison-Wesley; 1975.
    44. Shehzad A, Rockwood K, Stanley J, Dunn T, Howlett SE. Use of patient-reported symptoms from an online symptom tracking tool for dementia severity staging: development and validation of a machine learning approach. J Med Internet Res 2020 Nov 11;22(11):e20840 [FREE Full text] [CrossRef] [Medline]
    45. Rockwood JK, Richard M, Garden K, Hominick K, Mitnitski A, Rockwood K. Precipitating and predisposing events and symptoms for admission to assisted living or nursing home care. Can Geriatr J 2014 Mar;17(1):16-21 [FREE Full text] [CrossRef] [Medline]
    46. Bürkner PC, Charpentier E. Modelling monotonic effects of ordinal predictors in Bayesian regression models. Br J Math Stat Psychol 2020 Nov;73(3):420-451. [CrossRef] [Medline]
    47. Bürkner P. brms: an R Package for Bayesian multilevel models using Stan. J Stat Softw 2017;80(1):1-28 [FREE Full text] [CrossRef]
    48. Bürkner P. Advanced Bayesian multilevel modeling with the R Package brms. R J 2018;10(1):395-411 [FREE Full text] [CrossRef]
    49. Carpenter B, Gelman A, Hoffman M, Lee D, Goodrich B, Betancourt M, et al. Stan: a probabilistic programming language. J Stat Softw 2017;76(1):1-32 [FREE Full text] [CrossRef]
    50. R: a language and environment for statistical computing. R Foundation for Statistical Computing. 2018.   URL: https://www.gbif.org/tool/81287/r-a-language-and-environment-for-statistical-computing [accessed 2022-01-11]
    51. Wickham H, Averick M, Bryan J, Chang W, McGowan L, François R, et al. Welcome to the Tidyverse. J Open Sci Softw 2019 Nov;4(43):1686. [CrossRef]
    52. Georges J, Jansen S, Jackson J, Meyrieux A, Sadowska A, Selmes M. Alzheimer's disease in real life--the dementia carer's survey. Int J Geriatr Psychiatry 2008 May;23(5):546-551. [CrossRef] [Medline]
    53. Tsai C, Hwang W, Lee J, Wang W, Huang L, Huang L, et al. Predictors of caregiver burden in aged caregivers of demented older patients. BMC Geriatr 2021 Jan 14;21(1):59 [FREE Full text] [CrossRef] [Medline]
    54. Hasegawa N, Hashimoto M, Koyama A, Ishikawa T, Yatabe Y, Honda K, et al. Patient-related factors associated with depressive state in caregivers of patients with dementia at home. J Am Med Dir Assoc 2014 May;15(5):371.e15-371.e18. [CrossRef] [Medline]
    55. Sheehan B. Assessment scales in dementia. Ther Adv Neurol Disord 2012 Nov;5(6):349-358 [FREE Full text] [CrossRef] [Medline]
    56. Boateng GO, Neilands TB, Frongillo EA, Melgar-Quiñonez HR, Young SL. Best practices for developing and validating scales for health, social, and behavioral research: a primer. Front Public Health 2018;6:149 [FREE Full text] [CrossRef] [Medline]
    57. Hwang JP, Tsai SJ, Yang CH, Liu KM, Lirng JF. Repetitive phenomena in dementia. Int J Psychiatry Med 2000;30(2):165-171. [CrossRef] [Medline]
    58. Moe KE, Vitiello MV, Larsen LH, Prinz PN. Symposium: cognitive processes and sleep disturbances: sleep/wake patterns in Alzheimer's disease: relationships with cognition and function. J Sleep Res 1995 Mar;4(1):15-20 [FREE Full text] [CrossRef] [Medline]
    59. Beaulieu-Bonneau S, Hudon C. Sleep disturbances in older adults with mild cognitive impairment. Int Psychogeriatr 2009 Aug;21(4):654-666. [CrossRef] [Medline]
    60. Shi L, Chen S, Ma M, Bao Y, Han Y, Wang Y, et al. Sleep disturbances increase the risk of dementia: a systematic review and meta-analysis. Sleep Med Rev 2018 Aug;40:4-16. [CrossRef] [Medline]
    61. Minakawa EN, Wada K, Nagai Y. Sleep disturbance as a potential modifiable risk factor for Alzheimer's disease. Int J Mol Sci 2019 Feb 13;20(4):803 [FREE Full text] [CrossRef] [Medline]
    62. Bianchetti A, Trabucchi M. Behavioural and psychological symptoms of dementia: clinical aspects. Neurosci Res Commun 2005 Nov;35(3):173-183. [CrossRef]
    63. Vicini Chilovi B, Conti M, Zanetti M, Mazzù I, Rozzini L, Padovani A. Differential impact of apathy and depression in the development of dementia in mild cognitive impairment patients. Dement Geriatr Cogn Disord 2009;27(4):390-398. [CrossRef] [Medline]
    64. Cook C, Fay S, Rockwood K. Decreased initiation of usual activities in people with mild-to-moderate Alzheimer's disease: a descriptive analysis from the VISTA clinical trial. Int Psychogeriatr 2008 Oct;20(5):952-963. [CrossRef] [Medline]
    65. Bianchetti A, Perotta D, Cravello L, Ranieri P, Trabucchi M. Effectiveness of a specific nutritional supplement on cognitive, behavioral and functional symptoms in mild cognitive impairment and Alzheimer's dementia: caregivers judgments. Results of an observational survey. J Gerontol Geriatrics 2018;66(2):74 [FREE Full text]
    66. Kivipelto M, Mangialasche F, Ngandu T. Lifestyle interventions to prevent cognitive impairment, dementia and Alzheimer disease. Nat Rev Neurol 2018 Nov;14(11):653-666. [CrossRef] [Medline]
    67. Livingston G, Sommerlad A, Orgeta V, Costafreda SG, Huntley J, Ames D, et al. Dementia prevention, intervention, and care. Lancet 2017 Dec 16;390(10113):2673-2734. [CrossRef] [Medline]
    68. Ngandu T, Lehtisalo J, Solomon A, Levälahti E, Ahtiluoto S, Antikainen R, et al. A 2 year multidomain intervention of diet, exercise, cognitive training, and vascular risk monitoring versus control to prevent cognitive decline in at-risk elderly people (FINGER): a randomised controlled trial. Lancet 2015 Jun 06;385(9984):2255-2263. [CrossRef] [Medline]
    69. Scheltens P, Kamphuis PJ, Verhey FR, Olde Rikkert MG, Wurtman RJ, Wilkinson D, et al. Efficacy of a medical food in mild Alzheimer's disease: a randomized, controlled trial. Alzheimers Dement 2010 Jan;6(1):1-10.e1. [CrossRef] [Medline]
    70. Scheltens P, Twisk JW, Blesa R, Scarpini E, von Arnim CA, Bongers A, et al. Efficacy of Souvenaid in mild Alzheimer's disease: results from a randomized, controlled trial. J Alzheimers Dis 2012;31(1):225-236. [CrossRef] [Medline]
    71. Shah RC, Kamphuis PJ, Leurgans S, Swinkels SH, Sadowsky CH, Bongers A, et al. The S-Connect study: results from a randomized, controlled trial of Souvenaid in mild-to-moderate Alzheimer's disease. Alzheimers Res Ther 2013;5(6):59 [FREE Full text] [CrossRef] [Medline]
    72. Soininen H, Solomon A, Visser PJ, Hendrix SB, Blennow K, Kivipelto M, LipiDiDiet clinical study group. 24-month intervention with a specific multinutrient in people with prodromal Alzheimer's disease (LipiDiDiet): a randomised, double-blind, controlled trial. Lancet Neurol 2017 Dec;16(12):965-975 [FREE Full text] [CrossRef] [Medline]
    73. Soininen H, Solomon A, Visser PJ, Hendrix SB, Blennow K, Kivipelto M, LipiDiDiet clinical study group. 36-month LipiDiDiet multinutrient clinical trial in prodromal Alzheimer's disease. Alzheimers Dement 2021 Jan;17(1):29-40 [FREE Full text] [CrossRef] [Medline]
    74. Reuben DB, Tinetti ME. Goal-oriented patient care--an alternative health outcomes paradigm. N Engl J Med 2012 Mar 01;366(9):777-779. [CrossRef] [Medline]
    75. Frank LB. Commentary on "Health economics and the value of therapy in Alzheimer's disease." Report from the Alzheimer's Association Research Roundtable on patient-reported outcomes and dementia research. Alzheimers Dement 2007 Jul;3(3):162-165. [CrossRef] [Medline]
    76. Forsythe L, Heckert A, Margolis MK, Schrandt S, Frank L. Methods and impact of engagement in research, from theory to practice and back again: early findings from the Patient-Centered Outcomes Research Institute. Qual Life Res 2018 Jan;27(1):17-31 [FREE Full text] [CrossRef] [Medline]
    77. Rockwood K, MacKnight C. Assessing the clinical importance of statistically significant improvement in anti-dementia drug trials. Neuroepidemiology 2001 May;20(2):51-56. [CrossRef] [Medline]
    78. Shabbir SH, Sanders AE. Clinical significance in dementia research: a review of the literature. Am J Alzheimers Dis Other Demen 2014 Sep;29(6):492-497 [FREE Full text] [CrossRef] [Medline]
    79. Spering CC, Hobson V, Lucas JA, Menon CV, Hall JR, O'Bryant SE. Diagnostic accuracy of the MMSE in detecting probable and possible Alzheimer's disease in ethnically diverse highly educated individuals: an analysis of the NACC database. J Gerontol A Biol Sci Med Sci 2012 Aug;67(8):890-896 [FREE Full text] [CrossRef] [Medline]
    80. Raghavan N, Samtani MN, Farnum M, Yang E, Novak G, Grundman M, Alzheimer’s Disease Neuroimaging Initiative. The ADAS-Cog revisited: novel composite scales based on ADAS-Cog to improve efficiency in MCI and early AD trials. Alzheimers Dement 2013 Feb;9(1 Suppl):S21-S31 [FREE Full text] [CrossRef] [Medline]
    81. Jennings LA, Ramirez KD, Hays RD, Wenger NS, Reuben DB. Personalized goal attainment in dementia care: measuring what persons with dementia and their caregivers want. J Am Geriatr Soc 2018 Nov;66(11):2120-2127 [FREE Full text] [CrossRef] [Medline]
    82. Jennings LA, Palimaru A, Corona MG, Cagigas XE, Ramirez KD, Zhao T, et al. Patient and caregiver goals for dementia care. Qual Life Res 2017 Mar;26(3):685-693 [FREE Full text] [CrossRef] [Medline]

    ‎
    AD: Alzheimer disease
    ADAS-Cog: Alzheimer Disease Assessment Scale–Cognitive subscale
    CDR: Clinical Dementia Rating
    IADL: instrumental activities of daily living
    MCI: mild cognitive impairment

    Edited by A Mavragani; submitted 08.04.21; peer-reviewed by L McGarrigle, C Kerssens, P Harvey; comments to author 28.06.21; revised version received 13.08.21; accepted 02.12.21; published 27.01.22

    Copyright

    ©Taylor Dunn, Susan E Howlett, Sanja Stanojevic, Aaqib Shehzad, Justin Stanley, Kenneth Rockwood. Originally published in the Journal of Medical Internet Research (https://www.jmir.org), 27.01.2022.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on https://www.jmir.org/, as well as this copyright and license information must be included.