This paper is in the following e-collection/theme issue:

Research Instruments, Questionnaires, and Tools (576) Dementia and Cognitive Decline (481) Diagnostic Tools in Mental Health (242)

Published on in Vol 22, No 12 (2020): December

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/17332, first published .
Electronic Cognitive Screen Technology for Screening Older Adults With Dementia and Mild Cognitive Impairment in a Community Setting: Development and Validation Study

Electronic Cognitive Screen Technology for Screening Older Adults With Dementia and Mild Cognitive Impairment in a Community Setting: Development and Validation Study

Electronic Cognitive Screen Technology for Screening Older Adults With Dementia and Mild Cognitive Impairment in a Community Setting: Development and Validation Study

Authors of this article:

Joyce Y C Chan1 Author Orcid Image ;   Adrian Wong1, 2 Author Orcid Image ;   Brian Yiu1 Author Orcid Image ;   Hazel Mok1 Author Orcid Image ;   Patti Lam3 Author Orcid Image ;   Pauline Kwan1 Author Orcid Image ;   Amany Chan3 Author Orcid Image ;   Vincent C T Mok1, 2, 4 Author Orcid Image ;   Kelvin K F Tsoi5 Author Orcid Image ;   Timothy C Y Kwok1, 2, 3 Author Orcid Image
Article Authors Cited by (17) Tweetations (4) Metrics

    Original Paper

    1Department of Medicine and Therapeutics, The Chinese University of Hong Kong, Hong Kong, Hong Kong

    2Therese Pei Fong Chow Research Centre for Prevention of Dementia, The Chinese University of Hong Kong, Hong Kong, Hong Kong

    3Jockey Club Centre for Osteoporosis Care and Control, The Chinese University of Hong Kong, Hong Kong, Hong Kong

    4Gerald Choa Neuroscience Centre, Lui Che Woo Institute of Innovative Medicine, The Chinese University of Hong Kong, Hong Kong, Hong Kong

    5Jockey Club School of Public Health and Primary Care, The Chinese University of Hong Kong, Hong Kong, Hong Kong

    *all authors contributed equally

    Corresponding Author:

    Timothy C Y Kwok, MD

    Department of Medicine and Therapeutics

    The Chinese University of Hong Kong

    9/F., Lui Che Woo Clinical Sciences Building, Prince of Wales Hospital

    30-32 Ngan Shing St, Shatin, N.T.

    Hong Kong, 852

    Hong Kong

    Phone: 852 3505 3145

    Email: tkwok@cuhk.edu.hk


    Related ArticleThis is a corrected version. See correction statement in: https://www.jmir.org/2021/1/e26724/

    Background: A digital cognitive test can be a useful and quick tool for the screening of cognitive impairment. Previous studies have shown that the diagnostic performance of digital cognitive tests is comparable with that of conventional paper-and-pencil tests. However, the use of commercially available digital cognitive tests is not common in Hong Kong, which may be due to the high cost of the tests and the language barrier. Thus, we developed a brief and user-friendly digital cognitive test called the Electronic Cognitive Screen (EC-Screen) for the detection of mild cognitive impairment (MCI) and dementia of older adults.

    Objective: The aim of this study was to evaluate the performance of the EC-Screen for the detection of MCI and dementia in older adults.

    Methods: The EC-Screen is a brief digital cognitive test that has been adapted from the Rapid Cognitive Screen test. The EC-Screen uses a cloud-based platform and runs on a tablet. Participants with MCI, dementia, and cognitively healthy controls were recruited from research clinics and the community. The outcomes were the performance of the EC-Screen in distinguishing participants with MCI and dementia from controls, and in distinguishing participants with dementia from those with MCI and controls. The cohort was randomly split into derivation and validation cohorts based on the participants’ disease group. In the derivation cohort, the regression-derived score of the EC-Screen was calculated using binomial logistic regression. Two predictive models were produced. The first model was used to distinguish participants with MCI and dementia from controls, and the second model was used to distinguish participants with dementia from those with MCI and controls. Receiver operating characteristic curves were constructed and the areas under the curves (AUCs) were calculated. The performances of the two predictive models were tested using the validation cohorts. The relationship between the EC-Screen and paper-and-pencil Montreal Cognitive Assessment-Hong Kong version (HK-MoCA) was evaluated by the Pearson correlation coefficient.

    Results: A total of 126 controls, 54 participants with MCI, and 63 participants with dementia were included in the study. In differentiating participants with MCI and dementia from controls, the AUC of the EC-Screen in the derivation and validation cohorts was 0.87 and 0.84, respectively. The optimal sensitivity and specificity in the derivation cohorts were 0.81 and 0.80, respectively. In differentiating participants with dementia from those with MCI and controls, the AUC of the derivation and validation cohorts was 0.90 and 0.88, respectively. The optimal sensitivity and specificity in the derivation cohort were 0.83 and 0.83, respectively. There was a significant correlation between the EC-Screen and HK-MoCA (r=–0.67, P<.001).

    Conclusions: The EC-Screen is suggested to be a promising tool for the detection of MCI and dementia. This test can be self-administered or assisted by a nonprofessional staff or family member. Therefore, the EC-Screen can be a useful tool for case finding in primary health care and community settings.

    J Med Internet Res 2020;22(12):e17332

    doi:10.2196/17332

    Keywords

    EC-Screen; cognitive screening; dementia; mild cognitive impairment 


    Dementia is a global challenge due to the aging population. The prevalence of dementia in older adults ranges from 5% to 7%, and the prevalence of mild cognitive impairment (MCI) ranges from 10% to 20% [1-3]. There are almost 10 million new cases of dementia diagnosed every year worldwide [4]. Studies have shown that early treatment and intervention can help to slow down cognitive decline in older adults [5-7]. The use of a cognitive screening test can facilitate early diagnosis, which in turn helps older adults with dementia and their families to work out a short-term coping and long-term care plan so that they can receive proper dementia-related care, advice, and support in a timely manner, and can live in the community. Improved community support can help to delay or reduce reliance on high-cost residential care services [8].

    Paper-and-pencil cognitive screening tests such as the Montreal Cognitive Assessment (MoCA) are commonly used for the detection of cognitive impairment [9]. Although the utility of paper-and-pencil cognitive tests is generally good [10,11], most of these tests must be administered by professional staff, which increases the waiting time for patients and also risks introducing rater biases in test administration and scoring. Moreover, the calculation of the cutoff scores in paper-and-pencil cognitive tests cannot take behavioral data such as response time into account. Furthermore, “practice effects” occur with repeated applications, which could undermine the usefulness of the tests for measuring either the treatment response or the monitoring of disease progression [12,13]. In addition, older adults may not be motivated to seek out or undergo cognitive assessment with health care professionals, or they may have difficulties in accessing health care services. Indeed, a meta-analysis reported a high rate of undetected dementia, especially in China and India [14]. Therefore, it is important to find a way to help family members and health care professionals decide whether it is necessary to seek professional assessment by detecting early signs of cognitive impairment in the older people in their lives or in their care.

    Recent studies have proposed the use of digital cognitive tests to overcome some of the above-mentioned barriers, as digital cognitive tests provide automatic, standardized administration procedures, including presentation of the stimulus, scoring, and performance classification [15-18]. Digital cognitive tests can be self-administered or used with minimal assistance by family members or nonprofessional staff, which can significantly increase access to cognitive screening in the general community. Furthermore, digital cognitive tests allow for accurate measurement of participants’ response time, which is known to be affected at an early stage in cognitive disorders [19]. A previous study showed that the diagnostic performance of digital cognitive tests is comparable with that of traditional paper-and-pencil tests [20]. Therefore, digital cognitive tests may play a helpful role as a preliminary screen in the workflow of cognitive assessment; those who show deficits may then undergo further assessment by professionals, thus facilitating better health care resource utilization. However, despite the availability of some commercial digital cognitive tests, their use is not common in Hong Kong, which may be due to the high cost of the tests and language barrier. Therefore, there is a need to develop a brief, user-friendly, and inexpensive digital cognitive test.

    To fill this gap, we developed a brief digital cognitive test called the Electronic Cognitive Screen (EC-Screen) using a cloud-based platform that runs on a tablet. The EC-Screen is adapted from the Rapid Cognitive Screen (RCS), which is a short and well-validated paper-and-pencil cognitive test [21]. We aim to promote the use of the EC-Screen in primary health care and community settings in Hong Kong, such as in general practitioner clinics and community elder centers. The objective of this study was to evaluate the validity and performance of the EC-Screen for the detection of MCI and dementia in older adults.


    Recruitment of Participants

    This study was approved by the clinical research ethics committee of the Chinese University of Hong Kong (CUHK). Participants were recruited from research clinics of the Geriatrics and Neurology divisions of the CUHK, and from a community elderly center, namely the Jockey Club Center for Positive Aging in Hong Kong. The recruitment period was from March to November 2019. The inclusion criteria of the participants were aged ≥55 years, able to communicate in the Chinese language, and adequate perceptual-motor ability so as to be able to participate in cognitive testing. The exclusion criteria were people with uncontrolled psychiatric illnesses and participants who selected the illiterate version. This is because the answer time in the illiterate version is longer than that of the standard version, and therefore we excluded this version for the analysis to enable effective comparison.

    Participants with MCI and dementia were consecutive patients from the Geriatrics and Neurology divisions of the CUHK. All of the participants with a diagnosis of MCI and dementia were assessed by a geriatrician. The diagnostic criterion of MCI was based on the Petersen criterion [22], and the diagnostic criterion of dementia was based on the International Classification of Diseases version 10 [23]. The healthy controls were recruited from the Jockey Club Center for Positive Aging and the Division of Neurology of the CUHK. The controls underwent neuropsychological assessment and the Hong Kong version of the MoCA (HK-MoCA) [9,24], and were assessed as cognitively healthy. A purposive sampling method was used [25]. All of the participants provided informed consent through the EC-Screen platform on a designated page that was designed to obtain consent, and the participants also signed a written consent form agreeing to participate in the research.

    EC-Screen

    The EC-Screen was developed by the Department of Medicine and Therapeutics and the Division of Neurology of the CUHK. A local software company assisted with software development. The platform reads out all of the questions and then prompts the participant to select the answer on the touchscreen. Modifications of the test instructions were made for any illiterate participant by providing the option for the questions and possible responses to be read out by the software. For participants who are able to read, the platform only reads out the questions and the response choices are shown on the screen. The administration time of the EC-Screen is approximately 5 minutes.

    The EC-Screen is composed of two parts. The first part collects the participant’s personal information and the second part is the digital cognitive test. In the personal information part, participants are required to enter their year of birth, gender, education level, and area of residence. In the digital cognitive test part, the participants are required to answer three subtests, including a clock-setting test, story test, and 5-word delayed recognition test. The clock-setting test assesses executive functions and visuospatial abilities, the story test assesses mental flexibility, and the 5-word delayed recognition test assesses memory function. The digital cognitive test part of the EC-Screen was adapted from the RCS [21]. The Chinese Cantonese translation of the RCS was provided by Saint Louis University (St. Louis, MO, USA). The Chinese translation of the test items and the content validity were reviewed by a team of experienced experts, including a geriatrician (TK) and a clinical psychologist (AW). A comparison between RCS and EC-Screen is shown in Multimedia Appendix 1.

    In brief, the flow of the digital cognitive test part of the EC-Screen is as follows: At the beginning of the test, the participant is required to learn 5 two-syllable words that are read out by the platform. The participant is then required to answer the clock-setting test in which a clock is presented on the screen and the participant is required to set the clock hands to a specified time. After the clock-setting test, the participant is required to answer the story test, which is a story-based fact conversion test. The platform reads a short story and the participant is required to remember the details of the story and appropriately identify the fact that a well-known landmark belongs to a certain region in Hong Kong. After the story test, the participant is required to answer the 5-word delayed recognition test. A total of 12 two-syllable words containing 5 target words and 7 distractors are presented on the screen, and the participant is asked to indicate which 5 words are the target word that he/she learned at the beginning of the test.

    The flow of the EC-Screen is shown in Multimedia Appendix 2 and associated screenshots are shown in Figure 1. The total score of the delayed recognition test is 5, and the scoring of the clock-setting test and story test is simply dichotomized as correct or incorrect. The measurement of the time score in each subtest is focused on the interval between the end of the presentation of the instructions and the completion of the task.

    ‎
    Figure 1. Screenshots of EC-Screen.
    View this figure

    Comparison Test

    The HK-MoCA was used as a comparison test. The HK-MoCA is a well-validated multidomain paper-and-pencil cognitive test that assesses visuospatial and executive functions, naming, memory, attention, abstraction, and orientation [9,24]. The maximum total score of the HK-MoCA is 30 and the administration time is approximately 10 to 15 minutes. The EC-Screen and HK-MoCA were administrated by trained research assistants. Both tests were conducted on the same day in the research clinic or elderly center. The assessors were not blind to the participants’ clinical diagnosis during the implementation of the tests because the participants were patients in the clinics. However, since the administration of the EC-Screen is given automatically by the system, the results obtained with the EC-Screen are not affected by this lack of blinding.

    Outcomes

    The outcomes were the performance of the EC-Screen in distinguishing the participants with MCI and dementia from controls and in distinguishing the participants with dementia from those with MCI and controls.

    Sample Size Calculation

    Based on the estimated prevalence rates of dementia and MCI at 8.9% and 8.5%, respectively [26], with a power of 0.8, a type I error of 0.05, and an expected sensitivity and specificity of 0.80 each, it was determined that a minimal overall sample size of 108 was required in the derivation cohort [27].

    Statistical Analysis

    The cohort was randomly split into derivation and validation cohorts (6:4) according to the participants’ disease group (ie, control, MCI, and dementia). In the derivation cohort, multivariable binary logistic regression analysis was performed to test the association between the individual scores and the time spent on each subtest. A list of variables was identified and preliminarily tested using the general linear model. Raw scores and the time spent on each subtest were selected for further testing in the regression model. The scores and time spent on the subtests were standardized to a z-score for analysis. Receiver operating characteristic (ROC) curves were constructed to examine the ability of the predicted probability derived from the optimal logistic regression model with the scores and time spent on the subtests of the EC-Screen used as the explanatory variables. Two predictive models were produced. The first predictive model was used to distinguish participants with MCI and dementia from controls, and the second predictive model was used to distinguish participants with dementia from those with MCI and controls. The areas under the ROC curves (AUCs) were calculated with a 95% CI. A cut-off point was derived at an optimal balance of sensitivity and specificity. The performances of the two predictive models were then tested using the validation cohort. Concurrent validity was evaluated based on the Pearson correlation coefficient between the predicted probability score of the EC-Screen and the total score of the HK-MoCA. A P value ≤.05 was regarded as statistically significant. Statistical analyses were conducted using R with the readxl, pROC, and ggpubr packages.


    Characteristics of Participants

    A total of 283 participants were recruited for this study. However, data of 18 participants, including 6 controls, 5 with MCI, and 7 with dementia, failed to upload to the database platform due to technical problems. In addition, 22 participants, including 1 control, 9 with MCI, and 12 with dementia, used the illiterate version, and were therefore excluded from the analysis. As a result, the screening results of 243 participants, including 126 controls, 54 participants with MCI, and 63 participants with dementia, were analyzed (Figure 2). The participants were randomly split into the derivation cohort and validation cohort. The characteristics of the participants are shown in Table 1. There were no significant differences in age, gender, educational level, and HK-MoCA score between the derivation and validation cohorts.

    ‎
    Figure 2. Flow diagram of participants.
    View this figure
    Table 1. Characteristics of the participants.
    CharacteristicDerivation cohortValidation cohort

    		Control (n=75)MCIa (n=37)Dementia (n=33)Control (n=51)MCI (n=17)Dementia (n=30)
    Mean age (years), mean (SD)70.2 (8.1)76.1 (6.3)78.6 (7.1)70.0 (9.3)78.4 (7.6)79.8 (7.5)
    Females, n (%)60 (80)19 (51)26 (79)40 (78)12 (71)20 (67)
    Education level, n (%)






    		Primary level or below29 (39)18 (49)18 (55)13 (25)12 (71)23 (77)

    		Secondary level or above46 (61)19 (51)15 (45)38 (75)5 (29)7 (23)
    HK-MoCAb score, mean (SD)24.4 (3.3)20.1 (3.7)12.2 (6.4)23.9 (3.9)19.7 (4.4)13.8 (5.1)
    Z-score of EC-Screenc subtests, mean (SD)






    		Clock-setting test1.24 (1.5)1.22 (1.5)0.73 (1.3)1.41 (1.5)0.88 (1.4)1.40 (1.5)

    		Delayed recognition test3.52 (1.4)2.97 (1.3)1.45 (1.2)3.67 (1.4)2.59 (1.5)1.43 (1.5)

    		Story test1.08 (1.5)0.81 (1.4)0.55 (1.2)1.18 (1.5)1.59 (1.5)0.90 (1.4)
    Time spent on EC-Screen subtests (seconds), mean (SD)






    		Clock-setting test31.7 (13.9)39.6 (16.8)68.4 (51.3)31.6 (12.4)49.4 (27.6)67.5 (42.0)

    		Delayed recognition test28.0 (12.4)36.3 (15.7)43.8 (24.2)30.3 (14.9)48.2 (26.2)55.6 (34.0)

    		Story test75.3 (11.9)75.8 (18.3)89.1 (23.4)73.7 (10.2)84.7 (13.7)87.6 (24.3)

    aMCI: mild cognitive impairment.

    bHK-MoCA: Hong Kong version of Montreal Cognitive Assessment.

    cEC-Screen: Electronic Cognitive Screen.

    Validation Results

    Predictive Model for Distinguishing Participants With MCI and Dementia From Controls

    A predicted probability score for having MCI and dementia derived from the EC-Screen was obtained by taking the raw score of the 5-word delayed recognition test and the clock-setting test, as well as the time spent in the 5-word delayed recognition test and clock-setting test into the following regression formula (see Multimedia Appendix 3 for the regression coefficients):

    logit (p) = –1.015 – 0.08 (clock score) – 0.68 (delayed recognition score) + 0.03 (clock time) + 0.05 (delayed recognition time)

    In differentiating participants with MCI and dementia from controls, the AUCs of the EC-Screen in the derivation and validation cohort were high (Table 2). The optimal sensitivity and specificity in derivation cohort were 0.81 and 0.80, respectively, with the cut-off point of the predicted probability score identified as ≥0.43. The sensitivity and specificity in the validation cohort were equivalent but slightly lower. The ROC curves in the derivation cohort and the validation cohort did not show overfitting of the model (Figure 3).

    Table 2. Results of diagnostic performance of the EC-Screen–derived regression.
    Regression modelAUCa (95% CI)Cut-off valueSensitivitySpecificity
    Detect MCIb + dementia from controls




    		Derivation cohort0.87 (0.81-0.93)0.430.810.80

    		Validation cohort0.84 (0.76-0.92)0.430.790.78
    Detect dementia from MCI + controls




    		Derivation cohort0.90 (0.84-0.95)0.220.830.83

    		Validation cohort0.88 (0.81-0.96)0.220.820.76

    aAUC: area under the curve.

    bMCI: mild cognitive impairment.

    ‎
    Figure 3. Receiver operating characteristic (ROC) curves of EC-Screen for discriminating among participants with mild cognitive impairment and dementia.
    View this figure
    Predictive Model for Distinguishing Dementia Participants from MCI Participants and Controls

    A predicted probability score for having dementia derived from the EC-Screen was obtained by taking the raw score of the 5-word delayed recognition test, the clock-setting test, and the story test, as well as the time spent in the 5-word delayed recognition test and clock-setting test into the following regression formula (see Multimedia Appendix 3 for regression coefficients):

    logit (p) = –1.05 – 0.26 (clock score) – 0.15 (story score) – 0.87 (delayed recognition score) + 0.02 (clock time) + 0.03 (delayed recognition time)

    In differentiating dementia participants from MCI participants and controls, the AUCs of the EC-Screen of the derivation and validation cohorts were high (Table 2). The optimal sensitivity and specificity in the derivation cohort were 0.83 and 0.83, respectively, with the cut-off point of the predicted probability score identified as ≥0.22. The sensitivity and specificity of the validation cohort were equivalent, but slightly lower (Table 2). The ROC curves in the derivation cohort and the validation cohort did not show overfitting of the model (Figure 4).

    ‎
    Figure 4. Receiver operating characteristic (ROC) curves of EC-Screen for discriminating among participants with dementia from those with mild cognitive impairment and controls in the derivation and validation cohorts.
    View this figure

    Concurrent Validity

    There was a significant correlation between the predicted probability score of the EC-Screen–derived regression and the total score of the HK-MoCA (r=–0.67, P<.001) (Figure 5).

    ‎
    Figure 5. Scatterplot showing the relationship between the predicted probability of EC-Screen–derived regression and the Hong Kong version of the Montreal Cognitive Assessment (HK-MoCA).
    View this figure

    Administration Process

    The average administration time of the EC-Screen was 4.5 minutes. In the qualitative report from users, some of the participants could complete the test by themselves and some of them required assistance from a helper to use the tablet. Therefore, the EC-Screen can be self-administered or assisted by a nonprofessional staff or family member.


    Principal Findings

    This study shows that the EC-Screen has good criteria and concurrent validity to identify older adults with MCI and dementia. It is brief and only requires 5 minutes to administer. The automatic administration and scoring algorithm can ease the workload of professional and health care staff. The EC-Screen is a promising tool to use in community centers and primary health care clinics, and thus older adults at risk can receive cognitive screening promptly in the community.

    Digital methods allow for capturing response times accurately, which are not easy to capture with paper-and-pencil tests. Participants with MCI and dementia require a longer time in the clock-setting test, which might reflect problems in processing speed and executive functions. The traditional method of the clock-drawing test requires more precise fine motor control, especially when drawing on a tablet. In contrast, the clock-setting test requires less fine motor control and is thus easier for older adults, which minimizes the confounding effects of physical constraints and poor motor dexterity. The diagnostic performance of the clock-setting test was slightly better than that determined for the clock-drawing test in a pilot study [28]. Therefore, the digital clock-setting test was used in the EC-Screen. We used a digital delayed recognition test instead of a traditional method of the delayed free recall test because current voice recognition technology is not yet able to automatically understand a stranger’s voice correctly. Therefore, the digital version of the delayed recognition test was considered to be more practical for use in community settings than the digital version of the delayed free recall test. Delayed recognition tests are commonly used for cognitive screening. Previous studies have shown that the diagnostic performance of the digital version of delayed recognition tests effectively detected both MCI and dementia [20,29]. Both the raw score and time spent in the 5-word delayed recognition test were statistically significant in the regression model, indicating that problems in memory retrieval and processing efficiency are important markers of cognitive disorders. Impairment of delayed memory recognition could reflect problems in encoding, consolidation, or storage, which together comprise a cardinal feature of Alzheimer disease. Therefore, performance on delayed recognition may serve as a more sensitive marker than delayed free recall for identifying patients with early cognitive decline at risk for progression to Alzheimer disease [30]. The question of the story test is not the exact content of the story and requires the participant to convert a fact that a landmark belongs to a given district. Therefore, the story test can assess the mental ability to switch between two concepts.

    Some older adults may be aware of their memory decline, and some family members may worry about their parents or grandparents with potential signs of cognitive decline; thus, the EC-Screen can help them to decide whether it is necessary to seek medical and professional advice. Older adults can obtain the cognitive screening assessment from community centers or elderly centers. Therefore, the EC-Screen can promote timely assessment for older adults at risk in the community.

    A digital cognitive test can capture behavioral data accurately. Some studies found that drawing time or drawing process can be a predictive factor for cognitive impairment [31,32]. In the last decade, some multidomain digital cognitive tests have been investigated, including Brain on Track [13] and Computerized Cognitive Screen [33]. These digital cognitive tests assess memory, attention, processing speed, and executive functions, and the administration time is around 20 to 25 minutes. The AUC of Brain on Track for the detection of MCI was 0.86 and the AUC of the Computerized Cognitive Screen for the detection of MCI and dementia was 0.78. There are some commercially available computerized cognitive test batteries such as the Computer assessment for Mild Cognitive Impairment (CAMCI) [34] and CNS Vital Signs [35]. However, the administration time of these tests is longer (>20 minutes) and the costs are rather high. The EC-Screen showed comparable diagnostic performance with a simpler design. Further evaluation of the EC-Screen in a larger cohort of older people recruited from various sources in the community is ongoing.

    Previous studies have reported that the performance on cognitive tests such as the MoCA is affected by education [36-38]. Such education effects are more obvious in Asian countries, as elderly people in these countries are generally less educated [36,38]. The EC-Screen has an adapted version with illiterate options for administration of the test. Twenty-two participants chose the illiterate version in this study. The design of the illiterate version is tailor-made for participants with a very low education level. However, the administration time of this version is longer than that of the standard version, and therefore we excluded the participants who used the illiterate version from this analysis. We are currently planning to separately analyze the participants who took the illiterate version when a larger sample is obtained.

    Limitations

    There were some limitations to this study. First, the sample size was small, and therefore EC-Screen results showing that it can discriminate among dementia, MCI, and controls need to be confirmed in a larger study. Second, the test/retest reliability was not investigated in this study and needs to be examined in the future.

    Conclusions

    The EC-Screen is suggested to be a promising tool for the detection of MCI and dementia. The EC-Screen is brief and can be self-administered or assisted by a nonprofessional staff or family member. Therefore, it can be a useful tool for case finding in primary health care and community settings.

    Acknowledgments

    We thank Professor JE Morley, Saint Louis University School of Medicine, USA, for having agreed to let us adapt his Rapid Cognitive Screen test into EC-Screen for older Chinese people. We are also grateful for the funding support from the Hong Kong Jockey Club Charities trust, and for the support of the Jockey Club Centre for Positive Ageing for its contribution in design and data collection. We appreciate the support from Mindvivid Limited in software development of EC-Screen. We also thank Ms. Anthea Ng, research assistant of the Division of Neurology at The Chinese University of Hong Kong, for her help in data collection and entry.

    Conflicts of Interest

    None declared.

    ‎
    Multimedia Appendix 1

    Comparison of Rapid Cognitive Screen and EC-Screen.

    DOCX File , 18 KB
    ‎
    Multimedia Appendix 2

    Description of the flow of EC-Screen.

    DOCX File , 23 KB
    ‎
    Multimedia Appendix 3

    Regression coefficients of the regression models.

    DOCX File , 24 KB
    1. Prince M, Bryce R, Albanese E, Wimo A, Ribeiro W, Ferri CP. The global prevalence of dementia: a systematic review and metaanalysis. Alzheimers Dement 2013 Jan;9(1):63-75. [CrossRef] [Medline]
    2. Petersen RC. Mild Cognitive Impairment. N Engl J Med 2011 Jun 09;364(23):2227-2234. [CrossRef]
    3. Langa KM, Levine DA. The diagnosis and management of mild cognitive impairment: a clinical review. JAMA 2014 Dec 17;312(23):2551-2561 [FREE Full text] [CrossRef] [Medline]
    4. Dementia. World Health Organization. 2019 Sep 19.   URL: https://www.who.int/news-room/fact-sheets/detail/dementia [accessed 2020-07-02]
    5. Hill NTM, Mowszowski L, Naismith SL, Chadwick VL, Valenzuela M, Lampit A. Computerized Cognitive Training in Older Adults With Mild Cognitive Impairment or Dementia: A Systematic Review and Meta-Analysis. Am J Psychiatry 2017 Apr 01;174(4):329-340. [CrossRef] [Medline]
    6. Karssemeijer EGA, Aaronson JA, Bossers WJ, Smits T, Olde Rikkert MGM, Kessels RPC. Positive effects of combined cognitive and physical exercise training on cognitive function in older adults with mild cognitive impairment or dementia: A meta-analysis. Ageing Res Rev 2017 Nov;40:75-83. [CrossRef] [Medline]
    7. Guitar NA, Connelly DM, Nagamatsu LS, Orange JB, Muir-Hunter SW. The effects of physical exercise on executive function in community-dwelling older adults living with Alzheimer's-type dementia: A systematic review. Ageing Res Rev 2018 Nov;47:159-167. [CrossRef] [Medline]
    8. Prince M, Bryce R, Ferri C. The benefits of early diagnosis and intervention. Alzheimer's Disease International World Alzheimer Report. 2011.   URL: https://www.alz.co.uk/research/world-report-2011 [accessed 2020-04-18]
    9. Nasreddine Z, Phillips N, Bédirian V, Charbonneau S, Whitehead V, Collin I, et al. The Montreal Cognitive Assessment, MoCA: a brief screening tool for mild cognitive impairment. J Am Geriatr Soc 2005 Apr;53(4):695-699. [CrossRef] [Medline]
    10. Tsoi KKF, Chan JYC, Hirai HW, Wong A, Mok VCT, Lam LCW, et al. Recall Tests Are Effective to Detect Mild Cognitive Impairment: A Systematic Review and Meta-analysis of 108 Diagnostic Studies. J Am Med Dir Assoc 2017 Sep 01;18(9):807. [CrossRef] [Medline]
    11. Tsoi KKF, Chan JYC, Hirai HW, Wong SYS, Kwok TCY. Cognitive Tests to Detect Dementia: A Systematic Review and Meta-analysis. JAMA Intern Med 2015 Sep;175(9):1450-1458. [CrossRef] [Medline]
    12. Sternin A, Burns A, Owen AM. Thirty-Five Years of Computerized Cognitive Assessment of Aging-Where Are We Now? Diagnostics (Basel) 2019 Sep 06;9(3):114 [FREE Full text] [CrossRef] [Medline]
    13. Ruano L, Severo M, Sousa A, Ruano C, Branco M, Barreto R, et al. Tracking Cognitive Performance in the General Population and in Patients with Mild Cognitive Impairment with a Self-Applied Computerized Test (Brain on Track). J Alzheimers Dis 2019;71(2):541-548. [CrossRef] [Medline]
    14. Lang L, Clifford A, Wei L, Zhang D, Leung D, Augustine G, et al. Prevalence and determinants of undetected dementia in the community: a systematic literature review and a meta-analysis. BMJ Open 2017 Feb 03;7(2):e011146 [FREE Full text] [CrossRef] [Medline]
    15. Wild K, Howieson D, Webbe F, Seelye A, Kaye J. Status of computerized cognitive testing in aging: a systematic review. Alzheimers Dement 2008 Nov;4(6):428-437 [FREE Full text] [CrossRef] [Medline]
    16. Tierney MC, Lermer MA. Computerized cognitive assessment in primary care to identify patients with suspected cognitive impairment. J Alzheimers Dis 2010;20(3):823-832. [CrossRef] [Medline]
    17. Zygouris S, Tsolaki M. Computerized cognitive testing for older adults: a review. Am J Alzheimers Dis Other Demen 2015 Feb;30(1):13-28 [FREE Full text] [CrossRef] [Medline]
    18. de Oliveira MO, Brucki SMD. Computerized Neurocognitive Test (CNT) in mild cognitive impairment and Alzheimer's disease. Dement Neuropsychol 2014;8(2):112-116 [FREE Full text] [CrossRef] [Medline]
    19. Müller S, Preische O, Heymann P, Elbing U, Laske C. Increased Diagnostic Accuracy of Digital vs. Conventional Clock Drawing Test for Discrimination of Patients in the Early Course of Alzheimer's Disease from Cognitively Healthy Individuals. Front Aging Neurosci 2017;9:101. [CrossRef] [Medline]
    20. Chan JYC, Kwong JSW, Wong A, Kwok TCY, Tsoi KKF. Comparison of Computerized and Paper-and-Pencil Memory Tests in Detection of Mild Cognitive Impairment and Dementia: A Systematic Review and Meta-analysis of Diagnostic Studies. J Am Med Dir Assoc 2018 Sep;19(9):748-756. [CrossRef] [Medline]
    21. Malmstrom TK, Voss VB, Cruz-Oliver DM, Cummings-Vaughn LA, Tumosa N, Grossberg GT, et al. The Rapid Cognitive Screen (RCS): A Point-of-Care Screening for Dementia and Mild Cognitive Impairment. J Nutr Health Aging 2015 Aug;19(7):741-744. [CrossRef] [Medline]
    22. Petersen RC, Smith GE, Waring SC, Ivnik RJ, Tangalos EG, Kokmen E. Mild cognitive impairment: clinical characterization and outcome. Arch Neurol 1999 Mar 01;56(3):303-308. [CrossRef] [Medline]
    23. World Health Organization. The ICD-10 Classification of Mental and Behavioural Disorders: Diagnostic Criteria for Research. Geneva: WHO; 1993.   URL: https://www.who.int/classifications/icd/en/GRNBOOK.pdf [accessed 2020-04-18]
    24. Wong A, Xiong YY, Kwan PWL, Chan AYY, Lam WWM, Wang K, et al. The validity, reliability and clinical utility of the Hong Kong Montreal Cognitive Assessment (HK-MoCA) in patients with cerebral small vessel disease. Dement Geriatr Cogn Disord 2009;28(1):81-87. [CrossRef] [Medline]
    25. Timmins F. Nursing Research Generating and Assessing Evidence for Nursing Practice. Nurse Educ Pract 2013 Nov;13(6):e29. [CrossRef]
    26. Lam LCW, Tam CWC, Lui VWC, Chan WC, Chan SSM, Wong S, et al. Prevalence of very mild and mild dementia in community-dwelling older Chinese people in Hong Kong. Int Psychogeriatr 2008 Feb;20(1):135-148. [CrossRef] [Medline]
    27. Flahault A, Cadilhac M, Thomas G. Sample size calculation should be performed for design accuracy in diagnostic test studies. J Clin Epidemiol 2005 Aug;58(8):859-862. [CrossRef] [Medline]
    28. Chan J, Wong A, Tsoi K, Kwok T. Development of Electronic Cognitive Screen for Screening of People with Cognitive Impairment. A pilot validation study. 2019 May 29 Presented at: International Symposium on Digital Health; May 29, 2019; Hong Kong SAR.
    29. Kingsbury R, Pachana NA, Humphreys M, Tehan G, Byrne GJ. Utility of a Computerised Cognitive Screen in MCI and Depression in an Older Population. Austral J Rehab Couns 2015 Oct 15;16(1):14-26. [CrossRef]
    30. De Simone MS, Perri R, Fadda L, Caltagirone C, Carlesimo GA. Predicting progression to Alzheimer's disease in subjects with amnestic mild cognitive impairment using performance on recall and recognition tests. J Neurol 2019 Jan;266(1):102-111. [CrossRef] [Medline]
    31. Tsoi KK, Leung NW, Lam MW. P2-184: An Automated Electronic Rating System for the Overlapped Pentagons in Dementia Screening Tests. Alzheimers Dement 2016 Jul 01;12(7S_Part_14):P687-P688. [CrossRef]
    32. Robens S, Heymann P, Gienger R, Hett A, Müller S, Laske C, et al. The Digital Tree Drawing Test for Screening of Early Dementia: An Explorative Study Comparing Healthy Controls, Patients with Mild Cognitive Impairment, and Patients with Early Dementia of the Alzheimer Type. J Alzheimers Dis 2019;68(4):1561-1574. [CrossRef] [Medline]
    33. Wong A, Fong C, Mok VC, Leung K, Tong RK. Computerized Cognitive Screen (CoCoSc): A Self-Administered Computerized Test for Screening for Cognitive Impairment in Community Social Centers. J Alzheimers Dis 2017;59(4):1299-1306. [CrossRef] [Medline]
    34. Saxton J, Morrow L, Eschman A, Archer G, Luther J, Zuccolotto A. Computer assessment of mild cognitive impairment. Postgrad Med 2009 Mar 13;121(2):177-185 [FREE Full text] [CrossRef] [Medline]
    35. Gualtieri CT, Johnson LG. Neurocognitive testing supports a broader concept of mild cognitive impairment. Am J Alzheimers Dis Other Demen 2005;20(6):359-366 [FREE Full text] [CrossRef] [Medline]
    36. Lee J, Lee DW, Cho S, Na DL, Jeon HJ, Kim S, et al. Brief screening for mild cognitive impairment in elderly outpatient clinic: validation of the Korean version of the Montreal Cognitive Assessment. J Geriatr Psychiatry Neurol 2008 Jun;21(2):104-110. [CrossRef] [Medline]
    37. Pinto TCC, Machado L, Bulgacov TM, Rodrigues-Júnior AL, Costa MLG, Ximenes RCC, et al. Influence of Age and Education on the Performance of Elderly in the Brazilian Version of the Montreal Cognitive Assessment Battery. Dement Geriatr Cogn Disord 2018;45(5-6):290-299. [CrossRef] [Medline]
    38. Wong A, Law LSN, Liu W, Wang Z, Lo ESK, Lau A, et al. Montreal Cognitive Assessment: One Cutoff Never Fits All. Stroke 2015 Dec;46(12):3547-3550. [CrossRef] [Medline]

    ‎
    AUC: area under the curve
    CUHK: Chinese University of Hong Kong
    EC-Screen: Electronic Cognitive Screen
    HK-MoCA: Hong Kong version of the Montreal Cognitive Assessment
    MCI: mild cognitive impairment
    MoCA: Montreal Cognitive Assessment
    RCS: Rapid Cognitive Screen
    ROC: receiver operating characteristic

    Edited by G Eysenbach; submitted 07.12.19; peer-reviewed by E Siegmund-Schultze, MDG Pimentel, K Baudin, D Scharre; comments to author 30.03.20; revised version received 21.07.20; accepted 31.10.20; published 18.12.20

    Copyright

    ©Joyce Y C Chan, Adrian Wong, Brian Yiu, Hazel Mok, Patti Lam, Pauline Kwan, Amany Chan, Vincent C T Mok, Kelvin K F Tsoi, Timothy C Y Kwok. Originally published in the Journal of Medical Internet Research (http://www.jmir.org), 18.12.2020.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on http://www.jmir.org/, as well as this copyright and license information must be included.