This paper is in the following e-collection/theme issue:

Extended Reality, Virtual Reality and Virtual Worlds (508) Virtual Reality Interventions in Mental Health (109) Methods and New Tools in Mental Health Research (424) Dementia and Cognitive Decline (419) Cognitive Training for the Elderly (82) Evaluation of XR and Spatial Computing (21)

Published on in Vol 23, No 5 (2021): May

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/24526, first published .
Effect of Cognitive Training in Fully Immersive Virtual Reality on Visuospatial Function and Frontal-Occipital Functional Connectivity in Predementia: Randomized Controlled Trial

Effect of Cognitive Training in Fully Immersive Virtual Reality on Visuospatial Function and Frontal-Occipital Functional Connectivity in Predementia: Randomized Controlled Trial

Effect of Cognitive Training in Fully Immersive Virtual Reality on Visuospatial Function and Frontal-Occipital Functional Connectivity in Predementia: Randomized Controlled Trial

Authors of this article:

Jae Myeong Kang1, 2 Author Orcid Image ;   Nambeom Kim3 Author Orcid Image ;   Sook Young Lee1 Author Orcid Image ;   Soo Kyun Woo1 Author Orcid Image ;   Geumjin Park1 Author Orcid Image ;   Byeong Kil Yeon4 Author Orcid Image ;   Jung Woon Park5 Author Orcid Image ;   Jung-Hae Youn6 Author Orcid Image ;   Seung-Ho Ryu7 Author Orcid Image ;   Jun-Young Lee8 Author Orcid Image ;   Seong-Jin Cho1 Author Orcid Image
Article Authors Cited by (39) Tweetations (10) Metrics

    Original Paper

    1Department of Psychiatry, Gil Medical Center, Gachon University College of Medicine, Incheon, Republic of Korea

    2Brain Health Center, Gil Medical Center, Incheon, Republic of Korea

    3Biomedical Engineering Research Center, Gachon University, Incheon, Republic of Korea

    4Department of Psychiatry, Gyeonggi Provincial Medical Center Suwon Hospital, Suwon, Republic of Korea

    5Department of Game Engineering and IT Convergence Engineering, Graduate School of Gachon University, Seongnam, Republic of Korea

    6Department of Counseling Psychology, Cha University, Seongnam, Republic of Korea

    7Department of Psychiatry, School of Medicine, Konkuk University Medical Center, Konkuk University, Seoul, Republic of Korea

    8Department of Psychiatry, SMG-SNU Boramae Medical Center, Seoul National University College of Medicine, Seoul, Republic of Korea

    Corresponding Author:

    Seong-Jin Cho, MD, PhD

    Department of Psychiatry

    Gil Medical Center

    Gachon University College of Medicine

    21, 774-gil

    Namdong-daero, Namdong-gu

    Incheon, 21565

    Republic of Korea

    Phone: 82 32 460 8420

    Email: sjcho@gilhospital.com


    Background: Cognitive training can potentially prevent cognitive decline. However, the results of recent studies using semi-immersive virtual reality (VR)-assisted cognitive training are inconsistent.

    Objective: We aimed to examine the hypothesis that cognitive training using fully immersive VR, which may facilitate visuospatial processes, could improve visuospatial functioning, comprehensive neuropsychological functioning, psychiatric symptoms, and functional connectivity in the visual brain network in predementia.

    Methods: Participants over 60 years old with subjective cognitive decline or mild cognitive impairment from a memory clinic were randomly allocated to the VR (n=23) or the control (n=18) group. The VR group participants received multidomain and neuropsychologist-assisted cognitive training in a fully immersive VR environment twice a week for 1 month. The control group participants did not undergo any additional intervention except for their usual therapy such as pharmacotherapy. Participants of both groups were evaluated for cognitive function using face-to-face comprehensive neuropsychological tests, including the Rey-Osterrieth Complex Figure Test (RCFT) copy task; for psychiatric symptoms such as depression, apathy, affect, and quality of life; as well as resting-state functional magnetic resonance imaging (rsfMRI) at baseline and after training. Repeated-measures analysis of variance was used to compare the effect of cognitive training between groups. Seed-to-voxel–based analyses were used to identify the cognitive improvement–related functional connectivity in the visual network of the brain.

    Results: After VR cognitive training, significant improvement was found in the total score (F1,39=14.69, P=.001) and basic components score of the RCFT copy task (F1,39=9.27, P=.005) compared with those of the control group. The VR group also showed improvements, albeit not significant, in naming ability (F1,39=3.55, P=.07), verbal memory delayed recall (F1,39=3.03, P=.09), and phonemic fluency (F1,39=3.08, P=.09). Improvements in psychiatric symptoms such as apathy (F1,39=7.02, P=.01), affect (F1,39=14.40, P=.001 for positive affect; F1,39=4.23, P=.047 for negative affect), and quality of life (F1,39=4.49, P=.04) were found in the VR group compared to the control group. Improvement in the RCFT copy task was associated with a frontal-occipital functional connectivity increase revealed by rsfMRI in the VR group compared to the control group.

    Conclusions: Fully immersive VR cognitive training had positive effects on the visuospatial function, apathy, affect, quality of life, and increased frontal-occipital functional connectivity in older people in a predementia state. Future trials using VR cognitive training with larger sample sizes and more sophisticated designs over a longer duration may reveal greater improvements in cognition, psychiatric symptoms, and brain functional connectivity.

    Trial Registration: Clinical Research Information Service KCT0005243; https://tinyurl.com/2a4kfasa

    J Med Internet Res 2021;23(5):e24526

    doi:10.2196/24526

    Keywords

    virtual reality; cognitive training; visuospatial function; fMRI; visual network; mild cognitive impairment 


    Dementia is a major neurodegenerative disorder, affecting approximately 10% of older people [1]. Cognitive, psychological, and behavioral deterioration are typical manifestations of dementia, ultimately resulting in functional impairments and disability [2]. The individual and societal burden of dementia is accelerating rapidly compared to other diseases [1,3]; however, due to the unclear mechanisms and multifactorial pathology underlying the development and progression of dementia, only symptomatic treatments are currently available [4].

    To date, many researchers have suggested that prevention is crucial, and have identified risk and protective factors associated with dementia, as well as preventive strategies [5]. According to a recent large study, one-third of Alzheimer disease (AD) cases are attributable to potentially modifiable risk factors such as educational attainment, vascular factors, and depression [6]. Additionally, lifelong exposure to cognitively and mentally engaging activities has been shown to protect against cognitive decline [7], and performance of cognitively stimulating activities in advanced age was associated with better cognitive function [8]. Accordingly, recent cognitive training studies have shown that repeated practice of exercises to restore brain and cognitive reserves resulted in small to moderate positive improvements in cognition in patients with mild to moderate dementia [9].

    Advances in computer sciences and information and communication technology (ICT) have resulted in increased availability and accessibility of computerized cognitive training. Although conclusive results have yet to be found, preliminary studies have reported improvements in trained and nontrained cognition, and enhanced brain activity in related regions after computerized cognitive training in individuals with mild cognitive impairment (MCI) [10-12]. Working memory training was effective in improving verbal memory and hippocampal activation in patients with MCI [11], and exposure to a driving video game resulted in increased ability to control the vehicle that was related to midline frontal theta power in older people [12]. Moreover, emerging ICT applications using virtual reality (VR) have resulted in evolutions in health care, including cognitive and behavioral therapy [13]. VR can offer interventions in flexible and real world–like environments, facilitating visuospatial function through learning and transference outcomes [14], highlighting a role for cognitive training in a virtual environment in basic research and clinical practice. Owing to the lack of knowledge and dearth of experiments on VR-based cognitive training, especially the fully immersive type [15,16], further studies are needed to ascertain its potential therapeutic efficacy.

    Recently, the number of neuroimaging studies attempting to reveal the underlying neural mechanisms associated with cognitive decline has increased [17,18]. Functional connectivity studies using resting-state functional magnetic resonance imaging (rsfMRI) have identified networks temporally coinciding with spatially distant neurophysiological events that are intrinsically coherent during a resting state such as the default-mode network [19]. We considered that functional connectivity studies using rsfMRI may be able to reveal the neural mechanism, especially in the visual network, responsible for the observed cognitive improvements following VR cognitive training, as such training is based on the cognitive reserve hypothesis associated with functional neural networks [20].

    To test this hypothesis, we performed a preliminary randomized controlled trial to determine the efficacy and mechanisms of VR cognitive training in a predementia state. We aimed to ascertain the effects of VR multidomain cognitive training on visuospatial function, comprehensive neuropsychological function, and psychiatric symptoms in predementia. Moreover, we examined the hypothesis that cognitive improvement could be related to increased functional connectivity in the visual network of the brain.


    Participants

    Participants over 60 years old in a predementia state (ranging from subjective cognitive decline to MCI) were prospectively recruited between May and December 2019 from the memory clinic of Gachon University Gil Medical Center, Republic of Korea. Among 58 individuals who were assessed for eligibility using structured clinical interviews and brain MRI, four participants were excluded due to cerebral infarction on MRI (n=2), severe white matter hyperintensity on MRI (n=1), and history of a recent dental implant surgery (n=1). Nine participants voluntarily withdrew from the study due to an acute medical condition (n=2), hospitalization of a family member (n=1), scheduling conflict (n=1), and unknown personal reasons (n=5). Finally, a total of 45 participants were randomly assigned to either the VR group or the control group.

    All participants had subjective cognitive complaints, including memory decline, but did not meet the criteria for diagnosis of a major neurocognitive disorder based on the Diagnostic and Statistical Manual of Mental Disorders (5th edition) [2]. Participants were classified as having subjective cognitive decline according to the corresponding research criteria and five cognitive domain scores such as attention, language, visuospatial, memory, and frontal executive functions above –1.5 SD [21,22]. Participants were classified as having MCI according to the Petersen criteria [23]. Screening evaluation of the participants was performed by a board-certified psychiatrist (JK) and a clinical neuropsychologist (SL).

    The exclusion criteria for the participants were as follows: (i) Korean version of Mini-Mental State Examination (MMSE) score <20; (ii) impaired activities of daily living; (iii) comorbidity of severe medical or surgical conditions; (iv) major psychiatric disorders; (v) history of any kind of dementia; (vi) history of neurodegenerative disorders, including Creutzfeldt-Jakob disease, Pick disease, Huntington disease, Parkinson disease, inflammation associated with HIV, and syphilis; (vii) structural abnormalities on MRI such as intracranial hemorrhage, cerebral, cerebellar, or brainstem infarction, hydrocephalus, traumatic brain injury, severe white matter hyperintensity, tumors, multiple sclerosis, or vasculitis; and (viii) inability to use the VR system.

    Information on study objectives, group allocation, cognitive intervention, brief study protocol, risks and benefits, and confidentiality was given to all participants before enrollment. All participants provided offline written informed consent, and the Institutional Review Board of Gachon University Gil Medical Center approved this study (GCIRB2018-396).

    Study Design

    This was an open-label, randomized controlled trial (KCT0005243) that aimed to investigate the efficacy of a fully immersive VR cognitive training program on visuospatial function in older people with risk for dementia (Multimedia Appendix 1). Participants were randomly assigned to either the VR or the control group. The unblinded randomization was performed by drawing lots with the participants present. Participants in both groups were evaluated for visuospatial function, comprehensive neuropsychological function, and psychiatric symptoms, and underwent rsfMRI before and after the 1-month cognitive training. The participants in the VR group underwent VR cognitive training twice a week for a total of eight sessions in addition to their usual therapy such as pharmacotherapy for the prevention of dementia (eg, choline alfoscerate and cholinesterase inhibitor); the participants in the control group did not undergo any additional intervention except for their usual therapy such as pharmacotherapy.

    VR Cognitive Training

    The multidomain VR cognitive training program was developed between November 2018 and April 2019 by the authors who are board-certified geriatric neuropsychiatrists and clinical neuropsychologists with expertise. The VR cognitive training program consisted of multiple games involving multidomain cognitive tasks to assess: (i) attention (to find differences), (ii) executive function and memory (to select items needed to perform certain tasks), (iii) working memory and ability to perform mathematical calculations (to prepare an exact amount of money), (iv) visuospatial orientation (to find a path using a memorized map), (v) visuospatial function (to spatially place furniture exactly based on a memorized drawing), (vi) verbal memory (to remember certain words), (vii) visual memory (to remember specific flags and symbols), and (viii) processing speed and working memory (to catch animals in a certain order). All virtual environments were fully immersive 3D settings allowing for feelings of increased presence and visuospatial stimulation; training was accompanied by game elements to increase the interest and motivation of the participants. Representative images of the VR training program are presented in Multimedia Appendix 2.

    Each session lasted approximately 20-30 minutes. The VR training took place using a head-mounted Oculus Rift CV1 display, with Oculus Touch controllers held in both of the participant’s hands. Each training session was performed with the participant in a seated position, and the difficulty level increased throughout the study period from easy to difficult (levels 1-4), with two sessions at each difficulty level. All procedures were performed in the memory clinic of Gachon University Gil Medical Center and were guided by a certified clinical neuropsychologist (SL) in addition to automatic verbal and visual messages from the program. There were no revisions, updates, or breaches of the program during the study period. This program was used exclusively in this study and is not available for commercial use.

    Procedures and Outcome Measures

    All participants underwent face-to-face comprehensive neuropsychological tests and evaluations using psychiatric scales, as well as rsfMRI at baseline and after the VR cognitive training period. Baseline evaluations of diagnostic criteria included global and functional scales such as the Korean version of the MMSE, Clinical Dementia Rating (CDR), CDR Sum of Boxes (CDR-SOB), global deterioration scale, and instrumental activities of daily living scales.

    The primary outcome was the effect of the VR cognitive training on visuospatial function measured by the Rey-Osterrieth Complex Figure Test (RCFT) copy task, which has been validated in the Korean population [24,25]. Basic components, including a large rectangle (1 point), diagonal cross (1 point), horizontal midline of a large rectangle (1 point), and vertical midline of a large rectangle (1 point), were also evaluated because they are considered important in qualitative aspects [26,27]. The neuropsychologist (GP) who scored the RCFT copy task was blinded to the randomization.

    The secondary outcomes concerned the effect on comprehensive neuropsychological function; psychiatric symptoms such as affect, apathy, quality of life (QoL), and depression; and functional connectivity in the visual network of the brain.

    The neuropsychological tests consisted of the MMSE and subtests from the comprehensive neuropsychological test battery [25]. Attention was assessed by the digit span forward and backward test and Trail Making Test (TMT) part A [25]. The Korean version of the Boston Naming Test (K-BNT) was used to assess language ability [25,28]. Memory was assessed by measuring performance on three tasks of the Seoul Verbal Learning Test (SVLT): immediate recall, delayed recall after 20 minutes, and recognition [25]. Frontal executive function was assessed by phonemic word fluency testing, the TMT-B, and the Stroop Color Test [25]. All neuropsychological test results were adjusted for age and years of education, and are presented as standardized z-scores.

    Noncognitive psychiatric symptoms that typically start to decline in the early dementia stage were also assessed [29]. Depressive symptoms were evaluated by the validated 30-item Geriatric Depression Scale (GDS), including questions pertaining to mood, anxiety, energy, satisfaction, hopefulness, inattention, and sleep quality [30,31]. The GDS comprises a series of binary yes/no questions (scored as 1 or 0, respectively), with higher scores indicating severe depression. Apathy was evaluated by the validated 18-item Apathy Evaluation Scale (AES), including items pertaining to emotional affect, behavior, and cognitive apathy [32,33]. Items of the AES are rated on a 4-point Likert scale, with a low score indicating severe apathy. Affect was evaluated by the Positive and Negative Affect Schedule (PANAS), which consists of 10 items to assess positive affect (PANAS-P) measures such as alertness and enthusiasm and 10 items to assess negative affect (PANAS-N) such as lethargy and feelings of sadness [34,35]. Each of the PANAS items is rated from 1 (not at all) to 5 (very much), with higher scores indicating higher affect. Participants’ QoL was evaluated by the QoL-AD scale, which has been validated for use in people with dementia, including 13 subjective rating items to assess physical health, living situation, relationships with friends, and the ability to engage in leisure activities [36,37]. Items of the QoL-AD are assessed on a 4-point Likert scale, with higher scores indicating better QoL.

    The Simulator Sickness Questionnaire (SSQ) was administered after each session to evaluate tolerability of the VR cognitive training program [38]. Simulator sickness refers to side effects from virtual environment usage, and is also called cybersickness [39,40] and VR sickness [41]. The SSQ consists of 16 items yielding three subscales (nausea, oculomotor, and disorientation) and a total severity score, with high scores indicating increased symptoms. The levels of interest and satisfaction were also assessed on a Likert scale ranging from 0 to 100 after the period of VR cognitive training in a face-to-face manner.

    MRI Acquisition

    A 3-Tesla whole-body Siemens scanner (TrioTim syngo) was used for functional image acquisition with an interleaved T2*-weighted echo-planar imaging gradient echo sequence (repetition time/echo time=2500/25 milliseconds, flip angle=90°, slice thickness=3.5 mm, in-plane resolution=3.5×3.5 mm, matrix size=64×64) with a 12-channel birdcage head coil. For each participant, 160 functional volumes were acquired at the pretraining and posttraining time points. After rsfMRI, an anatomical image was acquired using a high T1-weighted 3D-gradient echo pulse sequence with magnetization-prepared rapid gradient echo (repetition time/echo time/inversion time=1900/3.3/900 milliseconds, flip angle=9°, slice thickness=1.0 mm, in-plane resolution=0.5×0.5 mm, matrix size=416×512). T1-weighted images were acquired only at the pretraining time point.

    Functional Connectivity Analyses With rsfMRI

    Preprocessing of the rsfMRI data was performed using Statistical Parametric Mapping software version 12 (Wellcome Trust Centre for Neuroimaging). First, a slice-timing correction was applied and the center of each image was relocated near the anterior commissure. Second, rsfMRI and T1-weighted images were imported into CONN FC toolbox v19c [42] for further preprocessing. To correct for between-scan rigid body motion, the functional images were realigned to the first image in the time series. The functional images were coregistered with anatomical images and spatially normalized to the Montreal Neurological Institute space using a transformation matrix derived from the T1-weighted anatomical image segmentation. The functional images were then resliced to 2×2×2 mm and spatially smoothed using an 8-mm full width at half maximum Gaussian kernel.

    All preprocessed rsfMRI images were bandpass-filtered (0.008-0.09 Hz), and physiological and other spurious noise sources in the blood oxygenation level–dependent signal were removed using the anatomical component-based noise correction strategy implemented in CONN [43]. Outliers were calculated using the Artifact Detection Tools toolbox [44], and six motion correction parameters obtained from realignment were also modeled as nuisance covariates. The seed-to-voxel analyses were performed in the visual network with four cortical seed regions (right visual lateral, left visual lateral, visual medial, and visual occipital cortices) with predefined regions of interest based on the Harvard-Oxford atlas (fMRIB Software Library) [45]. Seed-based analyses were adjusted for age, years of education, sex, CDR-SOB, depressive symptoms, and pharmacotherapy. The mean time series for each seed region was calculated and then correlated with the time courses of all other voxels in the brain for each participant.

    Sample Calculation and Statistical Analyses

    Sample calculation was based on a recent meta-analysis on the effectiveness of VR for people with MCI or dementia that produced small-to-medium effect sizes using a random-effects model (effect size=0.29) from a total of 11 studies [15]. Assuming an attrition rate of 20%, a total sample size of 32 patients (16 per treatment group) would provide 0.8 power at a two-sided α error of .05. Power analysis was performed with G*Power software version 3.1.9.2.

    Comparisons of demographic and clinical variables between the two groups were performed using independent t tests, the Mann-Whitney U test, or the χ2 test. The paired t test was used in within-group comparisons of pretraining and posttraining measures. Repeated-measures analyses of variance was used to find the group interaction of the VR cognitive training on neuropsychological function and psychiatric symptom scales after adjusting for age, years of education, sex, CDR-SOB, depressive symptoms, and pharmacotherapy. Age and years of education were not adjusted in analyses with comprehensive neuropsychological test results that are presented as age- and years of education–adjusted z-scores. All statistical analyses were performed with SPSS software version 23 (SPSS Inc), with a significance level assessed at P<.05 (two-tailed).

    For rsfMRI data, Pearson correlation coefficients were converted to normally distributed scores using the Fisher r-to-z transformation. Group-level comparisons between the VR and control groups were performed using a general linear model in which improved cognitive task score was used as an explanatory variable and the posttraining minus pretraining z-transformation value was used as a dependent variable after adjusting for age, sex, years of education, CDR-SOB, depressive symptoms, and pharmacotherapy. The statistical thresholds for significance were set at voxel-wise uncorrected P<.001 and cluster-wise corrected P<.05 to correct for false-positive rates.


    Participants

    Of the 45 participants who were randomly allocated to the VR (n=25) or the control (n=20) group, 41 participants completed the study. After allocation, two participants of the VR group dropped out of the study due to dizziness (n=1) and unfamiliarity with the VR machine during the first session (n=1). Two participants of the control group dropped out because of hospitalization due to a traffic accident (n=1) and unknown personal reasons (n=1). Ultimately, 41 participants were included in the analyses. The trial flow chart is presented in Figure 1.

    ‎
    Figure 1. Trial flow chart. VR: virtual reality; MRI: magnetic resonance imaging.
    View this figure

    Demographic and Clinical Characteristics

    Table 1 presents the detailed demographic and clinical characteristics of the study participants. Among the 41 participants, 23 (56%) and 18 (44%) were assigned to the VR and control groups, respectively. Participant age was around 75 years, and they were predominantly women. No group differences were found in the baseline diagnostic evaluation.

    Table 1. Demographic and clinical characteristics of all study participants.
    CharacteristicTotal (N=41)VRa group (n=23)Control group (n=18)χ2 or UbP value
    Age (years), mean (SD)74.51 (5.81)75.48 (4.67)73.28 (6.96)–1.13.26
    Sex (female), n (%)29 (70.7)17 (73.9)12 (66.7)0.26.61
    Education (years), mean (SD)8.07 (4.39)7.70 (4.10)8.56 (4.83)–0.01.99
    MMSEc, mean (SD)26.24 (2.85)26.22 (2.91)26.28 (2.87)0.09.93
    CDRd, mean (SD)0.41 (0.22)0.41 (0.19)0.42 (0.26)–0.02.99
    CDR-SOBe, mean (SD)0.92 (1.00)0.98 (0.85)0.83 (1.19)–1.24.21
    Global Deterioration Scale, mean (SD)2.20 (0.78)2.26 (0.75)2.11 (0.83)–0.78.44
    IADLf, mean (SD)0.13 (0.24)0.14 (0.21)0.11 (0.28)–1.09.27

    aVR: virtual reality.

    bMann-Whitney U tests were used for all group comparisons except for sex, which was compared using the Pearson χ2 test.

    cMMSE: Mini-Mental State Examination.

    dCDR: Clinical Dementia Rating.

    eCDR-SOB: CDR-Sum of Boxes.

    fIADL: instrumental activities of daily living.

    Effect of VR Cognitive Training on Visuospatial Function

    Table 2 shows the comparisons of the pretraining and posttraining visuospatial function within groups, as well as group interactions in the effects of VR cognitive training. VR training resulted in significant improvement in the RCFT copy task compared to the control group. Basic components of the RCFT copy task also improved in the VR group compared to the control group.

    Table 2. Group comparisons of visuospatial function pre and post virtual reality (VR) cognitive training.
    Function scorePretrainingPosttrainingWithin groups
    pretraining vs posttraining    		Between groups interactiona



    		t (df)P valueF1,39P valueη2
    RCFTbcopy (z-scorec), mean (SD)


    		14.69.0010.30

    		VR (n=23)–0.31 (1.09)0.22 (0.78)–3.50 (22).002



    		Control (n=18)–0.07 (1.14)–0.47 (1.22)2.15 (17).046


    RCFT copy basic componentsd, mean (SD)


    		9.27.0050.22

    		VR1.99 (0.59)2.14 (0.42)–2.82 (22).01



    		Control2.15 (0.54)2.07 (0.59)1.53 (17).14


    aRepeated measures analysis of variance after adjusting for age (for basic components only), years of education (for basic components only), sex, Clinical Dementia Rating-Sum of Boxes, depressive symptoms, and pharmacotherapy.

    bRCFT: Rey-Osterrieth Complex Figure Test; basic components consist of a large rectangle, diagonal cross, horizontal midline of a large rectangle, and vertical midline of a large rectangle.

    cAdjusted for age and years of education.

    dRaw scores.

    Effect of VR Cognitive Training on Comprehensive Neuropsychological Function

    Table 3 shows the comparisons of pretraining and posttraining comprehensive neuropsychological function within groups, as well as group interactions in the effects of VR cognitive training. K-BNT, SVLT delayed recall, and Controlled Oral Word Association Test phonemic fluency showed improvement in the VR group, but the group interaction was not significant.

    Table 3. Group comparisons of comprehensive neuropsychological tests pre and post virtual reality (VR) cognitive training.
    TestaPretraining, mean (SD)Posttraining, mean (SD)Within groups
    pretraining vs posttraining    		Between groups interactionb



    		t (df)P valueF1,39P valueη2
    Global cognition

    		MMSEc0.75.390.02


    		VR (n=23)26.22 (2.91)25.87 (3.36)0.97 (22).34




    		Control (n=18)26.28 (2.87)26.67 (3.09)–0.89 (17).39


    Attention

    		Digit span, forward0.00.960.00


    		VR (n=23)–0.11 (1.21)–0.24 (0.87)0.57 (22).57




    		Control (n=18)–0.08 (1.08)0.15 (1.03)–1.42 (17).18



    		Digit span, backward



    		0.04.840.00


    		VR (n=23)–0.09 (0.99)–0.15 (0.92)0.23 (22).82




    		Control (n=18)–0.23 (1.26)–0.25 (0.82)0.08 (17).94



    		TMTd-A2.32.140.06


    		VR (n=23)0.13 (0.58)0.12 (0.64)0.10 (22).93




    		Control (n=18)–0.87 (4.19)–0.38 (3.53)–1.00 (17).33


    Language and related functions

    		K-BNTe3.55.070.09


    		VR (n=23)–0.23 (1.08)0.19 (1.02)–4.08 (22)<.001




    		Control (n=18)–0.15 (1.00)–0.01 (1.37)–0.72 (17).48


    Verbal memory

    		SVLTf, immediate recall1.83.190.05


    		VR (n=23)0.23 (0.10)0.67 (1.24)–3.10 (22).005




    		Control (n=18)0.30 (0.83)0.52 (0.89)–2.29 (17).04



    		SVLT, delayed recall3.03.090.08


    		VR (n=23)–0.10 (1.40)0.66 (1.37)–4.59 (22)<.001




    		Control (n=18)0.12 (0.97)0.58 (0.94)–3.21 (17).005



    		SVLT, recognition0.37.550.01


    		VR (n=23)0.29 (1.39)0.48 (1.30)–0.93 (22).36




    		Control (n=18)0.37 (1.01)0.29 (1.07)0.41 (17).69


    Frontal executive function

    		COWATg, semantic fluency0.04.850.00


    		VR (n=23)–0.25 (0.99)–0.44 (1.17)1.01 (22).32




    		Control (n=18)–0.41 (1.00)–0.58 (0.88)1.09 (17).29



    		COWAT, phonemic fluency3.08.090.08


    		VR (n=23)–0.35 (0.88)–0.41 (0.78)0.39 (22).70




    		Control (n=18)–0.09 (0.82)0.27 (1.01)-1.89 (17).08



    		Stroop test, color/word reading0.05.820.00


    		VR (n=23)–0.01 (1.12)0.32 (1.04)–1.99 (22).06




    		Control (n=18)–0.01 (0.85)0.16 (1.21)–0.64 (17).53



    		TMT-B, mean (SD)0.13.730.00


    		VR (n=23)–1.43 (2.04)–0.64 (1.74)–2.30 (22).03




    		Control (n=18)–0.55 (1.52)–0.55 (1.62)0.01 (17) .996


    aAll data except for MMSE are presented as age and years of education–adjusted z-scores.

    bRepeated-measures analysis of variance after adjusting for age (for MMSE only), years of education (for MMSE only), sex, Clinical Dementia Rating-Sum of Boxes, depressive symptoms, and pharmacotherapy.

    cMMSE: Mini-Mental State Examination.

    dTMT-B: Trail Making Test.

    eK-BNT: Korean version of the Boston Naming Test.

    fSVLT: Seoul Verbal Learning Test.

    gCOWAT: Controlled Oral Word Association Test.

    Effect of VR Cognitive Training on Psychiatric Symptoms

    Table 4 shows the comparisons between the pretraining and posttraining measures based on psychiatric symptoms within groups, as well as group differences in the effects of VR cognitive training. Group differences were found in the AES, PANAS-P, PANAS-N, and QoL-AD measures, showing improvements in apathy, positive and negative affect, and QoL in the VR group.

    Table 4. Group comparisons of psychiatric symptoms pre and post virtual reality (VR) cognitive training.
    GroupPretraining, mean (SD)Posttraining, mean (SD)Within groups
    pretraining vs posttraining    		Between groups interactiona



    		t (df)P valueF1,39P valueη2
    GDSb



    		0.88.360.03

    		VR (n=23)15.00 (6.08)13.26 (6.49)2.46 (22).02



    		Control (n=18)12.17 (6.85)11.72 (7.18)0.47 (17).65


    AESc



    		7.02.010.17

    		VR (n=23)47.43 (10.20)54.35 (9.41)–3.04 (22).006



    		Control (n=18)52.83 (9.38)51.22 (8.72)0.98 (17).34


    PANAS-Pd



    		14.40.001 0.30

    		VR (n=23)17.00 (6.28)21.43 (7.27)–2.71 (22).01



    		Control (n=18)21.83 (7.48)16.50 (6.51)4.63 (17)<.001


    PANAS-Ne



    		4.23.047 0.11

    		VR (n=23)18.22 (7.09)16.30 (6.35)0.97 (22).34



    		Control (n=18)18.89 (5.31)20.44 (8.42)–1.16 (17).26


    QoL-ADf



    		4.49.040.12

    		VR (n=18)31.04 (4.69)32.26 (4.96)–1.23 (22).23


    Control (n=23)34.94 (9.43)32.72 (6.54)1.21 (17).25


    aRepeated-measures analysis of variance after adjusting for age, years of education, sex, Clinical Dementia Rating-Sum of Boxes, and pharmacotherapy.

    bGDS: Geriatric Depression Scale.

    cAES: Apathy Evaluation Scale.

    dPANAS-P: Positive and Negative Affect Schedule-positive affect.

    ePANAS-N: Positive and Negative Affect Schedule-negative affect.

    fQoL-AD: Quality of Life-Alzheimer Disease.

    Simulator Sickness, Interest, and Satisfaction Associated with the VR Training Program

    Table 5 shows the simulator sickness measured by the SSQ after each training session, reported on a Likert scale ranging from 0 to 100, in the VR group participants after the training period. The mean SSQ total score was 12.86 (SD 11.82), and the summary subscale mean score for nausea, oculomotor, and disorientation was 7.02 (SD 6.40), 11.15 (10.56), and 17.16 (16.91), respectively.

    Interest and satisfaction had mean scores of 79.78 (SD 14.18) and 78.04 (SD 12.50) on a Likert scale ranging from 0 to 100, respectively.

    Table 5. Mean (SD) simulator sickness questionnaire scores associated with the virtual reality cognitive training (n=23).
    SessionNauseaOculomotorDisorientationTotal score
    19.95 (14.80)14.83 (14.18)22.39 (22.89)17.24 (17.53)
    26.22 (10.61)11.53 (16.30)15.13 (18.25)12.20 (15.59)
    39.13 (12.69)11.21 (16.62)16.95 (25.51)13.66 (18.86)
    46.64 (9.73)9.89 (14.89)10.29 (19.78)10.24 (14.97)
    56.64 (10.54)7.91 (13.02)13.92 (23.37)10.24 (14.63)
    62.45 (7.17)9.56 (15.70)20.58 (26.83)11.22 (16.18)
    75.39 (6.94)9.89 (12.61)19.37 (27.12)12.20 (14.93)
    89.97 (11.20)14.82 (17.27)18.98 (27.35)16.32 (19.47)

    Increased Functional Connectivity in rsfMRI

    We investigated brain functional connectivity in the visual network associated with the improvement in the RCFT copy task. The areas with significantly increased connectivity in the seed-to-voxel visual networks are presented in Table 6: (a) from the right visual lateral cortices to the left paracingulate gyrus, right paracingulate gyrus, left frontal pole, left superior frontal gyrus, anterior cingulate gyrus, and white matter; and (b) from the visual medial cortices to the right insular cortex, right frontal pole, right frontal operculum cortex, right caudate, left caudate, right putamen, left insular cortex, and white matter.

    Figure 2 depicts the increased regional functional connectivity in the brain cortices and the white matter that are related to improvements in the RCFT copy task in the VR group compared to the control group.

    Table 6. Functional visual network connectivity related to improved Rey-Osterrieth Complex Figure Test copy task scores after virtual reality cognitive training.
    Seed and connected regions (voxels)Clusters

    		Voxel (2×2×2)MNIa coordinates (x, y, z)bFDRc–corrected P valued
    Visual lateral, Re291–06, +40, +42.003

    		Paracingulate gyrus, Lf118


    		Paracingulate gyrus, R68


    		Frontal pole, L41


    		Superior frontal gyrus, L29


    		Anterior cingulate gyrus7


    		Frontal pole, R1


    		White matter27

    Visual medial719 and 401+16, +20, +16 and –22, +22, +16<.001 and <.001

    		Insular cortex, R71


    		Frontal pole, R48


    		Frontal operculum cortex, R25


    		Caudate, R24


    		Caudate, L3


    		Putamen, R2


    		White matter546


    		Insular cortex, L2


    		White matter399

    Visual lateral, LN/AgN/AN/A
    Visual occipitalN/AN/A N/A

    aMNI: Montreal Neurological Institute.

    bCoordinates indicate the representative coverage region with maximum power among all connected regions.

    cFalse-discovery Rate.

    dGroup-level analyses between the VR and control groups were performed using a general linear model with Rey-Osterrieth Complex Figure Test copy task improvement as an explanatory variable and the post-pre training z transformation value as a dependent variable after adjusting for age, years of education, sex, Clinical Dementia Rating-Sum of Boxes, depressive symptoms, and pharmacotherapy.

    eR: right side.

    fL: left side.

    gN/A: not applicable.

    ‎
    Figure 2. Seed-to-voxel analyses based on the right lateral region (a) and the medial region (b) of the visual network (blue circles). Increased frontal-occipital functional connectivity related to the Rey-Osterrieth Complex Figure Test copy task improvement after virtual reality cognitive training. False discovery rate–corrected P<.05 for cluster threshold; uncorrected P<.001 for voxel threshold.
    View this figure

    Principal Findings

    This study found that 1-month multidomain cognitive training using fully immersive VR was effective in improving visuospatial function and frontal-occipital functional connectivity, as well as apathy, affect, and QoL in older people in a predementia cognitive state.

    The first major finding of this study is that VR cognitive training resulted in improvements in the RCFT copy task. Despite the inconsistent results reported in the literature, training-related changes in cognition have been repeatedly found in older people with cognitive disorders [9,10]. Neuropsychological test score improvements after traditional pen-and-paper or computerized cognitive training have been found in measures of global composite cognition [46-48], verbal memory [11,46,49,50], verbal letter fluency [46,47], verbal fluency [51,52], and visuospatial function in the clock-drawing test [46,53]. It has also been reported that VR cognitive training was effective in improving frontal executive function in individuals with MCI [54], as well as attention and visual memory in older people [55,56]. In line with these previous studies, our results also showed that multidomain cognitive training in a virtual environment was effective in visuospatial function measured by the RCFT copy task in total and basic components comprising the gestalt of the feature showing the ability to approach [26,27]. Although not significant, improvements in naming ability, verbal memory delayed recall, and frontal executive function were also found in the training group compared to the control group. It is possible that the relatively short 1-month training period might have resulted in the lack of group difference, as a learning effect may have impacted the posttraining neuropsychological test results in the control group. However, the improvement in visuospatial function in the VR group, even after the short period of cognitive training, might be attributed to the ecological nature of the fully immersive VR environment. In the enriched auditorily and visually stimulating environment, processing of visual orientation, visuospatial construction, and visual selective attention likely occurred [57,58]. In recent studies with VR evaluation, investigators have been able to effectively differentiate between the navigational [59] and visuospatial deficits observed in patients with MCI and healthy older people [60,61]. In studies with VR interventions, VR cognitive training was found to be effective [55,62] or ineffective [56,63] in improving visuospatial function in older people or those in an early dementia stage. We believe that the cognitive training performed in the maximally immersive environment with the head-mounted display, headphones, and hand movement trackers in our study might have increased visuospatial functioning in those at a predementia stage [64]. The immersion methods utilized in previous studies investigating VR cognitive training in older people have employed desktop-based systems [55,56], screen and sensors [62], screen and glasses [65,66], and head-mounted display and fixed joystick setups [63]. Although heterogeneity in study populations and methodological differences among prior studies have resulted in inconsistent findings, this study provides further evidence to support the benefits of VR cognitive training in eliciting improvements in visuospatial processing through the repeated presentation of real-world, dynamic, multisensory, and interactive environments.

    Another novel finding was the increased functional connectivity observed in the frontal-occipital cortical network after VR cognitive training, which was associated with improved performance in the RCFT copy task, consistent with the associations between cognitive improvements and neuronal plasticity that have been observed previously [67]. In patients with MCI, significant associations have been observed between verbal memory improvement and left hippocampal activation in task-related fMRI after 8-week training to improve auditory processing speed and accuracy [11]. Other studies have shown that 6 weeks of episodic memory training in patients with MCI resulted in the manifestation of new associations between improved delayed word recall test performance and brain activation in the right inferior parietal lobule in fMRI during memory encoding [68]. In healthy older people, 8 weeks of exposure to a cognitive control training program led to an increased frontoparietal network related to cognitive control ability [69]; another study found that verbal recall was associated with an increased left hippocampal volume in healthy older people after 8 weekly verbal recall memory training sessions [70]. Thus, in this study, repetitive cognitive training in a novel fully immersive environment might have increased the frontal-occipital activation in accordance with improved visuospatial function. We also observed increased functional connectivity in white matter areas, which are known to exhibit a lower hemodynamic response than the grey matter. Although fMRI studies have focused on grey matter until recently, the increased functional connectivity in the white matter close to the grey matter supports the growing neural evidence of fMRI white matter changes induced by VR cognitive training [71,72].

    This evident link between visuospatial construction and frontal-occipital functional connectivity might be explained by the acquired cognitive system engagement induced by the RCFT copy task, which requires the participant to copy a complex geometric figure [73]. Visuoconstructive ability is based on the Van Sommers model of drawing [74]; according to this cognitive model, the RCFT copy task consists of (i) visual recognition of a 2D Rey-Osterrieth complex figure; (ii) visual representation of the figure in long-term or temporary memory; (iii) graphical output processes such as those related to depiction decisions (eg, context, orientation, viewpoint, details, and boundary) or reproduction strategies (eg, copying orders, dimensions, shapes, diagonals, crosses, line sets); (iv) graphical planning (eg, routine or contingent planning); and (v) articulation and economic constraints during motor output. Through these steps, multiple brain regions have been found to be associated with performance in the RCFT copy task, including the temporal, parietal, occipital, and frontal cortices in both hemispheres or in the right hemisphere alone [75-77]. Although we observed increased activity only in the primary visual cortices (visual medial) and the right associative visual cortices (right visual lateral) connecting to the areas in the middle frontal cortices, these regions are known to be involved in the visual recognition and graphic output planning processes required to complete the RCFT copy task [74], and are associated with visuo-motor transformation and multistep object use in the task [77]. A recent study reported that lesions in the right superior parietal lobe and the middle occipital gyrus were associated with poor RCFT copy task performance [78], which is in accordance with our results. Furthermore, there have been reports on improvements in nontrained cognitive functions, also known as transfer effects, in memory training in older people with MCI [79,80]. Previous studies have shown that repeated memory-focused training might have enhanced the processing speed of memory retrieval and the efficiency of working memory, assuming that frontal executive function was the main recipient of the transfer effects [79,80]. Although recent studies have applied cognitive training with novel computerized tools and involvement of multiple cognitive domains, existing programs have only applied cognitive training in a 2D environment with an emphasis on language abilities [9,53,79,81]. Since frontal executive function plays a major role in all cognitive domains and higher-order cognitive controls [82], the improved performance on the RCFT copy task may be supported by increased functional connectivity in the frontal-occipital network.

    The psychiatric benefit of VR cognitive training in individuals in a predementia state should be considered. In this study, participants in the VR group showed improved apathy, affect, and QoL scores after training compared with those in the control group. A recent review reported that computerized cognitive training resulted in long-term improvements in psychological outcome measures [16]. Although methodologies vary across studies, 3D VR cognitive training was effective in improving depressive symptoms in patients with MCI compared with an active control group receiving music therapy [63]. Moreover, a few feasibility studies have reported improved alertness, pleasure, apathy, and security following one-time exposure to a less immersive VR environment [65,66]. We postulate that apathy, affect, and QoL might be improved by the VR cognitive training, as these are some of the early symptoms of dementia [83]. Immersive virtual environments might facilitate the limited functioning of patients with cognitive disorders that affect communication, interaction, motivation, engagement, and positive attitudes toward others [84]. Thus, the importance of virtual environments should be considered in cognitive training because the feeling of presence itself in a 3D space can enhance volitional motivation, allowing one to constantly process external stimuli and cognitively adjust to changing environments [85].

    Simulator sickness reported after every session was minimal in the VR cognitive training group. In this study, the SSQ total score (mean 12.86, SD 11.82) indicated minimal symptoms (score 5-10) according to the suggested categorization established in flight simulators [86]. Although the SSQ was originally developed and validated in military personnel using flight simulators, it is the most commonly used measure of sickness in a virtual environment [40]. A recent meta-analysis of the SSQ in virtual environments reported total and subscale scores and dropout rates according to VR conditions (total 28.00, SD 1.71; nausea 16.72, SD 0.77; oculomotor 17.09, SD 0.55; disorientation 23.50, SD 1.17; dropout rate 15.6%) [87]. Compared to the results in a VR environment, our results on the SSQ scores and dropout rates (8%) showed better tolerability, with moderate interest and satisfaction. The SSQ scores have been reported to be higher in VR than in a flight simulator environment [86] and with gaming content than without it [87]. Despite the characteristics of VR in this study, such as fully immerse, game and training components, and old users at an early stage of cognitive decline, these results may imply that fully immersive VR can be a safe and interesting method for cognitive training.

    Limitations

    Our study had several strengths and limitations. This is one of the largest VR cognitive training studies to use a fully immersive 3D VR program. Compared to 2D or semi-immersive VR programs, our results highlight the positive effects of employing fully immersive 3D VR in cognitive training, as we found neural evidence supporting the improvement in visuospatial function. However, there are several limitations and lessons learned in this study. First, the small sample size and short training period were the main limitations. Although sample sizes in studies investigating the effects of cognitive training are increasing [88], most VR trials still rely on small sample sizes and are performed over a short duration, especially those using fully virtual environments [15]. Short clinical trial periods in previous studies investigating the effect of computerized cognitive training programs have also been a limiting factor in the field as a whole [88]. Thus, future studies should aim to increase the sample sizes and extend the duration of training to better evaluate the effect of VR cognitive training. Second, we considered that the per-protocol analysis could bias the results of this randomized controlled trial, although the number of participants who dropped out of the study was the same in both groups. Third, the lack of an active control group in this study is another limitation. Some previous trials have included active control groups receiving psychoeducation, cognitive therapy, face-to-face music therapy, or pen-and-paper cognitive training for comparisons with the VR training group [15,63]. In the future, various active control groups should be considered to confirm the effectiveness of VR cognitive training. Fourth, the lack of examination for AD biomarkers such as cerebrospinal fluid analysis or brain imaging for amyloid detection can be a limitation because it is unclear whether the participants in our study will develop AD, which is the most prevalent cause of dementia. Future studies involving AD biomarkers could clearly explain the pure effect of cognitive training in individuals in a preclinical or prodromal dementia state. Lastly, heterogeneity among patients, practitioners, program content, and accessibility to the VR system can limit the generalizability of the results to other populations.

    Conclusions

    We found that fully immersive VR cognitive training improved cognition and psychiatric symptoms in a predementia state. Visuospatial function improved in such individuals relative to controls, and this finding was supported by increased frontal-occipital functional connectivity assessed by rsfMRI. These findings suggest that VR training can enhance visuospatial ability by exposing patients to an enriched virtual environment, leading to improved apathy, affect, and QoL. Our results support the neurotherapeutic use of VR cognitive training as an effective nonpharmacological intervention for those who are at risk for dementia; however, more rigorous trials should be performed to confirm the effects and identify the associated neural mechanisms.

    Acknowledgments

    We would like to thank C2MONSTER for help in designing and manufacturing the multidomain VR cognitive training program. This research was funded by the support program for Development of Dementia Care Service using Advanced ICT Technology 2018 funded by Korea Radio Promotion Association (RAPA) and the Ministry of Science and ICT (MSIT), Korea, under the Information Technology Research Center support program (IITP-2021-2017-0-01630) supervised by the Institute for Information & Communications Technology Promotion. The funding sources had no role in the study design; collection, analysis, and interpretation of data; writing of the manuscript; or decision to submit the article for publication.

    Authors' Contributions

    JK, NK, and SL conceived and designed the study, acquired and analyzed the data, interpreted the study findings, and drafted the manuscript. SW, GP, and JP analyzed the data. BY, JL, JY, and SR designed the study, interpreted the study findings, supervised and directed the conduct of the study, and critically reviewed the manuscript. SC conceived and designed the study, acquired and analyzed the data, interpreted the study findings, supervised and directed the conduct of the study, and critically reviewed the manuscript.

    Conflicts of Interest

    None declared.

    ‎
    Multimedia Appendix 1

    CONSORT-EHEALTH (V 1.6.1) - Submission/Publication Form.

    PDF File (Adobe PDF File), 446 KB
    ‎
    Multimedia Appendix 2

    Representative images of the virtual reality training program.

    DOCX File , 1988 KB
    1. Alzheimer's Association. 2016 Alzheimer's disease facts and figures. Alzheimers Dement 2016 Apr;12(4):459-509. [CrossRef] [Medline]
    2. American Psychiatric Association. Diagnostic and statistical manual of mental disorders (DSM-5). Washington, DC: American Psychiatric Pub; 2013.
    3. US Burden of Disease Collaborators, Mokdad AH, Ballestros K, Echko M, Glenn S, Olsen HE, et al. The State of US Health, 1990-2016: burden of diseases, injuries, and risk factors among US states. JAMA 2018 Apr 10;319(14):1444-1472 [FREE Full text] [CrossRef] [Medline]
    4. Cao J, Hou J, Ping J, Cai D. Advances in developing novel therapeutic strategies for Alzheimer's disease. Mol Neurodegener 2018 Dec 12;13(1):64 [FREE Full text] [CrossRef] [Medline]
    5. Livingston G, Sommerlad A, Orgeta V, Costafreda SG, Huntley J, Ames D, et al. Dementia prevention, intervention, and care. Lancet 2017 Dec 16;390(10113):2673-2734. [CrossRef] [Medline]
    6. Norton S, Matthews FE, Barnes DE, Yaffe K, Brayne C. Potential for primary prevention of Alzheimer's disease: an analysis of population-based data. Lancet Neurol 2014 Aug;13(8):788-794. [CrossRef] [Medline]
    7. Marioni RE, Proust-Lima C, Amieva H, Brayne C, Matthews FE, Dartigues J, et al. Cognitive lifestyle jointly predicts longitudinal cognitive decline and mortality risk. Eur J Epidemiol 2014 Mar 28;29(3):211-219 [FREE Full text] [CrossRef] [Medline]
    8. Wilson RS, Segawa E, Boyle PA, Bennett DA. Influence of late-life cognitive activity on cognitive health. Neurology 2012 Apr 10;78(15):1123-1129 [FREE Full text] [CrossRef] [Medline]
    9. Bahar-Fuchs A, Martyr A, Goh A, Sabates J, Clare L. Cognitive training for people with mild to moderate dementia. Cochrane Database Syst Rev 2019 Mar 25;3:CD013069 [FREE Full text] [CrossRef] [Medline]
    10. Gates N, Vernooij R, Di Nisio M, Karim S, March E, Martínez G, et al. Computerised cognitive training for preventing dementia in people with mild cognitive impairment. Cochrane Database Syst Rev 2019 Mar 13;3:CD012279 [FREE Full text] [CrossRef] [Medline]
    11. Rosen AC, Sugiura L, Kramer JH, Whitfield-Gabrieli S, Gabrieli JD. Cognitive training changes hippocampal function in mild cognitive impairment: a pilot study. J Alzheimers Dis 2011;26(Suppl 3):349-357 [FREE Full text] [CrossRef] [Medline]
    12. Anguera JA, Boccanfuso J, Rintoul JL, Al-Hashimi O, Faraji F, Janowich J, et al. Video game training enhances cognitive control in older adults. Nature 2013 Sep 05;501(7465):97-101 [FREE Full text] [CrossRef] [Medline]
    13. Bohil CJ, Alicea B, Biocca FA. Virtual reality in neuroscience research and therapy. Nat Rev Neurosci 2011 Nov 03;12(12):752-762. [CrossRef] [Medline]
    14. Biocca F. The cyborg's dilemma: progressive embodiment in virtual environments 1. J Comput Mediat Commun 1997;3(2):JCMC324. [CrossRef]
    15. Kim O, Pang Y, Kim J. The effectiveness of virtual reality for people with mild cognitive impairment or dementia: a meta-analysis. BMC Psychiatry 2019 Jul 12;19(1):219 [FREE Full text] [CrossRef] [Medline]
    16. Coyle H, Traynor V, Solowij N. Computerized and virtual reality cognitive training for individuals at high risk of cognitive decline: systematic review of the literature. Am J Geriatr Psychiatry 2015 Apr;23(4):335-359. [CrossRef] [Medline]
    17. Sperling R. Potential of functional MRI as a biomarker in early Alzheimer's disease. Neurobiol Aging 2011 Dec;32(Suppl 1):S37-S43 [FREE Full text] [CrossRef] [Medline]
    18. Davatzikos C, Bhatt P, Shaw LM, Batmanghelich KN, Trojanowski JQ. Prediction of MCI to AD conversion, via MRI, CSF biomarkers, and pattern classification. Neurobiol Aging 2011 Dec;32(12):2322-2327 [FREE Full text] [CrossRef] [Medline]
    19. Buckner R, Andrews-Hanna J, Schacter D. The brain's default network: anatomy, function, and relevance to disease. Ann N Y Acad Sci 2008 Mar;1124:1-38. [CrossRef] [Medline]
    20. Stern Y. Cognitive reserve. Neuropsychologia 2009 Aug;47(10):2015-2028 [FREE Full text] [CrossRef] [Medline]
    21. Molinuevo JL, Rabin LA, Amariglio R, Buckley R, Dubois B, Ellis KA, Subjective Cognitive Decline Initiative (SCD-I) Working Group. Implementation of subjective cognitive decline criteria in research studies. Alzheimers Dement 2017 Mar 05;13(3):296-311. [CrossRef] [Medline]
    22. Jessen F, Amariglio RE, van Boxtel M, Breteler M, Ceccaldi M, Chételat G, Subjective Cognitive Decline Initiative (SCD-I) Working Group. A conceptual framework for research on subjective cognitive decline in preclinical Alzheimer's disease. Alzheimers Dement 2014 Nov 02;10(6):844-852 [FREE Full text] [CrossRef] [Medline]
    23. Petersen RC. Mild cognitive impairment as a diagnostic entity. J Intern Med 2004 Sep;256(3):183-194 [FREE Full text] [CrossRef] [Medline]
    24. Meyers JE, Meyers KR. Rey complex figure test under four different administration procedures. The Clinical Neuropsychologist 1995 Feb;9(1):63-67. [CrossRef]
    25. Kang Y, Jahng S, Na D. Seoul Neuropsychological Screening Battery, 2nd Edition (SNSB-II). Seoul: Human Brain Research & Consulting Co; 2012.
    26. Bylsma F, Bobholz J, Schretlen D, Correa D. A brief, reliable approach to coding how subjects copy the Rey-Osterrieth Complex Figure. J Int Neuropsychol Soc 1995;1:125.
    27. Sargénius HL, Bylsma FW, Lydersen S, Hestad K. Visual-constructional ability in individuals with severe obesity: Rey Complex Figure Test accuracy and the Q-Score. Front Psychol 2017 Sep 20;8:1629. [CrossRef] [Medline]
    28. Kim H, Na DL. Normative data on the Korean version of the Boston Naming Test. J Clin Exp Neuropsychol 1999 Feb 09;21(1):127-133. [CrossRef] [Medline]
    29. Lyketsos CG, Carrillo MC, Ryan JM, Khachaturian AS, Trzepacz P, Amatniek J, et al. Neuropsychiatric symptoms in Alzheimer's disease. Alzheimers Dement 2011 Sep 01;7(5):532-539 [FREE Full text] [CrossRef] [Medline]
    30. Bae JN, Cho MJ. Development of the Korean version of the Geriatric Depression Scale and its short form among elderly psychiatric patients. J Psychosom Res 2004 Sep;57(3):297-305. [CrossRef] [Medline]
    31. Yesavage JA, Brink T, Rose TL, Lum O, Huang V, Adey M, et al. Development and validation of a geriatric depression screening scale: A preliminary report. J Psych Res 1982 Jan;17(1):37-49. [CrossRef]
    32. Marin RS, Biedrzycki RC, Firinciogullari S. Reliability and validity of the apathy evaluation scale. Psych Res 1991 Aug;38(2):143-162. [CrossRef]
    33. Lee YM, Park IH, Koo MS, Ko SY, Kang HM, Song JE. The reliability and validity of the Korean version of Apathy Evaluation Scale and its application in patients with schizophrenia. Korean J Schizophr Res 2013;16(2):80. [CrossRef]
    34. Watson D, Clark LA, Tellegen A. Development and validation of brief measures of positive and negative affect: The PANAS scales. J Person Soc Psychol 1988;54(6):1063-1070. [CrossRef]
    35. Lim Y, Yu B, Kim D, Kim J. The positive and negative affect schedule: psychometric properties of the korean version. Psychiatry Investig 2010 Sep;7(3):163-169 [FREE Full text] [CrossRef] [Medline]
    36. Thorgrimsen L, Selwood A, Spector A, Royan L, de Madariaga Lopez M, Woods RT, et al. Whose quality of life is it anyway? The validity and reliability of the Quality of Life-Alzheimer's Disease (QoL-AD) scale. Alzheimer Dis Assoc Disord 2003;17(4):201-208. [CrossRef] [Medline]
    37. Shin H. A preliminary study on the Korean version of quality of life-Alzheimer's disease (QOL-AD) scale in community-dwelling elderly with dementia. J Prev Med Public Health 2006 May;39(3):243-248 [FREE Full text] [Medline]
    38. Kennedy RS, Lane NE, Berbaum KS, Lilienthal MG. Simulator Sickness Questionnaire: an enhanced method for quantifying simulator sickness. Int J Aviat Psychol 1993 Jul;3(3):203-220. [CrossRef]
    39. LaViola JJ. A discussion of cybersickness in virtual environments. SIGCHI Bull 2000 Jan;32(1):47-56. [CrossRef]
    40. Rebenitsch L, Owen C. Review on cybersickness in applications and visual displays. Virt Real 2016 Apr 26;20(2):101-125. [CrossRef]
    41. Kim HK, Park J, Choi Y, Choe M. Virtual reality sickness questionnaire (VRSQ): Motion sickness measurement index in a virtual reality environment. Appl Ergon 2018 May;69:66-73. [CrossRef] [Medline]
    42. Whitfield-Gabrieli S, Nieto-Castanon A. Conn: a functional connectivity toolbox for correlated and anticorrelated brain networks. Brain Connect 2012 Jun;2(3):125-141. [CrossRef] [Medline]
    43. Behzadi Y, Restom K, Liau J, Liu TT. A component based noise correction method (CompCor) for BOLD and perfusion based fMRI. Neuroimage 2007 Aug 01;37(1):90-101 [FREE Full text] [CrossRef] [Medline]
    44. Jo HJ, Saad ZS, Simmons WK, Milbury LA, Cox RW. Mapping sources of correlation in resting state FMRI, with artifact detection and removal. Neuroimage 2010 Aug 15;52(2):571-582 [FREE Full text] [CrossRef] [Medline]
    45. Smith SM, Jenkinson M, Woolrich MW, Beckmann CF, Behrens TE, Johansen-Berg H, et al. Advances in functional and structural MR image analysis and implementation as FSL. Neuroimage 2004 Jan;23(Suppl 1):S208-S219. [CrossRef] [Medline]
    46. Mapelli D, Di Rosa E, Nocita R, Sava D. Cognitive stimulation in patients with dementia: randomized controlled trial. Dement Geriatr Cogn Dis Extra 2013;3(1):263-271 [FREE Full text] [CrossRef] [Medline]
    47. Bergamaschi S, Arcara G, Calza A, Villani D, Orgeta V, Mondini S. One-year repeated cycles of cognitive training (CT) for Alzheimer's disease. Aging Clin Exp Res 2013 Aug;25(4):421-426. [CrossRef] [Medline]
    48. Jeong JH, Na HR, Choi SH, Kim J, Na DL, Seo SW, et al. Group- and home-based cognitive intervention for patients with mild cognitive impairment: a randomized controlled trial. Psychother Psychosom 2016 May 27;85(4):198-207 [FREE Full text] [CrossRef] [Medline]
    49. Cavallo M, Angilletta C. Long-lasting neuropsychological effects of a computerized cognitive training in patients affected by early stage Alzheimer's disease: are they stable over time? J Appl Gerontol 2019 Jul;38(7):1035-1044. [CrossRef] [Medline]
    50. Jelcic N, Cagnin A, Meneghello F, Turolla A, Ermani M, Dam M. Effects of lexical-semantic treatment on memory in early Alzheimer disease: an observer-blinded randomized controlled trial. Neurorehabil Neural Repair 2012 Oct;26(8):949-956. [CrossRef] [Medline]
    51. Trebbastoni A, Imbriano L, Podda L, Rendace L, Sacchetti ML, Campanelli A, et al. Cognitive training in patients with Alzheimer's disease: findings of a 12-month randomized controlled trial. Curr Alzheimer Res 2018 Mar 14;15(5):452-461. [CrossRef] [Medline]
    52. Cavallo M, Hunter EM, van der Hiele K, Angilletta C. Computerized structured cognitive training in patients affected by early-stage Alzheimer's disease is feasible and effective: a randomized controlled study. Arch Clin Neuropsychol 2016 Dec 01;31(8):868-876. [CrossRef] [Medline]
    53. Nousia A, Siokas V, Aretouli E, Messinis L, Aloizou A, Martzoukou M, et al. Beneficial effect of multidomain cognitive training on the neuropsychological performance of patients with early-stage Alzheimer's disease. Neural Plast 2018 Jul 11;2018:2845176-2828459. [CrossRef] [Medline]
    54. Liao Y, Chen I, Lin Y, Chen Y, Hsu W. Effects of virtual reality-based physical and cognitive training on executive function and dual-task gait performance in older adults with mild cognitive impairment: a randomized control trial. Front Aging Neurosci 2019 Jul 16;11:162. [CrossRef] [Medline]
    55. Gamito P, Oliveira J, Morais D, Coelho C, Santos N, Alves C, et al. Cognitive stimulation of elderly individuals with instrumental virtual reality-based activities of daily life: pre-post treatment study. Cyberpsychol Behav Soc Netw 2019 Jan;22(1):69-75. [CrossRef] [Medline]
    56. Gamito P, Oliveira J, Alves C, Santos N, Coelho C, Brito R. Virtual reality-based cognitive stimulation to improve cognitive functioning in community elderly: controlled study. Cyberpsychol Behav Soc Netw 2020 Mar 01;23(3):150-156. [CrossRef] [Medline]
    57. Green CS, Bavelier D. Action video game modifies visual selective attention. Nature 2003 May 29;423(6939):534-537. [CrossRef] [Medline]
    58. West GL, Stevens SA, Pun C, Pratt J. Visuospatial experience modulates attentional capture: evidence from action video game players. J Vis 2008 Dec 22;8(16):13.1-9 [FREE Full text] [CrossRef] [Medline]
    59. Cushman LA, Stein K, Duffy CJ. Detecting navigational deficits in cognitive aging and Alzheimer disease using virtual reality. Neurology 2008 Sep 16;71(12):888-895 [FREE Full text] [CrossRef] [Medline]
    60. Zygouris S, Giakoumis D, Votis K, Doumpoulakis S, Ntovas K, Segkouli S, et al. Can a virtual reality cognitive training application fulfill a dual role? using the Virtual Supermarket Cognitive Training Application as a screening tool for mild cognitive impairment. J Alzheimers Dis 2015 Feb 19;44(4):1333-1347. [CrossRef]
    61. Howett D, Castegnaro A, Krzywicka K, Hagman J, Marchment D, Henson R, et al. Differentiation of mild cognitive impairment using an entorhinal cortex-based test of virtual reality navigation. Brain 2019 Jun 01;142(6):1751-1766. [CrossRef] [Medline]
    62. Tarnanas I, Schlee W, Tsolaki M, Müri R, Mosimann U, Nef T. Ecological validity of virtual reality daily living activities screening for early dementia: longitudinal study. JMIR Serious Games 2013 Aug 06;1(1):e1 [FREE Full text] [CrossRef] [Medline]
    63. Optale G, Urgesi C, Busato V, Marin S, Piron L, Priftis K, et al. Controlling memory impairment in elderly adults using virtual reality memory training: a randomized controlled pilot study. Neurorehabil Neural Repair 2010 May 24;24(4):348-357. [CrossRef] [Medline]
    64. Sayma M, Tuijt R, Cooper C, Walters K. Are we there yet? Immersive virtual reality to improve cognitive function in dementia and mild cognitive impairment. Gerontologist 2020 Sep 15;60(7):e502-e512. [CrossRef] [Medline]
    65. Manera V, Chapoulie E, Bourgeois J, Guerchouche R, David R, Ondrej J, et al. A feasibility study with image-based rendered virtual reality in patients with mild cognitive impairment and dementia. PLoS One 2016 Mar 18;11(3):e0151487 [FREE Full text] [CrossRef] [Medline]
    66. Moyle W, Jones C, Dwan T, Petrovich T. Effectiveness of a virtual reality forest on people with dementia: a mixed methods pilot study. Gerontologist 2018 May 08;58(3):478-487. [CrossRef] [Medline]
    67. Ten Brinke LF, Davis JC, Barha CK, Liu-Ambrose T. Effects of computerized cognitive training on neuroimaging outcomes in older adults: a systematic review. BMC Geriatr 2017 Jul 10;17(1):139 [FREE Full text] [CrossRef] [Medline]
    68. Belleville S, Clément F, Mellah S, Gilbert B, Fontaine F, Gauthier S. Training-related brain plasticity in subjects at risk of developing Alzheimer's disease. Brain 2011 Jun;134(Pt 6):1623-1634. [CrossRef] [Medline]
    69. Kim H, Chey J, Lee S. Effects of multicomponent training of cognitive control on cognitive function and brain activation in older adults. Neurosci Res 2017 Nov;124:8-15 [FREE Full text] [CrossRef] [Medline]
    70. Engvig A, Fjell AM, Westlye LT, Skaane NV, Dale AM, Holland D, et al. Effects of cognitive training on gray matter volumes in memory clinic patients with subjective memory impairment. J Alzheimers Dis 2014;41(3):779-791. [CrossRef] [Medline]
    71. Gawryluk JR, Mazerolle EL, D'Arcy RCN. Does functional MRI detect activation in white matter? A review of emerging evidence, issues, and future directions. Front Neurosci 2014;8:239. [CrossRef] [Medline]
    72. Grajauskas LA, Frizzell T, Song X, D'Arcy RCN. White matter fMRI activation cannot be treated as a nuisance regressor: overcoming a historical blind spot. Front Neurosci 2019 Oct 4;13:1024. [CrossRef] [Medline]
    73. Shin M, Park S, Park S, Seol S, Kwon JS. Clinical and empirical applications of the Rey-Osterrieth Complex Figure Test. Nat Protoc 2006 Jul 27;1(2):892-899. [CrossRef] [Medline]
    74. Sommers PV. A system for drawing and drawing-related neuropsychology. Cognitive Neuropsychol 1989 Mar;6(2):117-164. [CrossRef]
    75. Melrose RJ, Harwood D, Khoo T, Mandelkern M, Sultzer DL. Association between cerebral metabolism and Rey-Osterrieth Complex Figure Test performance in Alzheimer's disease. J Clin Exp Neuropsychol 2013 Feb 07;35(3):246-258 [FREE Full text] [CrossRef] [Medline]
    76. Kang SH, Park YH, Lee D, Kim JP, Chin J, Ahn Y, et al. The cortical neuroanatomy related to specific neuropsychological deficits in Alzheimer's continuum. Dement Neurocogn Disord 2019 Sep;18(3):77-95 [FREE Full text] [CrossRef] [Medline]
    77. Chen H, Pan X, Lau JKL, Bickerton W, Pradeep B, Taheri M, et al. Lesion-symptom mapping of a complex figure copy task: A large-scale PCA study of the BCoS trial. Neuroimage Clin 2016;11:622-634 [FREE Full text] [CrossRef] [Medline]
    78. Biesbroek JM, van Zandvoort MJE, Kuijf HJ, Weaver NA, Kappelle LJ, Vos PC, Utrecht VCI Study Group. The anatomy of visuospatial construction revealed by lesion-symptom mapping. Neuropsychologia 2014 Sep;62:68-76. [CrossRef] [Medline]
    79. Youn J, Park S, Lee J, Cho S, Kim J, Ryu S. Cognitive improvement in older adults with mild cognitive impairment: evidence from a multi-strategic metamemory training. J Clin Med 2020 Jan 28;9(2):362 [FREE Full text] [CrossRef] [Medline]
    80. Weng W, Liang J, Xue J, Zhu T, Jiang Y, Wang J, et al. The transfer effects of cognitive training on working memory among Chinese older adults with mild cognitive impairment: a randomized controlled trial. Front Aging Neurosci 2019 Aug 14;11:212. [CrossRef] [Medline]
    81. Han JW, Son KL, Byun HJ, Ko JW, Kim K, Hong JW, et al. Efficacy of the Ubiquitous Spaced Retrieval-based Memory Advancement and Rehabilitation Training (USMART) program among patients with mild cognitive impairment: a randomized controlled crossover trial. Alzheimers Res Ther 2017 Jun 06;9(1):39 [FREE Full text] [CrossRef] [Medline]
    82. Badre D. Cognitive control, hierarchy, and the rostro-caudal organization of the frontal lobes. Trends Cogn Sci 2008 May;12(5):193-200. [CrossRef] [Medline]
    83. Lyketsos CG, Lopez O, Jones B, Fitzpatrick AL, Breitner J, DeKosky S. Prevalence of neuropsychiatric symptoms in dementia and mild cognitive impairment: results from the cardiovascular health study. JAMA 2002 Sep 25;288(12):1475-1483. [CrossRef] [Medline]
    84. Garcia L, Kartolo A, Méthot-Curtis E. A discussion of the use of virtual reality in dementia. In: Virtual reality in psychological, medical and pedagogical applications. Rijeka: Intech; 2012:123-136.
    85. Riva G, Waterworth JA, Waterworth EL, Mantovani F. From intention to action: The role of presence. New Ideas Psychol 2011 Jan;29(1):24-37. [CrossRef]
    86. Kennedy R, Drexler J, Compton D, Stanney K, Lanham D, Harm D. Configural scoring of simulator sickness, cybersickness and space adaptation syndrome: similarities and differences. In: Hettinger LJ, Haas MW, editors. Virtual and adaptive environments: Applications, implications, and human performance issues. Mahwah, NJ: Lawrence Erlbaum Associates; 2003:247.
    87. Saredakis D, Szpak A, Birckhead B, Keage H, Rizzo A, Loetscher T. Factors associated with virtual reality sickness in head-mounted displays: a systematic review and meta-analysis. Front Hum Neurosci 2020;14:96. [CrossRef] [Medline]
    88. Gates NJ, Rutjes AW, Di Nisio M, Karim S, Chong L, March E, et al. Computerised cognitive training for 12 or more weeks for maintaining cognitive function in cognitively healthy people in late life. Cochrane Database Syst Rev 2020 Feb 27;2:CD012277 [FREE Full text] [CrossRef] [Medline]

    ‎
    AD: Alzheimer disease
    AES: Apathy Evaluation Scale
    CDR: Clinical Dementia Rating
    CDR-SOB: Clinical Dementia Rating-Sum of Boxes
    fMRI: functional magnetic resonance imaging
    GDS: Geriatric Depression Scale
    ICT: information and communication technology
    K-BNT: Korean version of the Boston Naming Test
    MCI: mild cognitive impairment
    MMSE: Mini-Mental State Examination
    MRI: magnetic resonance imaging
    PANAS: Positive and Negative Affect Schedule
    PANAS-N: Positive and Negative Affect Schedule-negative
    PANAS-P: Positive and Negative Affect Schedule-positive
    QoL: quality of life
    RCFT: Rey-Osterrieth Complex Figure Test
    rsfMRI: resting-state functional magnetic resonance imaging
    SSQ: Simulator Sickness Questionnaire
    SVLT: Seoul Verbal Learning Test
    TMT: Trail Making Test
    VR: virtual reality

    Edited by G Eysenbach; submitted 23.09.20; peer-reviewed by N Martin; comments to author 15.10.20; revised version received 26.10.20; accepted 11.04.21; published 06.05.21

    Copyright

    ©Jae Myeong Kang, Nambeom Kim, Sook Young Lee, Soo Kyun Woo, Geumjin Park, Byeong Kil Yeon, Jung Woon Park, Jung-Hae Youn, Seung-Ho Ryu, Jun-Young Lee, Seong-Jin Cho. Originally published in the Journal of Medical Internet Research (https://www.jmir.org), 06.05.2021.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on https://www.jmir.org/, as well as this copyright and license information must be included.