Review
Abstract
Background: Stroke remains one of the major chronic illnesses worldwide that health care organizations will need to address for the next several decades. Individuals poststroke are subject to levels of cognitive impairment and mental health problems. Virtual reality (VR)-based therapies are new technologies used for cognitive rehabilitation and the management of psychological outcomes.
Objective: This study performed a meta-analysis to evaluate the effects of VR-based therapies on cognitive function and mental health in patients with stroke.
Methods: A comprehensive database search was performed using PubMed, MEDLINE (Ovid), Embase, Cochrane Library, and APA PsycINFO databases for randomized controlled trials (RCTs) that studied the effects of VR on patients with stroke. We included trials published up to April 15, 2021, that fulfilled our inclusion and exclusion criteria. The literature was screened, data were extracted, and the methodological quality of the included trials was assessed. Meta-analysis was performed using RevMan 5.3 software.
Results: A total of 894 patients from 23 RCTs were included in our meta-analysis. Compared to traditional rehabilitation therapies, the executive function (standard mean difference [SMD]=0.88, 95% confidence interval [CI]=0.06-1.70, P=.03), memory (SMD=1.44, 95% CI=0.21-2.68, P=.02), and visuospatial function (SMD=0.78, 95% CI=0.23-1.33, P=.006) significantly improved among patients after VR intervention. However, there were no significant differences observed in global cognitive function, attention, verbal fluency, depression, and the quality of life (QoL).
Conclusions: The findings of our meta-analysis showed that VR-based therapies are efficacious in improving executive function, memory, and visuospatial function in patients with stroke. For global cognitive function, attention, verbal fluency, depression, and the QoL, further research is required.
Trial Registration: PROSPERO International Prospective Register of Systematic Reviews CRD42021252788; https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=252788
doi:10.2196/31007
Keywords
Introduction
Stroke is the second-highest cause of death worldwide and a leading cause of disability, contributing to approximately 3 million cases every year in China [
]. Survival rates of stroke have improved steadily over the past 2 decades; however, a longer survival length is often accompanied by the sequelae of long-term effects [ , ]. One such long-term effect of stroke is cognitive impairment [ ]. It is estimated that approximately 80% of stroke survivors may experience new onset or worsening of cognitive impairment during their recovery [ , ]. Brain changes can affect 1 or more cognitive domains, including spatial awareness, praxis, perception, memory, language, and executive function [ ]. Stroke-related cognitive deficits may interfere with functional recovery, the ability to (re-)acquire motor skills, and compromise independence [ , , ], potentially exerting considerable influence on rehabilitation outcomes. Although stroke occurs as an acute event, it is a chronic condition that necessitates multidimensional and overwhelming treatment [ ]. The neurological trauma of stroke survivors is irreversible and devastating; hence, after a stroke, patients face various stressors, which may trigger different aspects of their health, especially their mental health [ ]. Mental health is defined as a state of complete happiness, which refers to our ability to enjoy life and cope with challenges [ ]. Depression, anxiety, and stress are particularly common and persistent psychological problems following a stroke, with a high risk of relapse, even after a long period of remission [ ]. Approximately 22%-40% of stroke survivors are affected by depression symptoms, 9.4%-36.7% by an anxiety disorder, and around 31% by poststroke stress [ ]. Multiple studies have also shown that due to unsatisfactory sequelae and irreversible prognosis, patients with stroke always experience higher levels of emotional distress and ineffective coping than the general population, which poses adverse effects on the rehabilitation process and indirectly affects the patients’ quality of life (QoL) [ , ].Given the cognitive and psychological impacts on stroke survivors, strategies to support these individuals are considered a priority. Targeted rehabilitation can help address the clinically important cognitive and psychological consequences of stroke. However, the effect sizes of conventional rehabilitation are moderate at best, with high dropout rates, as patients, especially those with cognitive and psychological impairments, use rehabilitation services less efficiently and show less adherence to required changes in their lifestyle [
, ]. With underscored inadequacies of conventional rehabilitation, new high-tech innovations that use virtual reality (VR) are considered a potential avenue toward effective rehabilitation and may offer a supplementary platform to enhance the cognitive and psychological benefits after stroke.VR is defined as a user–computer interface created with computer hardware and software, enabling the user to simulate interactions with environments that appear and feel similar to real-world objects and events through multiple sensory canals [
]. The term “virtual reality” was first coined in the late 1980s [ ]. Until the late 1990s [ ], VR-based rehabilitation was more widely used and sophisticated within health care systems as VR technology became more readily available and affordable [ , ]. Multiple recent studies have shown the positive role of VR in several clinical conditions, including acute pain [ ], social anxiety disorder [ ], and chronic obstructive pulmonary disease [ ]. With the characteristics of immersion, interaction, and imagination, the application of VR in neurorehabilitation has also been growing rapidly in the recent years [ , ]. Currently, the neurorehabilitation applications of VR have been introduced in the field of neurorehabilitation for Parkinson’s disease, Alzheimer’s disease, brain injury, cerebral palsy, unilateral spatial neglect, and, especially, stroke [ - ]. Management of VR-based neurorehabilitation for stroke is highly related to recovery, reorganization, and neuroplasticity. VR can also exploit a brain mechanism known as embodied simulation, encouraging the patients’ motivation and participation by allowing physical and emotional interactions with the environment through the digital medium [ ]. In particular, VR offers a high level of flexibility and control over therapeutic tasks by automatically recording and tracking the user’s performance [ , ], enabling the user to perform intensive training according to their ability and keeping the experience of interaction with therapeutic tasks enjoyable and compelling [ , ].Due to tremendous benefits for health and the relatively inexpensive medium for rehabilitation training, a significant amount of work focusing on the effects of VR has been proposed for the rehabilitation of deficits following stroke [
, ]. Multiple recent randomized controlled trials (RCTs) on the effects of VR have supported the use of VR in stroke rehabilitation to improve cognitive and psychological outcomes [ - ]. In contrast to studies supporting VR-based rehabilitation, some researchers have argued that there are no or only minor effects detected in global cognitive function, memory, depression, or the QoL [ , , ].Although there are several systematic reviews conducted on the contribution of VR-based interventions to cognition rehabilitation, no unified conclusion has yet been reached. Anna et al [
] conducted a meta-analysis by summarizing RCTs published before June 2017 and supported VR as an adjunct to cognition rehabilitation. However, the number of included studies was only 2, suggesting a tenuous finding.Another recent review [
] extensively searched relevant trials conducted before November 2019. It examined the effectiveness of VR-based therapies on both global cognition and domain-specific cognition poststroke, suggesting that VR therapy is not superior to control interventions in improving both global cognition and domain-specific cognition in patients with stroke. However, their conclusions were also merely based on data from 2 studies, resulting in insufficient statistical power. A systematic review by Zhang et al [ ], only focusing on global cognitive function, also supported no benefits of VR for cognition. Furthermore, the psychological benefits of VR have also received more attention recently. A systematic review [ ] indicated that exercise-based VR interventions are potentially valuable as a support in improving psychological outcomes. Nonetheless, due to the diversity of study design and insufficient data, the authors only described their results and did not conduct a meta-analysis. Hence, the overall effect of VR-based therapies on improving cognition and mental health in patients with stroke remains unclear.The evidence is sparse, and a comprehensive picture of the effects of VR-based therapies is needed. With ongoing advancements in VR, a plethora of original studies focused on cognitive recovery and mental health after stroke has been recently published. This makes it possible to review VR applications and guide future design and implementation of VR technology in clinical practice. Thus, our review aimed to comprehensively examine the effects of VR-based therapies on cognition, the QoL, and depressive symptoms in patients with stroke.
Methods
This systematic review was registered with Prospero, the International Prospective Registry of Systematic Reviews (registration no. CRD42021252788). We conducted this systematic review according to the Preferred Reporting Items for Systematic Reviews and Meta-Analysis (PRISMA) statement.
Literature Search Strategy
RCTs from PubMed, Embase, MEDLINE (Ovid), Cochrane Library, and APA PsycINFO databases were comprehensively searched. RCTs published in English before April 15, 2021, investigating the impact of VR-based therapies on the cognition and mental health of patients with stroke were included. In addition, we conducted reference tracking on the published trials and meta-analysis reviews in this field to make sure all relevant studies were included. The search strategies, including terms for stroke, VR, cognition function, the QoL, and depression, are presented in
.Inclusion Criteria
Types of Trials
We only included RCTs that were peer reviewed and written in English. Reviews, single-case studies, dissertations, conference papers, and abstracts were excluded.
Types of Participants
Patients aged 18 years or older with stroke were included. Patients with stroke were identified by any available diagnostic criteria, such as brain computed tomography, magnetic resonance imaging, or other standards and consensus by clinicians. To maximize the number of meta-analyses, we did not restrict the search to any specific stroke population.
Types of Interventions
VR-based interventions include either single-component interventions or multiple-component interventions for patients with stroke. VR had to consist of a screen or a head-mounted device, including games with immersive, semi-immersive, and non-immersive systems, simulating virtual environments using computers, video consoles, mobile apps, and VR. The intervention setting, duration, and frequency were not restricted. Participants in the control group could undergo usual care or non-VR interventions.
Types of Outcome Measures
The primary outcomes were global cognition and domain-specific cognition (eg, attention, executive function, memory, psychomotor speed, verbal fluency). According to Isabelle Dor’s [
] classification, the components of mental health include emotional well-being/QoL and psychological and social well-being. Our systematic review specifically included depression, stress/distress, anxiety, coping competence, overall mental health, the QoL, and self-efficacy.Study Selection and Data Extraction
Two reviewers independently assessed studies obtained from the database searches in three phases: title, abstract, and full-paper screening. Data were extracted by the same two reviewers from trials using a Microsoft Excel spreadsheet. The information extracted from each trial included the first author, year, setting, sample size, participant ages, details of intervention and the control, outcomes, and corresponding measures. Disagreements were resolved through a discussion with a senior investigator.
Quality Appraisal
The Cochrane risk-of-bias tool was used to assess the quality of eligible trials, focusing on sequence generation, allocation concealment, blinding, attrition bias, completeness of outcome data, and other sources of bias. Any disagreements were settled by a discussion with a third person.
Data Synthesis and Analysis
The standard mean difference (SMD) and weighted mean difference (WMD) with a 95% confidence interval (CI) were determined for continuity data. Statistical heterogeneity was assessed using the Cochran Q test and the Higgins I2 statistical test. The results implied low-level heterogeneity when I2 < 50%, and we used a fixed-effects model to fix the issue. The results implied moderate or high heterogeneity when I2 ≥ 50%, and subgroups were determined based on the different characteristics of the studies to identify the sources of heterogeneity. Sensitivity analysis was performed by comparing the effect sizes and CIs of the remaining RCTs after removing each included RCT at a time. Descriptive analysis was used to deal with nonmergeable data. Potential publication bias was assessed with funnel plots and the Egger test if the group included 10 trials or more [
]. All meta-analyses were performed in RevMan 5.3 (Nordic Cochrane Center, Cochrane Collaboration, Copenhagen, Denmark) for outcomes that were evaluated in at least 2 of the included RCTs.Results
Study Selection
A total of 7117 studies were identified from the 5 databases searched. A further 2932 studies were identified through manual searching, including searching for systematic reviews, and included studies’ reference lists. After 261 duplicates were removed, 4189 full-text manuscripts were identified by screening their titles and abstracts. After full-text reviews, 23 studies (including 894 participants) from 8 countries satisfied the inclusion criteria and were eventually included in our systematic review (
).Study Characteristics
shows the study characteristics and patient demographic data of the included trials. Sample sizes ranged from 18 to 145, for a total of 894 patients with stroke. In total, 11 (47.8%) of the 23 trials were conducted in Korea [ , , - ], 3 (13%) in Portugal [ - ], 2 (8.7%) in Spain [ , ], 2 in China [ , ], 2 in Australia [ , ], and 1 (4.3%) each in Lithuania [ ], Brazil [ ] and Turkey [ ].
Regarding the types of VR-based therapies, 16 (69.6%) trials administered VR as a singular session [
- , , , - , , , - , , ], 5 (21.7%) trials were categorized as having used VR-based therapies plus occupational therapy [ , , , , ], and 2 trials as having used VR-based therapies plus computer-assisted cognitive rehabilitation [ , ]. The frequency and duration of VR exposure varied considerably between trials. In our review, the duration of VR-based therapies ranged from 3 to 10 weeks, with the majority being 4 weeks, and the frequency of intervention varied from 2 to 5 times per week. The control group underwent conventional rehabilitation therapy [ - , , , , , , , , ] or other support interventions such as occupational therapy [ , , , , , , ], computer-assisted cognitive rehabilitation [ , ], and other rehabilitation therapies [ , , ].Of the 23 included trials, outcomes of our interest included global cognitive function (10 trials, 43.5%), executive function (5 trials, 21.7%), memory (5 trials), verbal fluency (2 trials, 8.7%), visuospatial ability (2 trials), attention (6 trials, 26.1%), depression symptom (5 trials), and the QoL (7 trials, 30.4%). Although the tools used for outcome evaluation varied across trials, all were valid scales, and the process of data collection was carried out by experienced staff. Tools used to evaluate global cognitive function included the Montreal Cognitive Assessment (MoCA) [
, , , ], the Mini-Mental State Examination (MMSE) [ , , , ], and the Loewenstein Occupational Therapy Cognitive Assessment (LOTCA) [ , ]. Five trials evaluated the executive function domain using the CogState Groton Maze Learning Task [ ], the Tower of London Test [ ], the Stroop test [ ], Trail-Making Test-B [ ], and the the Digit Span Test [ ]. Tools used to evaluate memory of patients with stroke included the visual recognition test [ ], the visual span test [ ], Wechsler Memory Scale-III [ ], the Digit Span Test [ ], and the Trail-Making Test [ ]. The Digit Span Test [ ] and Wechsler Memory Scale-III [ ] were used to assess the verbal fluency of patients. Visuospatial ability was evaluated using the Motor-Free Visual Perception Test-3 [ ] and the visual span test [ ]. Attention was evaluated using the Single Letter Cancelation Test [ ], Color of Color Word in Word–Color Test [ ], and the Trail-Making Test [ , , , ]. The Hamilton Scale [ , , ], the Beck Depression Inventory [ ], and the Neurobehavioral Functioning Inventory [ ] were used to assess the level of depression. The Stroke Impact Scale [ , , ] was primarily used to assess the QoL, followed by the Short-Form 36 Health Survey Questionnaire [ ], the Short-Form 8 Health Survey Questionnaire [ ], the Nottingham Health Profile [ ] and the EuroQoL Five Dimensions Questionnaire [ ].Risk-of-Bias Assessment
The risk of bias is summarized in
. In general, all 23 trials included in our review showed an acceptable risk of bias. The randomization sequence was adequately generated in 20 trials (86.9%), and 11 trials (47.8%) adequately concealed allocation. We categorized the risk of performance bias in all studies as low because blinding of participants and personnel was not possible in our systematic review. Approximately half of the trials blinded outcome assessors, and the risk of detection bias of these trials was judged as low. Of the 23 trials, 16 (69.6%) had no dropouts or used the intention-to-treat principle to compensate for dropouts; therefore, their risk of reporting bias was rated as low. All trials were categorized as having a low risk of bias in terms of attrition and other bias.Results of the Meta-analysis
The outcomes of global cognitive function, domain-specific cognition, and mental health were evaluated using various tools in the included trials. Domain-specific cognition included executive function, memory, verbal fluency, visuospatial ability, and attention in our review. Depression and the QoL were synthesized in our review. The change scores from baseline to final values were used in our final efficacy analysis. The results of our analysis of each outcome are as follows.
Global Cognitive Function
As shown in
, effect sizes of global cognitive function could be generated for 10 trials [ , , , , , - , , ] with 323 patients. A random-effects model was used as heterogeneity existed in our review (I2=89%, P<.001). Compared to the control, there was no evidence that VR-based therapies can significantly improve global cognitive function for patients with stroke (SMD=0.32, 95% CI=–0.43-1.06, P=.41).In the subgroup that included VR versus the usual-care control group, the effect was significant (SMD=2.51, 95% CI=0.52-4.5, P=0.01; I2=87%, P<.001; high heterogeneity; N=61), while versus the other-support control group, no significant effect was detected (SMD=–0.41, 95% CI=–0.99-0.17, P=.16; I2=79%, P<.001; high heterogeneity; N=262). The subgroup interaction was significant (χ2=7.65, P=.01, I2=86.9%). In the subgroups of duration (less than 1-month or over 1-month intervention) and measurement instruments (MMSE, MoCA, or LOTCA), the subgroup interactions were nonsignificant (duration: χ2=0.12, P=.73, I2=0%; measurement instruments: χ2=2.83, P=.24, I2=29.2%), and heterogeneity was still significant in most of these subgroups.
Executive Function
The effect of VR-based therapies on executive function was measured in 5 trials [
, , , , ] including 133 patients. The pooled results with a random-effects model showed that VR-based therapies can significantly improve executive function compared to the control (SMD=0.88, 95% CI=0.06-1.70, P=.03), with high heterogeneity (I2=79%, P<.001; ). In the subgroups of the control groups (usual-care or other-support control) and duration (less than 1-month or over 1-month intervention), the subgroup interactions were nonsignificant (control: χ2=0.91, P=.34, I2=0%; duration: χ2=1.46, P=.23, I2=31.5%). Heterogeneity still existed in the subgroups.Memory
The effect of VR-based therapies on memory was measured in 5 trials [
, , , , ] involving 167 participants. Based on a random-effects model, our results showed a beneficial effect of VR-based therapies on enhancing memory in patients with stroke (SMD=1.44, 95% CI=0.21-2.68, P=.02), with high heterogeneity (I2=91%, P<.001; ). The control and duration subgroup interactions were nonsignificant (control: χ2=0.12, P=.72, I2=0%; duration: χ2=0.88, P=.35, I2=0%). Moderate heterogeneity existed in all subgroups.Verbal Fluency
The effect of VR-based therapies on verbal fluency was measured in 2 trials [
, ] involving 64 patients. Using a fixed-effects model, our meta-analysis showed no statistical significance on verbal fluency (SMD=0.11, 95% CI=–0.38-0.61, P=.65), with no heterogeneity (I2=0%, P=.65; ).Visuospatial Ability
The effect of VR-based therapies on visuospatial ability was measured in 2 trials [
, ] involving 56 patients. We used a fixed-effects model for pooling the results, and the overall result showed that VR-based therapies have a significant effect on visuospatial ability compared with the control (SMD=0.78, 95% CI=0.23-1.33, P=.006), with no heterogeneity (I2=6%, P=.30; ).Attention
The effect of VR-based therapies on attention was measured in 6 trials [
, , - ] involving 166 patients. We used a fixed-effects model for pooling the results, and the overall result presented no significant effect on attention between groups (SMD=–0.09, 95% CI=–0.39-0.22, P=.58), with no heterogeneity (I2=0%, P=.56; ).Depression
The effect of VR-based therapies on depression symptoms was measured in 5 trials [
, , , , ] including 255 participants. Lower scores indicated better psychological states. Based on a random-effects model, our results indicated that there was no statistical significance between the VR and control groups (SMD=0.20, 95% CI=–0.25-0.64, P=.39), with moderate heterogeneity (I2=56%, P=.06; ).QoL
The effect of VR-based therapies on the QoL was measured in 7 trials [
, , , , , , ] including 272 patients. Using a fixed-effects model, our results showed that VR-based therapies had no significant beneficial effect on the QoL (SMD=0.07, 95% CI=–0.17-0.31, P=.55), with low heterogeneity (I2=12%, P=.34; ).Publication Bias and Sensitivity Analyses
Funnel plots for global cognitive function showed symmetry. The Egger test of global cognitive function was not significant (P=.29,
), indicating no significant publication bias in our review. A sensitivity analysis was conducted, excluding individual trials one by one, to confirm the results of our meta-analysis. We found that except for the outcomes of executive function, the rest of the outcomes showed no substantial modification of the overall effect.Discussion
Principal Findings
Our meta-analysis, based on 23 RCTs, indicated that VR therapy is an effective method of improving executive function, memory, and visuospatial ability on patients with stroke. However, current evidence fails to support the effects of VR-based therapies in improving global cognitive function, attention, verbal fluency, depression, and the QoL. Unlike prior systematic reviews [
, ] primarily focused more on either one type of VR, such as exercise-based VR, or one aspect of cognition indicators, such as only global cognitive function, our review [ ] comprehensively evaluated the effect of VR-based therapies on global and domain-specific cognition and mental health outcomes.VR-based therapies have demonstrated efficacy in the diagnosis, physical rehabilitation, and cognitive rehabilitation of individuals with neurocognitive disorders [
, ]. A growing body of studies has confirmed that the application of VR is effective in cognitive rehabilitation for patients affected by stroke [ , , ]. However, our pooled results showed no significant benefits of VR in improving global cognitive function for patients with stroke. Our result was comparable to recently published meta-analysis reviews by Wiley et al [ ] and Zhang et al [ ], who reported that VR therapy is not superior to control interventions in improving global cognition in individuals with stroke. This result differs from another systematic review [ ], which only included 4 studies published in 2018. The review found that there is a small-to-medium effect of VR therapy on cognitive outcomes for people after a stroke. A possible explanation for this conflicting finding is that most VR-based therapies do not always concentrate on the training of cognitive function. It remains to be determined whether more training sessions specifically focused on global cognitive function would affect outcomes.Furthermore, the samples had relatively heterogeneous characteristics, such as stroke onset, the severity of the impairment, and lesion characteristics, which may affect cognition recovery in poststroke patients.
Cognitive function is a complex concept that includes various domain-specific cognition, such as attention, executive function, memory, and psychomotor speed [
]. In our review, we found improvements in executive function, memory, and visuospatial ability, indicating that VR can be considered an effective therapy for improving domain-specific cognition. These positive findings of VR therapy are in line with previous reviews [ , , ], which report that VR represents a promising methodological approach, implementing specific cognitive and behavioural functions, such as executive function, attention, spatial cognition, memory, and language. A previous systematic review by Alexander et al [ ] also supports these positive findings on domain-specific cognition. Wiley et al [ ] employed a systematic review to examine the effectiveness of exercise-based VR therapy for poststroke, with 8 studies involving 196 participants, which did not find improvements in attention, memory, and language poststroke. The added value of VR in domain-specific cognition compared with most of the currently provided conventional therapies may be underlined by the following mechanisms. Flannery et al [ ] stated that VR training activates brain metabolism, increases cerebral blood flow, and the release of neurotransmitters. Carrieri et al [ ] confirmed that VR can foster the reactivation and improvement of various cortex functions and optimize the efficiency of the sensory cortex and is also effective in improving cognitive function.Poor mental health after a stroke is common and complex. An individual’s QoL is greatly reduced by re-experiencing the situation with depression, anxiety, agitation, and stress. Many studies and clinical trials have shown the potential of VR in relieving stress, depression, and anxiety in an imagined space, which makes it possible to provide efficient educational and psychological training without causing harm to patients with psychological problems [
, ]. There are several possible explanations for these improvements in mental health. Damsbo [ ] explained that the use of VR allows individuals to learn emotion regulation strategies in the context of life-like virtual environments, thereby alleviating their negative emotions during long-term recovery. Choi et al [ ] thought VR, through quasi-naturalistic and realistic stimuli in a multisensory fashion, can significantly enhance patients’ awareness of the movement performed, as well as self-identification and self-recognition, and makes patients derive a high level of interest and enjoyment via the use of VR. However, the overall effects of VR on depression and the QoL were not encouraging in our meta-analysis. Some studies agree with the findings of our review [ , ]. The results of Lee [ ] showed that some VR-based games are not suitable for patients following a stroke. Furthermore, patients with cognitive impairment may feel frustrated during the therapy, resulting in poor emotional experiences. Hence, the degree to which participants feel motivated and engaged during VR therapy can depend on the individual characteristics and the intervention content. The investigation of the mechanisms underlying how VR can influence mental functions is a critical point in stroke rehabilitation research. A likely cause of disagreement in findings on the QoL is that the QoL may worsen over time after stroke. However, the mean duration since stroke is inconsistent, even with no restrictions on duration among the trials included in our review. It is, therefore, possible that the duration since stroke is an important factor that should be considered when selecting a VR therapy to increase the QoL for stroke patients.Subgroup Analyses
Most subgroup analyses did not reveal significant differences between groups. Subgroup analyses consisted of a small number of comparisons, and the lack of relevant differences in most subgroup analyses might be caused by low statistical power. Only the subgroup analysis on global cognitive function showed that the effect of the usual-care control group was significant. There was also the issue with moderate-to-high heterogeneity in our meta-analysis, and grouping the included trials by measurement tools, duration of intervention, and delivery of control did not eliminate heterogeneity. Given the highly variable interventions of included trials, it is not surprising to find high heterogeneity in this case.
Strengths and Limitations
This meta-analysis followed the guidelines for performing rigorous systematic reviews [
]. Our review was only based on RCTs, which reinforces the evidence of our results. We also proposed a rigorous screening and search strategy to identify the most comprehensive literature in five major databases. Consequently, the results of our review are a widespread belief. However, there were still some potential limitations to our review. First, the number of trials included in our meta-analysis was limited. Hence, the power to detect small effect sizes was limited. Second, the included trials were extremely varied in terms of intervention contents and doses, and delivery of the control and measurement instruments, which made it rather complex to determine the optimal intensity of VR programs. Third, the quality, quantity, and sample size of included trials were far from ideal. Concealed treatment allocation was often not guaranteed, and blinding of outcome assessments was often not carried out. For example, only less than half of the included trials reported details of allocation concealment, leading to selection bias or confounding of the pooled results. Concerning detecting bias, almost half of the included trials failed to report information or had a high risk of blinding outcome assessment. Despite the rigorous nature of the included research designs (only included RCTs), our results must be interpreted with caution. Fourth, since we only considered effect post-intervention, the sustainability of VR-based therapy effects was not explored in our review. Indeed, details of long-term effects were unavailable in most trials included. Further research is needed to assess whether the effect observed in our review would persist over time and, if not, to evaluate at what duration and frequency the VR therapy should be repeated in order to sustain its effect. Finally, although a significant amount of work has been done in this area with promising results, the relevant characteristics of VR systems and the quantification of their impact on recovery are not yet clearly understood. As a result, we do not know how the different parameters of the proposed VR scenarios exactly affect recovery or whether they are effective at all. There is also a need to consider individual variability in order to optimize the impact of training.Implications for Clinical Practice and Future Research
Notwithstanding potential limitations, the present findings offer some implications for researchers and health practitioners. In this high-tech era, clinicians may have more options and alternatives by providing an interactive and visually stimulating approach for patients with stroke, especially for those who cannot easily access traditional rehabilitation methods. The following issues need to be considered when applying VR-based therapies. First, VR should be adapted to the patient’s needs and characteristics in performing activities, tasks, and tests. Second, safety problems need to be highlighted for older adults with reduced vision or other sensory problems. It is critical to consider a methodology type and an interaction technique that will result in the safe implementation of a VR therapy for patients with sensory and cognitive impairment. Finally, the price of VR equipment should be considered to meet the needs of target populations. In addition, there is a need for further research in this field to promote cost-effective care.
Conclusions
VR is a promising approach and can be used effectively in clinical neurorehabilitation. Although existing studies are limited, this review demonstrated statistically significant effects of VR-based therapies on executive function, memory, and visuospatial function in patients with stroke, but not on global cognitive function, attention, verbal fluency, depression, and the QoL. Larger, multicenter RCTs are warranted to confirm these positive effects. The completion of high‐quality trials will ultimately advance the knowledge about optimal cognitive and psychological rehabilitation strategies for patients with stroke.
Conflicts of Interest
None declared.
Search strategy.
DOCX File , 22 KB
Study characteristics.
DOCX File , 43 KB
Forest plot for VR on depression and QoL. VR: virtual reality; QoL: quality of life.
DOCX File , 211 KB
The Egger funnel plot of publication bias.
DOCX File , 20 KBReferences
- Zhang Q, Zhang K, Li M, Gu J, Li X, Li M, et al. Validity and reliability of the Mandarin version of the Treatment Burden Questionnaire among stroke patients in Mainland China. Fam Pract 2021 Jul 28;38(4):537-542. [CrossRef] [Medline]
- Feigin VL, Forouzanfar MH, Krishnamurthi R, Mensah GA, Connor M, Bennett DA, et al. Global and regional burden of stroke during 1990–2010: findings from the Global Burden of Disease Study 2010. The Lancet 2014 Jan 18;383(9913):245-255 [FREE Full text] [CrossRef] [Medline]
- Patel MD, Tilling K, Lawrence E, Rudd AG, Wolfe CDA, McKevitt C. Relationships between long-term stroke disability, handicap and health-related quality of life. Age Ageing 2006 May;35(3):273-279. [CrossRef] [Medline]
- Donovan NJ, Kendall DL, Heaton SC, Kwon S, Velozo CA, Duncan PW. Conceptualizing functional cognition in stroke. Neurorehabil Neural Repair 2008;22(2):122-135. [CrossRef] [Medline]
- Al-Qazzaz NK, Ali SH, Ahmad SA, Islam S, Mohamad K. Cognitive impairment and memory dysfunction after a stroke diagnosis: a post-stroke memory assessment. Neuropsychiatr Dis Treat 2014;10:1677-1691 [FREE Full text] [CrossRef] [Medline]
- Nys GMS, van Zandvoort MJE, de Kort PLM, van der Worp HB, Jansen BPW, Algra A, et al. The prognostic value of domain-specific cognitive abilities in acute first-ever stroke. Neurology 2005 Mar 08;64(5):821-827. [CrossRef] [Medline]
- Nys GMS, Van Zandvoort MJE, De Kort PLM, Jansen BPW, Van der Worp HB, Kappelle LJ, et al. Domain-specific cognitive recovery after first-ever stroke: a follow-up study of 111 cases. J Int Neuropsychol Soc 2005 Nov;11(7):795-806. [CrossRef] [Medline]
- Qian J, McDonough DJ, Gao Z. The effectiveness of virtual reality exercise on individual's physiological, psychological and rehabilitative outcomes: a systematic review. Int J Environ Res Public Health 2020 Jun 10;17(11):4133 [FREE Full text] [CrossRef] [Medline]
- Boger EJ, Demain S, Latter S. Self-management: a systematic review of outcome measures adopted in self-management interventions for stroke. Disabil Rehabil 2013 Aug;35(17):1415-1428 [FREE Full text] [CrossRef] [Medline]
- Doré I, Caron J. Mental health: concepts, measures, determinants. Sante Ment Que 2017;42(1):125-145 [FREE Full text] [Medline]
- Ayerbe L, Ayis S, Rudd AG, Heuschmann PU, Wolfe CDA. Natural history, predictors, and associations of depression 5 years after stroke: the South London Stroke Register. Stroke 2011 Jul;42(7):1907-1911. [CrossRef] [Medline]
- Almhdawi KA, Alazrai A, Kanaan S, Shyyab AA, Oteir AO, Mansour ZM, et al. Post-stroke depression, anxiety, and stress symptoms and their associated factors: a cross-sectional study. Neuropsychol Rehabil 2021 Aug 18;31(7):1091-1104. [CrossRef] [Medline]
- Towfighi A, Ovbiagele B, El Husseini N, Hackett ML, Jorge RE, Kissela BM, American Heart Association Stroke Council, Council on Cardiovascular Stroke Nursing, Council on Quality of Care Outcomes Research. Poststroke depression: a scientific statement for healthcare professionals from the American Heart Association/American Stroke Association. Stroke 2017 Feb;48(2):e30-e43. [CrossRef] [Medline]
- Baumeister H, Härter M. Prevalence of mental disorders based on general population surveys. Soc Psychiatry Psychiatr Epidemiol 2007 Jul;42(7):537-546. [CrossRef] [Medline]
- Gillen R, Tennen H, McKee TE, Gernert-Dott P, Affleck G. Depressive symptoms and history of depression predict rehabilitation efficiency in stroke patients. Arch Phys Med Rehabil 2001 Dec;82(12):1645-1649. [CrossRef] [Medline]
- Schöttke H, Gerke L, Düsing R, Möllmann A. Post-stroke depression and functional impairments: a 3-year prospective study. Compr Psychiatry 2020 May;99:152171 [FREE Full text] [CrossRef] [Medline]
- Dellazizzo L, Potvin S, Luigi M, Dumais A. Evidence on virtual reality-based therapies for psychiatric disorders: meta-review of meta-analyses. J Med Internet Res 2020 Aug 19;22(8):e20889 [FREE Full text] [CrossRef] [Medline]
- Dermody G, Whitehead L, Wilson G, Glass C. The role of virtual reality in improving health outcomes for community-dwelling older adults: systematic review. J Med Internet Res 2020 Jun 01;22(6):e17331 [FREE Full text] [CrossRef] [Medline]
- Riva G, Mancuso V, Cavedoni S, Stramba-Badiale C. Virtual reality in neurorehabilitation: a review of its effects on multiple cognitive domains. Expert Rev Med Devices 2020 Oct;17(10):1035-1061. [CrossRef] [Medline]
- Threapleton K, Drummond A, Standen P. Virtual rehabilitation: what are the practical barriers for home-based research? Digit Health 2016 Apr;2:2055207616641302 [FREE Full text] [CrossRef] [Medline]
- Jung T, Moorhouse N, Shi X, Amin MF. A virtual reality-supported intervention for pulmonary rehabilitation of patients with chronic obstructive pulmonary disease: mixed methods study. J Med Internet Res 2020 Jul 07;22(7):e14178 [FREE Full text] [CrossRef] [Medline]
- Smith V, Warty RR, Sursas JA, Payne O, Nair A, Krishnan S, et al. The effectiveness of virtual reality in managing acute pain and anxiety for medical inpatients: systematic review. J Med Internet Res 2020 Nov 02;22(11):e17980 [FREE Full text] [CrossRef] [Medline]
- Kim H, Lee S, Jung D, Hur J, Lee H, Lee S, et al. Effectiveness of a participatory and interactive virtual reality intervention in patients with social anxiety disorder: longitudinal questionnaire study. J Med Internet Res 2020 Oct 06;22(10):e23024 [FREE Full text] [CrossRef] [Medline]
- Kim W, Cho S, Ku J, Kim Y, Lee K, Hwang H, et al. Clinical application of virtual reality for upper limb motor rehabilitation in stroke: review of technologies and clinical evidence. J Clin Med 2020 Oct 21;9(10):3369 [FREE Full text] [CrossRef] [Medline]
- Aminov A, Rogers JM, Middleton S, Caeyenberghs K, Wilson PH. What do randomized controlled trials say about virtual rehabilitation in stroke? A systematic literature review and meta-analysis of upper-limb and cognitive outcomes. J Neuroeng Rehabil 2018 Mar 27;15(1):29 [FREE Full text] [CrossRef] [Medline]
- Jin R, Pilozzi A, Huang X. Current cognition tests, potential virtual reality applications, and serious games in cognitive assessment and non-pharmacological therapy for neurocognitive disorders. J Clin Med 2020 Oct 13;9(10):3287 [FREE Full text] [CrossRef] [Medline]
- Imbimbo I, Coraci D, Santilli C, Loreti C, Piccinini G, Ricciardi D, et al. Parkinson's disease and virtual reality rehabilitation: cognitive reserve influences the walking and balance outcome. Neurol Sci 2021 Mar 04. [CrossRef] [Medline]
- Shen J, Xiang H, Luna J, Grishchenko A, Patterson J, Strouse RV, et al. Virtual reality-based executive function rehabilitation system for children with traumatic brain injury: design and usability study. JMIR Serious Games 2020 Aug 25;8(3):e16947 [FREE Full text] [CrossRef] [Medline]
- Teo W, Muthalib M, Yamin S, Hendy AM, Bramstedt K, Kotsopoulos E, et al. Does a combination of virtual reality, neuromodulation and neuroimaging provide a comprehensive platform for neurorehabilitation? A narrative review of the literature. Front Hum Neurosci 2016 Jun 24;10:284 [FREE Full text] [CrossRef] [Medline]
- Edmans JA, Gladman JRF, Cobb S, Sunderland A, Pridmore T, Hilton D, et al. Validity of a virtual environment for stroke rehabilitation. Stroke 2006 Nov;37(11):2770-2775. [CrossRef] [Medline]
- Levin MF. Can virtual reality offer enriched environments for rehabilitation? Expert Rev Neurother 2011 Feb;11(2):153-155. [CrossRef] [Medline]
- Taylor MJD, McCormick D, Shawis T, Impson R, Griffin M. Activity-promoting gaming systems in exercise and rehabilitation. J Rehabil Res Dev 2011;48(10):1171-1186 [FREE Full text] [CrossRef] [Medline]
- Gamito P, Oliveira J, Coelho C, Morais D, Lopes P, Pacheco J, et al. Cognitive training on stroke patients via virtual reality-based serious games. Disabil Rehabil 2017 Feb 05;39(4):385-388. [CrossRef] [Medline]
- Kim BR, Chun MH, Kim LS, Park JY. Effect of virtual reality on cognition in stroke patients. Ann Rehabil Med 2011 Aug;35(4):450-459 [FREE Full text] [CrossRef] [Medline]
- Cho K, Yu J, Jung J. Effects of virtual reality-based rehabilitation on upper extremity function and visual perception in stroke patients: a randomized control trial. J Phys Ther Sci 2012;24(11):1205-1208. [CrossRef] [Medline]
- Lin R, Chiang S, Heitkemper MM, Weng S, Lin C, Yang F, et al. Effectiveness of early rehabilitation combined with virtual reality training on muscle strength, mood state, and functional status in patients with acute stroke: a randomized controlled trial. Worldviews Evid Based Nurs 2020 Apr;17(2):158-167. [CrossRef] [Medline]
- Lee H, Huang C, Ho S, Sung W. The effect of a virtual reality game intervention on balance for patients with stroke: a randomized controlled trial. Games Health J 2017 Oct;6(5):303-311. [CrossRef] [Medline]
- Lee CH, Kim YS, Jung JH. Effectiveness of virtual reality based cognitive rehabilitation on cognitive function, motivation and depression in stroke patients. Medico Legal Update 2020;20(1):1880-1886. [CrossRef]
- Wiley E, Khattab S, Tang A. Examining the effect of virtual reality therapy on cognition post-stroke: a systematic review and meta-analysis. Disabil Rehabil Assist Technol 2020 May 02:1-11. [CrossRef] [Medline]
- Zhang B, Li D, Liu Y, Wang J, Xiao Q. Virtual reality for limb motor function, balance, gait, cognition and daily function of stroke patients: a systematic review and meta-analysis. J Adv Nurs 2021 Aug 06;77(8):3255-3273. [CrossRef] [Medline]
- Higgins JPT, Thomas J, Chandler J, Cumpston M, Li T, Page MJ, et al, editors. Cochrane Handbook for Systematic Reviews of Interventions. London: Cochrane; 2021.
- Cho D, Lee S. Effects of virtual reality immersive training with computerized cognitive training on cognitive function and activities of daily living performance in patients with acute stage stroke: a preliminary randomized controlled trial. Medicine (Baltimore) 2019 Mar;98(11):e14752 [FREE Full text] [CrossRef] [Medline]
- Choi D, Choi W, Lee S. Influence of Nintendo Wii Fit balance game on visual perception, postural balance, and walking in stroke survivors: a pilot randomized clinical trial. Games Health J 2018 Dec;7(6):377-384. [CrossRef]
- Choi H, Shin W, Bang D. Mirror therapy using gesture recognition for upper limb function, neck discomfort, and quality of life after chronic stroke: a single-blind randomized controlled trial. Med Sci Monit 2019 May 03;25:3271-3278 [FREE Full text] [CrossRef] [Medline]
- Choi JH, Han EY, Kim BR, Kim SM, Im SH, Lee SY, et al. Effectiveness of commercial gaming-based virtual reality movement therapy on functional recovery of upper extremity in subacute stroke patients. Ann Rehabil Med 2014 Aug;38(4):485-493 [FREE Full text] [CrossRef] [Medline]
- Shin J, Bog Park S, Ho Jang S. Effects of game-based virtual reality on health-related quality of life in chronic stroke patients: a randomized, controlled study. Comput Biol Med 2015 Aug;63:92-98. [CrossRef] [Medline]
- Shin J, Kim M, Lee J, Jeon Y, Kim S, Lee S, et al. Effects of virtual reality-based rehabilitation on distal upper extremity function and health-related quality of life: a single-blinded, randomized controlled trial. J Neuroeng Rehabil 2016 Feb 24;13(1):17 [FREE Full text] [CrossRef] [Medline]
- Kim DH, Kim K, Lee S. The effects of effects of virtual reality training with upper limb sensory exercise stimulation on the AROM of upper limb joints, function, and concentration in chronic stroke patients. Phys Med Rehabil Kurortmed 2019 Jul 16;30(02):86-94. [CrossRef]
- Oh Y, Kim G, Han K, Won YH, Park S, Seo J, et al. Efficacy of virtual reality combined with real instrument training for patients with stroke: a randomized controlled trial. Arch Phys Med Rehabil 2019 Aug;100(8):1400-1408 [FREE Full text] [CrossRef] [Medline]
- Park M, Ko M, Oh S, Lee J, Ham Y, Yi H, et al. Effects of virtual reality-based planar motion exercises on upper extremity function, range of motion, and health-related quality of life: a multicenter, single-blinded, randomized, controlled pilot study. J Neuroeng Rehabil 2019 Oct 24;16(1):122 [FREE Full text] [CrossRef] [Medline]
- Faria AL, Andrade A, Soares L, I Badia SB. Benefits of virtual reality based cognitive rehabilitation through simulated activities of daily living: a randomized controlled trial with stroke patients. J Neuroeng Rehabil 2016 Nov 02;13(1):96 [FREE Full text] [CrossRef] [Medline]
- Faria AL, Pinho MS, Bermúdez I Badia S. A comparison of two personalization and adaptive cognitive rehabilitation approaches: a randomized controlled trial with chronic stroke patients. J Neuroeng Rehabil 2020 Jun 16;17(1):78 [FREE Full text] [CrossRef] [Medline]
- Faria AL, Cameirão MS, Couras JF, Aguiar JRO, Costa GM, Bermúdez I Badia S. Combined cognitive-motor rehabilitation in virtual reality improves motor outcomes in chronic stroke: a pilot study. Front Psychol 2018;9:854 [FREE Full text] [CrossRef] [Medline]
- Unibaso-Markaida I, Iraurgi I, Ortiz-Marqués N, Amayra I, Martínez-Rodríguez S. Effect of the Wii Sports Resort on the improvement in attention, processing speed and working memory in moderate stroke. J Neuroeng Rehabil 2019 Feb 28;16(1):32 [FREE Full text] [CrossRef] [Medline]
- Ballester BR, Nirme J, Camacho I, Duarte E, Rodríguez S, Cuxart A, et al. Domiciliary VR-based therapy for functional recovery and cortical reorganization: randomized controlled trial in participants at the chronic stage post stroke. JMIR Serious Games 2017 Aug 07;5(3):e15 [FREE Full text] [CrossRef] [Medline]
- Rogers JM, Duckworth J, Middleton S, Steenbergen B, Wilson PH. Elements virtual rehabilitation improves motor, cognitive, and functional outcomes in adult stroke: evidence from a randomized controlled pilot study. J Neuroeng Rehabil 2019 May 15;16(1):56 [FREE Full text] [CrossRef] [Medline]
- Johnson L, Bird M, Muthalib M, Teo W. An innovative STRoke Interactive Virtual thErapy (STRIVE) online platform for community-dwelling stroke survivors: a randomized controlled trial. Arch Phys Med Rehabil 2020 Jul;101(7):1131-1137. [CrossRef] [Medline]
- Baltaduonienė D, Kubilius R, Berškienė K, Vitkus L, Petruševičienė D. Change of cognitive functions after stroke with rehabilitation systems. Transl Neurosci 2019;10:118-124 [FREE Full text] [CrossRef] [Medline]
- da Silva Ribeiro NM, Ferraz DD, Pedreira É, Pinheiro Í, da Silva Pinto AC, Neto MG, et al. Virtual rehabilitation via Nintendo Wii® and conventional physical therapy effectively treat post-stroke hemiparetic patients. Top Stroke Rehabil 2015 Aug;22(4):299-305. [CrossRef] [Medline]
- Şimşek TT, Çekok K. The effects of Nintendo Wii(TM)-based balance and upper extremity training on activities of daily living and quality of life in patients with sub-acute stroke: a randomized controlled study. Int J Neurosci 2016 Dec;126(12):1061-1070. [CrossRef] [Medline]
- Zhang Q, Hu JN, Wei LJ. Effects of traditional Chinese exercise on cognitive and psychological outcomes in older adults with mild cognitive impairment: a systematic review and meta-analysis. Medicene 2019 Feb:e14581. [CrossRef] [Medline]
- Maggio MG, Latella D, Maresca G, Sciarrone F, Manuli A, Naro A, et al. Virtual reality and cognitive rehabilitation in people with stroke: an overview. J Neurosci Nurs 2019 Apr;51(2):101-105. [CrossRef] [Medline]
- Maggio MG, Maresca G, De Luca R, Stagnitti MC, Porcari B, Ferrera MC, et al. The growing use of virtual reality in cognitive rehabilitation: fact, fake or vision? A scoping review. J Natl Med Assoc 2019 Aug;111(4):457-463. [CrossRef] [Medline]
- Moreno A, Wall KJ, Thangavelu K, Craven L, Ward E, Dissanayaka NN. A systematic review of the use of virtual reality and its effects on cognition in individuals with neurocognitive disorders. Alzheimers Dement (N Y) 2019 Jan;5(1):834-850 [FREE Full text] [CrossRef] [Medline]
- Flannery RB. Treating learned helplessness in the elderly dementia patient: preliminary inquiry. Am J Alzheimers Dis Other Demen 2002;17(6):345-349 [FREE Full text] [CrossRef] [Medline]
- Carrieri M, Petracca A, Lancia S, Basso Moro S, Brigadoi S, Spezialetti M, et al. Prefrontal cortex activation upon a demanding virtual hand-controlled task: a new frontier for neuroergonomics. Front Hum Neurosci 2016 Jul 19;10(7):53 [FREE Full text] [CrossRef] [Medline]
- Park MJ, Kim DJ, Lee U, Na EJ, Jeon HJ. A literature overview of virtual reality (VR) in treatment of psychiatric disorders: recent advances and limitations. Front Psychiatry 2019 Jul;10:505 [FREE Full text] [CrossRef] [Medline]
- Damsbo AG, Kraglund KL, Buttenschøn HN, Johnsen SP, Andersen G, Mortensen JK. Predictors for wellbeing and characteristics of mental health after stroke. J Affect Disord 2020 Mar 01;264:358-364 [FREE Full text] [CrossRef] [Medline]
- Lee SH, Lee J, Kim M, Jeon Y, Kim S, Shin J. Virtual reality rehabilitation with functional electrical stimulation improves upper extremity function in patients with chronic stroke: a pilot randomized controlled study. Arch Phys Med Rehabil 2018 Aug;99(8):1447-1453.e1. [CrossRef] [Medline]
- Choi Y, Ku J, Lim H, Kim YH, Paik N. Mobile game-based virtual reality rehabilitation program for upper limb dysfunction after ischemic stroke. Restor Neurol Neurosci 2016 May 02;34(3):455-463. [CrossRef] [Medline]
Abbreviations
CI: confidence interval |
LOTCA: Loewenstein Occupational Therapy Cognitive Assessment |
MMSE: Mini-Mental State Examination |
MoCA: Montreal Cognitive Assessment |
QoL: quality of life |
RCT: randomized controlled trial |
SMD: standardized mean difference |
VR: virtual reality |
WMD: weighted mean difference |
Edited by R Kukafka; submitted 06.06.21; peer-reviewed by JW Hur, HS Kim, J Wang; comments to author 11.08.21; revised version received 14.08.21; accepted 12.09.21; published 17.11.21
Copyright©Qi Zhang, Yu Fu, Yanhui Lu, Yating Zhang, Qifang Huang, Yajie Yang, Ke Zhang, Mingzi Li. Originally published in the Journal of Medical Internet Research (https://www.jmir.org), 17.11.2021.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on https://www.jmir.org/, as well as this copyright and license information must be included.