This paper is in the following e-collection/theme issue:

Telehealth and Telemonitoring (1557) Extended Reality, Virtual Reality and Virtual Worlds (509) Emerging Technologies for Rehabilitation (241) Cognitive and Neurorehabilitation (236) Clinical Communication, Electronic Consultation and Telehealth (542) Assistive Technologies (98) Neurology and Neurosciences (148)

Published on in Vol 25 (2023)

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/45458, first published .
Benefits of Telerehabilitation for Patients With Severe Acquired Brain Injury: Promising Results From a Multicenter Randomized Controlled Trial Using Nonimmersive Virtual Reality

Benefits of Telerehabilitation for Patients With Severe Acquired Brain Injury: Promising Results From a Multicenter Randomized Controlled Trial Using Nonimmersive Virtual Reality

Benefits of Telerehabilitation for Patients With Severe Acquired Brain Injury: Promising Results From a Multicenter Randomized Controlled Trial Using Nonimmersive Virtual Reality

Authors of this article:

Rocco Salvatore Calabrò1 Author Orcid Image ;   Mirjam Bonanno1 Author Orcid Image ;   William Torregrossa1 Author Orcid Image ;   Luisa Cacciante2 Author Orcid Image ;   Antonio Celesti3 Author Orcid Image ;   Carmela Rifici1 Author Orcid Image ;   Paolo Tonin4 Author Orcid Image ;   Rosaria De Luca1 Author Orcid Image ;   Angelo Quartarone1 Author Orcid Image
Article Authors Cited by (8) Tweetations (9) Metrics

    Original Paper

    1Istituto di Ricovero e Cura a Carattere Scientifico Centro Neurolesi Bonino Pulejo, Messina, Italy

    2Laboratory of Healthcare Innovation Technology, Istituto di Ricovero e Cura a Carattere Scientifico San Camillo Hospital, Venezia, Italy

    3Department of Mathematics, Computer Science, Physics and Earth Science, University of Messina, Messina, Italy

    4Sant'Anna Institute, Crotone, Italy

    Corresponding Author:

    Mirjam Bonanno, MSc, PT

    Istituto di Ricovero e Cura a Carattere Scientifico Centro Neurolesi Bonino Pulejo

    Cda Casazza, SS 113

    Messina, 98123

    Italy

    Phone: 39 09060128391

    Email: mirjam.bonanno@irccsme.it


    Background: In neurorehabilitation, the use of innovative technologies offers many opportunities to monitor and improve the health status of patients with severe acquired brain injury (SABI). Telerehabilitation allows for continuity of service through the entire rehabilitation cycle, including assessment, intervention, consultation, and education, affording early reintegration and positively enhancing the quality of life (QoL).

    Objective: The main purpose of this multicenter randomized controlled trial was to test the effectiveness of advanced training provided using a nonimmersive virtual reality rehabilitation system (ie, the VRRS HomeKit device) in improving functional outcomes in patients with SABI.

    Methods: In total, 40 patients with SABI and their 40 caregivers visiting 2 Italian rehabilitation centers were enrolled in the study protocol and randomized into 2 groups. Of the 40 patients, 20 (50%) underwent the experimental training using the VRRS HomeKit (teleneuro-VRRS group), whereas the other 20 (50%) were administered usual territorial rehabilitative treatments (UTRTs; control group). To investigate motor and neuropsychological functioning, patients with SABI were evaluated before (T0) and at the end of (T1) each training session by a multispecialist team through a complete clinical and psychometric battery: the Barthel Index (BI), the Tinetti Scale (TS), the Modified Ashworth Scale (MAS), the Montreal Cognitive Assessment (MoCa), the Frontal Assessment Battery (FAB), the Beck Depression Inventory II (BDI-II), the Short Form Health Survey 36 (SF-36), and the Psychological General Well-Being Index (PGWBI). In addition, the Caregiver Burden Inventory (CBI) was administered to each caregiver to investigate the emotional burden status.

    Results: The teleneuro-VRRS group achieved a statistically significant improvement in both general and motor outcomes, as well as psychological well-being and QoL, compared to the control group. In particular, the BI (P<.001), FAB (P<.001), and BDI-II (P<.001) were the outcome scales with the best improvement. The burden of caregivers also significantly improved in the teleneuro-VRRS group (CBI; P<.004). Between-group analysis showed statistical differences in the anxiety (effect size [ES]=0.85, P<.02) and self-control (ES=0.40, P<.03) subtests of the PGWBI and in the social role functioning (ES=0.85, P<.02) subtest of the SF-36, confirmed by quite medium and large ESs.

    Conclusions: Our results suggest that the VRRS is a suitable alternative tool or complementary tool or both to improve motor (level of functional independence) and cognitive (frontal/executive abilities) outcomes, reducing behavioral alterations (anxiety and depression symptoms) in patients with SABI, with a beneficial impact also on the caregivers’ burden distress management, mitigating distress and promoting positive aspects of caring.

    Trial Registration: ClinicalTrials.gov NCT03709875; https://classic.clinicaltrials.gov/ct2/show/NCT03709875

    J Med Internet Res 2023;25:e45458

    doi:10.2196/45458

    Keywords

    telerehabilitation; teleneuro-VRRS; virtual reality rehabilitation system; SABI; severe acquired brain injury; acquired brain injury; virtual reality; rehabilitation; neurorehabilitation; brain injury; neurology 


    Severe acquired brain injury (SABI) is a leading cause of death and disability worldwide. SABI refers to damage to the brain, occurring from traumatic brain injury (TBI) and nontraumatic causes (eg, ischemic or hemorrhagic stroke or anoxia following cardiac arrest), with a coma state lasting at least 24 hours [1,2]. Functional recovery following SABI usually reaches its peak at around 6 months (usually 1 year for TBI) and begins to decline as far as 1 year after the injury [3], although sensory motor deficits and cognitive behavioral abnormalities can persist up to months or years. In particular, following SABI, patients usually present with moderate-to-severe hemiparesis, spasticity in the upper and lower limbs, and loss of trunk control that limit breathing and communication [4]. All these physical disabilities associated with cognitive impairment can cause significant handicaps and limit return to a normal and productive life. Cognitive dysfunctions involve attention processes, executive functions, memory abilities, reasoning and problem solving, and visual spatial cognition and are worsened by mood disorders as well as other behavioral problems, including impulsivity/aggressivity [5]. All these problems negatively affect not only the patient’s but also the caregiver’s quality of life (QoL), given that family members play a crucial role in the rehabilitation process, supporting the recovery of patients with SABI [6]. Thus, a specific neurorehabilitation pathway is necessary for these individuals with frailty and should also be planned postdischarge to ensure the continuity of care. Indeed, SABI motor and cognitive therapy should be as intensive and long lasting as possible to allow patients to achieve the best independence and QoL [7]. Notably, neurorehabilitation approaches may be classified into 2 main categories: conventional, using paper-and-pencil exercises (for cognitive tasks) and face-to-face physical interaction with the therapist (for motor tasks) [8,9], and advanced [10,11], using computer-assisted techniques, robotics, or virtual reality (VR) [12-14]. Both are based on the use of specific strategies to retrain or alleviate the cognitive [15] and motor [16] alterations in patients with SABI.

    Generally, conventional techniques consist of manual/paper-and-pencil exercises with the physical presence of a therapist in a traditional setting, whereas VR exercises use a computer interface to train motor and cognitive functions in a gamelike setting [17,18].

    However, the families of patients with SABI can face some concerns, such as limited access to appropriate health care services and outpatient clinics because of traveling costs and geographical barriers. This reduces the amount of care provided to patients [19] and consequently increases caregivers’ distress and burnout [20]. In this context, there is a growing literature on the use of telemedicine for remote assessment and clinical interventions, as well as in the promising field of telerehabilitation (TR). This latter can be applied as either a personalized [21-23] or a group [24] intervention to improve functional outcomes in SABI.

    TR has been defined as “the delivery of rehabilitation services via information and communication technologies.” Recent evidence supports the feasibility and utility of a home-based system to effectively deliver TR, improve patients’ outcomes, screen for complications of the disease, and provide the patients with a means for at-home interaction with medical personnel [25].

    In the past few years, it has been shown that VR technology could be useful to stimulate recovery following a stroke [26] and TBI [27]. VR training offers the advantage of simulating daily activities according to patients’ needs in order to motivate them by avoiding boredom and frustration [28,29], although it requires compliance by the patients. Additionally, the use of nonimmersive VR tools is more advantageous in being cheaper and easier to use than immersive VR systems.

    However, there is still a lack of studies on TR and nonimmersive VR training for cognitive and motor outcomes in patients with SABI. To this end, our study could fill this gap in the neurorehabilitation field. In fact, the concomitant use of TR and VR tools may offer many opportunities to monitor and improve the health status of patients with SABI. TR may allow for continuity of service and care through the entire rehabilitation cycle, including assessment, intervention, consultation, and education, affording early reintegration and positively enhancing the QoL [30].

    Among the TR systems, the Virtual Reality Rehabilitation System (VRRS) HomeKit device (Khymeia) enables the patient to carry out the training program at home, completely supervised by the therapist through a remote workstation [31]. The TR tool is equipped with VR that provides the patient with the ability to perform repetitive and goal-oriented tasks, with exercises with gradually increasing difficulty, promoting the motivation and overall functioning of the patient [32]. Moreover, to also focus on caregivers’ needs, evaluating their level of distress, emotional burnout, and psychological well-being is necessary. In fact, in our opinion, their role as cotherapists and their direct interaction during training are essential elements of a good neurorehabilitation process. The presence of a collaborative caregiver may indeed help obtaining better outcomes for the patient.

    The main purpose of this multicenter randomized controlled trial (RCT) was to test the effectiveness of advanced training provided using the VRRS HomeKit device in improving functional outcomes in patients with SABI. Moreover, we sought to investigate the effects of TR on the psychological well-being of caregivers of patients with SABI.


    Study Population

    This study enrolled 40 subjects with SABI (n=23, 58%, males and n=17, 42%, females) and their 40 caregivers (n=14, 35%, males and n=26, 65%, females) who visited the Intensive Neurorehabilitation Care Unit of the Istituto di Ricovero e Cura a Carattere Scientifico (IRCCS) Centro Neurolesi “Bonino-Pulejo” (Messina, Italy) and the IRCCS San Camillo (Venice, Italy) from October 2018 to August 2022 (see Figure 1 and Multimedia Appendix 1).

    ‎
    Figure 1. Study flow diagram adapted from Consolidated Standards of Reporting Trials (CONSORT) 2010. IRCCS: Istituto di Ricovero e Cura a Carattere Scientifico; UTRT: usual territorial rehabilitative treatment;VRRS: virtual reality rehabilitation system.

    Ethical Considerations

    The study was conducted according to the ethical policies and procedures approved by the local ethics committee Centro Neurolesi Bonino Pulejo (IRCCS-ME 08/2018), and it is part of a registered RCT (NCT03709875). All patients’ legal guardians provided written informed consent for study participation and data publication.

    Procedures

    Patients’ inclusion criteria were (1) a diagnosis of SABI (vascular or traumatic etiology) in the subacute/chronic phase (ie, at least 6 months after the event), (2) age range between 18 and 75 years, (3) the presence of a stable internet connection, and (4) the presence of a caregiver able to use simple digital devices.

    Patients’ exclusion criteria were (1) severe cognitive and behavioral impairments, (2) cardiorespiratory instability or other medical illness potentially interfering with treatment, (3) severe limb spasticity (Modified Ashworth Scale [MAS] score>3), and (4) a high risk of spontaneous fracture.

    Patients were randomly assigned to 1 of 2 groups using a web-based application for block randomization. We used the block randomization method (block size=4) to ensure balance in the sample size across groups over time. Clinical evaluations were performed by therapists different from those who administered the treatments.

    In both groups, each treatment (cognitive or motor or both as per patients’ functional status) lasted about 1 hour/day, 5 days/week, for 12 weeks.

    The teleneuro-VRRS group received advanced motor and cognitive training at home with the VRRS HomeKit device, with the caregivers acting as cotherapists, whereas the control group was administered usual territorial rehabilitative treatment (UTRT, physical) and cognitive training at home. Before discharge, patients and caregivers were instructed on the use of the VRRS HomeKit device, and the training section was simulated within the hospital setting to find out potential problems and assess usability [33]. Both patients and caregivers had 3 meetings with the telemedicine operators to be provided with the basic information for the correct use of the tool. Next, the patients underwent 6 simulation training sessions (3 times/week for 2 weeks, each session lasting about 1 hour). The TR simulation was carried out using the Tele-Cockpit workstation and the same VRRS HomeKit device the patients would have used at home. The instruction training session was scheduled at another time if the caregiver or patient felt insecure about using the system.

    Outcome Measures

    Each patient received a complete motor and neuropsychological evaluation before and immediately after the rehabilitation treatment (ie, at T0 and T1, respectively), administered by skilled physiotherapists, psychologists, or psychiatric therapists of both centers (IRCCS Centro Neurolesi and IRCCS San Camillo). The assessors were blind to the patients’ treatment. The motor evaluation included the Barthel Index (BI) [34] to assess the global functional status, the Tinetti Scale (TS) [35] to evaluate balance and gait recovery, and the MAS [36] to evaluate spasticity in upper limbs (shoulder, elbow, wrist) and lower limbs (hip, knee, ankle). The neuropsychological assessment included the Beck Depression Inventory II (BDI-II) to evaluate depression symptoms [37], the Montreal Cognitive Assessment (MoCA) to assess the global cognitive status [38], the Short Form Health Survey 36 (SF-36) [39] to measure the QoL, the Psychological General Well-Being Index (PGWBI) [40] for behavioral and mood problems, and the Frontal Assessment Battery (FAB) [41] to evaluate frontal abilities. In addition, the Caregiver Burden Inventory (CBI) [42] was administered to each caregiver to evaluate the emotional burden status (see Table 1).

    Table 1. Neuropsychological and motor assessments used with patients with SABIa and their caregivers.
    Test/scaleDomainsAdministered toDescription
    BIb [34]Global functional statusPatientsThe BI is an ordinal scale used to measure performance in ADLc. In total, 10 variables describing ADL and mobility are scored, with higher scores reflecting a greater ability to function independently following hospital discharge.
    TSd [35]Balance and gaitPatientsThe test includes 2 short sections, one examining static balance abilities in a chair and then standing and the other gait. The Tinetti test has a gait score and a balance score. It uses a 3-point ordinal scale of 0, 1, and 2. Gait is scored over 12, and balance is scored over 16, totaling 28.
    MASe [36]SpasticityPatientsThe MAS is a muscle tone assessment scale used to assess the resistance experienced during passive range of motion for upper and lower limbs, which does not require any instrumentation and is quick to perform.
    BDI-IIf [37]Depression symptomsPatientsThe BDI-II is a widely used measure; it is a 21-item self-report inventory measuring the severity of depression symptoms (cut-off>10).
    MoCag [38]Global functioning cognitionPatientsMoCA is a cognitive screening test questionnaire used in the detection of mild/severe cognitive impairment (cut-off<26). MoCA assesses multiple cognitive domains, including attention, concentration, executive functions, memory, language, visuospatial skills, abstraction, calculation, and orientation. It is a paper-and-pencil tool that requires approximately 10 minutes to administer and is scored out of 30 points.
    SF-36h [39]Impact of a disease (QoLi)PatientsThe SF-36 is a generic, multidimensional tool consisting of 36 questions that can be divided into 8 subscales.
    PGWBIj [40]General well-beingPatientsThe PGWBI consists of 22 self-administered items rated on a 6-point scale, which assess the psychological and general well-being of respondents in 6 health-related QoL domains: anxiety, depression, positive well-being, self-control, general health, and vitality.
    FABk [41]Executive functionsPatientsThe FAB is a short clinical battery of 6 neuropsychological subtests designed to assess frontal lobe function. The 6 FAB tasks evaluate cognitive and behavioral domains that are thought to be under the control of the frontal lobe: conceptualization and abstract reasoning, lexical verbal fluency and mental flexibility, motor programming and executive control of action, self-regulation and resistance to interference, perseveration, and inhibitory control behavior and environmental autonomy (cut-off<12).
    CBIl [42]Distress symptomsCaregiversThe CBI is a 24-item Likert-format scale (score 0-4) that measures 5 dimensions of caregiver burden: time dependence, developmental, physical, social, and emotional.

    aSABI: severe acquired brain injury.

    bBI: Barthel Index.

    cADL: activities of daily living.

    dTS: Tinetti Scale.

    eMAS: Modified Ashworth Scale.

    fBDI-II: Beck Depression Inventory II.

    gMoCa: Montreal Cognitive Assessment.

    hSF-36: Short Form Health Survey 36.

    iQoL: quality of life.

    jPGWBI: Psychological General Well-Being Index.

    kFAB: Frontal Assessment Battery.

    lCBI: Caregiver Burden Inventory.

    Usual Territorial Rehabilitative Treatment

    UTRT consisted of both cognitive and motor programs in a face-to-face setting. During the study period, patients were followed at home by a physiotherapist (2-3 times/week) or a speech therapist (2-3 times/week) according to their individualized rehabilitation program. Treatments for motor limbs activity focused on functional active-assisted and active exercises (eg, reaching or gait movements), in addition to treatments to improve balance and posture on functional exercises (eg, standing up or sitting down, changing direction and speed, and walking upstairs, when possible) and treatments to ameliorate the execution of common activities of daily living (ADL), such as feeding, washing, and toileting. Conventional paper-and-pencil training was used to improve multiple cognitive functions through specific rehabilitative programs for (1) attention processes and concentration, (2) verbal and visuospatial memory abilities, and (3) executive functions. These programs consisted of a series of exercises using standard rehabilitative materials (eg, images, colors, barrage tasks) and a face-to-face approach with the cognitive therapist in a quiet environment, without disturbing noises or distractions (see Tables 2-5).

    Table 2. SABIa cognitive neurorehabilitation program with motor exercises: VRRSb HomeKit vs conventional UTRTc.
    ExerciseUTRTVRRS HomeKit
    Eye-hand coordinationEye-hand coordination exercises include goal-directed movement, with the support of the therapist, to collect objects of various shapes, colors, and sizes. The main goal is to increase active movements in the upper limbs, and manipulative exercises are proposed through active-passive mobilization, reaching, and pointing activities.Manual eye coordination exercises include the visual achievement of colored targets (eg, balls, machines, asteroids) to select or collect them by moving the upper limbs using a K-wand sensor. The therapist may subsequently increase the rate of displacement of the moving targets, making the exercise more difficult. The main goal is to increase active movements in the upper limbs, and manipulative exercises are proposed with the K-wand sensor module, which includes a cylinder-like sensor that allows the patient unable to use the touch system to carry out activities of gripping, selecting, pointing, and reaching.
    Trunk controlTrunk control exercises include sit-to-stand activities to improve postural changes from a sitting to a standing position, training for postural changing, standing still, and weight shifting without audio and video stimulation.Trunk control exercises include both sitting activities with laterolateral and anteroposterior movements of the trunk and standing activities with the support of the caregiver. The patient, using sensors on the trunk, has to collect colored targets by moving the trunk and controlling the shift of the body weight to achieve improved control of reactive stepping (eg, faster reaction time).
    Bimanual coordinationBimanual coordination activities are carried out through exercises working on the skills of the upper limbs and hands. In a sitting position, different types of balls, both in shape and in size, and other objects are used to exercise the fingers and fingertips. The exercises can be simplified by modulating the distance of the chosen ball or object.Exercises for carrying out bimanual coordination activities are based on trying to catch targets (eg, machines, balls, water drops via a virtual umbrella) in motion and in all directions, associated with audio and video stimulation. The therapist can choose the number of targets for the patient to select and the time within which the exercise should be performed.

    aSABI: severe acquired brain injury.

    bVRRS: virtual reality rehabilitation system.

    cUTRT: usual territorial rehabilitative treatment.

    Table 3. SABIa cognitive neurorehabilitation program with cognitive exercises: VRRSb HomeKit vs conventional UTRTc.
    ExerciseUTRTVRRS HomeKit
    Selective attention processesThis includes indicating and touching directly with the hand the selected/standard target stimuli in relation to specific characteristics presented (eg, colors, images, animals, functions), neglecting distractions, which consist of other pictures different in the number and complexity of criteria. A cognitive therapist provides verbal commands to the patient, which combines the different selective images. The patient touches the standard target stimuli presented in a specific time according to the therapist’s verbal command.This includes selecting and immediately recalling the same feedback (audio and video) of various elements (eg, colors, musical strings, geometric forms or not, animals) observed in the virtual environment. The patient touches the virtual target element in a specific time; this action causes a visual change with specific audio feedback (positive reinforcement), using the VVRS interaction between the cognitive therapist and the patient. Otherwise, the element disappears (negative reinforcement).
    Sustained attention processesTo stimulate sustained attention processes, the patient observes 3-5 target stimuli for a variable and progressive amount of time (10-15 minutes), with an attentional focus on traditional tasks.The patient observes 3-5 target stimuli for a variable and progressive amount of time (10-15 minutes), with an attentional focus on virtual tasks. These elements remain visible to the observer for a variable amount of time established by the interaction between the virtual system, the therapist, and the patient.

    aSABI: severe acquired brain injury.

    bVRRS: virtual reality rehabilitation system.

    cUTRT: usual territorial rehabilitative treatment.

    Table 4. SABIa cognitive neurorehabilitation program for memory abilities: VRRSb HomeKit vs conventional UTRTc.
    ExerciseUTRTVRRS HomeKit
    VerbalMemory-training tasks are carried out with paper and pencil in a face-to-face rehabilitative setting, with an interaction only between therapist and patient. These tasks include recalling the locations of a series of items on a specific rehabilitative table (in a cognitive room), recalling digits or letters in either the order presented or reverse order, or recalling specifically where a particular number, name, or digit was in a sequence.In these memory-training tasks, the patient is asked to observe at first particular elements and then (in the immediate and recall time) to remember those (eg, eggs, seasons, colors, balls, numbers, environments, animals, geometric forms or not, fruits, jobs) with a dynamic interaction in a semi-immersive virtual environment (using sprites tasks). The patient must remember the place (the position; visuospatial memory) and name (verbal information) of the element observed.
    VisuospatialThe goal is to process visual stimuli, to comprehend spatial relationships between objects and to visualize different scenarios or images, to record and recover information needed to plan a course to a location, and to recall the virtual location/position of an object or the occurrence of an event. The patient must remember the place (the position; visuospatial memory) and name (verbal information) of the element observed.The goal is to process visual stimuli to comprehend spatial relationships between virtual objects and to visualize different virtual scenarios or computer-based images, to record and recover information needed to plan a course to a location, and to recall the virtual location/position of an object or the occurrence of an event.

    aSABI: severe acquired brain injury.

    bVRRS: virtual reality rehabilitation system.

    cUTRT: usual territorial rehabilitative treatment.

    Table 5. SABIa cognitive neurorehabilitation program for executive functions: VRRSb HomeKit vs conventional UTRTc.
    ExerciseUTRTVRRS HomeKit
    Verbal fluencyThis involves working on categorization (semantic and phonemic) without the use of virtual tools. Some movements finalized to direct touch and to move specific objects (eg, pencils, pens) in different directions (eg, left, right) are programmed.This involves working on categorization (semantic and phonemic), planning, association, and analogical reasoning using a computer-based approach. Some movements finalized to virtually touch, move, or manipulate specific objects (eg, balls, flowers, butterflies) in different directions are programmed.
    ReasoningThis involves planning, association, and analogical reasoning without the use of virtual tools according to the therapist’s indication in a specific space (eg, rehabilitative table) or realizing specific associations (eg, letter-color), using a pen-and-pencil approach, organized in a face-to-face rehabilitative session.This involves planning, association, and analogical reasoning using a computer-based approach or realizing specific associations (eg, number-color) with a dynamic interaction in a virtual environment. When the patient touches virtual objects, they obtain video and audio feedback (using sprites tasks). In particular, the patient realizes ideomotor sequences (from simple to complex series of actions) after the verbal command of the therapist.

    aSABI: severe acquired brain injury.

    bVRRS: virtual reality rehabilitation system.

    cUTRT: usual territorial rehabilitative treatment.

    Teleneurotraining Using the VRRS HomeKit

    The experimental training was conducted using the VRRS HomeKit (Figure 2). The device is a tablet placed in a carrying case, with sensors, such as a K-wand and K-sensors, that allows conducting a complete training program at home, including motor, cognitive, and speech therapy modules. During each training session, the patient is supported by the therapist (neuropsychologist or physiotherapist) through the teleworkstation (ie, Tele-Cockpit) and by the caregiver in the role of a cotherapist to assist the therapist. Tele-Cockpit is an innovative technological workstation equipped with a proprietary integrated videoconferencing system for the management of remote and home devices, such as the VRRS HomeKit. The system includes teletraining, telemonitoring, teleconsultation, and streaming of diagnostic imaging. Tele-Cockpit allows the therapist to take control of the remote device and simultaneously see what the patient is doing on the VRRS HomeKit, fully interacting with them in real time.

    Teleneuro-VRRS sessions included the stimulation of specific cognitive domains, such as attention, verbal and visuospatial memory, and executive functions, as well as motor function training, using the advanced system, the VRRS HomeKit. The exercises were presented with increasing difficulty and implemented according to the patient’s response to the treatment (ie, when 9 of 10 answers were correct) and the number of errors (errors<1). Additionally, the therapists could also select the duration of each virtual exercise to better personalize both motor and cognitive tasks according to patients’ abilities, attention levels, and needs.

    Each session lasted about 1 hour (the same as the URTRs), although some extra time (less than 15 minutes) was also necessary for technology issues, including low bandwidth, content glitches, and comfort with the system linked to the distance of the user or the height at which the device is placed in the home setting.

    The VRRS HomeKit allows nonimmersive virtual exercises where the patient interacts with 2D scenarios and objects through the touch screen or through particular sensors: a K-wand equipped with light recognition technology used for movement tracking and orientation, which is handled by the patient during catching and reaching virtual exercises for the upper limbs, and a K-sensor consisting of a set of sensors placed on wearable strips of different sizes, which is used to carry out full-body motor teletraining activities. This means that although nonimmersive VR is in both cases represented on the same flat screen, the upper and lower limbs can move in the 3 dimensions of the space while interacting with the virtual environment. The entire cost of the system (Tele-Cockpit plus HomeKit) was €36,000 (USD 39,508): each home kit cost €8000 (USD 8780), and we bought 4 of them to ensure proper study training); see Tables 2-5.

    ‎
    Figure 2. The VRRS HomeKit used to train patients with SABI in TR modality. SABI: severe acquired brain injury; TR: telerehabilitation; VRRS: virtual reality rehabilitation system.

    Statistical Analysis

    Continuous variables were expressed as mean and SD values (ie, age and time since injury) or first-third quartiles (ie, psychometric and outcome measures), as appropriate. Categorical variables (ie, education and etiology) were expressed as frequencies and percentages. The normal distribution of the sample was investigated through the Shapiro-Wilk test, whereas the Levene test was performed to assess the equality of variances among times for each variable. According to the reduced sample dimension and nonnormality of all variables, we chose a nonparametric analysis. Thus, where appropriate, outcome measures and psychometric variables were analyzed using the 1- or 2-tailed Wilcoxon signed-rank test to detect changes between baseline (T0) and posttreatment (T1) periods within the same group (intragroup analysis); in contrast, the comparison of continuous variables and outcome measures between the 2 groups (intergroup analysis), at both T0 and T1, was performed considering the mean of the Mann-Whitney U test. Linear correlation between variables was calculated with the nonparametric Spearman rank correlation coefficient. In addition, we calculated the effect sizes (ESs) for each psychometric and outcome measure through the Cohen d test between 2 groups to describe whether the treatment effects achieved had a sufficient magnitude. Statistical significance was set at a bilateral α level of .05. Each analysis was performed on the open source software R 4.1.3 (R Foundation for Statistical Computing) for Windows (Microsoft Corporation) [43].

    In this study, we did not perform an intention-to-treat analysis because heterogeneity might have been introduced if noncompliant subjects, dropouts, and compliant subjects were mixed in the final analysis, with potential concerns also around the real/potential efficacy of the treatments [44].


    Participant Characteristics

    The mean age of the 40 patients was 48.12 (SD 16.84) years. Of them, 12 (23%) had a traumatic etiology and 28 (77%) a vascular etiology, with a time since injury from 6 to 18 months (mean 11.43, SD 3.45). A more detailed description of both patients’ and caregivers’ demographic characteristics is reported in Tables 6 and 7, respectively.

    All subjects completed the training, and no adverse event was reported. We found no significant differences between the 2 groups (including patients and caregivers) in age, gender, and education (Tables 6 and 7). At baseline (T0), our analysis showed no significant differences between the outcome scores of the 2 groups (Table 8).

    In the teleneuro-VRRS intragroup analysis (Table 9), comparing baseline (T0) and posttreatment (T1) periods, we found statistical differences in the BI (P<.001), FAB (P<.001), BDI-II (P<.001), and MoCA (P<.001); the TS for balance (P<.03) and gait (P<.02); and the CBI (P<.004). See also Figures 3 and 4.

    Moreover, by analyzing the SF-36 subtests, we found statistically significant differences between baseline (T0) and posttreatment (T1) periods in physical functioning (P<.01), physical role functioning (P<.001), emotional role functioning (P<.008), and general health perception (P<.001). The PGWBI results were extremely significant in all subtests, as reported in Table 8.

    In the baseline (T0) and posttreatment (T1) analysis of the control group, statistically significant differences emerged in the BI (P<.001) and the TS for gait (P<.03), as well as in MoCA (P<.001). In the SF-36, only the physical functioning (P<.004), bodily pain (P<.01), and general health perception (P<.004) subtests showed statistical significance (Table 9). Moreover, the general health (P<.004) and vitality (P=.05) PGWBI subtests were statistically significant.

    We calculated the usability score with the System Usability Scale (SUS; median=69.00, first quartile=65.00, third quartile=76.25), indicating high user satisfaction with the tool’s usability. Between-group analysis (Table 8) showed statistical differences in the anxiety (P<.02, ES=0.85) and self-control (P<.03, ES=0.40) subtests of the PGWBI and in the social role functioning (P<.02, ES=0.85) subtest of the SF-36. This was also confirmed by the quite medium and large ESs.

    Table 6. Demographic and clinical characteristics of patients with SABIa in teleneuro-VRRSb and control groups.
    CharacteristicsAll participants (N=40)Control group (n=20)Teleneuro-VRRS group (n=20)
    Age (years), mean (SD); P=.058c48.12 (16.84)43.4 (15.78)52.85 (16.90)
    Gender, n (%); P=.99c

    		Male23 (58)11 (55)12 (60)

    		Female17 (42)9 (45)8 (40)
    Education (years), n (%); P=.99c

    		Elementary school14 (35)5 (25)8 (40)

    		Middle school18 (44)13 (65)6 (30)

    		High school7 (18)2 (10)5 (25)

    		University1 (3)01 (5)
    Etiology, n (%); P=.73c

    		Vascular28 (70)15 (75)13 (65)

    		Traumatic12 (30)5 (25)7 (35)
    Time since injury, mean (SD); P=.89c11.43 (3.45)10.76 (3.68)12 (3.22)

    aSABI: severe acquired brain injury.

    bVRRS: virtual reality rehabilitation system.

    cP values at baseline (T0) between the 2 groups.

    Table 7. Demographic and clinical characteristics of caregivers (N=40) of patients with SABIa in teleneuro-VRRSb and control groups.
    CharacteristicsAll participants (N=40)Control group (n=20)Teleneuro-VRRS group (n=20)
    Age (years), mean (SD); P=.96c51.1 (12.77)50.4 (14.33)51.8 (11.33)
    Gender, n (%); P=.32c

    		Male14 (35)11 (55)5 (25)

    		Female26 (65)9 (45)15 (75)
    Education (years), n (%)d; P=.72c

    		Elementary school6 (15)4 (20)2 (10)

    		Middle school19 (48)7 (35)12 (60)

    		High school14 (35)8 (40)6 (30)

    		University1 (3)1 (5)0

    aSABI: severe acquired brain injury.

    bVRRS: virtual reality rehabilitation system.

    cP values at baseline (T0) between the 2 groups.

    dThe percentages might add up to more than 100 because of rounding.

    Table 8. Statistical comparison using the Mann-Whitney U test between teleneuro-training using the VRRSa HomeKit and conventional UTRTb for neuropsychological evaluation and their ESc.
    Psychometric test/scaled and domainBaseline (T0) P value between 2 groupsPosttreatment (T1) P value in between-group analysisES
    BIe (global functional status).88.350.26
    TSf (gross motor functions)

    		Balance.31.090.82

    		Gait.85.910.08
    MASg

    		Spasticity, upper limb.37.960.05

    		Spasticity, lower limb.70.810.11
    MoCAh (global cognitive index).40.470.33
    BDI-IIi (depression symptoms).08.110.31
    FABj (executive functions).34.500.04
    CBIk (caregiver’s burden).64.620.10
    SF-36l

    		Physical functioning.87.960.10

    		Limitation in physical role functioning.40.180.39

    		Bodily pain.70.960.04

    		Vitality.77.370.23

    		General health perceptions.91.270.20

    		Mental health.59.530.08

    		Emotional role functioning.12.200.05

    		Social role functioning.69.02m0.85
    PGWBIn

    		Positive well-being.87.180.38

    		General health.77.160.48

    		Depressed mood.97.050.61

    		Vitality.68.130.43

    		Self-control.87.03m0.40

    		Anxiety.99.02m0.85

    aVRRS: virtual reality rehabilitation system.

    bUTRT: usual territorial rehabilitative treatment.

    cES: effect size.

    dSpecific motor and cognitive domains are reported in parentheses.

    eBI: Barthel Index.

    fTS: Tinetti Scale.

    gMAS: Modified Ashworth Scale.

    hMoCa: Montreal Cognitive Assessment.

    iBDI-II: Beck Depression Inventory II.

    jFAB: Frontal Assessment Battery.

    kCBI: Caregiver Burden Inventory.

    lSF-36: Short Form Health Survey 36.

    mThe P value is significant at a significance level of .05 (2-tailed).

    nPGWBI: Psychological General Well-Being Index.

    Table 9. First-third quartiles, obtained through the Wilcoxon signed-rank test, of psychometric tests administered to patients with SABIa and their caregivers, between teleneuro-training using the VRRSb HomeKit (teleneuro-VRRS) and conventional UTRTc (control), and statistical intragroup analysis at baseline (T0) and posttreatment (T1).
    Psychometric test/scaled and domainRange (first-third IQR)T0-T1 P value (intragroup analysis)

    		Teleneuro-VRRSControlTeleneuro-VRRSControl
    BIe (global functional status)35.00-58.7513.75-66.75<.001f<.001f
    TSg (gross motor functions)

    		Balance11.00-15.005.75-11.00<.03f.90

    		Gait6.00-10.005.25-10.00<.02f.03f
    MASh

    		Spasticity, upper limb3.00-6.004.50-6.00.90.90

    		Spasticity, lower limb3.00-6.004.50-6.00.70.70
    MoCAi (global cognitive index)20.00-26.0021.75-26.25<.001f<.001f
    BDI-IIj (depression symptoms)7.00-12.259.00-12.25<.001f.14
    FABk (executive functions)14.00-14.0013.44-16.30<.001f.58
    CBIl (caregiver’s burden)27.00-49.0013.75-58.50<.004f.07
    SF-36m

    		Physical functioning0.00-13.750.00-43.25<.01f<.004f

    		Limitation in physical role functioning0.000.00-30.00<.001f<.05

    		Bodily pain37.50-88.0075.00-90.00.50<.01f

    		Vitality25.00-45.0040.00-60.00.18.74

    		General health perceptions25.00-45.0035.00-56.25<.001f<.004f

    		Mental health47.25-65.2547.25-61.25.20.10

    		Emotional role functioning24.75-100.0035.00-86.25<.008f.99

    		Social role functioning25.00-65.2530.00-72.50.11.62
    PGWBIn

    		Positive well-being35.00-58.7524.75-45.50<.002f.08

    		General health43.75-65.0038.75-56.25<.004f.004f

    		Depressed mood69.00-90.7559.50-72.25<.005f.40

    		Vitality45.00-57.5041.75-55.00<.001f<.05f

    		Self-control57.00-70.0049.50-61.00<.001f.21

    		Anxiety68.75-85.0057.25-72.00<.004f.91

    aSABI: severe acquired brain injury.

    bVRRS: virtual reality rehabilitation system.

    cUTRT: usual territorial rehabilitative treatment.

    dSpecific motor and cognitive domains are reported in parentheses.

    eBI: Barthel Index.

    fThe P value is significant at a significance level of .05 (2-tailed).

    gTS: Tinetti Scale.

    hMAS: Modified Ashworth Scale.

    iMoCa: Montreal Cognitive Assessment.

    jBDI-II: Beck Depression Inventory II.

    kFAB: Frontal Assessment Battery.

    lCBI: Caregiver Burden Inventory.

    mSF-36: Short Form Health Survey 36.

    nPGWBI: Psychological General Well-Being Index.

    ‎
    Figure 3. The histogram compares the main functional and cognitive psychometric data obtained posttreatment (T1) between the teleneuro-VRRS group (orange) and the control group (conventional training, blue). VRRS: virtual reality rehabilitation system.
    ‎
    Figure 4. The histogram compares the psychometric data (TS and MAS) obtained posttreatment (T1) between the teleneuro-VRRS group (orange) and the control group (conventional training, blue). MAS: Modified Ashworth Scale; TS: Tinetti Scale; VRRS: virtual reality rehabilitation system.

    Principal Findings

    This multicenter RCT sought to investigate the efficacy of a TR nonimmersive VR system on the motor performance and cognitive abilities of patients with SABI compared to a control group undergoing conventional training (URTRs). Our results indicated that both teleneuro-VRRS and control groups improved in global functional, cognitive, and general health status. However, we found that only the teleneuro-VRRS group improved in motor and executive functions, with a significant reduction in anxiety and depression symptoms. These findings confirmed the results of a previous study carried out on patients with stroke [23].

    The current literature mostly focuses on the usability and feasibility of TR systems [33], whereas their efficacy has been less investigated, especially in TBI. Indeed, to the best of our knowledge, this is the first study to assess the effects of a teleneuro-VRRS on motor and cognitive outcomes using a specific TR program in patients with SABI. In fact, other authors have used scheduled telephone interviews or internet-based approaches [24] for educational interventions and exercise maintenance without a rehabilitation program. Nonetheless, patients with SABI perceived our approach as optimal and satisfying, because it may guarantee the continuity of care. In this aspect, the TR modality allows constant and intensive treatment, thanks to its easy use and the possibility of asynchronous sessions, whereas UTRT depends exclusively on the presence of therapists and is usually limited to about 3 times/week. In line with our data, Solana et al [23] showed how TR using a computerized platform improves cognitive functioning, with regard to attention, memory, and executive functions, in people with TBI. The teletraining also increased the efficiency of the rehabilitation process, facilitating access to treatment and reducing the associated costs. Moreover, a VR system can play a crucial role in the patient’s functional recovery, since it encourages more active participation and allows for longer training sessions. In our teleneuro-VRRS sample, the VRRS increased patients’ motivation and enjoyment, both important factors for successful rehabilitative treatment [26,27].

    In a VR environment, exercises favor the development of the knowledge of (1) results of movements and (2) quality of movements (performance) [28,29,45,46]. This way, VR can stimulate the central nervous system, which receives increased feedback signals (augmented feedback), inducing profound changes in neural plasticity, responsible for motor and cognitive function recovery [30,31,47-50]. In this context, better results may be achieved by coupling different tools. Indeed, the emerging use of neuromodulation demonstrates a positive effect by promoting neuroplasticity and functional recovery following a brain injury [51-53]. Eilam-Stock et al [54] studied the promising effects of a combined approach using a TR system plus neuromodulation (ie, transcranial direct current stimulation [tDCS]) in a patient with brain injury. The authors reported improvements in specific cognitive domains, such as attention and working memory, processing speed, and semantic fluency. This may be consistent with the site of stimulation (ie, the left dorsolateral prefrontal cortex) that is involved directly and indirectly in these cognitive processes. Further studies using the combined approach are needed to demonstrate whether and to which extent this could be effective in patients with SABI.

    Another important finding of our study is the more evident reduction in the burden of distress in the caregivers of patients in the teleneuro-VRRS group compared to the control group. This is probably why caregivers were involved during the TR sessions, acting as cotherapists, but received, at the same time, support from a multidisciplinary rehabilitation team for their social, physical, and psychological needs. In fact, remote interventions can be effective in reducing psychological distress, thanks to the active participation in the care and decision-making processes, also avoiding travel difficulties related to access of appropriate health care providers [55-57].

    Lastly, we investigated the usability of the TR system by means of the SUS score, demonstrating that subjects perceived the system as efficient, more satisfying, and easier to use, in line with the literature [58-61]. To overcome the challenges in the use of technologies for some patients with SABI, training both patients and caregivers when they are at the rehabilitation center could be of help [13].

    Strengths, Limitations, and Future Perspectives

    The strengths of the study are linked to the development and implementation of complete and dedicated motor and cognitive TR training using a VR system, whereas most of the previous studies have mainly focused on feasibility/usability. In addition, our VR system was available in the asynchronous modality to enable patients to undergo repetitive and intensive training, even without the direct supervision of the therapist. In addition, the caregivers acted as cotherapists during the rehabilitation session, reducing their burden and efforts and helping improve patient outcomes. Indeed, the growing literature demonstrates the importance of family members in the rehabilitation pathway and the patient’s reintegration [62].

    The main limitations of the study are the relatively small sample size that prevents us from generalizing our promising results to the entire SABI population, in addition to the lack of follow-up. Nonetheless, it was difficult to enroll a larger and homogenous SABI sample, also considering the organizational problems related to the COVID-19 pandemic. Another concern may be that we included both vascular and traumatic SABI, which are known to have different recovery patterns and functional outcomes. However, the aim of the study was to investigate the feasibility and potential efficacy of TR in this patient population to pave the way for the continuity of care.

    The lack of “human touch” and face-to-face interaction, which is a well-known special tool for nonverbal communication with patients [63], is the main pitfall of the use of TR, in addition to the scarce usability by older patients. We investigated the latter issue in a previous work, with positive results [13]. In addition, the reduced/lack of internet availability in rural settings and vision difficulties due to the small screen size of the tablet, often associated with poor sound quality, are other important concerns to acknowledge when dealing with TR.

    Considering that TR is a growing and potentially efficacious field, it should be analyzed in terms of cost and effectiveness [64]. In fact, this analysis should include the cost of technologies (ie, the VR system) and equipment, the internet, and specific maintenance services. In this aspect, the primary savings due to the use of TR for patients with neurological issues are related to the absence of in-person therapist costs and mileage reimbursement [64]. However, the costs of face-to-face rehabilitation include the therapist’s service and travel expenses for both the therapist (ie, domiciliary therapy) and the caregiver (ie, ambulatory care) in terms of money, time spent, and effort [65]. Nevertheless, a combination of both approaches (TR and UTRT) will meet the needs of those patients who cannot travel or have a higher economic burden. Future studies must analyze the economic issue, comparing TR and UTRT costs for patients with neurological issues, with regard to those with SABI. Lastly, future research in the TR field should also measure the group-by-time interaction effect, analyzing the extent to which the difference between groups varies at different occasions, through specific statistical tests, such as repeated measures ANOVA [66].

    Conclusion

    Our study demonstrates that TR using nonimmersive VR may improve functional outcomes in patients with SABI. Indeed, TR could be considered a suitable alternative to traditional rehabilitation in this patient population to guarantee the continuity of care after discharge, especially in remote or underserved areas. Larger-sample multicenter studies are needed to further investigate the effects of TR when using more patient-tailored motor and cognitive training programs, also considering the cost-benefit analysis.

    Acknowledgments

    The research was founded by the Italian Ministry of Health (WFR: GR-2016-02361306).

    Data Availability

    Data are available upon request from the corresponding author.

    Authors' Contributions

    Conceptualization was handled by RSC and RDL; methodology by MB, LC, and RDL; formal analysis by MB and RDL; investigation by RSC, RDL, AC, WT, and PT; resources by AQ; data curation by MB; writing—original draft preparation by RSC, RDL, MB, and LC; writing—review and editing by RSC; funding acquisition by RSC and AQ; and validation and visualization by all authors. All authors have read and agreed to the submitted version of the manuscript.

    Conflicts of Interest

    None declared.

    Multimedia Appendix 1

    CONSORT E-HEALTH checklist (V 1.6.1).

    PDF File (Adobe PDF File), 1243 KB
    1. Qu D, Li W, Zhang S, Li R, Wang H, Chen B. Traumatic brain injury is associated with both hemorrhagic stroke and ischemic stroke: a systematic review and meta-analysis. Front Neurosci. 2022;16:814684. [FREE Full text] [CrossRef] [Medline]
    2. Giacino JT, Fins JJ, Laureys S, Schiff ND. Disorders of consciousness after acquired brain injury: the state of the science. Nat Rev Neurol. Feb 2014;10(2):99-114. [FREE Full text] [CrossRef] [Medline]
    3. De Luca R, Calabrò RS, Bramanti P. Cognitive rehabilitation after severe acquired brain injury: current evidence and future directions. Neuropsychol Rehabil. Sep 2018;28(6):879-898. [CrossRef] [Medline]
    4. Bonanno M, De Luca R, Torregrossa W, Tonin P, Calabrò RS. Moving toward appropriate motor assessment tools in people affected by severe acquired brain injury: a scoping review with clinical advices. Healthcare (Basel). Jun 15, 2022;10(6):1115. [FREE Full text] [CrossRef] [Medline]
    5. Chung CSY, Pollock A, Campbell T, Durward BR, Hagen S. Cognitive rehabilitation for executive dysfunction in adults with stroke or other adult non-progressive acquired brain damage. Cochrane Database Syst Rev. Apr 30, 2013;2013(4):CD008391. [FREE Full text] [CrossRef] [Medline]
    6. D'Ippolito M, Aloisi M, Azicnuda E, Silvestro D, Giustini M, Verni F, et al. Changes in caregivers lifestyle after severe acquired brain injury: a preliminary investigation. Biomed Res Int. 2018;2018:2824081. [FREE Full text] [CrossRef] [Medline]
    7. Oberholzer M, Müri RM. Neurorehabilitation of traumatic brain injury (TBI): a clinical review. Med Sci (Basel). Mar 18, 2019;7(3):47. [FREE Full text] [CrossRef] [Medline]
    8. Bartolo M, Bargellesi S, Castioni CA, Bonaiuti D, Intensive Care and Neurorehabilitation Italian Study Group; Antenucci R, et al. Early rehabilitation for severe acquired brain injury in intensive care unit: multicenter observational study. Eur J Phys Rehabil Med. Feb 2016;52(1):90-100. [FREE Full text] [Medline]
    9. Hellweg S. Effectiveness of physiotherapy and occupational therapy after traumatic brain injury in the intensive care unit. Crit Care Res Pract. 2012;2012:768456. [FREE Full text] [CrossRef] [Medline]
    10. De Luca R, Marra A, Pollicino P, Buda M, Mucari M, Bonanno M, et al. Advances in neurorehabilitation of TREM2-related dementia: a case report on a novel multimodal approach using virtual reality. Medicine (Baltimore). May 27, 2022;101(21):e29470. [FREE Full text] [CrossRef] [Medline]
    11. Jung H, Jeong J, Cheong Y, Nam T, Kim J, Park C, et al. The effectiveness of computer-assisted cognitive rehabilitation and the degree of recovery in patients with traumatic brain injury and stroke. J Clin Med. Dec 07, 2021;10(24):5728. [FREE Full text] [CrossRef] [Medline]
    12. Chen SH, Thomas JD, Glueckauf RL, Bracy OL. The effectiveness of computer-assisted cognitive rehabilitation for persons with traumatic brain injury. Brain Inj. Mar 1997;11(3):197-209. [CrossRef] [Medline]
    13. Fusco A, Giovannini S, Castelli L, Coraci D, Gatto DM, Reale G, et al. Virtual reality and lower limb rehabilitation: effects on motor and cognitive outcome-a crossover pilot study. J Clin Med. Apr 20, 2022;11(9):2300. [FREE Full text] [CrossRef] [Medline]
    14. Gassert R, Dietz V. Rehabilitation robots for the treatment of sensorimotor deficits: a neurophysiological perspective. J Neuroeng Rehabil. Jun 05, 2018;15(1):46. [FREE Full text] [CrossRef] [Medline]
    15. Välimäki M, Mishina K, Kaakinen JK, Holm SK, Vahlo J, Kirjonen M, et al. Digital gaming for improving the functioning of people with traumatic brain injury: randomized clinical feasibility study. J Med Internet Res. Mar 19, 2018;20(3):e77. [FREE Full text] [CrossRef] [Medline]
    16. Henderson A, Korner-Bitensky N, Levin M. Virtual reality in stroke rehabilitation: a systematic review of its effectiveness for upper limb motor recovery. Top Stroke Rehabil. 2007;14(2):52-61. [CrossRef] [Medline]
    17. Sokołowska B. Impact of virtual reality cognitive and motor exercises on brain health. Int J Environ Res Public Health. Feb 25, 2023;20(5):4150. [FREE Full text] [CrossRef] [Medline]
    18. Lebowitz MS, Dams-O'Connor K, Cantor JB. Feasibility of computerized brain plasticity-based cognitive training after traumatic brain injury. J Rehabil Res Dev. 2012;49(10):1547-1556. [FREE Full text] [CrossRef] [Medline]
    19. Bivona U, Villalobos D, De Luca M, Zilli F, Ferri G, Lucatello S, et al. Psychological status and role of caregivers in the neuro-rehabilitation of patients with severe acquired brain injury (ABI). Brain Inj. Dec 05, 2020;34(13-14):1714-1722. [CrossRef] [Medline]
    20. Qadeer A, Khalid U, Amin M, Murtaza S, Khaliq MF, Shoaib M. Caregiver's burden of the patients with traumatic brain injury. Cureus. Aug 21, 2017;9(8):e1590. [FREE Full text] [CrossRef] [Medline]
    21. Tchero H, Tabue Teguo M, Lannuzel A, Rusch E. Telerehabilitation for stroke survivors: systematic review and meta-analysis. J Med Internet Res. Oct 26, 2018;20(10):e10867. [FREE Full text] [CrossRef] [Medline]
    22. Subbarao BS, Stokke J, Martin SJ. Telerehabilitation in acquired brain injury. Phys Med Rehabil Clin N Am. May 2021;32(2):223-238. [FREE Full text] [CrossRef] [Medline]
    23. Solana J, Cáceres C, García-Molina A, Opisso E, Roig T, Tormos JM, et al. Improving brain injury cognitive rehabilitation by personalized telerehabilitation services: Guttmann neuropersonal trainer. IEEE J Biomed Health Inform. Jan 2015;19(1):124-131. [CrossRef] [Medline]
    24. Boulos ME, Colella B, Meusel L, Sharma B, Peter MK, Worthington T, et al. Feasibility of group telerehabilitation for individuals with chronic acquired brain injury: integrating clinical care and research. Disabil Rehabil. Feb 28, 2023:1-13. [CrossRef] [Medline]
    25. Laver KE, Adey-Wakeling Z, Crotty M, Lannin NA, George S, Sherrington C. Telerehabilitation services for stroke. Cochrane Database Syst Rev. Jan 31, 2020;1(1):CD010255. [FREE Full text] [CrossRef] [Medline]
    26. Saposnik G, Cohen LG, Mamdani M, Pooyania S, Ploughman M, Cheung D, et al. Stroke Outcomes Research Canada. Efficacy and safety of non-immersive virtual reality exercising in stroke rehabilitation (EVREST): a randomised, multicentre, single-blind, controlled trial. Lancet Neurol. Sep 2016;15(10):1019-1027. [FREE Full text] [CrossRef] [Medline]
    27. Esfahlani SS, Thompson T, Parsa AD, Brown I, Cirstea S. ReHabgame: a non-immersive virtual reality rehabilitation system with applications in neuroscience. Heliyon. Feb 2018;4(2):e00526. [FREE Full text] [CrossRef] [Medline]
    28. Li K, Robertson J, Ramos J, Gella S. Computer-based cognitive retraining for adults with chronic acquired brain injury: a pilot study. Occup Ther Health Care. Oct 2013;27(4):333-344. [CrossRef] [Medline]
    29. De Luca R, Calabrò RS, Gervasi G, De Salvo S, Bonanno L, Corallo F, et al. Is computer-assisted training effective in improving rehabilitative outcomes after brain injury? A case-control hospital-based study. Disabil Health J. Jul 2014;7(3):356-360. [CrossRef] [Medline]
    30. Torrisi M, Maresca G, De Cola MC, Cannavò A, Sciarrone F, Silvestri G, et al. Using telerehabilitation to improve cognitive function in post-stroke survivors: is this the time for the continuity of care? Int J Rehabil Res. Dec 2019;42(4):344-351. [CrossRef] [Medline]
    31. Laver KE, Lange B, George S, Deutsch JE, Saposnik G, Crotty M. Virtual reality for stroke rehabilitation. Cochrane Database Syst Rev. Nov 20, 2017;11(11):CD008349. [FREE Full text] [CrossRef] [Medline]
    32. Tokgöz P, Stampa S, Wähnert D, Vordemvenne T, Dockweiler C. Virtual reality in the rehabilitation of patients with injuries and diseases of upper extremities. Healthcare (Basel). Jun 16, 2022;10(6):1124. [FREE Full text] [CrossRef] [Medline]
    33. De Luca R, Maggio MG, Naro A, Portaro S, Cannavò A, Calabrò RS. Can patients with severe traumatic brain injury be trained with cognitive telerehabilitation? An inpatient feasibility and usability study. J Clin Neurosci. Sep 2020;79:246-250. [CrossRef] [Medline]
    34. Mahoney FI, Barthel D. Functional evaluation: the Barthel Index. Md State Med J. Feb 1965;14:61-65. [Medline]
    35. Raîche M, Hébert R, Prince F, Corriveau H. Screening older adults at risk of falling with the Tinetti balance scale. Lancet. Sep 16, 2000;356(9234):1001-1002. [CrossRef] [Medline]
    36. Bohannon RW, Smith MB. Interrater reliability of a Modified Ashworth Scale of muscle spasticity. Phys Ther. Feb 1987;67(2):206-207. [CrossRef] [Medline]
    37. Green A, Felmingham K, Baguley IJ, Slewa-Younan S, Simpson S. The clinical utility of the Beck Depression Inventory after traumatic brain injury. Brain Inj. Dec 2001;15(12):1021-1028. [CrossRef] [Medline]
    38. An J, Cao Q, Lin W, An J, Wang Y, Yang L, et al. Cognition in patients with traumatic brain injury measured by the Montreal Cognitive Assessment-Basic. Appl Neuropsychol Adult. 2021;28(2):124-131. [CrossRef] [Medline]
    39. Guilfoyle MR, Seeley HM, Corteen E, Harkin C, Richards H, Menon DK, et al. Assessing quality of life after traumatic brain injury: examination of the Short Form 36 Health Survey. J Neurotrauma. Dec 2010;27(12):2173-2181. [CrossRef] [Medline]
    40. Lundgren-Nilsson Å, Jonsdottir IH, Ahlborg G, Tennant A. Construct validity of the Psychological General Well Being Index (PGWBI) in a sample of patients undergoing treatment for stress-related exhaustion: a Rasch analysis. Health Qual Life Outcomes. Jan 07, 2013;11:2. [FREE Full text] [CrossRef] [Medline]
    41. Rojas N, Laguë-Beauvais M, Belisle A, Lamoureux J, AlSideiri G, Marcoux J, et al. Frontal assessment battery (FAB) performance following traumatic brain injury hospitalized in an acute care setting. Appl Neuropsychol Adult. 2019;26(4):319-330. [CrossRef] [Medline]
    42. Novak M, Guest C. Application of a multidimensional caregiver burden inventory. Gerontologist. Dec 1989;29(6):798-803. [CrossRef] [Medline]
    43. R Core Team. R: a language and environment for statistical computing. R Foundation for Statistical Computing. URL: https://www.R-project.org/ [accessed 2023-07-27]
    44. Gupta SK. Intention-to-treat concept: a review. Perspect Clin Res. Jul 2011;2(3):109-112. [FREE Full text] [CrossRef] [Medline]
    45. Wulf G, Shea C, Lewthwaite R. Motor skill learning and performance: a review of influential factors. Med Educ. Jan 2010;44(1):75-84. [CrossRef] [Medline]
    46. Feitosa JA, Fernandes CA, Casseb RF, Castellano G. Effects of virtual reality-based motor rehabilitation: a systematic review of fMRI studies. J Neural Eng. Jan 24, 2022;19(1):011002. [CrossRef] [Medline]
    47. Ownsworth T, Arnautovska U, Beadle E, Shum DHK, Moyle W. Efficacy of telerehabilitation for adults with traumatic brain injury: a systematic review. J Head Trauma Rehabil. 2018;33(4):E33-E46. [CrossRef] [Medline]
    48. Dias P, Silva R, Amorim P, Lains J, Roque E, Pereira ISF, et al. Using virtual reality to increase motivation in poststroke rehabilitation. IEEE Comput Graph Appl. 2019;39(1):64-70. [CrossRef] [Medline]
    49. Szczepańska-Gieracha J, Cieślik B, Rutkowski S, Kiper P, Turolla A. What can virtual reality offer to stroke patients? A narrative review of the literature. NeuroRehabilitation. 2020;47(2):109-120. [CrossRef] [Medline]
    50. Maggio MG, De Luca R, Molonia F, Porcari B, Destro M, Casella C, et al. Cognitive rehabilitation in patients with traumatic brain injury: a narrative review on the emerging use of virtual reality. J Clin Neurosci. Mar 2019;61:1-4. [CrossRef] [Medline]
    51. De Luca R, Maggio MG, Maresca G, Latella D, Cannavò A, Sciarrone F, et al. Improving cognitive function after traumatic brain injury: a clinical trial on the potential use of the semi-immersive virtual reality. Behav Neurol. 2019;2019:9268179. [FREE Full text] [CrossRef] [Medline]
    52. Georgiev D, Georgieva I, Gong Z, Nanjappan V, Georgiev G. Virtual reality for neurorehabilitation and cognitive enhancement. Brain Sci. Feb 11, 2021;11(2):221. [FREE Full text] [CrossRef] [Medline]
    53. Bonanno M, De Luca R, De Nunzio AM, Quartarone A, Calabrò RS. Innovative technologies in the neurorehabilitation of traumatic brain injury: a systematic review. Brain Sci. Dec 07, 2022;12(12):1678. [FREE Full text] [CrossRef] [Medline]
    54. Eilam-Stock T, George A, Charvet LE. Cognitive telerehabilitation with transcranial direct current stimulation improves cognitive and emotional functioning following a traumatic brain injury: a case study. Arch Clin Neuropsychol. Apr 21, 2021;36(3):442-453. [CrossRef] [Medline]
    55. Chi N, Demiris G. A systematic review of telehealth tools and interventions to support family caregivers. J Telemed Telecare. Jan 2015;21(1):37-44. [FREE Full text] [CrossRef] [Medline]
    56. Suntai Z, Laha-Walsh K, Albright DL. Effectiveness of remote interventions in improving caregiver stress outcomes for caregivers of people with traumatic brain injury. Rehabil Psychol. Nov 2021;66(4):415-422. [CrossRef] [Medline]
    57. Shepherd-Banigan ME, Shapiro A, McDuffie JR, Brancu M, Sperber NR, Van Houtven CH, et al. Interventions that support or involve caregivers or families of patients with traumatic injury: a systematic review. J Gen Intern Med. Jul 2018;33(7):1177-1186. [FREE Full text] [CrossRef] [Medline]
    58. Huijgen BCH, Vollenbroek-Hutten MMR, Zampolini M, Opisso E, Bernabeu M, Van Nieuwenhoven J, et al. Feasibility of a home-based telerehabilitation system compared to usual care: arm/hand function in patients with stroke, traumatic brain injury and multiple sclerosis. J Telemed Telecare. 2008;14(5):249-256. [CrossRef] [Medline]
    59. Beit Yosef A, Jacobs JM, Shenkar S, Shames J, Schwartz I, Doryon Y, et al. Activity performance, participation, and quality of life among adults in the chronic stage after acquired brain injury-the feasibility of an occupation-based telerehabilitation intervention. Front Neurol. Dec 6, 2019;10:1247. [FREE Full text] [CrossRef] [Medline]
    60. Eicher C, Haesner M, Spranger M, Kuzmicheva O, Gräser A, Steinhagen-Thiessen E. Usability and acceptability by a younger and older user group regarding a mobile robot-supported gait rehabilitation system. Assist Technol. 2019;31(1):25-33. [CrossRef] [Medline]
    61. Ownsworth T, Theodoros D, Cahill L, Vaezipour A, Quinn R, Kendall M, et al. Perceived usability and acceptability of videoconferencing for delivering community-based rehabilitation to individuals with acquired brain injury: a qualitative investigation. J Int Neuropsychol Soc. Jan 2020;26(1):47-57. [CrossRef] [Medline]
    62. Maggio MG, De Luca R, Torrisi M, De Cola MC, Buda A, Rosano M, et al. Is there a correlation between family functioning and functional recovery in patients with acquired brain injury? An exploratory study. Appl Nurs Res. Jun 2018;41:11-14. [CrossRef] [Medline]
    63. Geri T, Viceconti A, Minacci M, Testa M, Rossettini G. Manual therapy: exploiting the role of human touch. Musculoskelet Sci Pract. Dec 2019;44:102044. [CrossRef] [Medline]
    64. Del Pino R, Díez-Cirarda M, Ustarroz-Aguirre I, Gonzalez-Larragan S, Caprino M, Busnatu S, et al. Costs and effects of telerehabilitation in neurological and cardiological diseases: a systematic review. Front Med (Lausanne). 2022;9:832229. [FREE Full text] [CrossRef] [Medline]
    65. Shenoy MP, Shenoy PD. Identifying the challenges and cost-effectiveness of telerehabilitation: a narrative review. JCDR. 2018;12(12):1-4. [CrossRef]
    66. Leppink J, O'Sullivan P, Winston K. Are differences between groups different at different occasions? Perspect Med Educ. Dec 2017;6(6):413-417. [FREE Full text] [CrossRef] [Medline]

    ‎
    ADL: activities of daily living
    BDI-II: Beck Depression Inventory II
    BI: Barthel Index
    CBI: Caregiver Burden Inventory
    ES: effect size
    FAB: Frontal Assessment Battery
    IRCCS: Istituto di Ricovero e Cura a Carattere Scientifico
    MAS: Modified Ashworth Scale
    MoCa: Montreal Cognitive Assessment
    PGWBI: Psychological General Well-Being Index
    QoL: quality of life
    RCT: randomized controlled trial
    SABI: severe acquired brain injury
    SF-36: Short Form Health Survey 36
    SUS: System Usability Scale
    TBI: traumatic brain injury
    TR: telerehabilitation
    TS: Tinetti Scale
    UTRT: usual territorial rehabilitative treatment
    VR: virtual reality
    VRRS: virtual reality rehabilitation system

    Edited by G Eysenbach; submitted 02.01.23; peer-reviewed by L Holanda, T Szturm; comments to author 05.04.23; revised version received 26.04.23; accepted 09.06.23; published 21.08.23.

    Copyright

    ©Rocco Salvatore Calabrò, Mirjam Bonanno, William Torregrossa, Luisa Cacciante, Antonio Celesti, Carmela Rifici, Paolo Tonin, Rosaria De Luca, Angelo Quartarone. Originally published in the Journal of Medical Internet Research (https://www.jmir.org), 21.08.2023.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on https://www.jmir.org/, as well as this copyright and license information must be included.