Published on in Vol 22, No 4 (2020): April

Bringing Virtual Reality From Clinical Trials to Clinical Practice for the Treatment of Eating Disorders: An Example Using Virtual Reality Cue Exposure Therapy

Bringing Virtual Reality From Clinical Trials to Clinical Practice for the Treatment of Eating Disorders: An Example Using Virtual Reality Cue Exposure Therapy

Bringing Virtual Reality From Clinical Trials to Clinical Practice for the Treatment of Eating Disorders: An Example Using Virtual Reality Cue Exposure Therapy

Viewpoint

1PGSP-Stanford PsyD Consortium, Palo Alto, CA, United States

2Department of Psychiatry and Behavioral Sciences, Stanford University, Stanford, CA, United States

3Applied Technology for Neuro-Psychology Lab, Istituto Auxologico Italiano, Milan, Italy

4Centro Studi e Ricerche di Psicologia della Comunicazione, Università Cattolica del Sacro Cuore, Milan, Italy

*these authors contributed equally

Corresponding Author:

Debra L Safer, MD

Department of Psychiatry and Behavioral Sciences

Stanford University

401 Quarry Rd

Stanford, CA, 94304

United States

Phone: 1 650 498 9111

Fax:1 650 723 9087

Email: dlsafer@stanford.edu


Novel treatment options for eating disorders (EDs) are critically needed to enhance treatment outcomes and reduce the rates of treatment dropouts. On average, only 50% of individuals receiving evidence-based care remit, whereas 24% drop out before treatment completion. One particularly promising direction involves integrating virtual reality (VR) with existing evidence-based treatments (EBTs) such as cue exposure therapy (CET). Across psychiatric disorders, VR-based interventions are demonstrating at least preliminary efficacy and noninferiority to traditional treatments. Furthermore, VR technology has become increasingly portable, resulting in improved acceptance, increased access, and reductions in cost. However, more efficient research processes may be needed to uncover the potential benefits of these rapid technological advances. This viewpoint paper reviews existing empirical support for integrating VR with EBTs (with a focus on its use with EDs) and proposes key next steps to more rapidly bring this innovative technology-based intervention into real-world clinic settings, as warranted. VR-CET for EDs is used to illustrate a suggested process for developing such treatment enhancements. We recommend following a deployment-focused model of intervention development and testing to enable rapid implementation of robust, practice-ready treatments. In addition, our review highlights the need for a comprehensive clinical protocol that supports clinicians and researchers in the implementation and testing of VR-CET and identifies key missing protocol components with rationale for their inclusion. Ultimately, this work may lead to a more complete understanding of the full potential of the applications and integrations of VR into mental health care globally.

J Med Internet Res 2020;22(4):e16386

doi:10.2196/16386

Keywords



Eating disorders (EDs) pose serious risks to psychological and physical health [1,2], resulting in an elevated risk of death for those with EDs compared with the general population [3-5]. Although evidence-based treatments (EBTs) for EDs demonstrate reasonable efficacy, on average, only 50% of individuals receiving evidence-based care remit fully [6-8], and 24% are estimated to drop out before the completion of treatment [9]. Innovation is needed to improve treatment outcomes.

Virtual reality (VR) is a technology that can augment existing EBTs with the possibility of enhancing treatment outcomes. Through the creation of immersive computer-generated experiences, users interact naturally with stimuli representing the real world while simultaneously benefiting from a clinical, supervised setting [10]. Moreover, VR shares with the brain the same basic mechanism: embodied simulations [11]. In fact, a VR system, similar to the brain, maintains a model (simulation) of the body and the space around it.

These features offer different potential advantages for using VR to augment existing EBTs for EDs [12-16]. Advantages may include automating and standardizing ED psychoeducation, opportunities to practice emotion regulation skills, reprogramming attentional biases, enhancing insight by identifying body distortion, changing implicit and explicit perceptual bodily distortions, reducing weight stigma and biases, enhancing empathy among support persons, and augmenting exposure therapy. In particular, three different randomized controlled trials [14,17,18] have shown at long-term follow-ups (6 and 12 months) that VR-enhanced cognitive behavioral therapy (CBT) for EDs had a higher efficacy on some outcomes than CBT alone (eg, greater improvement in body image disturbances; increased reduction in the frequency of binge, purge, and overeating episodes; and more weight loss for obese individuals with binge eating disorder, BED).

Nevertheless, traditional models for testing treatments, which include case series and randomized controlled trials to test efficacy under highly controlled research conditions in academic centers, followed by effectiveness and implementation studies, may render these rapidly changing technologies obsolete by the time they are clinic-ready. For example, since the early 2000s, immersive VR has become increasingly sophisticated with improved 3-dimensional constructed environments; compatibility with mobile phones; and a wide variety of head-mounted display devices equipped with increased field of view, higher-resolution images, and lightweight and comfortable designs [19]. Testing these interventions within real-world clinic settings quickly, before they are replaced by newer technology, may be crucial to benefit from the existing content and devices [20].

In this paper, we discuss the great potential of VR-based interventions in the treatment of psychiatric disorders and research efforts needed to support the development of effective clinic-ready treatments in a timely manner. Of the many applications of VR in the treatment of EDs [21,22], virtual reality cue exposure therapy (VR-CET) has the strongest empirical support at present [18,23-25]. Therefore, we focus on VR-CET to anchor the discussion. Specifically, this paper provides: (1) an overview of VR-CET and its potential advantages to augment EBTs; (2) a brief review of the empirical support for VR-based exposures in psychiatric disorders, with a focus on VR-CET for EDs; (3) an argument for small-scale effectiveness trials early in treatment development (following the deployment-focused model of intervention development and testing by Weisz et al [20]); and (4) ideas on how VR-CET can be more rapidly developed and implemented in real-world clinic settings, highlighting key missing protocol components, with rationale for their inclusion.


VR-CET provides traditional cue exposure therapy (CET) in a virtual environment. CET is a subcategory of exposure therapy that is specific to eating and substance-related disorders. Both techniques involve repeated, controlled exposures to relevant stimuli. However, CET was initially specifically designed to target cravings (vs fear) [26]. CET is based on classical conditioning, a learning theory that explains how maladaptive behavior can develop in response to previously neutral stimuli. According to classical conditioning, repeatedly pairing a neutral stimulus (conditioned stimuli) with a stimulus (unconditioned stimulus) that naturally evokes a biologically potent response (unconditioned response) may eventually result in responding similarly to the neutral stimulus as one would for the biologically potent stimulus (conditioned response). For example, in the classical conditioning model of binge eating, Jansen [27] conceptualizes the intake of food as the unconditioned stimulus and its metabolic effects as the unconditioned response. Cues that reliably signal food intake, such as sight, smell, taste, and the context in which one eats, act as conditioned stimuli. The presence of these cues (conditioned stimuli) elicits physiological responses that are experienced as craving (ie, an almost irresistible urge to eat), which can increase the probability of binge episodes (conditioned response) [28-31]. In CET, the main objective is to weaken the bond between the cues (conditioned stimuli) and the maladaptive responses (conditioned responses), which may mask or inhibit initial learning [32]. Specifically, VR can reduce eating-related anxiety during and after exposure to virtual food, helping to disrupt the reconsolidation of adverse, food-related memories [24,26].

In VR-CET for EDs, patients are repeatedly exposed to emotionally provoking eating-related situations that typically result in maladaptive behaviors (eg, binge eating and avoidance). Exposure is planned gradually and designed to eliminate the ED behavior. New associations develop with eating-related anxiety and cravings in response to stimuli decreasing over time [24,33]. Emotional changes may occur, in part, because of the modifications to dysfunctional thinking and increased self-efficacy [34]. Other VR exposure programs created in the context of CBT extend the exposure activities to include cognitive restructuring and practice using alternative emotion regulation strategies in response to triggering stimuli. These strategies may help address core ED symptomatology [31].

VR offers several promising advantages to in vivo exposure that may result in reduced therapist burden, more rapid symptom improvement, improved acceptance of treatment, reduced treatment dropouts, and more accurate measurement-based care. VR environments may more closely approximate the settings in which problematic eating behaviors take place compared with the clinician’s office or imaginal exercises. A therapist can manipulate a larger number of stimuli within the VR environment than in the real world (eg, intensity of the feared stimulus) and personalize both contextual cues (eg, social setting and room type) and sensorial cues (eg, smell, sound, and tactile effects). VR environments can be tailored precisely to a patient’s fear hierarchy (ie, the client’s rank order list of cues that elicit anxiety on a scale from lowest to highest). Extensive evidence exists showing VR environments produce emotional, behavioral, and physiological responses in patients similar to those observed in real-life situations [15]. Thus, VR enables the therapist to guide the patient through an exposure or use skills within a more ecologically valid environment, efficiently challenging dysfunctional mental representations [34] and potentially facilitating improved application of the acquired skills and subsequent generalization. In addition, VR-based exposures may be a more acceptable strategy than the traditional leap from an in-office imaginal exposure to an in vivo exposure. Gradually moving from virtual to in vivo exposures offers a middle step and a more palliative intervention that may reduce treatment dropout rates [31,33]. The appeal of a new and exciting technology may also contribute to the patients’ willingness to engage with exposures in VR. Indeed, one study found that 89% of patients with specific phobia chose VR over in vivo exposures when given a choice [35]. Preference for VR over in vivo exposures may very well be a manifestation of avoidance of the feared stimuli in patients with specific phobia. For example, about 25% of patients with specific phobia refuse exposure therapy [35]. However, reviews [36,37] show limited evidence that safety behaviors may not be detrimental to exposure efficacy based on the inhibitory learning model and thus conclude that judicious use of safety behavior can be clinically indicated. It is recommended to eliminate safety behavior as soon as the clients are willing. Thus, in cases in which avoidance appears to drive the patient’s rationale for in virtuo exposure, VR may serve as a stepping-stone to in vivo exposure for patients who would not otherwise receive care. Furthermore, a review of VR in the treatment of EDs indicated increased motivation for change in VR treatments and lower rates of loss to follow-up compared with in vivo active comparisons across several studies [10]. Finally, data collection and measurements can occur in session more effectively when using VR. This can eliminate potential adherence and validity problems with in vivo exposure compliance tracking. VR can enable tracking of many ecologically valid variables (eg, level of anxiety and urge to binge), which can be recorded and viewed in real time [38].

Unfortunately, studies indicate that many therapists hold negative beliefs about in vivo exposure therapy for anxiety disorders (eg, exposure may harm patients, result in symptom exacerbation, or harm therapists because of vicarious trauma), which may pose a barrier to treatment dissemination [39]. In contrast, there is growing interest and increasing acceptability among therapists regarding VR-based exposure. For instance, recent studies suggest that therapists have an overall positive attitude toward VR exposure therapy (pros rated higher than cons) and view VR as applicable to conditions other than anxiety [40], including EDs [41]. Lindner et al [40] also noted that high financial costs and technical difficulties were no longer top-rated negative aspects with the release of consumer VR platforms. However, the authors note that VR has not yet been widely implemented in routine care, for unclear reasons.


The intention of this paper is not to systematically review the literature on VR-based exposure therapy because that would be outside the scope of this viewpoint paper. Instead, we provide an overview of the empirical support for VR-based exposure with a focus on EDs to highlight the foundational work and provide context for our arguments in the subsequent sections. A substantial body of research supports the efficacy of VR-CET and VR-based exposures for numerous psychiatric disorders, notably those that frequently co-occur with EDs such as anxiety, substance use disorders, and posttraumatic stress disorder (PTSD) [42-44]. VR exposure therapy is consistently more effective than nonactive control groups (ie, waitlist), whereas comparisons between VR exposure therapy and manualized CBT and/or in vivo exposures tend to show equivalence in outcomes [43-49]. Considerable research has focused on anxiety disorders (eg, social phobia, panic disorder with agoraphobia, and specific phobias), with meta-analytic studies reporting large effect sizes (eg, Cohen d=0.95, ranging from 0.87 in PTSD to 1.79 in panic disorder with agoraphobia) [50]. Meta-analyses also reveal moderate effect sizes for VR exposure therapy over waitlist controls in PTSD [48,49] and show the benefit of VR exposure therapy in the assessment or treatment of acute stress disorder and paranoia [51]. These reviews note that although more research is needed to better understand the mechanisms of action, VR-specific variables such as a sense of presence within virtual environments may affect treatment outcomes [43,45]. Additional important takeaways are that modern VR systems are becoming increasingly affordable, accessible, and user-friendly [44] and that VR may be especially useful in exploring hypotheses related to the processes and mechanisms involved in exposure therapy because of the high degree of control and manipulation of specific variables that this technology allows [45]. Finally, the existing reviews illustrate the insufficient state of the current literature, given inconsistent reporting of key variables [43] and the fact that although studies have been conducted in controlled research contexts, research within real-world clinical settings are lacking [45,51].

Compared with research on the use of VR-based exposures for anxiety and related disorders, the number of studies that have specifically investigated the use of VR-CET for EDs is small. With so few individual studies conducted to date, publication of meta-analyses or reviews of VR-CET for EDs has not yet been warranted. However, the limited research conducted thus far is favorable. For example, patients with bulimia nervosa (BN) and BED who remained symptomatic after CBT showed a significantly greater reduction in binge eating and higher percentages of abstinence from binge eating and purging after randomization to six sessions of VR-CET vs six sessions of additional CBT [23]. Results from a 6-month follow-up of this same study revealed that reductions in binge, purge, and overeating episodes were greater after treatment with VR-CET [18]. Such results suggest VR-CET is not only efficacious posttreatment but appears to have lasting effects.

A total of three case reports using a similar nonimmersive VR-CET program as a complementary tool to CBT demonstrated positive effects with patients diagnosed with restrictive anorexia nervosa (AN-R), binge/purge anorexia nervosa (AN-B/P), and BN [52-54]. All patients reported lower levels of anxiety as well as reduced frequency of safety and avoidance behaviors related to food after completing a short (six or seven sessions) VR-CET module. Notably, the patient diagnosed with AN-R increased her BMI from 15 kg/m2 to 16.8 kg/m2 [52], the patient diagnosed with AN-B/P reduced her binge/purge behaviors from two to three times per day to once per week [53], and the patient diagnosed with BN completely eliminated binge and purge episodes [54]. Furthermore, the patients in these case reports reported that VR treatment was acceptable and helpful [52-54]. Of note, VR exposure was particularly helpful for exploring thoughts and emotions experienced in the moment while eating a virtual food, enabling productive therapeutic discussions to take place in an “‘ecological’ environment, one that was clinically significant but also safe” [53].

Given the aforementioned research, VR-CET for EDs may have value for advancing the field of EDs. The patients’ responses to VR-CET outlined in the research above are rapid. Faster acting treatments may reduce treatment length and, as a result, reduce clinic wait times—thereby positively addressing access to care issues. Given these potential advantages, we discuss the importance of pilot testing in real-world clinical settings at this stage in the developmental process.


A recent systematic review of VR in the assessment, understanding, and treatment of mental health disorders broadly argues that the progress in implementing and disseminating VR applications has been slow despite growing interest [55]. The authors propose that VR in mental health care could be revolutionary in that the results of VR treatment may surpass those of a standard course of EBT [55]. Reilly et al [56] specifically argue for the expansion of exposure approaches and techniques, including VR-CET, for EDs. However, to date, the studies employing VR-CET for EDs have been conducted in Europe under the highly controlled settings of research trials. To translate this research into clinical practice, VR-CET needs to be tested in real-world clinic settings.

Historically, across disorders, implementation of VR in treatment was limited by the cost of technology and concerns about acceptability (eg, motion sickness experienced by a high percentage of participants) [57,58]. However, over time, VR technology has become increasingly portable (with the advent of handheld devices), resulting in improved acceptance, increased access, and reduction in cost. Market trends suggest that the demand for VR will rise steeply, with estimates of 55 million headset orders for 2022 alone [59], making VR nearly ubiquitous in American homes, similar to the personal computer. This increased access increases the likelihood of bringing VR-CET into the clinic, with supporting use at home. Investigation of how best to translate the existing research into real-world application is timely.

Given the limited number of efficacy trials of VR-CET for EDs to date, some may argue that translating this treatment into clinical practice at this stage of development is premature. In traditional models of EBT development, efficacy trials that provide substantial evidence for the treatment’s success under controlled conditions are conducted before studying the treatment in real-world settings. However, as other researchers have observed [20], the gap between research and real-world conditions is sometimes so big that regardless of the treatment’s robustness under controlled conditions, the treatment is not able to endure the conditions of the real world; the task of closing this gap at the end of a series of efficacy trials becomes unnecessarily complex and inefficient. As the former National Institute of Mental Health (NIMH) Director Thomas Insel [60] pointed out, interventions developed in highly controlled research settings often fail to take into account the key characteristics of the patients, providers, and settings in which the intervention will ultimately be implemented, which limits their practical value. For example, patients with comorbid issues are often excluded, and interventions are conducted by highly trained and closely supervised clinicians. However, in practice settings, comorbid issues tend to be the rule rather than the exception, and up to 40% of mental health providers in the public sector do not have a graduate or professional degree [60]. In addition, setting factors such as billing constraints and typical patterns of patient service use (eg, number of sessions typically attended in the setting) tend to be overlooked. As a result, treatments developed under highly controlled settings may be scientifically valid but not necessarily clinically meaningful or generalizable to real-world clinic settings [60].

As an alternative to traditional models of treatment development, Weisz et al [20] describe a “deployment-focused model of intervention development and testing” that integrates testing of treatments in practice settings early and throughout the treatment development process, rather than as a final phase, to ensure that they are applicable to and successful in the settings in which they will be delivered. Notably, the NIMH also shows interest in supporting clinic-based treatment development approaches in the NIMH Strategic Plan for Research [61]. We argue that deployment-focused model is not only particularly applicable to VR-CET but also an integral component of its successful development and testing—particularly given the likelihood of the technologies involved to become obsolete. Estimates of the time lag between when a treatment is initially developed and when it reaches the stage of dissemination, following the traditional research models, average about 17 years [62]. We thus identify a next direction for researchers and practitioners to translate this research into practice.


Weisz et al [20] propose that the first stage of deployment-focused treatment development involves the creation of a treatment protocol. Indeed, bringing VR-CET into clinical practice at this stage of development requires the creation of a protocol that is easily disseminated; adaptable across cultures and settings; and clearly outlines acceptability, feasibility, and implementation factors. As such, characteristics of providers and the usual settings in which care is provided must be considered. Many factors that would inform the creation of this protocol and ensure that VR-CET is practice-ready are noted in the literature as important but not consistently reported or described in sufficient detail. More comprehensive and consistent reporting of these factors has the potential to inform a VR-CET protocol that would support researchers and clinicians in becoming comfortable in implementing a technological innovation that has potential to advance the treatment for EDs. These factors include (1) patient and clinician reactions to and satisfaction with VR technology [40,63]; (2) logistical parameters such as space required, costs, and institutional buy-in [63]; (3) considerations in creating VR content, including working with software and/or third-party vendors and the optimal level of presence (the extent to which the individual interacts with the VR environment as if it is reality) for treatment effects to occur [64,65]; (4) clinical guidelines and outcome data, including outcomes compared with traditional EBTs, how to determine patient suitability for VR, optimal frequency and number of sessions, and the amount of time within the VR environment [66-68]; and (5) parameters regarding safety and acceptability, including cybersickness (side effects resulting from our physiological motion detection systems when in VR) [66]. Addressing these factors in a treatment protocol and providing examples for how to successfully execute each point will help move VR-CET from research settings to clinical practice.

In addition, future research should take advantage of the unique methods of data collection and assessment available within VR, including the collection of real-time self-reported data in virtuo and biological measurements that can track eye movements, facial gestures, and the movement of body parts. Given the large number of stimuli that can be manipulated and tightly controlled within VR environments (eg, intensity of stimuli, contextual, and sensorial cues), basic science research can utilize VR applications to advance the understanding of ED mechanisms of change.

Given that we are suggesting a deployment-focused model of treatment development for a novel iteration (VR-based) of an already validated therapy (CET), it is important to consider the risks compared with potential benefits of treatment implementation. One important risk associated with the utilization of any VR platform includes cybersickness, a side effect that 20% to 80% of VR users may experience [69,70]. The symptoms of cybersickness are similar to motion sickness and can include nausea, headaches, and dizziness [71]. For most people, cybersickness occurs about 15 min into the VR immersion, is worst in the first session, and becomes negligible by the third session [66]. In addition, clear procedures to address cybersickness within VR-based exposure protocols can mitigate the risks associated with these unpleasant symptoms and should always be included when implementing VR-based therapies [66]. Another risk is the potential loss of effectiveness when translating an already validated therapy into VR-based therapy. A recent review examined the negative effects of VR-based treatments for anxiety disorders using deterioration rates (rates of worsening symptomatology) as the primary outcome [72]. Deterioration rates for VR were found to coincide with other therapeutic approaches; the authors concluded that VR appears to be a nondeleterious treatment for patients with anxiety disorders [72]. In addition, meta-analytic studies show that VR exposure therapy for anxiety-related and trauma-related or stress-related disorders is not significantly less effective than in vivo treatment [43-49].

Overall, the evidence thus far suggests minimal known risk associated with VR exposure therapy, which may reduce concern for deployment-focused treatment development. In addition, the standard of care in clinical practice involves the use of an informed consent process by which patients are provided with clear information regarding their treatment options, including the relative risks and potential benefits of each approach. Given the minimal known risks associated with VR-based treatments and the ability of VR-based exposures to provide an acceptable and effective treatment option for those who refuse, drop out of, or do not progress via in vivo exposures, we believe the potential benefits outweigh the costs of offering VR-based exposures as an alternative treatment option. To further minimize any associated risks of offering a novel treatment alternative to an already validated treatment approach, we suggest that the real-world trials of this technology should assess the patients’ progress and suggest in vivo exposures or a different active treatment if a patient is not making progress.

Given evidence that integrating VR technology with EBTs for EDs such as CBT leads to significantly improved outcomes [12,15], with faster effects and better maintenance than standard treatment alone [12,16], following the above recommendations to create and implement a comprehensive VR-CET protocol may help make evidence-based care more accessible and cost-effective for patients with an ED. We hypothesize that implementing VR-CET in real-world clinical settings may also foster increased patient participation in and excitement about treatment through their involvement in designing VR-based exposures. Furthermore, a patient’s experience of success (eg, tolerating the urge to binge) within VR may increase their perception of self-efficacy, enhancing confidence to translate therapy skills to real-world experiences.

Overall, comprehensive study of VR-CET in real-world clinic settings is a fruitful direction that may advance intervention protocols for EDs. In particular, a clear protocol for VR-CET for EDs will help translate the exciting research supporting the applications of VR into a clinic-ready intervention, providing a model use and, ultimately, a more comprehensive understanding of the full potential of the applications of VR on mental health care globally. We suggest that continued research efforts focus on advancing VR-CET following the clinic-based treatment development approach to more rapidly move technology-based interventions from research settings into the real world, as warranted.

Acknowledgments

The authors thank Marta Ferrer-Garcia, PhD, and Realiteer Corp for their respective contributions to this research as well as Micro-Star International Co, Ltd, for their product loan. Drs Runfola, Adler, Safer, and Bullock would like to acknowledge the financial support from the National Eating Disorders Association. Giuseppe Riva would like to acknowledge the financial support by the Italian Ministry of Education, University and Research research project Unlocking the memory of the body: Virtual Reality in Anorexia Nervosa (201597WTTM).

Authors' Contributions

TB and EV should be considered joint first author. Drs CR and DS should be considered joint senior author.

Conflicts of Interest

None declared.

  1. Kaye WH, Klump KL, Frank GK, Strober M. Anorexia and bulimia nervosa. Annu Rev Med 2000;51:299-313. [CrossRef] [Medline]
  2. Smink FR, van Hoeken D, Hoek HW. Epidemiology, course, and outcome of eating disorders. Curr Opin Psychiatry 2013 Nov;26(6):543-548. [CrossRef] [Medline]
  3. Chesney E, Goodwin GM, Fazel S. Risks of all-cause and suicide mortality in mental disorders: a meta-review. World Psychiatry 2014 Jun;13(2):153-160 [FREE Full text] [CrossRef] [Medline]
  4. Papadopoulos FC, Ekbom A, Brandt L, Ekselius L. Excess mortality, causes of death and prognostic factors in anorexia nervosa. Br J Psychiatry 2009 Jan;194(1):10-17. [CrossRef] [Medline]
  5. Suokas JT, Suvisaari JM, Gissler M, Löfman R, Linna MS, Raevuori A, et al. Mortality in eating disorders: a follow-up study of adult eating disorder patients treated in tertiary care, 1995-2010. Psychiatry Res 2013 Dec 30;210(3):1101-1106. [CrossRef] [Medline]
  6. Brownley KA, Berkman ND, Peat CM, Lohr KN, Cullen KE, Bann CM, et al. Binge-eating disorder in adults: A systematic review and meta-analysis. Ann Intern Med 2016 Sep 20;165(6):409-420 [FREE Full text] [CrossRef] [Medline]
  7. Knott S, Woodward D, Hoefkens A, Limbert C. Cognitive behaviour therapy for bulimia nervosa and eating disorders not otherwise specified: Translation from randomized controlled trial to a clinical setting. Behav Cogn Psychother 2015 Nov;43(6):641-654. [CrossRef] [Medline]
  8. Södersten P, Bergh C, Leon M, Brodin U, Zandian M. Cognitive behavior therapy for eating disorders versus normalization of eating behavior. Physiol Behav 2017 May 15;174:178-190 [FREE Full text] [CrossRef] [Medline]
  9. Linardon J, Hindle A, Brennan L. Dropout from cognitive-behavioral therapy for eating disorders: A meta-analysis of randomized, controlled trials. Int J Eat Disord 2018 May;51(5):381-391. [CrossRef] [Medline]
  10. Clus D, Larsen ME, Lemey C, Berrouiguet S. The use of virtual reality in patients with eating disorders: systematic review. J Med Internet Res 2018 Apr 27;20(4):e157 [FREE Full text] [CrossRef] [Medline]
  11. Riva G, Wiederhold BK, Mantovani F. Neuroscience of virtual reality: From virtual exposure to embodied medicine. Cyberpsychol Behav Soc Netw 2019 Jan;22(1):82-96 [FREE Full text] [CrossRef] [Medline]
  12. Riva G, Bacchetta M, Cesa G, Conti S, Molinari E. Six-month follow-up of in-patient experiential cognitive therapy for binge eating disorders. Cyberpsychol Behav 2003 Jun;6(3):251-258. [CrossRef] [Medline]
  13. Riva G, Bacchetta M, Cesa G, Conti S, Molinari E. The use of VR in the treatment of eating disorders. Stud Health Technol Inform 2004;99:121-163. [Medline]
  14. Marco JH, Perpiñá C, Botella C. Effectiveness of cognitive behavioral therapy supported by virtual reality in the treatment of body image in eating disorders: one year follow-up. Psychiatry Res 2013 Oct 30;209(3):619-625. [CrossRef] [Medline]
  15. de Carvalho MR, Dias TR, Duchesne M, Nardi AE, Appolinario JC. Virtual reality as a promising strategy in the assessment and treatment of bulimia nervosa and binge eating disorder: A systematic review. Behav Sci (Basel) 2017 Jul 9;7(3):pii: E43 [FREE Full text] [CrossRef] [Medline]
  16. Gutiérrez-Malsonado J, Ferrer-García M, Dakanalis A, Riva G. Virtual reality: applications to eating disorders. In: Agras WS, Robinson A, editors. The Oxford Handbook of Eating Disorders. Second Edition. New York: Oxford University Press; 2018.
  17. Cesa GL, Manzoni GM, Bacchetta M, Castelnuovo G, Conti S, Gaggioli A, et al. Virtual reality for enhancing the cognitive behavioral treatment of obesity with binge eating disorder: randomized controlled study with one-year follow-up. J Med Internet Res 2013 Jun 12;15(6):e113 [FREE Full text] [CrossRef] [Medline]
  18. Ferrer-Garcia M, Pla-Sanjuanelo J, Dakanalis A, Vilalta-Abella F, Riva G, Fernandez-Aranda F, et al. A randomized trial of virtual reality-based cue exposure second-level therapy and cognitive behavior second-level therapy for bulimia nervosa and binge-eating disorder: Outcome at six-month followup. Cyberpsychol Behav Soc Netw 2019 Jan;22(1):60-68. [CrossRef] [Medline]
  19. Jerdan SW, Grindle M, van Woerden HC, Boulos MN. Head-mounted virtual reality and mental health: Critical review of current research. JMIR Serious Games 2018 Jul 6;6(3):e14 [FREE Full text] [CrossRef] [Medline]
  20. Weisz JR, Chu BC, Polo AJ. Treatment dissemination and evidence-based practice: Strengthening intervention through clinician-researcher collaboration. Clin Psychol Sci Pract 2004;11(3):300-307. [CrossRef]
  21. Serino S, Chirico A, Pedroli E, Polli N, Cacciatore C, Riva G. Two-phases innovative treatment for anorexia nervosa: The potential of virtual reality body-swap. Ann Rev CyberTher Telemed 2017;15:111-115 [FREE Full text]
  22. Serino S, Polli N, Riva G. From avatars to body swapping: The use of virtual reality for assessing and treating body-size distortion in individuals with anorexia. J Clin Psychol 2019 Feb;75(2):313-322 [FREE Full text] [CrossRef] [Medline]
  23. Ferrer-García M, Gutiérrez-Maldonado J, Pla-Sanjuanelo J, Vilalta-Abella F, Riva G, Clerici M, et al. A randomised controlled comparison of second-level treatment approaches for treatment-resistant adults with bulimia nervosa and binge eating disorder: Assessing the benefits of virtual reality cue exposure therapy. Eur Eat Disord Rev 2017 Nov;25(6):479-490. [CrossRef] [Medline]
  24. Pla-Sanjuanelo J, Ferrer-García M, Gutiérrez-Maldonado J, Riva G, Andreu-Gracia A, Dakanalis A, et al. Identifying specific cues and contexts related to bingeing behavior for the development of effective virtual environments. Appetite 2015 Apr;87:81-89. [CrossRef] [Medline]
  25. Pla-Sanjuanelo J, Ferrer-García M, Vilalta-Abella F, Riva G, Dakanalis A, Ribas-Sabaté J, et al. Testing virtual reality-based cue-exposure software: which cue-elicited responses best discriminate between patients with eating disorders and healthy controls? Eat Weight Disord 2019 Aug;24(4):757-765. [CrossRef] [Medline]
  26. Koskina A, Campbell IC, Schmidt U. Exposure therapy in eating disorders revisited. Neurosci Biobehav Rev 2013 Feb;37(2):193-208. [CrossRef] [Medline]
  27. Jansen A. A learning model of binge eating: cue reactivity and cue exposure. Behav Res Ther 1998 Mar;36(3):257-272. [CrossRef] [Medline]
  28. Boswell RG, Kober H. Food cue reactivity and craving predict eating and weight gain: a meta-analytic review. Obes Rev 2016 Feb;17(2):159-177 [FREE Full text] [CrossRef] [Medline]
  29. García-García I, Narberhaus A, Marqués-Iturria I, Garolera M, Rădoi A, Segura B, et al. Neural responses to visual food cues: insights from functional magnetic resonance imaging. Eur Eat Disord Rev 2013 Mar;21(2):89-98. [CrossRef] [Medline]
  30. Lyu Z, Zheng P, Jackson T. Attention disengagement difficulties among average weight women who binge eat. Eur Eat Disord Rev 2016 Jul;24(4):286-293. [CrossRef] [Medline]
  31. Wolz I, Sauvaget A, Granero R, Mestre-Bach G, Baño M, Martín-Romera V, et al. Subjective craving and event-related brain response to olfactory and visual chocolate cues in binge-eating and healthy individuals. Sci Rep 2017 Feb 3;7:41736 [FREE Full text] [CrossRef] [Medline]
  32. Craske MG, Treanor M, Conway CC, Zbozinek T, Vervliet B. Maximizing exposure therapy: an inhibitory learning approach. Behav Res Ther 2014 Jul;58:10-23 [FREE Full text] [CrossRef] [Medline]
  33. Bulik CM, Sullivan PF, Carter FA, McIntosh VV, Joyce PR. The role of exposure with response prevention in the cognitive-behavioural therapy for bulimia nervosa. Psychol Med 1998 May;28(3):611-623. [CrossRef] [Medline]
  34. Albano AM, Botella C, Bouchard S, Draheim A, Hoffman L, Khanna M. More than Meets the Eye: Implications of Virtual Reality for Improving and Disseminating Anxiety and Depression Treatment. 2019 Presented at: ABCT 53rd Annual Convention; November 21-24, 2019; Atlanta   URL: https://www.eventscribe.com/2019/ABCT/fsPopup.asp?Mode=sessioninfo&PresentationID=603846
  35. Garcia-Palacios A, Hoffman HG, See SK, Tsai A, Botella C. Redefining therapeutic success with virtual reality exposure therapy. Cyberpsychol Behav 2001 Jun;4(3):341-348. [CrossRef] [Medline]
  36. Blakey SM, Abramowitz JS. The effects of safety behaviors during exposure therapy for anxiety: Critical analysis from an inhibitory learning perspective. Clin Psychol Rev 2016 Nov;49:1-15. [CrossRef] [Medline]
  37. Weisman JS, Rodebaugh TL. Exposure therapy augmentation: A review and extension of techniques informed by an inhibitory learning approach. Clin Psychol Rev 2018 Feb;59:41-51. [CrossRef] [Medline]
  38. Parsons TD. Virtual reality for enhanced ecological validity and experimental control in the clinical, affective and social neurosciences. Front Hum Neurosci 2015;9:660 [FREE Full text] [CrossRef] [Medline]
  39. Deacon BJ, Farrell NR, Kemp JJ, Dixon LJ, Sy JT, Zhang AR, et al. Assessing therapist reservations about exposure therapy for anxiety disorders: the Therapist Beliefs about Exposure Scale. J Anxiety Disord 2013 Dec;27(8):772-780. [CrossRef] [Medline]
  40. Lindner P, Miloff A, Zetterlund E, Reuterskiöld L, Andersson G, Carlbring P. Attitudes toward and familiarity with virtual reality therapy among practicing cognitive behavior therapists: A cross-sectional survey study in the era of consumer VR platforms. Front Psychol 2019;10:176 [FREE Full text] [CrossRef] [Medline]
  41. Nauman E, Brown T, Runfola C, Safer D, Bullock K, Nameth K, et al. Virtual reality cue exposure therapy for eating disorders: development of a culturally specific manual in the U.S. for use in a real world clinic setting. 2019 Presented at: International Conference on Eating Disorders; March 14-16, 2019; New York   URL: https://www.aedweb.org/aed-events/previous-conferences/iced-2019
  42. Hone-Blanchet A, Wensing T, Fecteau S. The use of virtual reality in craving assessment and cue-exposure therapy in substance use disorders. Front Hum Neurosci 2014;8:844 [FREE Full text] [CrossRef] [Medline]
  43. Turner WA, Casey LM. Outcomes associated with virtual reality in psychological interventions: where are we now? Clin Psychol Rev 2014 Dec;34(8):634-644. [CrossRef] [Medline]
  44. Valmaggia LR, Latif L, Kempton MJ, Rus-Calafell M. Virtual reality in the psychological treatment for mental health problems: An systematic review of recent evidence. Psychiatry Res 2016 Feb 28;236:189-195. [CrossRef] [Medline]
  45. Botella C, Fernández-Álvarez J, Guillén V, García-Palacios A, Baños R. Recent progress in virtual reality exposure therapy for phobias: A systematic review. Curr Psychiatry Rep 2017 Jul;19(7):42. [CrossRef] [Medline]
  46. Wechsler TF, Kümpers F, Mühlberger A. Inferiority or even superiority of virtual reality exposure therapy in phobias? - A systematic review and quantitative meta-analysis on randomized controlled trials specifically comparing the efficacy of virtual reality exposure to gold standard exposure in agoraphobia, specific phobia, and social phobia. Front Psychol 2019;10:1758 [FREE Full text] [CrossRef] [Medline]
  47. Carl E, Stein AT, Levihn-Coon A, Pogue JR, Rothbaum B, Emmelkamp P, et al. Virtual reality exposure therapy for anxiety and related disorders: A meta-analysis of randomized controlled trials. J Anxiety Disord 2019 Jan;61:27-36. [CrossRef] [Medline]
  48. Kothgassner OD, Goreis A, Kafka JX, van Eickels RL, Plener PL, Felnhofer A. Virtual reality exposure therapy for posttraumatic stress disorder (PTSD): a meta-analysis. Eur J Psychotraumatol 2019;10(1):1654782 [FREE Full text] [CrossRef] [Medline]
  49. Deng W, Hu D, Xu S, Liu X, Zhao J, Chen Q, et al. The efficacy of virtual reality exposure therapy for PTSD symptoms: A systematic review and meta-analysis. J Affect Disord 2019 Oct 1;257:698-709. [CrossRef] [Medline]
  50. Parsons TD, Rizzo AA. Affective outcomes of virtual reality exposure therapy for anxiety and specific phobias: a meta-analysis. J Behav Ther Exp Psychiatry 2008 Sep;39(3):250-261. [CrossRef] [Medline]
  51. Oing T, Prescott J. Implementations of virtual reality for anxiety-related disorders: systematic review. JMIR Serious Games 2018 Nov 7;6(4):e10965 [FREE Full text] [CrossRef] [Medline]
  52. Cardi V, Krug I, Perpiñá C, Mataix-Cols D, Roncero M, Treasure J. The use of a nonimmersive virtual reality programme in anorexia nervosa: a single case-report. Eur Eat Disord Rev 2012 May;20(3):240-245. [CrossRef] [Medline]
  53. Perpiñá C, Roncero M. Similarities and differences between eating disorders and obese patients in a virtual environment for normalizing eating patterns. Compr Psychiatry 2016 May;67:39-45. [CrossRef] [Medline]
  54. Roncero M, Perpiñá C. Normalizing the eating pattern with virtual reality for bulimia nervosa: a case report. Rev Mex Trastor Aliment 2015 Jul;6(2):152-159. [CrossRef]
  55. Freeman D, Reeve S, Robinson A, Ehlers A, Clark D, Spanlang B, et al. Virtual reality in the assessment, understanding, and treatment of mental health disorders. Psychol Med 2017 Oct;47(14):2393-2400. [CrossRef] [Medline]
  56. Reilly EE, Anderson LM, Gorrell S, Schaumberg K, Anderson DA. Expanding exposure-based interventions for eating disorders. Int J Eat Disord 2017 Oct;50(10):1137-1141 [FREE Full text] [CrossRef] [Medline]
  57. Rizzo AS, Koenig ST. Is clinical virtual reality ready for primetime? Neuropsychology 2017 Nov;31(8):877-899. [CrossRef] [Medline]
  58. Wiederhold BK, Riva G. Virtual reality therapy: Emerging topics and future challenges. Cyberpsychol Behav Soc Netw 2019 Jan;22(1):3-6. [CrossRef] [Medline]
  59. Sallomi P, Lee P. Deloitte US.: Deloitte Touche Tohmatsu Kimited; 2016. Technology, Media & Telecommunications Predictions   URL: https:/​/www2.​deloitte.com/​content/​dam/​Deloitte/​au/​Documents/​technology-media-telecommunications/​deloitte-au-tmt-predictions-2016-report-050218.​pdf [accessed 2020-02-17]
  60. Insel T. The National Institute of Mental Health.: NIMH; 2011 May 20. Making the Most of our Interventions Research   URL: https:/​/www.​nimh.nih.gov/​about/​directors/​thomas-insel/​blog/​2011/​making-the-most-of-our-interventions-research.​shtml [accessed 2020-02-17]
  61. National Institute of Mental Health.: NIMH Strategic Objective 3   URL: https://www.nimh.nih.gov/about/strategic-planning-reports/strategic-objective-3.shtml [accessed 2020-02-17]
  62. Morris ZS, Wooding S, Grant J. The answer is 17 years, what is the question: understanding time lags in translational research. J R Soc Med 2011 Dec;104(12):510-520 [FREE Full text] [CrossRef] [Medline]
  63. Birckhead B, Khalil C, Liu X, Conovitz S, Rizzo A, Danovitch I, et al. Recommendations for methodology of virtual reality clinical trials in health care by an international working group: Iterative study. JMIR Ment Health 2019 Jan 31;6(1):e11973 [FREE Full text] [CrossRef] [Medline]
  64. Regenbrecht HT, Schubert TW, Friedmann F. Measuring the sense of presence and its relations to fear of heights in virtual environments. Int J Hum-Comput Interact 1998 Sep;10(3):233-249. [CrossRef]
  65. Robillard G, Bouchard S, Fournier T, Renaud P. Anxiety and presence during VR immersion: a comparative study of the reactions of phobic and non-phobic participants in therapeutic virtual environments derived from computer games. Cyberpsychol Behav 2003 Oct;6(5):467-476. [CrossRef] [Medline]
  66. Gregg L, Tarrier N. Virtual reality in mental health : a review of the literature. Soc Psychiatry Psychiatr Epidemiol 2007 May;42(5):343-354. [CrossRef] [Medline]
  67. Ferrer-García M, Gutiérrez-Maldonado J. The use of virtual reality in the study, assessment, and treatment of body image in eating disorders and nonclinical samples: a review of the literature. Body Image 2012 Jan;9(1):1-11. [CrossRef] [Medline]
  68. Pericot-Valverde I, Secades-Villa R, Gutiérrez-Maldonado J. A randomized clinical trial of cue exposure treatment through virtual reality for smoking cessation. J Subst Abuse Treat 2019 Jan;96:26-32. [CrossRef] [Medline]
  69. Cobb SV, Nichols S, Ramsey A, Wilson JR. Virtual reality-induced symptoms and effects (VRISE). Presence 1999 Apr;8(2):169-186. [CrossRef]
  70. Munafo J, Diedrick M, Stoffregen TA. The virtual reality head-mounted display Oculus Rift induces motion sickness and is sexist in its effects. Exp Brain Res 2017 Mar;235(3):889-901. [CrossRef] [Medline]
  71. Rebenitsch L, Owen C. Review on cybersickness in applications and visual displays. Virtual Real 2016;20(2):101-125. [CrossRef]
  72. Fernández-Álvarez J, Rozental A, Carlbring P, Colombo D, Riva G, Anderson PL, et al. Deterioration rates in Virtual Reality Therapy: An individual patient data level meta-analysis. J Anxiety Disord 2019 Jan;61:3-17. [CrossRef] [Medline]


AN-B/P: anorexia nervosa, binge/purge type
AN-R: anorexia nervosa, restrictive type
BED: binge eating disorder
BN: bulimia nervosa
CBT: cognitive behavioral therapy
CET: cue exposure therapy
EBT: evidence-based treatment
ED: eating disorder
NIMH: National Institute of Mental Health
PTSD: posttraumatic stress disorder
VR: virtual reality
VR-CET: virtual reality cue exposure therapy


Edited by G Eysenbach; submitted 24.09.19; peer-reviewed by M Lippmann, S DeForte; comments to author 02.11.19; revised version received 07.12.19; accepted 15.12.19; published 23.04.20

Copyright

©Theresa Brown, Emily Nauman Vogel, Sarah Adler, Cara Bohon, Kim Bullock, Katherine Nameth, Giuseppe Riva, Debra L Safer, Cristin D Runfola. Originally published in the Journal of Medical Internet Research (http://www.jmir.org), 23.04.2020.

This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on http://www.jmir.org/, as well as this copyright and license information must be included.