Published on in Vol 25 (2023)

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/43634, first published .
Effects of Fetal Images Produced in Virtual Reality on Maternal-Fetal Attachment: Randomized Controlled Trial

Effects of Fetal Images Produced in Virtual Reality on Maternal-Fetal Attachment: Randomized Controlled Trial

Effects of Fetal Images Produced in Virtual Reality on Maternal-Fetal Attachment: Randomized Controlled Trial

Original Paper

1Department of Obstetrics and Gynecology, Seoul National University Bundang Hospital, Seoul National University College of Medicine, Seongnam-si, Gyeonggi-do, Republic of Korea

2Department of Computer Science and Engineering, Seoul National University, Seoul, Republic of Korea

3Division of Biomedical Engineering, Hankuk University of Foreign Studies, Gyeonggi-do, Republic of Korea

4Department of Neuropsychiatry, Seoul National University Bundang Hospital, Seoul National University College of Medicine, Seongnam-si, Gyeonggi-do, Republic of Korea

*these authors contributed equally

Corresponding Author:

Jee Yoon Park, MD

Department of Obstetrics and Gynecology

Seoul National University Bundang Hospital

Seoul National University College of Medicine

82 Gumi-ro, 173 beon-gil, Bundang-gu

Seongnam-si, Gyeonggi-do, 13620

Republic of Korea

Phone: 82 31 787 7266

Fax:82 31 787 4054

Email: jyparkmd08@snu.ac.kr


Background: Maternal-fetal attachment (MFA) has been reported to be associated with the postpartum mother-infant relationship. Seeing the fetus through ultrasound might influence MFA, and the effect could be increased by more realistic images, such as those generated in virtual reality (VR).

Objective: The aim was to determine the effect of fetal images generated in VR on MFA and depressive symptoms through a prenatal-coaching mobile app.

Methods: This 2-arm parallel randomized controlled trial involved a total of 80 pregnant women. Eligible women were randomly assigned to either a mobile app–only group (n=40) or an app plus VR group (n=40). The VR group experienced their own baby’s images generated in VR based on images obtained from fetal ultrasonography. The prenatal-coaching mobile app recommended health behavior for the pregnant women according to gestational age, provided feedback on entered data for maternal weight, blood pressure, and glucose levels, and included a private diary service for fetal ultrasound images. Both groups received the same app, but the VR group also viewed fetal images produced in VR; these images were stored in the app. All participants filled out questionnaires to assess MFA, depressive symptoms, and other basic medical information. The questionnaires were filled out again after the interventions.

Results: Basic demographic data were comparable between the 2 groups. Most of the assessments showed comparable results for the 2 groups, but the mean score to assess interaction with the fetus was significantly higher for the VR group than the control group (0.4 vs 0.1, P=.004). The proportion of participants with an increased score for this category after the intervention was significantly higher in the VR group than the control group (43% vs 13%, P=.005). The feedback questionnaire revealed that scores for the degree of perception of fetal appearance all increased after the intervention in the VR group.

Conclusions: The use of a mobile app with fetal images in VR significantly increased maternal interaction with the fetus.

Trial Registration: ClinicalTrials.gov NCT04942197; https://clinicaltrials.gov/ct2/show/NCT04942197

J Med Internet Res 2023;25:e43634

doi:10.2196/43634

Keywords



Pregnancy brings various lifelong psychological changes and frequently affects a woman’s values, identity, marital relationship, parenting, and mood [1-3]. Depression is a serious psychological complication of childbearing, and its prevalence has increased during the COVID-19 pandemic [4]. Prenatal check-ups include many laboratory tests and ultrasonographic examinations, usually reassuring pregnant women by confirming fetal well-being; however, this can also cause stress, and depression or anxiety can develop [2,5]. Postpartum depression is a critical problem, since it results in various harmful consequences, such as avoidance of childcare, child abuse, and suicide [6-9].

Several studies have revealed that strong maternal emotions and bonding with the baby have protective effects against postpartum depression and anxiety, and these studies have tried to determine which factors stimulate or improve maternal-fetal attachment (MFA) [10,11]. Delavari et al [12] demonstrated a significant inverse association between MFA and the development of postpartum depressive symptoms in a longitudinal study. Pregnant women with weak MFA are less likely to engage in health-promoting activities and more likely to be reluctant to perform childcare; thus, adverse outcomes in behavior and development of their children might increase [13-15]. In the natural course, MFA increases gradually as gestation progresses, stabilizes in late pregnancy, helps adaptation to physiological changes, and determines maternal responsibility [16,17]. Güney and Uçar [18] reported that maternal subjective recognition of fetal movement enhanced MFA.

Virtual reality (VR) is the newest trend in computer-based technology that simulates objects or situations regardless of location or time [19,20]. It has been applied in numerous fields of health care, such as providing treatment [21-23], facilitating pain management [24-26], simulating surgery [27,28], providing guidance for rehabilitation [29], and enhancing medical education [30,31]. Because pregnant women are not able to see their babies before giving birth, they perceive the existence of the fetus by indirect factors, such as fetal movement or grayscale videos viewed during ultrasonography examinations. Since VR, with the assistance of ultrasonography, can reproduce the appearance of the fetus very realistically, we hypothesized that the vivid images of the fetus possible with VR could help promote MFA.

The purposes of this study were to investigate whether fetal images generated in VR helped pregnant women to imagine or perceive fetal appearance and to determine the positive effect on MFA and the protective effect against depressive symptoms.


Study Design

This 2-arm, parallel randomized controlled trial was conducted at the Department of Obstetrics and Gynecology at Seoul National University Bundang Hospital, Republic of Korea. Participants were recruited among pregnant women who visited the institution for routine prenatal check-ups and pregnancies after 20 weeks of gestation and were identified as being eligible. Patients with a history of any psychiatric disorder (eg, mood disorder or anxiety disorder) were excluded from this study. Recruitment began in June 2021 and enrollment was completed in October 2021.

The target sample size was calculated based on changes in Cranley score reported in a previous study [32]. Given an average Cranley attachment score of 2.8 (SD 0.51), 32 patients were required in each study arm to determine an increase in Cranley score of 0.3 using the software G*Power 3, with an α value of .05, a power of 80% (β=.20), and a 2-tailed independent t test (or Student t test) [33]. Allowing for a 25% dropout rate, we decided to enroll a total of 88 patients (44 participants per arm).

Ethics Approval

Prior to initiation of this study, it was approved by the Seoul National University Bundang Hospital Institutional Review Board (B-2106-688-302), and the protocol was registered on ClinicalTrials.gov (NCT04942197). Written informed consent was obtained from all participants.

Randomization and Protocol

During the study period, 88 eligible women were recruited and assigned randomly to either the VR intervention group or a standard-care group at a ratio of 1:1 by restricted randomization, which was generated with statistical software from the Medical Research Collaborating Center of the institution (Figure 1). Clinicians who met the participants in practice were not involved in the randomization process and were blinded to the allocation to each group until the participants completed the study protocol. Maternal baseline demographics and obstetric information were collected throughout the study period.

Figure 1. Flowchart of participation in the study.

As the baseline work-up, the participants in both groups received and filled out three questionnaires: (1) an MFA assessment, (2) a depressive-symptoms assessment, and (3) a basic health behavior status and medical information survey. After they finished the 3 questionnaires, all participants underwent 3D fetal ultrasonography and were shown the fetal images on an ultrasonography monitor; however, only the VR intervention group was shown fetal images that merged ultrasonographic data to produce VR images; these were viewed in a headset. The fetal images were generated in VR from the data obtained through ultrasonography of the subject’s own fetus and were shown only to the VR group. A prenatal-coaching mobile app was provided afterwards, and consistent education on how to use the various functions of the app was given to all participants. Approximately 2 weeks later, the researchers checked the interim feedback on the proper use of the prenatal-coaching mobile app, and a fourth questionnaire to assess maternal understanding of fetal appearance was given to all participants. All participants completed the trial in 4 weeks, lasting from enrollment to the end of trial. They then repeated the 3 questionnaires from the beginning of the study (Figure 1). Every questionnaire was provided to the participants before and after fetal ultrasound examinations at the outpatient clinic; the average time for completion of each questionnaire was approximately 10 minutes.

All participants received the prenatal-coaching mobile app Aluvuu (available for both Android and iOS; Girjae Soft) when they were enrolled. This prenatal-coaching app provides services that enable submitting results for maternal weight and blood pressure and checking changes with intuitive graphs, and it includes a glucose-monitoring diary for participants with gestational diabetes mellitus or pregestational diabetes mellitus. Relevant information from authoritative guidelines on helpful activities (eg, yoga, exercise, and stretching) and a recommended diet were supplied according to gestational age (Figure 2).

Figure 2. Screenshots of the prenatal-coaching mobile app: (A) glucose-concentration monitoring diary for mothers with gestational diabetes mellitus; (B) graph demonstrating maternal weight change; (C) diagram showing maternal blood pressure, glucose concentration, diet, and exercise at a glance; (D) information on helpful activities during pregnancy by gestational age (eg, yoga for late pregnancy).

All participants viewed 3D ultrasonography images; however, the VR experience and the fetal images produced in VR were provided only to the VR intervention group (Figure 3A). All the images generated in VR were sent to the prenatal-coaching mobile app, so that the users could see the images whenever they wanted. The users could share the saved pictures of their fetus with their family members and monitor growth via measurements of fetal body parts, such as head diameter (biparietal diameter), abdominal circumference, and leg length (femur length; Figure 3B). Progress in fetal growth at each ultrasonography examination was demonstrated in graphs that were saved in a private library folder. The users could compare the fetal image with everyday objects such as apples to help understand the actual size of the fetus (Figure 4A). In addition, the VR experience allowed the participants to actively engage their imagination about their expected baby by modifying specific structures of the fetal face, such as the eyes, nose, mouth, and cheeks, by touching the screen (Figure 4B).

Figure 3. Fetal images produced in virtual reality: (A) fetal face and reconstructed image of the fetus generated in virtual reality based on 3D ultrasound–measured data of fetal body parts; (B) screenshots of the prenatal-coaching mobile app showing data converted from 3D ultrasounds and a graph demonstrating fetal growth (estimated based on data from ultrasound measurements).
Figure 4. Additional services provided by the prenatal-coaching mobile app for the fetal images produced in virtual reality. (A) Progress in fetal growth at each gestational age in ultrasound images. (B) Interface for users to modify specific structures of the fetal face, such as the eyes, nose, mouth, and cheeks, in virtual reality.

Questionnaires and Assessments

The most important questionnaire assessed MFA, which was the primary outcome of this study. Two well-known evaluation scoring systems were used: the Cranley method and the Condon method [34-36] (Multimedia Appendix 1; Table S1). The Cranley scoring method has 24 items that measure 5 behavior domains: role taking, differentiation of self from fetus, interaction with the fetus, attributing characteristics to fetus, and giving of self [37,38]. The choices for participants are scored from 1 to 5; thus, the total score ranges from 24 to 120. The Condon scale has 19 items that describe maternal attitude to the fetus; they are divided into 2 subscales [39]. The first subscale measures the quality of attachment and includes subjective maternal experiences, such as pleasure from interaction with the fetus and conceptualization of the fetus as an individual. The intensity of attachment is the second subscale; this measures the amount of time devoted to activities involving the fetus, such as talking, thinking, and dreaming about the fetus.

Maternal depressive symptoms were assessed by questionnaires that are generally used to screen for postpartum depression disorder, because there are no specific tests to determine pregnancy-related depressive symptoms that develop in the antenatal period. In fact, it is recommended that most postpartum depression scales be used regularly for high-risk patients starting with antenatal check-ups, not only during the postpartum period [40,41]. The Edinburgh Postnatal Depression Scale (EPDS) and Postpartum Depression Screening Scale (PDSS) were selected to evaluate the presence of depressive symptoms or disorder status for all participants [42,43]. The EPDS is the most widely applied screening test for postpartum depression; it has 10 items that rate the degrees of emotion that childbearing women have felt in the previous 7 days [44,45] The PDSS was developed to signify the concept or definition of postpartum depression; it uses 35 items to judge qualitative degrees of sleeping disturbance, eating disturbance, anxiety, insecurity, emotional lability, cognitive impairment, loss of self, guilt, shame, and contemplating harming oneself [46]. The recommended cutoff scores for minor postpartum depression are 60 for the PDSS and 9 for the EPDS [47].

The fourth questionnaire, which was given to participants at the interim follow-up, was a self-report to determine how much the participants understood the appearance of the fetus (Multimedia Appendix 1; Figure S1). The questions were as follows: (1) “Do you understand and imagine how big the actual size of your baby?” (2) “Do you understand and imagine the lengths of your baby’s arms and legs?” and (3) “Do you understand and imagine the detailed appearance of your baby’s face?” The participants could respond “definitely no,” “very little,” “moderately,” “very much,” or “definitely yes.” The replies were scored numerically from 1 to 5.

Statistical Analysis

Maternal obstetric information and the scores from all the questionnaires were compared in the groups. Continuous variables were analyzed with a 2-tailed Student t test and proportions were compared using the Fisher exact test. A P value <.05 was considered significant. All statistical analyses were performed using SPSS (version 25.0; IBM Corp).


Among 88 participants enrolled at the beginning of the study, 4 from each group were lost to follow-up; therefore, data from 80 participants were included and analyzed. Maternal baseline characteristics, such as age, parity, height, weight, education, and use of assisted reproductive technology for the conception, were comparable between the 2 groups (Table 1). The proportion of twin pregnancies was 30% in the intervention group and 35% in the control group. Other obstetric complications included preeclampsia/superimposed preeclampsia, chronic hypertension, gestational diabetes mellitus, pregestational diabetes mellitus, preterm labor, preterm premature rupture of membranes, short cervical length, oligohydramnios, fetal growth restriction, alleged myoma uteri, and underlying malignancy; these were not statistically different between the 2 groups.

Table 1. Baseline demographics and clinical characteristics of the participants.
CharacteristicsIntervention (n=40)Control (n=40)P value
Age (years), n (%)35 (3.9)34 (3.3).95
Nulliparous, n (%)30 (75)30 (75)>.99
Height (cm), mean (SD)162.6 (5.7)160.9 (4.2).14
Weight at delivery (kg), mean (SD)72.5 (9.6)70.2 (10.5).34
BMI at delivery (kg/m2), mean (SD)27.3 (3.0)27.1 (3.8).89
Prepregnancy weight (kg), mean (SD)58.9 (7.8)57.1 (9.9).36
Prepregnancy BMI (kg/m2), mean (SD)22.3 (2.7)22.0 (3.5).70
Education, n (%).81

High school graduate3 (7.5)1 (2.5)

Bachelor’s degree28 (70)33 (82.5)

Master’s degree or PhD9 (22.5)6 (15)
Assisted reproductive technology, n (%)15 (37.5)21 (52.5).26
Twins, n (%)12 (30)14 (35).81
Preeclampsia/superimposed preeclampsia, n (%)3 (7.5)7 (17.5).31
Chronic hypertension, n (%)1 (2.5)1 (2.5)>.99
Gestational diabetes, n (%)4 (10)7 (17.5).52
Pregestational diabetes mellitus, n (%)0 (0)1 (2.5)>.99
Use of insulin due to diabetic disorder, n (%)1 (2.5)2 (5)>.99
High risk for preterm births, n (%)8 (20)7 (17.5)>.99
Preterm labor with use of tocolytics, n (%)6 (15)6 (15)>.99
Preterm premature rupture of membranes, n (%)1 (2.5)1 (2.5)>.99
Short cervical length in midtrimester, n (%)6 (15)2 (5).26
Oligohydramnios, n (%)2 (5)1 (2.5)>.99
Fetal growth restriction, n (%)1 (2.5)1 (2.5)>.99
Alleged myoma uteri, n (%)5 (12.5)6 (15)>.99
Underlying malignancy, n (%)1 (2.5)1 (2.5)>.99

Table 2 demonstrates the primary outcome of this study. The mean values for gestational age at each evaluation, including the initial baseline evaluation and the follow-up evaluations, were comparable between the 2 groups. The median interval between the baseline evaluation and the second follow-up was 5.8 (IQR 4.6-7.9) weeks. The total scores obtained with the Cranley method and the Condon method did not show a statistical difference at either baseline or the follow-ups; however, among changes from baseline to follow-up, the mean value of 1 subscale of the Cranley test, interaction with the fetus, showed a greater increase in the intervention group than the control group (0.4, SD 0.5 vs 0.1, SD 0.4; P=.004). Table 3 shows the proportions of participants who had increased scores at follow-up evaluations compared to the initial baseline results. The rate of participants with an increased score was 43% for the intervention group, while it was 13% for the control group (P=.005).

Table 2. Comparison of maternal-fetal attachment in the intervention group and control group.

Intervention (n=40), mean (SD)Control (n=40), mean (SD)P value
Test results at initial baseline evaluation

Gestational age at baseline evaluation (weeks)27.8 (2.5)28.2 (3.5).498

Cranley test score


Total03.7 (9.0)95.3 (10.5).48


Role taking4.6 (0.6)4.6 (0.7).72


Differentiation of self from fetus3.9 (0.6)3.8 (0.6).48


Interaction with the fetus3.5 (0.7)3.7 (0.6).18


Attributing characteristics to fetus4.0 (0.5)4.0 (0.6).69


Giving of self4.0 (0.5)4.2 (0.6).17

Total Condon test score79.2 (8.6)79.5 (8.6).89
Test results at follow-up evaluation

Gestational age at follow-up evaluation (weeks)33.3 (2.4)33.9 (3.0).40

Cranley test score


Total98.2 (8.6)97.7 (8.2).79


Role taking4.7 (0.6)4.6 (0.6).45


Differentiation of self from fetus3.7 (0.6)3.8 (0.7).62


Interaction with the fetus3.8 (0.6)3.8 (0.6).85


Attributing characteristics to fetus4.4 (0.5)4.1 (0.5).06


Giving of self4.2 (0.6)4.3 (0.6).69

Total Condon test score81.7 (7.3)80.7 (7.3).52
Difference between initial evaluation and follow-up

Interval from initial evaluation to follow-up (weeks)6.3 (1.8)5.9 (2.3).40

Cranley test score


Total4.5 (7.3)2.5 (7.1).21


Role taking0.2 (0.5)0.1 (0.6).39


Differentiation of self from fetus0.0 (0.8)0.1 (0.8).56


Interaction with the fetus0.4 (0.5)0.1 (0.4).004


Attributing characteristics to fetus0.3 (0.7)0.2 (0.6).36


Giving of self0.1 (0.5)0.1 (0.6)>.9

Total Condon test score2.5 (5.9)1.2 (5.3).29
Table 3. Proportions of participants with increased scores at follow-up compared to initial baseline results for maternal-fetal attachment evaluation.
ItemsIntervention group (n=40), n (%)Control group (n=40), n (%)P value
Cranley test score

Total28 (70)26 (65).81

Role taking8 (20)7 (18)>.99

Differentiation of self from fetus9 (23)9 (23)>.99

Interaction with the fetus17 (43)5 (13).005

Attributing characteristics to fetus15 (38)11 (28).47

Giving of self6 (15)9 (23).57
Total Condon test score22 (55)21 (53)>.99

We also compared scores for depressive symptoms between the 2 groups (Table 4). The mean values of the EPDS test and the PDSS test at baseline and follow-up were comparable, and the rates of minor depression, determined by the recommended cutoffs, were also similar. The proportion of lower scores at the follow-up evaluation compared to baseline for the EPDS test was higher in the intervention group than in the control group; however, the difference did not reach statistical significance (53% vs 38%, P=.21). The interim questionnaire to evaluate how much the participants recognized the fetal appearance showed an increased proportions of participants with a high score (≥4) in the intervention group. The rate of participants with a high score did not change, or tended to decrease, in the control group (Multimedia Appendix 1, Figure S1).

Table 4. Comparison of maternal depressive mood between intervention group and control group.

Intervention (n=40)Control (n=40)P value
Test results at initial baseline evaluation

Gestational age at baseline evaluation (weeks), mean (SD)27.8 (2.5)28.2 (3.5).498

EPDSa score, mean (SD)6.8 (4.4)6.1 (3.4).43

EPDS score ≥10, n (%)7 (17.5)5.40 (12.5).76

PDSSb score, mean (SD)47.5 (11.4)48.6 (10.2).67

PDSS score >60, n (%)7 (17.5)5 (12.5).76
Test results at follow-up evaluation

Gestational age at follow-up evaluation (weeks), mean (SD)33.3 (2.4)33.9 (3.0).40

EPDS score, mean (SD)6.8 (4.0)6.3 (2.9).57

EPDS score ≥10, n (%)8 (20)6 (15).77

Lower EPDS score than initial baseline evaluation, n (%)21 (52.5)15 (37.5).21

PDSS score, mean (SD)47.5 (7.8)48.9 (7.8).41

PDSS score >60, n (%)3 (7.5)4 (10)>.99

Lower PDSS score than initial baseline evaluation, n (%)18 (45)17 (42.5).59

aEPDS: Edinburgh postpartum depression scale.

bPDSS: postpartum depression screening scale.


Principal Findings of the Study

All the participants experienced the prenatal-coaching mobile app, but only the intervention group experienced the VR images. The scores measuring maternal interaction with the fetus showed a significantly greater increase in the intervention group than the control group at follow-up (0.4 vs 0.1). The proportion of participants with increased scores at the follow-up evaluation was over 3 times greater in the intervention group than the control group (43% vs 13%). The intervention group seemed to show improvement in depressive-symptom test scores at the follow-up evaluation, although the difference was not statistically significant (53% vs 38%).

The Effect of Digital Technologies in Pregnancy

In this study, all participants experienced the mobile prenatal care app, which provided information about what the pregnant women should do and eat. Commercially available apps also provide information on symptoms or signs that pregnant women might feel in each gestational period. The participants were instructed to use the specific prenatal-coaching app that was developed for the trial, but most were already using one or more mobile apps to obtain information about their pregnancy and to record their own diaries or pictures of the fetus. During the pandemic era, the role of digital technology has grown due to the decrease in direct contact, and this has inspired the development of numerous mobile apps for pregnant women to take care of themselves without direct visits to a clinic. Marko et al [48] performed a prospective controlled trial and demonstrated that a mobile prenatal-care app reduced the number of in-person visits without decreasing patient satisfaction. Many prenatal mobile apps contain similar information about routine prenatal tests and currently have additional functions, such as coaching for blood sugar control in patients with gestational diabetes, thereby contributing to improving society by improving the lives of pregnant women and even helping their mental health [49-55].

Taking things further, the digital economy in the postpandemic era has focused on the application of VR to medical fields to produce consistent and easily accessible environments for the management of many disease entities [56,57]. There have been a few intriguing studies involving VR in obstetrics. Wong et al [58] reported that VR was effective in reducing labor pain in a randomized controlled trial. Williams et al [59] demonstrated the application of VR to train midwifery students in emergency skills such as neonatal resuscitation. One pilot study reported that immersive VR reduced anxiety in patients undergoing first-trimester surgical termination [60]. Since ultrasound is the most common tool in obstetrics, VR has been developed based on fetal ultrasounds, and the effectiveness for diagnosing fetal structural anomalies has been tested by several groups [61,62]. Grayscale ultrasound images of the fetus give important information to doctors, but pregnant women and their family members might have difficulty recognizing the face or body parts of the fetus. 3D ultrasounds help people understand the features of the fetus much better than grayscale images. Indeed, when 3D images are combined with VR, the images are far more realistic. Because VR images come from measured ultrasonography data, the fetus can be seen to grow and change in shape at each ultrasonographic examination, and the pregnant woman can easily recognize the differences.

Clinical Implications

We wanted to determine how fetal images generated in VR can affect maternal-fetal bonding in pregnant women and investigated the possibility that they might lower maternal anxiety or depressive symptoms. This randomized controlled trial showed that there was a significantly greater increase in measured scores of maternal interaction with the fetus in the VR group than the control group. Additionally, although the difference did not reach statistical significance, about half the VR group showed an improvement in depressive-symptom test scores. Cranley [37] defined MFA as “the extent to which women engage in behaviors that represent an affiliation and interaction with their unborn child”; thus, the concept could be considered slightly obscure from a medical perspective. Yarcheski et al [63] performed a meta-analytic study of the predictors of MFA and suggested that gestational age was positively related to increased MFA. Other predicting or associated factors that have been studied are social support for the mother; the mother’s own anxiety, self-esteem, and underlying depression; prenatal test results; whether the pregnancy was planned; maternal age; parity; income; education; and marital status [64-66].

Although MFA could be considered an abstract concept, the association between MFA and postpartum depression has been previously studied. Rollè et al [67] reviewed the literature on the relationship between MFA and perinatal depression and found that lower MFA was related to higher rates of postnatal depressive symptoms, although some of the studies in that review reported controversial or nonsignificant results. Rollè emphasized that the development of strong MFA should be encouraged during pregnancy to reduce postpartum depression and increase the psychological well-being of expectant parents. Modalities to increase healthy and positive MFA should be identified if MFA is to help prevent maternal depressive symptoms, since postpartum depression is a serious psychiatric condition after childbirth that can result in abnormal parenting behavior, negative maternal bonding, child abuse, adverse mental development in childhood, and even maternal suicide [68]. Seimyr et al [69] reported that physical contact with the fetus and sensitivity to fetal movements decreased maternal depression. In fact, an experimental study revealed that watching the fetus in 3D ultrasound images and attempts to touch the fetus in VR decreased maternal stress, as measured by salivary cortisol concentration [70]. Much research has revealed that maternal-fetal bonding increases when pregnant women experience better and more realistic images [71]. Pulliainen et al [72] performed a qualitative pilot study with pregnant women at high risk for preterm birth and showed that interactive 3D ultrasounds shown at the request of the pregnant women increased MFA. A randomized controlled trial of a 4D ultrasound intervention among pregnant women with substance use demonstrated a higher retention rate, as well as enhanced MFA, in the intervention group compared to the control group [73].

Conclusion

To our knowledge, there are no prior studies demonstrating the effect of VR on maternal-fetal interaction and other aspects of maternal mental status. Fetal images generated in VR seem to promote positive MFA and might reduce maternal depressive symptoms. In this study, we used a prenatal-coaching mobile app to maximize access to fetal images produced with a combination of VR and ultrasound. Since we examined very short-term changes after experiencing VR, future studies are essential to determine the long-term perinatal outcomes of using VR as a modality to increase MFA and to promote mental health during pregnancy.

Acknowledgments

This work was funded by the National Research Foundation of Korea of the Ministry of Small and Medium-sized Enterprises and Startups (grant S2798153). Girjae Soft was supported by this fund and developed the mobile app and virtual reality technology for fetal images. The researchers were independent of the funding bodies. The funders did not play a role in the design or conduct of the study; collection, management, analysis, or interpretation of the data; or preparation, review, or approval of the manuscript.

Authors' Contributions

All authors contributed to the design and conceptualization of the study. The final manuscript has been seen and approved by all authors, and we have taken due care to ensure the integrity of the work. JYP, KNL, and HJK are guarantors of integrity of the entire study. JYP, KNL, HJK, KC, AC, JS, and WM contributed to study concepts and study design; JYP, KNL, HJK, KJO, JYP, KNL, and HJK contributed to data acquisition, analysis, and interpretation; JYP, KNL, and HJK contributed to manuscript drafting and manuscript revision for important intellectual content; JYP, KNL, HJK, KC, AC, BK, JS, WM, and KJO contributed to approval of the final version of the submitted manuscript; JYP, KNL, HJK, KC, AC, BK, JS, WM, and KJO agreed to be accountable for all aspects of the work and ensuring that questions related to the accuracy or integrity of any part of the work are appropriately investigated and resolved; KC, AC, BK, JS, and WM contributed to literature research; JYP, KNL, and HJK contributed to statistical analysis; and JYP, KNL, HJK, KC, AC, BK, JS, WM, and KJO contributed to manuscript editing.

Conflicts of Interest

None declared.

Multimedia Appendix 1

Contents of questionnaire for maternal-fetal attachment evaluation (Table S1) and proportion of participants with score ≥4 on the questionnaire to assess maternal understanding of fetal appearance (Figure S1).

DOCX File , 76 KB

Multimedia Appendix 2

CONSORT-EHEALTH Checklist V1.6.2.

PDF File (Adobe PDF File), 87 KB

  1. DeSocio JE. Epigenetics, maternal prenatal psychosocial stress, and infant mental health. Arch Psychiatr Nurs 2018 Dec;32(6):901-906. [CrossRef] [Medline]
  2. Gul F, Sherin A, Jabeen M, Khan SA. Association of stress with anxiety and depression during pregnancy. J Pak Med Assoc 2017 Dec;67(12):1803-1808 [FREE Full text] [Medline]
  3. Reading AE, Cox DN, Sledmere CM, Campbell S. Psychological changes over the course of pregnancy: a study of attitudes toward the fetus/neonate. Health Psychol 1984;3(3):211-221. [CrossRef] [Medline]
  4. Tomfohr-Madsen LM, Racine N, Giesbrecht GF, Lebel C, Madigan S. Depression and anxiety in pregnancy during COVID-19: A rapid review and meta-analysis. Psychiatry Res 2021 Jun;300:113912 [FREE Full text] [CrossRef] [Medline]
  5. Hope H, Osam CS, Kontopantelis E, Hughes S, Munford L, Ashcroft DM, et al. The healthcare resource impact of maternal mental illness on children and adolescents: UK retrospective cohort study. Br J Psychiatry 2021 Sep;219(3):515-522 [FREE Full text] [CrossRef] [Medline]
  6. Field T. Postpartum depression effects on early interactions, parenting, and safety practices: a review. Infant Behav Dev 2010 Feb;33(1):1-6 [FREE Full text] [CrossRef] [Medline]
  7. Lahti M, Savolainen K, Tuovinen S, Pesonen A, Lahti J, Heinonen K, et al. Maternal depressive symptoms during and after pregnancy and psychiatric problems in children. J Am Acad Child Adolesc Psychiatry 2017 Jan;56(1):30-39.e7. [CrossRef] [Medline]
  8. Murray L. The impact of postnatal depression on infant development. J Child Psychol Psychiatry 1992 Mar;33(3):543-561. [CrossRef] [Medline]
  9. Murray L, Arteche A, Fearon P, Halligan S, Goodyer I, Cooper P. Maternal postnatal depression and the development of depression in offspring up to 16 years of age. J Am Acad Child Adolesc Psychiatry 2011 May;50(5):460-470. [CrossRef] [Medline]
  10. Matthies LM, Müller M, Doster A, Sohn C, Wallwiener M, Reck C, et al. Maternal-fetal attachment protects against postpartum anxiety: the mediating role of postpartum bonding and partnership satisfaction. Arch Gynecol Obstet 2020 Jan;301(1):107-117. [CrossRef] [Medline]
  11. Petri E, Palagini L, Bacci O, Borri C, Teristi V, Corezzi C, et al. Maternal-foetal attachment independently predicts the quality of maternal-infant bonding and post-partum psychopathology. J Matern Fetal Neonatal Med 2018 Dec;31(23):3153-3159. [CrossRef] [Medline]
  12. Delavari M, Mohammad-Alizadeh-Charandabi S, Mirghafourvand M. The relationship of maternal-fetal attachment and postpartum depression: a longitudinal study. Arch Psychiatr Nurs 2018 Apr;32(2):263-267. [CrossRef] [Medline]
  13. Arguz Cildir D, Ozbek A, Topuzoglu A, Orcin E, Janbakhishov CE. Association of prenatal attachment and early childhood emotional, behavioral, and developmental characteristics: A longitudinal study. Infant Ment Health J 2020 Jul;41(4):517-529. [CrossRef] [Medline]
  14. Köhler-Dauner F, Buchheim A, Hildebrand K, Mayer I, Clemens V, Ziegenhain U, et al. Maternal attachment representation, the risk of increased depressive symptoms and the influence on children's mental health during the SARS-CoV-2-pandemic. J Child Fam Stud 2022;31(2):392-408 [FREE Full text] [CrossRef] [Medline]
  15. Sacchi C, Miscioscia M, Visentin S, Simonelli A. Maternal-fetal attachment in pregnant Italian women: multidimensional influences and the association with maternal caregiving in the infant's first year of life. BMC Pregnancy Childbirth 2021 Jul 06;21(1):488 [FREE Full text] [CrossRef] [Medline]
  16. Maddahi MS, Dolatian M, Khoramabadi M, Talebi A. Correlation of maternal-fetal attachment and health practices during pregnancy with neonatal outcomes. Electron Physician 2016 Jul;8(7):2639-2644 [FREE Full text] [CrossRef] [Medline]
  17. Zhang L, Wang L, Yuan Q, Huang C, Cui S, Zhang K, et al. The mediating role of prenatal depression in adult attachment and maternal-fetal attachment in primigravida in the third trimester. BMC Pregnancy Childbirth 2021 Apr 16;21(1):307 [FREE Full text] [CrossRef] [Medline]
  18. Güney E, Uçar T. Effect of the fetal movement count on maternal-fetal attachment. Jpn J Nurs Sci 2019 Jan;16(1):71-79. [CrossRef] [Medline]
  19. Chiang D, Huang C, Cheng S, Cheng J, Wu C, Huang S, et al. Immersive virtual reality (VR) training increases the self-efficacy of in-hospital healthcare providers and patient families regarding tracheostomy-related knowledge and care skills: A prospective pre-post study. Medicine (Baltimore) 2022 Jan 14;101(2):e28570 [FREE Full text] [CrossRef] [Medline]
  20. Venkatesan M, Mohan H, Ryan JR, Schürch CM, Nolan GP, Frakes DH, et al. Virtual and augmented reality for biomedical applications. Cell Rep Med 2021 Jul 20;2(7):100348 [FREE Full text] [CrossRef] [Medline]
  21. Dellazizzo L, Potvin S, Luigi M, Dumais A. Evidence on virtual reality-based therapies for psychiatric disorders: meta-review of meta-analyses. J Med Internet Res 2020 Aug 19;22(8):e20889 [FREE Full text] [CrossRef] [Medline]
  22. Kang JM, Kim N, Lee SY, Woo SK, Park G, Yeon BK, et al. Effect of cognitive training in fully immersive virtual reality on visuospatial function and frontal-occipital functional connectivity in predementia: randomized controlled trial. J Med Internet Res 2021 May 06;23(5):e24526 [FREE Full text] [CrossRef] [Medline]
  23. van Loenen I, Scholten W, Muntingh A, Smit J, Batelaan N. The effectiveness of virtual reality exposure-based cognitive behavioral therapy for severe anxiety disorders, obsessive-compulsive disorder, and posttraumatic stress disorder: meta-analysis. J Med Internet Res 2022 Feb 10;24(2):e26736 [FREE Full text] [CrossRef] [Medline]
  24. Smith V, Warty RR, Sursas JA, Payne O, Nair A, Krishnan S, et al. The effectiveness of virtual reality in managing acute pain and anxiety for medical inpatients: systematic review. J Med Internet Res 2020 Nov 02;22(11):e17980 [FREE Full text] [CrossRef] [Medline]
  25. Garcia L, Birckhead B, Krishnamurthy P, Mackey I, Sackman J, Salmasi V, et al. Durability of the treatment effects of an 8-week self-administered home-based virtual reality program for chronic low back pain: 6-month follow-up study of a randomized clinical trial. J Med Internet Res 2022 May 25;24(5):e37480 [FREE Full text] [CrossRef] [Medline]
  26. Logan DE, Simons LE, Caruso TJ, Gold JI, Greenleaf W, Griffin A, et al. Leveraging virtual reality and augmented reality to combat chronic pain in youth: position paper from the interdisciplinary network on virtual and augmented technologies for pain management. J Med Internet Res 2021 Apr 26;23(4):e25916 [FREE Full text] [CrossRef] [Medline]
  27. Lungu AJ, Swinkels W, Claesen L, Tu P, Egger J, Chen X. A review on the applications of virtual reality, augmented reality and mixed reality in surgical simulation: an extension to different kinds of surgery. Expert Rev Med Devices 2021 Jan;18(1):47-62. [CrossRef] [Medline]
  28. Sanford DI, Ma R, Ghoreifi A, Haque TF, Nguyen JH, Hung AJ. Association of suturing technical skill assessment scores between virtual reality simulation and live surgery. J Endourol 2022 Oct;36(10):1388-1394. [CrossRef] [Medline]
  29. Chen J, Or CK, Chen T. Effectiveness of using virtual reality-supported exercise therapy for upper extremity motor rehabilitation in patients with stroke: systematic review and meta-analysis of randomized controlled trials. J Med Internet Res 2022 Jun 20;24(6):e24111 [FREE Full text] [CrossRef] [Medline]
  30. Chen F, Leng Y, Ge J, Wang D, Li C, Chen B, et al. Effectiveness of virtual reality in nursing education: meta-analysis. J Med Internet Res 2020 Sep 15;22(9):e18290 [FREE Full text] [CrossRef] [Medline]
  31. Perron JE, Coffey MJ, Lovell-Simons A, Dominguez L, King ME, Ooi CY. Resuscitating cardiopulmonary resuscitation training in a virtual reality: prospective interventional study. J Med Internet Res 2021 Jul 29;23(7):e22920 [FREE Full text] [CrossRef] [Medline]
  32. Sjögren B, Edman G, Widström AM, Mathiesen AS, Uvnäs‐Moberg K. Maternal foetal attachment and personality during first pregnancy. J Reprod Infant Psychol 2004 May;22(2):57-69. [CrossRef]
  33. Kang H. Sample size determination and power analysis using the G*Power software. J Educ Eval Health Prof 2021;18:17 [FREE Full text] [CrossRef] [Medline]
  34. Doster A, Wallwiener S, Müller M, Matthies LM, Plewniok K, Feller S, et al. Reliability and validity of the German version of the Maternal-Fetal Attachment Scale. Arch Gynecol Obstet 2018 May;297(5):1157-1167. [CrossRef] [Medline]
  35. Müller ME, Ferketich S. Factor analysis of the Maternal Fetal Attachment Scale. Nurs Res 1993;42(3):144-147. [Medline]
  36. Pohárnok M, Kopcsó K, Polgár PI. The structure and correlates of the 20-item Maternal-Fetal Attachment Scale in a population-based sample of Hungarian expectant women. Midwifery 2022 Sep;112:103422 [FREE Full text] [CrossRef] [Medline]
  37. Cranley MS. Development of a tool for the measurement of maternal attachment during pregnancy. Nurs Res 1981;30(5):281-284. [Medline]
  38. Lingeswaran A, Bindu H. Validation of Tamil version of Cranley's 24-item Maternal-Fetal Attachment Scale in Indian pregnant women. J Obstet Gynaecol India 2012 Dec;62(6):630-634 [FREE Full text] [CrossRef] [Medline]
  39. Condon J. The assessment of antenatal emotional attachment: development of a questionnaire instrument. Br J Med Psychol 1993 Jun;66 ( Pt 2):167-183. [CrossRef] [Medline]
  40. Tanuma-Takahashi A, Tanemoto T, Nagata C, Yokomizo R, Konishi A, Takehara K, et al. Antenatal screening timeline and cutoff scores of the Edinburgh Postnatal Depression Scale for predicting postpartum depressive symptoms in healthy women: a prospective cohort study. BMC Pregnancy Childbirth 2022 Jun 28;22(1):527 [FREE Full text] [CrossRef] [Medline]
  41. O'Connor E, Rossom RC, Henninger M, Groom HC, Burda BU. Primary care screening for and treatment of depression in pregnant and postpartum women: evidence report and systematic review for the US Preventive Services Task Force. JAMA 2016 Jan 26;315(4):388-406. [CrossRef] [Medline]
  42. Cox JL, Holden JM, Sagovsky R. Detection of postnatal depression. Development of the 10-item Edinburgh Postnatal Depression Scale. Br J Psychiatry 1987 Jun;150:782-786. [CrossRef] [Medline]
  43. Park S, Kim J. Predictive validity of the Edinburgh postnatal depression scale and other tools for screening depression in pregnant and postpartum women: a systematic review and meta-analysis. Arch Gynecol Obstet 2022 Apr 13:1-15. [CrossRef] [Medline]
  44. Horáková A, Nosková E, Švancer P, Marciánová V, Koliba P, Šebela A. Accuracy of the Edinburgh Postnatal Depression Scale in screening for major depressive disorder and other psychiatric disorders in women towards the end of their puerperium. Ceska Gynekol 2022;87(1):19-26. [CrossRef] [Medline]
  45. Mao F, Sun Y, Wang J, Huang Y, Lu Y, Cao F. Sensitivity to change and minimal clinically important difference of Edinburgh postnatal depression scale. Asian J Psychiatr 2021 Dec;66:102873. [CrossRef] [Medline]
  46. Beck CT, Gable RK. Postpartum Depression Screening Scale: development and psychometric testing. Nurs Res 2000;49(5):272-282. [CrossRef] [Medline]
  47. Beck CT, Gable RK. Comparative analysis of the performance of the Postpartum Depression Screening Scale with two other depression instruments. Nurs Res 2001;50(4):242-250. [CrossRef] [Medline]
  48. Marko KI, Ganju N, Krapf JM, Gaba ND, Brown JA, Benham JJ, et al. A mobile prenatal care app to reduce in-person visits: prospective controlled trial. JMIR Mhealth Uhealth 2019 May 01;7(5):e10520 [FREE Full text] [CrossRef] [Medline]
  49. Garnweidner-Holme L, Henriksen L, Torheim LE, Lukasse M. Effect of the Pregnant+ smartphone app on the dietary behavior of women with gestational diabetes mellitus: secondary analysis of a randomized controlled trial. JMIR Mhealth Uhealth 2020 Nov 04;8(11):e18614 [FREE Full text] [CrossRef] [Medline]
  50. Skar JB, Garnweidner-Holme LM, Lukasse M, Terragni L. Women's experiences with using a smartphone app (the Pregnant+ app) to manage gestational diabetes mellitus in a randomised controlled trial. Midwifery 2018 Mar;58:102-108. [CrossRef] [Medline]
  51. Souza FMDLC, Santos WND, Santos RSDC, Silva VLMD, Abrantes RMD, Soares VFR, et al. Effectiveness of mobile applications in pregnant women's adherence to prenatal consultations: randomized clinical trial. Rev Bras Enferm 2021;74Suppl 5(Suppl 5):e20190599 [FREE Full text] [CrossRef] [Medline]
  52. Wu K, Alegria R, Gonzalez J, Hu H, Wang H, Page R, et al. Characteristics and quality of mobile apps containing prenatal genetic testing information: systematic app store search and assessment. JMIR Mhealth Uhealth 2021 Oct 14;9(10):e30404 [FREE Full text] [CrossRef] [Medline]
  53. Smith R, Mahnert N, Foote J, Saunders K, Mourad J, Huberty J. Mindfulness effects in obstetric and gynecology patients during the Coronavirus Disease 2019 (COVID-19) pandemic: a randomized controlled trial. Obstet Gynecol 2021 Jun 01;137(6):1032-1040 [FREE Full text] [CrossRef] [Medline]
  54. Saad A, Magwood O, Aubry T, Alkhateeb Q, Hashmi SS, Hakim J, et al. Mobile interventions targeting common mental disorders among pregnant and postpartum women: An equity-focused systematic review. PLoS One 2021 Oct 29;16(10):e0259474 [FREE Full text] [CrossRef] [Medline]
  55. Bogaerts A, Bijlholt M, Mertens L, Braeken M, Jacobs B, Vandenberghe B, et al. Development and Field Evaluation of the INTER-ACT App, a Pregnancy and Interpregnancy Coaching App to Reduce Maternal Overweight and Obesity: Mixed Methods Design. JMIR Form Res 2020 Feb 14;4(2):e16090 [FREE Full text] [CrossRef] [Medline]
  56. Vlake JH, van Bommel J, Wils E, Bienvenu J, Hellemons ME, Korevaar TI, et al. Intensive Care Unit-Specific Virtual Reality for Critically Ill Patients With COVID-19: Multicenter Randomized Controlled Trial. J Med Internet Res 2022 Jan 31;24(1):e32368 [FREE Full text] [CrossRef] [Medline]
  57. Zhang Q, Fu Y, Lu Y, Zhang Y, Huang Q, Yang Y, et al. Impact of Virtual Reality-Based Therapies on Cognition and Mental Health of Stroke Patients: Systematic Review and Meta-analysis. J Med Internet Res 2021 Nov 17;23(11):e31007 [FREE Full text] [CrossRef] [Medline]
  58. Wong MS, Spiegel BM, Gregory KD. Virtual Reality Reduces Pain in Laboring Women: A Randomized Controlled Trial. Am J Perinatol 2021 Aug;38(S 01):e167-e172. [CrossRef] [Medline]
  59. Williams J, Jones D, Walker R. Consideration of using virtual reality for teaching neonatal resuscitation to midwifery students. Nurse Educ Pract 2018 Jul;31:126-129. [CrossRef] [Medline]
  60. Sridhar A, Shiliang Z, Woodson R, Kwan L. Non-pharmacological anxiety reduction with immersive virtual reality for first-trimester dilation and curettage: a pilot study. Eur J Contracept Reprod Health Care 2020 Dec;25(6):480-483. [CrossRef] [Medline]
  61. Pietersma CS, Mulders AGMGJ, Moolenaar LM, Hunink MGM, Koning AHJ, Willemsen SP, et al. First trimester anomaly scan using virtual reality (VR FETUS study): study protocol for a randomized clinical trial. BMC Pregnancy Childbirth 2020 Sep 07;20(1):515 [FREE Full text] [CrossRef] [Medline]
  62. Werner H, Lopes Dos Santos JR, Ribeiro G, Belmonte SL, Daltro P, Araujo Júnior E. Combination of ultrasound, magnetic resonance imaging and virtual reality technologies to generate immersive three-dimensional fetal images. Ultrasound Obstet Gynecol 2017 Aug;50(2):271-272 [FREE Full text] [CrossRef] [Medline]
  63. Yarcheski A, Mahon NE, Yarcheski TJ, Hanks MM, Cannella BL. A meta-analytic study of predictors of maternal-fetal attachment. Int J Nurs Stud 2009 May;46(5):708-715. [CrossRef] [Medline]
  64. Muller ME. A critical review of prenatal attachment research. Sch Inq Nurs Pract 1992;6(1):5-22; discussion 23. [CrossRef] [Medline]
  65. Stroup DF, Berlin JA, Morton SC, Olkin I, Williamson GD, Rennie D, et al. Meta-analysis of observational studies in epidemiology: a proposal for reporting. Meta-analysis Of Observational Studies in Epidemiology (MOOSE) group. JAMA 2000 Apr 19;283(15):2008-2012. [CrossRef] [Medline]
  66. Rees BL. Measuring identification with the mothering role. Res Nurs Health 1980 Jun;3(2):49-56. [CrossRef] [Medline]
  67. Rollè L, Giordano M, Santoniccolo F, Trombetta T. Prenatal Attachment and Perinatal Depression: A Systematic Review. Int J Environ Res Public Health 2020 Apr 12;17(8):2644 [FREE Full text] [CrossRef] [Medline]
  68. Zhao X, Zhang Z. Risk factors for postpartum depression: An evidence-based systematic review of systematic reviews and meta-analyses. Asian J Psychiatr 2020 Oct;53:102353. [CrossRef] [Medline]
  69. Seimyr L, Sjögren B, Welles-Nyström B, Nissen E. Antenatal maternal depressive mood and parental-fetal attachment at the end of pregnancy. Arch Womens Ment Health 2009 Oct;12(5):269-279. [CrossRef] [Medline]
  70. Severi FM, Prattichizzo D, Casarosa E, Barbagli F, Ferretti C, Altomare A, et al. Virtual fetal touch through a haptic interface decreases maternal anxiety and salivary cortisol. J Soc Gynecol Investig 2005 Jan;12(1):37-40. [CrossRef] [Medline]
  71. de Jong-Pleij EAP, Ribbert LSM, Pistorius LR, Tromp E, Mulder EJH, Bilardo CM. Three-dimensional ultrasound and maternal bonding, a third trimester study and a review. Prenat Diagn 2013 Jan;33(1):81-88. [CrossRef] [Medline]
  72. Pulliainen H, Niela-Vilén H, Ekholm E, Ahlqvist-Björkroth S. Experiences of interactive ultrasound examination among women at risk of preterm birth: a qualitative study. BMC Pregnancy Childbirth 2019 Sep 18;19(1):338 [FREE Full text] [CrossRef] [Medline]
  73. Jussila H, Pajulo M, Ekholm E. A Novel 4D Ultrasound Parenting Intervention for Substance Using Pregnant Women in Finland: Participation in Obstetric Care, Fetal Drug Exposure, and Perinatal Outcomes in a Randomized Controlled Trial. Matern Child Health J 2020 Jan;24(1):90-100 [FREE Full text] [CrossRef] [Medline]


MFA: maternal-fetal attachment
VR: virtual reality
EDPS: Edinburgh Postnatal Depression Scale
PDSS: Postpartum Depression Screening Scale


Edited by G Eysenbach; submitted 24.10.22; peer-reviewed by M Rousian, M Kapsetaki; comments to author 18.11.22; revised version received 07.12.22; accepted 19.01.23; published 24.02.23

Copyright

©Kyong-No Lee, Hyeon Ji Kim, Kiroong Choe, Aeri Cho, Bohyoung Kim, Jinwook Seo, Woojae Myung, Jee Yoon Park, Kyung Joon Oh. Originally published in the Journal of Medical Internet Research (https://www.jmir.org), 24.02.2023.

This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on https://www.jmir.org/, as well as this copyright and license information must be included.