Review
Abstract
Background: Internet-based psychological interventions provide accessible care to a wide range of users, overcoming some obstacles—such as distance, costs, and safety—that might discourage seeking help for mental issues. It is well known that psychological treatments and programs affect the body, as well as the mind, producing physiological changes that ought to be considered when assessing the efficacy of the intervention. However, the literature investigating changes in biomarkers specifically after internet-based psychological and mental health interventions has not yet extensively inquired into this topic.
Objective: This systematic review aims to provide a synthesis of literature examining the effects of internet-based psychological interventions—targeting both clinical (mental and physical) and nonclinical conditions—on biomarkers. A secondary aim was to evaluate whether the biomarkers’ variations were related to a complementary modification of the psychological or physical symptoms or to a general improvement of the participants’ well-being.
Methods: This review was conducted according to the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analysis) statement. A literature search was performed through 3 databases (PubMed, PsycINFO, and Scopus). Studies examining changes in biomarkers before and after internet-based psychological interventions or programs targeting both clinical and nonclinical samples were included, with no exclusion criteria concerning mental or physical conditions.
Results: A total of 24 studies fulfilled the inclusion criteria. These studies involved individuals with psychiatric or psychological problems (n=6, 25%), those with organic or medical diseases (n=10, 42%), and nonclinical populations (n=8, 33%). Concerning psychiatric or psychological problems, cognitive behavioral therapy (CBT) and CBT-informed interventions showed partial effectiveness in decreasing glycated hemoglobin blood glucose level (n=1) and chemokines (n=1) and in increasing connectivity between the default-mode network and the premotor or dorsolateral prefrontal cortex (n=1). Among individuals with organic or medical diseases, studies reported a significant change in cardiac or cardiovascular (n=3), inflammatory (n=2), cortisol (n=2), glycated hemoglobin (n=2), and immune response (n=1) biomarkers after CBT and CBT-informed interventions, and mindfulness and stress management interventions. Lastly, mindfulness, CBT and CBT-informed interventions, and music therapy succeeded in modifying immune response (n=2), cortisol (n=1), α amylase (n=1), posterior cingulate cortex reactivity to smoking cues (n=1), and carbon monoxide (n=1) levels in nonclinical populations. In some of the included studies (n=5), the psychological intervention or program also produced an improvement of the mental or physical condition of the participants or of their general well-being, alongside significant variations in biomarkers; CBT and CBT-informed interventions proved effective in reducing both psychological (n=2) and physical symptoms (n=2), while a mindfulness program successfully lowered cigarette consumption in a nonclinical sample (n=1).
Conclusions: Although further evidence is required, we hope to raise awareness on the potential impact of internet-based interventions on biomarkers related to mental and physical health.
doi:10.2196/55736
Keywords
Introduction
Internet-Based Interventions
In the psychological and mental health field, a growing body of evidence has demonstrated telepsychiatry’s ability to provide accessible, wide-ranging, and high-quality services. This allows us to overcome obstacles, such as distance, costs, and safety, making these methods preferable for users who live afar, have transportation difficulties, or have time limitations. It also fosters a sense of empowerment [
]. This explains that online approaches to psychological therapy might be more easily accepted than standard psychotherapy. Additionally, an online setting might create in the users an apparent sense of anonymity, promoting feelings of safety and self-disclosure and reducing the stigma typically associated with seeking mental health support [ - ]. Internet-based programs exhibit remarkable versatility, providing a diverse array of services to a broad spectrum of users. This includes both patients and healthy individuals across various age groups, as well as specific populations such as health care professionals [ ].On the other hand, online interventions might also carry some negative issues: one of the main disadvantages is the risk of potential breaches of privacy, confidentiality, and data security, likely due to the use of unsecured websites or easily hackable software [
]. They may also entail some inconveniences for both users and health care professionals and institutions, such as the need for adequate technological equipment and systems compatibility. Accordingly, cost-effectiveness is a relevant issue, and results from research on this topic are mixed, bringing evidence of both methodological flaws and similar—or in some cases, better—cost-effectiveness compared to traditional in-person therapy [ , ]. Furthermore, the remote nature of online interventions themselves leads to a higher risk of low adherence and greater dropout rates [ , ].Biomarkers
According to the National Institutes of Health (NIH), a biomarker is “a defined characteristic that is measured as an indicator of normal biological processes, pathogenic processes, or biological responses to an exposure or intervention, including therapeutic interventions. Biomarkers may include molecular, histologic, radiographic, or physiologic characteristics” [
]. The US Food and Drug Administration (FDA)–NIH Biomarker Working Group defined a taxonomy of biomarkers, distinguishing diagnostic, monitoring, response, predictive, prognostic, safety, and susceptibility or risk biomarkers [ ]. Response biomarkers, in particular, are used to evaluate change in a biological response, which can potentially be beneficial or harmful, in an individual after being exposed to a medical condition, a clinical intervention (including drug treatments), or an environmental agent.Within therapeutic interventions, examining potential variations in biomarker levels before and after treatment proves to be an effective method for objectively assessing the treatment’s effectiveness. Additionally, it facilitates a deeper understanding of whether these biological modifications align with concurrent changes in the symptoms targeted by the intervention. Mental and physical health are strictly linked and they profoundly impact one another [
]. Thus, psychological treatments and programs can also affect the body, as well as the mind, with beneficial effects on stress, the immune system, and brain activity [ ].A vast body of literature shows changes in biomarkers following psychological interventions. For example, psychological interventions, such as cognitive behavioral therapy (CBT), consistently proved to be efficient in improving both the immune system [
] and neurological functioning biomarkers [ , ] across various mental and organic health conditions. Moreover, Claudino et al [ ] found biomarker variations to be associated with symptoms reduction, allowing authors to consider them as a reliable way to assess treatment response [ ]. Finally, similar results were reported not only for standard psychological interventions but also for various psychosocial programs, such as music-based psychosocial intervention, together with reductions in cortisol and inflammatory activity [ ].Nonetheless, there is scarce evidence of the efficacy of internet-based psychological interventions in changing biomarkers across different health conditions. Considering the benefits of online treatments and the rapid spreading of technologies in health care—especially following the COVID-19 pandemic [
]—a systematic review is needed to comprehensively synthesize the current state of research, and it will help assess the efficacy of internet-based programs, compared to in-person ones.Aim
The main objective of this systematic review was to investigate the effects of internet-based psychological interventions targeting every type of condition (mental or physical) on various biomarkers, assessed before and after the intervention itself. Additionally, we aimed to determine whether the biomarkers’ variations were related to a complementary modification of the underlying mental or medical health condition, if present, or of the nonclinical issue addressed by the intervention or program.
The literature investigating changes in biomarkers after internet-based psychological and mental health interventions has not yet extensively inquired into this topic, and to the best of our knowledge, this is the first systematic review on this topic.
Methods
Procedure
The review was not registered. This systematic review was performed according to the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analysis) statement [
]. A literature search (on articles published until May 25, 2023) was independently performed by GG, CG, SR, and CMG using the PubMed, PsycINFO, and Scopus databases, with the search terms reported in . The reference lists of the identified meta-analysis and reviews were also checked to find additional relevant articles. GG, CG, and SR independently evaluated the suitability of all the identified papers; in case of conflicting opinions regarding the inclusion or exclusion of a paper, GG, CG, and SR consulted with each other and with RC to find an agreement.We included studies that investigated internet-based or app-based, remote, psychological or psychoeducational interventions or programs and that measured biomarkers before and after the intervention or program. Studies were included if:
- They administered a psychological or psychoeducational intervention, or a multicomponent intervention based on a psychological approach.
- At least half of the intervention or program had to be provided online or through a mobile phone app so that it could take place at the participant’s home.
- Biomarkers were assessed both before and after the intervention or program.
- They targeted psychiatric, psychological, or physical conditions or nonclinical individuals (we considered “nonclinical” as those participants who were not recruited based on a specific psychiatric or organic illness and those interventions that did not specifically target a certain disease—in opposition to “psychiatric or psychological” and “physical” samples, whose participants had a mental or medical diagnosis).
- They were written in English, French, or Italian.
Studies were excluded if:
- They assessed biomarkers only before or only after the intervention or program.
- They provided an internet-based psychological intervention or program without assessing any biomarker (eg, the study by ter Huurne et al [ ]).
- The intervention or program took place entirely in a prearranged setting, specifically ideated for this study, such as in-person, virtual reality (eg, the study by Yang et al [ ]), and computer-assisted interventions.
- They involved lifestyle interventions or programs (eg, physical activity or nutritional habits), without a psychological component (eg, the study by Carolan-Olah and Sayakhot [ ]).
- They conducted only cognitive trainings or tasks focused on executive functions, such as cognitive remediation therapy (CRT; eg, the study by Brockmeyer et al [ ]). As CRT is fundamentally distinct in nature from psychological and psychoeducational interventions, adding CRT would have made it challenging to compare the treatments meaningfully. However, we included studies with cognitive or executive tasks whenever these were only a part of the intervention, along with psychotherapy sessions (eg, the study by Lansing et al [ ]).
- They were reviews, meta-analyses, protocols, and letters to the editor.
See the figure in the Results section for this study’s flowchart.
We used Rayyan software to identify and exclude duplicates among the 3 databases.
From each included article, GG, CG, and SR independently extracted the main characteristics: study author, study title, study design, diagnosis, targeted population, medication, sample size, gender, age, intervention, duration of intervention, follow-up duration, and main results (Table S1 in
). GG, CG, and SR independently evaluated the strength of reporting with the Quality Assessment Tool for Before-After (Pre-Post) Studies with No Control Group, the Quality Assessment Tool for Case Series Studies, and the Quality Assessment of Controlled Intervention Studies [ ].Quality of Reporting
The strength of reporting was assessed with the Quality Assessment Tools developed by the National Heart, Lung, and Blood Institute tools [
]. The questions in these tools are designed to help the reviewer focus on the key concepts for assessing the internal validity of a study and concern the objective of this study, the population studied, how it was recruited and measured, the response rate, and the statistical analyses conducted (Tables S2-S4 in for details).Quality ratings (“good,” “fair,” or “poor”) were assigned based on the following calculation:
- Quality assessment of controlled intervention studies: 0-5 yeses: poor, 6-10 yeses: fair, and 11-14 yeses: good (Table S2 in );
- Quality assessment tool for before-after (pre-post) studies with no control group: 0-4 yeses: poor, 5-8 yeses: fair, and 9-12 yeses: good (Table S3 in ); and
- Quality assessment tool for case series studies: 0-3 yeses: poor, 4-6 yeses: fair, and 7-9 yeses: good (Table S4 in ).
Results
General Description
After screening for titles, abstracts, and full texts, we eventually included 24 papers of the 2934 studies identified through the databases and the 21 studies identified through other sources (
).The retained studies were either controlled trial intervention studies or randomized controlled trials (n=19, 79%) [
- ], pre-post studies with no control group (n=4, 17%) [ , - ], or case studies (n=1, 4%) [ ].The interventions or programs were addressed to individuals with a psychiatric or psychological problem (n=6, 25%), individuals with an organic or medical disease (n=10, 42%), and nonclinical populations (n=8, 33%).
The psychiatric or psychological problems included depression (n=3, 13%) [
, , ], posttraumatic stress disorder (n=2, 8%) [ , ], and sleep problems (n=1, 4%) [ ].The organic or medical diseases included type 1 diabetes (n=3, 13%) [
, , ], inflammatory bowel disease (n=2, 8%) [ , ], hypertension (n=2, 8%) [ , ], prostate cancer (n=1, 4%) [ ], preterm labor (n=1, 4%) [ ], and heart diseases (n=1, 4%) [ ].The nonclinical populations included health care professionals (n=3, 13%) [
, , ], smokers (n=2, 8%) [ , ], university students (n=2, 8%) [ , ], and healthy adult men (n=1, 4%) [ ].Two studies included patients with both a psychiatric or psychological problem and an organic or medical disease [
, ], and in this case, we included the studies under psychiatric or psychological problems.The psychotherapeutic interventions or programs were CBT or CBT-informed interventions (we included in this category different types of CBTs, such as trauma-focused CBT, CBT for insomnia, behavioral activation treatment, and motivational enhancement therapy CBT, as well as programs and e-counseling based on CBT techniques; n=14, 59%) [
, - , - , , , - ], mindfulness-based treatments (n=6, 25%) [ , , , , , ], stress management interventions (n=2, 8%) [ , ], coping skills training (n=1, 4%) [ ], and music therapy (n=1, 4%) [ ].The most frequently measured biomarkers were salivary cortisol (sCort; n=7, 29%) [
, , , , - ], tumor necrosis factor-α (n=5, 21%) [ , , , , ], α amylase (AA; n=4, 17%) [ , - ], hair cortisol concentrations (HCC; n=4, 17%) [ , , , ], interleukin-6 (n=4, 17%) [ , , , ], glycated hemoglobin (HbA1c) blood glucose level (n=4, 17%) [ , , , ], and C-reactive protein (CRP; n=4, 17%) [ , , , ]. We grouped the biomarkers measured on their physiological function or meaning, namely stress-related biomarkers, immune response biomarkers, cardiac or cardiovascular biomarkers, electrophysiological biomarkers, inflammatory biomarkers, electrolytes, renal function biomarkers, neurological function biomarkers, and others. Table S5 in provides more details.Results of the included studies are hereunder presented, divided by the underlying health condition of the targeted population (psychiatric or psychological illnesses, organic or medical diseases, and nonclinical samples), with a primary focus on biomarker variations between groups or in one group after intervention or program.
Interventions Targeting Psychiatric, Psychological Conditions, or Issues
Two studies found significant improvements in patients with depression after CBT and CBT-informed interventions, showing both reduced chemokines [
] and a decrease in HbA1c blood glucose levels in older adults with type 2 diabetes [ ]. In Romero-Sanchiz et al [ ], all chemokines decreased in concentration at the study’s end point; however, these differences were observed within participants with mild and moderate depression (mostly those who were medication-free) rather than between patients with severe depression and healthy controls [ ]. Concurrently to immune response biomarkers variations, depression scores significantly improved after the internet CBT intervention, showing a relation between chemokine concentrations and depressive symptoms. In Egede et al [ ], participants in the telehealth behavioral activation treatment arm showed stable levels of HbA1c, as opposed to it increasing in the same-room arm [ ]. Moreover, both the telehealth and the same-room treatments equally contributed to lower depression symptoms, with no significant differences between the two study arms.CBT for insomnia led to significantly increased functional connectivity in bilateral posterior cingulate cortices (PCCs) and right premotor or dorsolateral prefrontal cortex in patients with insomnia [
]. Changes in cytokines levels post interventions were not significant. Participants also reported significant improvements in several sleep quality indices, which correlated with biomarker variations.The remaining studies providing a CBT intervention to psychiatric samples, targeting patients with depression [
] and posttraumatic stress disorder [ , ], showed no significant changes in biomarkers, particularly stress-related biomarkers [ , ] and oxytocin and vasopressin concentrations [ ].Interventions Targeting Organic, Medical Conditions, or Issues
Blood pressure (BP) significantly decreased after CBT-informed e-counseling in patients with hypertension [
, ] and in patients with heart disease after a mindfulness-based intervention [ ]. Specifically, in Liu et al [ ], BP decreased equally in both the e-counseling group and the control group; at 12 months, the e-counseling group, compared to controls, showed a greater reduction in systolic BP (SBP), along with a significant reduction of urinary sodium in females. Similarly, Nolan et al [ ] found a significant reduction of BP in both the e-counseling group and the control group, with the variation of SBP being significantly greater in the e-counseling group, compared to controls, at 12 months. Pulse pressure also lessened after 4 and 12 months, while non–high-density lipoprotein cholesterol lowered at 4 months in the e-counseling group. In Gotink et al [ ], in patients with heart disease, heart rate (HR), BP, and HCC levels decreased over time, but these changes showed no significant difference between groups, although SBP reduction in the mindfulness group had a greater effect size in the mindfulness group compared to usual care.HbA1c blood glucose level significantly decreased in patients with type 1 diabetes in 2 studies after CBT interventions [
, ]. However, Kern et al [ ] was a case series study on 2 patients and Lansing et al [ ] had a sample of 15 patients only. According to Lansing et al [ ], a motivational enhancement CBT-informed intervention would benefit glycemic control and HbA1c in teenagers with diabetes [ ]. Following the active treatment phase, the HbA1c was indeed reduced compared to its pretreatment levels, whereas during the subsequent maintenance phase, no additional enhancements were observed. Nevertheless, the progress was preserved in most participants. On the contrary, HbA1c slightly increased in youth with type 1 diabetes in one study [ ], both in the coping skills training group and in the control one (with no difference between the two), but this variation was only borderline significant (P=.05). Although this does not reflect an improvement in metabolic control, the fact that HbA1c did not notably rise in teenagers with diabetes was considered a positive outcome by the authors.Indoleamine 2,3-dioxygenase significantly decreased in patients with inflammatory bowel disease after a stress management intervention [
]. However, the authors failed to find any change in the many other biomarkers investigated, including brain-derived neurotrophic factor and CRP.Furthermore, reduced inflammation biomarkers were found in patients with inflammatory bowel disease after mindfulness-based interventions [
]. Participants who received both the blended mindfulness-based intervention and the standard medical therapy presented a significant decrease in fecal calprotectin and CRP compared to participants who received standard medical therapy alone, but there was no significant difference in HCC emerged between the two groups. Immune response biomarkers significantly decreased in men with advanced prostate cancer after 6 months, both in the cognitive behavioral stress management intervention and the health promotion condition, with no significant difference between groups [ ]. However, this improvement faced a rebound increase at 6 months. Furthermore, contrary to the authors’ hypothesis, diurnal cortisol diminished only for participants in the health promotion condition after 6 months, while it was higher in men in the cognitive behavioral stress management group. Cortisol levels remained relatively stable over the subsequent 6 months.Lastly, no significant difference concerning the reduction of sCort levels was found between pregnant women with preterm labor assigned to either an internet-based cognitive behavioral stress management program for preterm labor or a control group based on distraction [
].Programs Targeting Nonclinical Populations
A reduction in certain stress-related biomarkers was found after mindfulness [
], but not after music therapy [ ]. Specifically, Beerse et al [ ] observed a significant reduction in sCort in both the mindfulness-based art therapy group and the neutral clay task control group, as well as a significant decrease in anxiety and perceived stress only in the experimental group. However, no significant correlations between sCort and perceived stress or between sCort and anxiety were detected. Finnerty et al [ ] revealed a slight—yet nonsignificant—decrease in the participants’ HCC levels after music therapy, compared to a significant increase in the control group, inferring that the program may enhance stress management skills rather than soothing anxiety [ ]. On this behalf, stress and anxiety scores did not change after the 6 weeks program across all kinds of programs and the control group.Two studies reported heterogeneous changes in immune biomarkers [
, ]. In Heckenberg et al [ ], secretory immunoglobulin A increased after a mindfulness-based stress reduction program on direct-care workers, suggesting an improved level of mucosal immunity. The authors also found that changes in salivary AA concentration only approached significance [ ].Schakel et al [
] measured several immune and psychophysiological outcomes in participants who underwent an internet CBT program. After treatment, authors reported a significant increase in immunoglobulin G, a decrease in interleukin-1β and tumor necrosis factor-α, as well as significant variations in a diverse number of chemokines and cytokines. Moreover, participants reported improvements in HR variables over time, but with no significant differences between conditions. Ultimately, HR variability, sCort, AA, and skin conductance showed neither a significant main effect of time nor an interaction between time and condition [ ].Two of the included studies focused on the smoking population and they both reported significant findings [
, ]. In Janes et al [ ], posterior cingulate cortex reactivity to smoking cues decreased after both the mindfulness training and the control program, with no significant difference between groups [ ]. Participants also reported a decrease in cigarette consumption after the program. On the other hand, in Webb et al [ ], 7-day point prevalence abstinence (PPA), defined as self-reported abstinence from smoking for 7 days, displayed higher rates in the program condition compared to the controls at 26 weeks, but this effect did not last up until the 52 weeks’ time point. The abstinence was biochemically verified through breath CO levels, which emerged to be consistent with participants’ self-evaluation, to the advantage of the program condition versus the control group after 26 weeks, but not after 52 weeks. Additionally, the consecutive 7-day PPA, defined as 2 or more consecutive 7-day PPA observations, resulted in significant enhancement in the program arm rather than in the control group both at 26 and 52 weeks.Lastly, the remaining studies did not report significant changes in biomarkers. Specifically, stress-related biomarkers were found to be substantially the same before and after both a stress management program [
] and mindfulness-based intervention [ ].Additional Health Outcomes Associated With Biomarker Variations
Although a significant variation in biomarkers can be useful in assessing treatment response, the efficacy of the intervention can be further reinforced if the changes in the biomarkers are associated with a relevant improvement in participants’ health outcomes. Some of the included studies reported, along with a significant variation in biomarkers, a reduction of patients’ symptoms (in the clinical samples) or an overall improvement of participants’ well-being (in the nonclinical samples), reflecting a fairly solid response to the intervention. Hereafter, we summarize the main outcomes of the above-mentioned studies.
Regarding the psychiatric or psychological samples, in Romero-Sanchiz et al [
], the significant decrease in chemokines in the CBT intervention in patients with depression matched a reduction in their symptoms. In Park et al [ ], CBT for insomnia successfully improved sleep quality in patients on dialysis with sleeping problems. This achievement correlated with the enhancement, between the pre- and postintervention time points, of the resting-state brain connectivity between the default mode network and the premotor or dorsolateral prefrontal cortex, cortical areas crucially involved in sleep regulation. Among the medical samples, in Liu et al [ ], cardiovascular outcomes were associated with improvements in physical activity: specifically, a greater number of daily steps was related to a lower BP. Furthermore, Lansing et al [ ], in addition to a decreasing HbA1c after the intervention, reported improvements in teens’ performance on executive functions, specifically working memory and inhibitory control tasks. Fewer errors in inhibitory control tasks significantly correlated with the decreased HbA1c (as well as with the increased frequency of glycemic control). Lastly, regarding nonclinical samples, Janes et al [ ] reported a significant correlation between the reduction of PCC reactivity to smoking cues and the decrease in cigarette consumption: although this biomarker decreased in both groups, only in the mindfulness training condition did participants who exhibited a reduction in PCC cue reactivity also showed a greater reduction of cigarette use. Nevertheless, in the clinical samples, the patients’ underlying condition (whether psychological or medical) could cause biological alterations. This makes it difficult to ascertain whether—and to what extent—the significant variations in biomarkers measured in the studies are due to the intervention, rather than the disorder itself.Predictors of Response
Regarding the issue of prediction of response, some of the studies investigated whether changes in biomarkers or their baseline values predicted an improvement in symptoms (typically with linear regressions). Janes et al [
] investigated whether variations in PCC reactivity to smoking cues predicted individual-level smoking reduction. Linear regressions were performed, with ΔPCC (the change in PCC reactivity from baseline to post intervention) significantly predicting changes in cigarettes smoked in the mindfulness group. This predictor was not significant in the control group. However, this model was only significant at the individual level, not at the group level. Laufer et al [ ] assessed the predictive value of salivary AA, sCort, and hair cortisol before intervention on treatment response to identifying prescriptive biological markers. No correlation was found between changes in biomarkers and changes in depressive symptoms. However, exploratory analysis found that baseline AA predicted treatment response. Nolan et al [ ] reported that total lipoprotein cholesterol and SBP were predictors of cardiovascular risk index after the intervention [ ]. Finally, Graham et al [ ] failed to report associations between changes in perceived stress and changes in CRP and interleukin-6.Quality of Reporting
The quality of reporting evaluation is reported in Tables S2-S4 in
. Four studies were rated as “good” per quality of reporting, 16 studies as “fair,” and 4 studies as “poor.”Some response patterns that emerged depending on the type of study should be underscored. In the 4 “before-after” studies, 75% (n=3) did not enroll all eligible participants (item 4) and 75% (n=3) did not have a large enough sample size (item 5); additionally, it was not possible to apply a few items to assess: the blindness of people assessing outcomes in 100% (n=4) of the studies (item 8), the percentage of dropout at follow-up in 75% (n=3) of the studies (item 9) and the individual-level outcome efforts in group-level interventions in 100% (n=3) of the studies (item 12). In 19 controlled intervention studies, 74% (n=14) were not double-blind (item 4), 58% (n=11) did not report intervention adherence measures (item 9), 58% (n=11) had a dropout rate higher than 20% (item 7), 47% (n=9) did not have a large enough sample size (item 12), and 47% (n=9) did not use an intention-to-treat (ITT) analysis (item 14).
Discussion
Principal Findings
The main goal of this systematic review was to investigate the effects of internet-based psychological interventions on various biomarkers. In addition, we aimed to explore whether variations in such biomarkers reflected alterations of the underlying health condition (whether psychiatric or psychological, organic or medical, or nonclinical). After the screening process, we included 24 studies, which were mainly randomized controlled trials. The most frequently targeted populations were patients who are depressed (for psychological or psychiatric samples), patients who are diabetic (for organic or medical samples), and health care professionals (for nonclinical samples); the most frequently administered programs were internet-based CBT or CBT-informed interventions; and the most frequently measured biomarkers were stress-related biomarkers.
Effect of Intervention or Program Duration on Biomarker Variations
Internet- and app-based interventions can extensively differ per intervention duration and sessions’ frequency. This produces a variety of conditions that may affect outcomes in different ways. The 24 studies included in this review were rather heterogeneous: except for 4 (17%) studies that provided 12-month interventions or programs [
, , , ] and 1 (4%) study with a 25-week-long program [ ], in the remaining papers (n=19, 79%) [ - , - , - ], the treatments lasted no longer than 3 months. Furthermore, among the included studies, the most frequently administered interventions were CBT and mindfulness-based therapy, which are typically short-term treatments.A brief intervention or program may represent an obstacle to significant findings, considering that some biomarkers might need a longer amount of time to significantly vary, perhaps longer than a brief treatment may allow. All the abovementioned studies that deliver interventions or programs that last 6 to 12 months report significant biomarkers’ changes, as opposed to the 8 (42%) out of 19 treatments [
, , , - , ] that lasted no longer than 3 months. This may suggest that the longer the intervention or program is, the more likely it is that biomarkers will change.Nonetheless, we should acknowledge that this does not always occur; in fact, some shorter interventions and programs still report biomarkers’ changes: for example, Park et al [
], Janes et al [ ], Beerse et al [ ], Schumacher et al [ ], and Schakel et al [ ], whose treatments lasted 3, 4, 5, 5, and 6 weeks, respectively.Potential methodological limitations should also be discussed. Follow-up may impact the data collected by researchers in various ways: biological samples (such as saliva or blood samples) might deteriorate with time and become unusable, if not forthwith analyzed; similarly, data might be lost due to misplacement. A further issue is the possible dropout of participants, who may not be reachable or might refuse to partake in the follow-up data collection, leading to a loss of statistical power in the conducted analysis. Therefore, variability of biomarkers at follow-up might stem from different sources, and methodological issues should be considered when interpreting results.
Effect of Follow-Up on Biomarker Variations
In light of the abovementioned topic, it should also be taken into consideration whether the studies provide a follow-up assessment to evaluate the possibility of a further alteration of biomarkers after a certain amount of time from the intervention end point. Eight (33%) [
- , , , , ] of the 24 included papers re-evaluated participants at follow-up, yet only 4 (17%) [ , , , ] also reported biomarkers’ changes.Unfortunately, the scarcity of follow-up biomarkers’ evaluations in the included studies and the gaps in measurements in those that provided a follow-up do not allow us to examine in depth the influence of time on the variations of several biological indicators. It is reasonable to think that changes in biomarker levels might depend on a multitude of factors, such as the type of intervention or program, its duration and frequency, and the possible presence of a psychiatric or medical condition, besides the nature of the biomarker itself and the length of follow-up. We need a more homogeneous group of studies to derive more definitive and reliable conclusions.
Augmentation
According to the reviewed literature, there is growing evidence suggesting that internet-based interventions and programs may be effective in improving a variety of health conditions, even producing significant alterations of some biological factors. Among the several biomarkers included in this systematic review, those that more frequently varied as a consequence of an online treatment or program were cardiac or cardiovascular biomarkers (especially BP and HR), inflammatory biomarkers, neurological function biomarkers, and HbA1c. Considering the type of internet-based interventions, CBT or CBT-informed and mindfulness-based interventions proved to be most efficient in improving both biomarkers and symptoms. However, this result might be biased, since these two psychological interventions were also the most represented among the included studies. These effects should not be underestimated in scientific research: when investigating the efficacy or effectiveness of a treatment or program, authors should take into consideration whether participants are currently following an online psychosocial intervention or program, seeing as this might represent a confounding variable. On the same note, internet-based interventions and programs also have implications in clinical practice and could be combined with in-person or pharmacological therapy in the treatment of both psychiatric or psychological and medical conditions [
]. Long-term interventions and programs may be useful to maintain symptom reduction in time and prevent relapses, promoting a more holistic approach to patient care. Furthermore, online or app-based interventions and programs could also be beneficial per prevention, for example, increasing motivation in smokers to quit smoking or teaching health care providers effective strategies to manage stress and anxiety. Given their promising qualities, future research should invest more in studying the long-term effects of internet-based interventions and programs: ideally, including larger and more diverse populations would further enrich our preliminary findings, by extending the generalizability of our results.Strengths and Limitations
To the best of our knowledge, this is the first systematic review exploring how biomarkers change because of internet-based psychological interventions and programs. One of the strongest assets of this research regards the fact that it was conducted by following a meticulous and defined methodology according to the PRISMA statement [
]. By the employment of 3 databases and the workforce of 3 independent evaluators, who executed the screening taking into consideration three languages, we managed to reach a satisfying number of studies (n=24). This should be deemed as a major strength, especially in light of internet-based interventions and programs being a relatively new approach.Nevertheless, conducting this systematic review presented some challenges. The first and main limitation of this study is that the included papers were greatly heterogeneous per targeted populations, administered interventions or programs, and measured biomarkers. Regarding online interventions, we included a variety of psychological, psychosocial, and motivational programs, although the most frequent were CBT or CBT-informed treatments. Such programs also varied per type of material (eg, videos, reading material, messages, etc) and methods of administration (eg, computer, smartphone app, etc). Another source of heterogeneity stems from the vastly different clinical and nonclinical conditions targeted by the interventions. To avoid possible confusion in reporting such variability, we attempted to mitigate this inconvenience by reporting our results separately for psychiatric or psychological, medical, and nonclinical populations: this clustering method allowed us to better describe and appreciate the different effects that various interventions and programs have on the different examined populations. This heterogeneity becomes even more conspicuous when it comes to biomarkers assessment (Table S5 in
), making it highly difficult to draw comprehensive conclusions. However, we believe that having an entirely homogeneous sample per biomarker (eg, only stress-related biomarkers or only immune response biomarkers) would provide a narrow perspective of the effect of the intervention, for the scope of our review. A second limitation of this review concerns a methodological fault, namely our inability to retrieve information regarding the agreement between authors in case of conflict when screening articles and assessing their suitability for inclusion (Cohen κ).Other limitations that should be discussed are not problems of this review itself, but they mainly concern inherent weaknesses of the included studies. First, many studies (n=10, 42%) [
, , , , - , , , ] relied at least on 1 self-measured biomarker assessment, whether it was by collecting saliva samples (eg, the studies by Graham et al [ ] and Beerse et al [ ]), app and sensor monitoring (eg, the studies by Bauman et al [ ] and Finnerty et al [ ]), or by accounting for their self-measured biomarkers values (eg, the study by Kern et al [ ]). Self-reporting, especially when it comes to biomarkers, is much more likely to affect the reliability of the collected data. This consideration may not apply to app and sensor monitoring, which were deemed as accurate and sensitive methods by the studies that used them (n=3, 13%) [ , , ], and therefore, we can safely assume that the results were not gravely affected by them. However, it is undeniable that other self-report methods can potentially interfere with the reliability of data, because participants may not be entirely truthful about their reported values or incorrectly execute the sample collection.Second, another flaw of most of the included studies is the absence of a follow-up evaluation. As previously stated, depending on the underlying condition and the type of outcome measures, some biomarkers may take longer to show a significant alteration. Therefore, some of the studies that did not find significant changes in biomarkers might have shown different results in the longer term. In the wake of this, in studies in which biomarkers vary significantly, a follow-up would allow us to examine how such improvements develop through time. Long-lasting effects of internet-based interventions and programs could help to avoid relapses and delay medical deterioration. Maintenance therapy, if permitted by the theoretical framework of the intervention or program, could be useful to preserve the treatment’s or program’s beneficial effects for a more extended period. Supporting this idea, in Lansing et al [
], the active treatment phase was followed by a maintenance period, which helped sustain the obtained results for 14 additional weeks after treatment ended [ ].Finally, the high dropout rate is another weakness of the included studies that needs to be addressed: as already mentioned in the quality assessment and visible in Tables S2-S4 in
, as far as it concerns the controlled intervention studies (n=19), more than half of the studies (n=10, 53%) have an overall dropout rate higher than 20%. Higher dropout rates can affect internal validity since they subtract potential additional data. In this review, the high dropout rate may be due to the internet-based nature of the interventions and programs. In face-to-face interventions or programs, the relevance in dropout prevention of a strong therapeutic alliance that encourages compliance has been well documented [ ]. Perceiving their therapist as more understanding, involved, and agreeable about their goals may be a protective factor for patients against dropout [ ]. Internet-based interventions and programs, especially if self-guided, often lack a relational component, which undoubtedly plays a fundamental role in face-to-face interventions and programs. This may lead to loss of motivation in individuals who find the treatment particularly challenging from an emotional standpoint. Karyotaki et al [ ] found that therapist-assisted online interventions or programs have lower dropout rates than self-guided ones. In light of this knowledge, clinicians using internet-based interventions or programs should commit to creating better opportunities to establish a solid alliance with patients, build up strong motivation, and discourage attrition.Future Research Directions
Even though our review allowed us to reach some notable findings, this research field is quite recent and deserves further development.
As previously stated, internet-based interventions and programs represent a fairly new answer to those seeking mental health or psychological support for a variety of conditions. The COVID-19 pandemic has ultimately increased this need, by both compelling social distance and worsening pre-existent mental health issues in the general population [
]. This, among many others, is one of the reasons why we managed to include only a moderate number of studies. Due to the continuous development of new technologies and the growth of demand for long-distance services, a great deal of research is expected to come along in the next few years, which will hopefully enrich this field of investigation.Another research domain that should be further explored, especially in psychological terms, concerns biomarkers. Biological indicators are often used to study organic and medical pathologies but quite rarely when it comes to the psychological and mental health field. A stronger body of scientific research on the biology of mental illnesses may allow us, from a clinical point of view, to reach both a better understanding of their underlying mechanisms and a more suitable way of treating them by adding fundamental new information to the pharmacology area. For these reasons, it is our best hope that future researchers will invest more in using biomarkers as a valid and reliable outcome measure for mental health issues as well.
Conclusion
Our review provides a synthesis of literature examining the effects of internet-based psychological treatments and programs on several biomarkers. The results suggest that such interventions may have some beneficial effects on a variety of health conditions, in some cases even presenting significant physiological changes. Nonetheless, some studies show little to no positive effects, and in general, the existing evidence is scarce and somewhat conflicting. Although further evidence is required, we hope to raise awareness on the potential impact of internet-based interventions on biomarkers related to mental and physical health.
Authors' Contributions
RC and CMG conceptualized this study. GG, CG, and SR did the data curation. GG and CG analyzed the data. GG, CG, SR, and RC handled the methodology. RC administrated this study, while RC, FM, PC, JL-C, and PZ supervised it. GG and CG wrote the original draft. GG, CG, RC, and CMG reviewed and edited the writing.
Conflicts of Interest
None declared.
Search terms.
DOCX File , 23 KBSupplementary tables S1-S5.
DOCX File , 2990 KBPRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) checklist.
DOCX File , 32 KBReferences
- Chakrabarti S. Usefulness of telepsychiatry: a critical evaluation of videoconferencing-based approaches. World J Psychiatry. 2015;5(3):286-304. [CrossRef] [Medline]
- Richards D, Viganó N. Online counseling: a narrative and critical review of the literature. J Clin Psychol. 2013;69(9):994-1011. [CrossRef] [Medline]
- Karyotaki E, Kleiboer A, Smit F, Turner DT, Pastor AM, Andersson G, et al. Predictors of treatment dropout in self-guided web-based interventions for depression: an 'individual patient data' meta-analysis. Psychol Med. 2015;45(13):2717-2726. [CrossRef] [Medline]
- Stoll J, Müller JA, Trachsel M. Ethical issues in online psychotherapy: a narrative review. Front Psychiatry. 2020;10:993. [CrossRef] [Medline]
- Biomarkers Definitions Working Group. Biomarkers and surrogate endpoints: preferred definitions and conceptual framework. Clin Pharmacol Ther. 2001;69(3):89-95. [CrossRef] [Medline]
- FDA-NIH Biomarker Working Group. BEST (Biomarkers, EndpointS, and other Tools) Resource. Silver Spring, MD. US Food and Drug Administration; 2016.
- Ohrnberger J, Fichera E, Sutton M. The relationship between physical and mental health: a mediation analysis. Soc Sci Med. 2017;195:42-49. [CrossRef] [Medline]
- Orosz A, Federspiel A, Eckert A, Seeher C, Dierks T, Tschitsaz A, et al. Exploring the effectiveness of a specialized therapy programme for burnout using subjective report and biomarkers of stress. Clin Psychol Psychother. 2021;28(4):852-861. [CrossRef] [Medline]
- Shields GS, Spahr CM, Slavich GM. Psychosocial interventions and immune system function: a systematic review and meta-analysis of randomized clinical trials. JAMA Psychiatry. 2020;77(10):1031-1043. [FREE Full text] [CrossRef] [Medline]
- Claudino FCDA, Gonçalves L, Schuch FB, Martins HRS, da Rocha NS. The effects of individual psychotherapy in BDNF levels of patients with mental disorders: a systematic review. Front Psychiatry. 2020;11:445. [CrossRef] [Medline]
- Marceau EM, Meuldijk D, Townsend ML, Solowij N, Grenyer BFS. Biomarker correlates of psychotherapy outcomes in borderline personality disorder: a systematic review. Neurosci Biobehav Rev. 2018;94:166-178. [CrossRef] [Medline]
- Fancourt D, Perkins R, Ascenso S, Atkins L, Kilfeather S, Carvalho L, et al. Group drumming modulates cytokine response in mental health services users: a preliminary study. Psychother Psychosom. 2016;85(1):53-55. [CrossRef] [Medline]
- Dash SP. The impact of IoT in healthcare: global technological change & the roadmap to a networked architecture in India. J Indian Inst Sci. 2020;100(4):773-785. [CrossRef] [Medline]
- Page MJ, McKenzie JE, Bossuyt PM, Boutron I, Hoffmann TC, Mulrow CD, et al. The PRISMA 2020 statement: an updated guideline for reporting systematic reviews. BMJ. 2021;372:n71. [FREE Full text] [CrossRef] [Medline]
- ter Huurne ED, Postel MG, de Haan HA, Drossaert CH, DeJong CA. Web-based treatment program using intensive therapeutic contact for patients with eating disorders: before-after study. J Med Internet Res. 2013;15(2):e12. [CrossRef] [Medline]
- Yang YJD, Allen T, Abdullahi SM, Pelphrey KA, Volkmar FR, Chapman SB. Neural mechanisms of behavioral change in young adults with high-functioning autism receiving virtual reality social cognition training: a pilot study. Autism Res. 2018;11(5):713-725. [FREE Full text] [CrossRef] [Medline]
- Carolan-Olah M, Sayakhot P. A randomized controlled trial of a web-based education intervention for women with gestational diabetes mellitus. Midwifery. 2019;68:39-47. [CrossRef] [Medline]
- Brockmeyer T, Walther S, Ingenerf K, Wild B, Hartmann M, Weisbrod M, et al. Brain effects of computer-assisted cognitive remediation therapy in anorexia nervosa: a pilot fMRI study. Psychiatry Res Neuroimaging. 2016;249:52-56. [CrossRef] [Medline]
- Lansing AH, Stanger C, Budney A, Christiano AS, Casella SJ. Pilot study of a web-delivered multicomponent intervention for rural teens with poorly controlled type 1 diabetes. J Diabetes Res. 2016;2016:7485613. [CrossRef] [Medline]
- Study quality assessment tools. National Heart, Lung, and Blood Institute (NHLBI). URL: https://www.nhlbi.nih.gov/health-topics/study-quality-assessment-tools [accessed 2023-09-27]
- Egede LE, Walker RJ, Payne EH, Knapp RG, Acierno R, Frueh BC. Effect of psychotherapy for depression via home telehealth on glycemic control in adults with type 2 diabetes: subgroup analysis of a randomized clinical trial. J Telemed Telecare. 2018;24(9):596-602. [CrossRef] [Medline]
- Romero-Sanchiz P, Nogueira-Arjona R, Araos P, Serrano A, Barrios V, Argente J, et al. Variation in chemokines plasma concentrations in primary care depressed patients associated with internet-based cognitive-behavioral therapy. Sci Rep. 2020;10(1):1078. [CrossRef] [Medline]
- Engel S, Schumacher S, Niemeyer H, Kuester A, Burchert S, Klusmann H, et al. Associations between oxytocin and vasopressin concentrations, traumatic event exposure and posttraumatic stress disorder symptoms: group comparisons, correlations, and courses during an internet-based cognitive-behavioural treatment. Eur J Psychotraumatol. 2021;12(1):1886499. [CrossRef] [Medline]
- Schumacher S, Engel S, Niemeyer H, Küster A, Burchert S, Skoluda N, et al. Salivary cortisol and alpha-amylase in posttraumatic stress disorder and their potential role in the evaluation of cognitive behavioral treatment outcomes. J Trauma Stress. 2022;35(1):78-89. [CrossRef] [Medline]
- Jaser SS, Whittemore R, Chao A, Jeon S, Faulkner MS, Grey M. Mediators of 12-month outcomes of two internet interventions for youth with type 1 diabetes. J Pediatr Psychol. 2014;39(3):306-315. [CrossRef] [Medline]
- González-Moret R, Cebolla A, Cortés X, Baños RM, Navarrete J, de la Rubia JE, et al. The effect of a mindfulness-based therapy on different biomarkers among patients with inflammatory bowel disease: a randomised controlled trial. Sci Rep. 2020;10(1):6071. [CrossRef] [Medline]
- Peerani F, Watt M, Ismond KP, Whitlock R, Ambrosio L, Hotte N, et al. A randomized controlled trial of a multicomponent online stress reduction intervention in inflammatory bowel disease. Therap Adv Gastroenterol. 2022;15:17562848221127238. [CrossRef] [Medline]
- Liu S, Tanaka R, Barr S, Nolan RP. Effects of self-guided e-counseling on health behaviors and blood pressure: results of a randomized trial. Patient Educ Couns. 2020;103(3):635-641. [CrossRef] [Medline]
- Nolan RP, Feldman R, Dawes M, Kaczorowski J, Lynn H, Barr SI, et al. Randomized controlled trial of e-counseling for hypertension: REACH. Circ Cardiovasc Qual Outcomes. 2018;11(7):e004420. [CrossRef] [Medline]
- Penedo FJ, Fox RS, Walsh EA, Yanez B, Miller GE, Oswald LB, et al. Effects of web-based cognitive behavioral stress management and health promotion interventions on neuroendocrine and inflammatory markers in men with advanced prostate cancer: a randomized controlled trial. Brain Behav Immun. 2021;95:168-177. [FREE Full text] [CrossRef] [Medline]
- Urech C, Scherer S, Emmenegger M, Gaab J, Tschudin S, Hoesli I, et al. Efficacy of an internet-based cognitive behavioral stress management training in women with idiopathic preterm labor: a randomized controlled intervention study. J Psychosom Res. 2017;103:140-146. [CrossRef] [Medline]
- Gotink RA, Younge JO, Wery MF, Utens EMWJ, Michels M, Rizopoulos D, et al. Online mindfulness as a promising method to improve exercise capacity in heart disease: 12-month follow-up of a randomized controlled trial. PLoS One. 2017;12(5):e0175923. [CrossRef] [Medline]
- Baumann H, Heuel L, Bischoff LL, Wollesen B. Efficacy of individualized sensory-based mHealth interventions to improve distress coping in healthcare professionals: a multi-arm parallel-group randomized controlled trial. Sensors (Basel). 2023;23(4):2322. [FREE Full text] [CrossRef] [Medline]
- Graham B, Jin Y, Bazeley P, Husni E, Calabrese LH. Online, low-volume meditation does not alter immune-related biomarkers. Brain Behav Immun Health. Dec 2022;26:100531. [FREE Full text] [CrossRef] [Medline]
- Janes AC, Datko M, Roy A, Barton B, Druker S, Neal C, et al. Quitting starts in the brain: a randomized controlled trial of app-based mindfulness shows decreases in neural responses to smoking cues that predict reductions in smoking. Neuropsychopharmacology. Aug 2019;44(9):1631-1638. [FREE Full text] [CrossRef] [Medline]
- Webb J, Peerbux S, Ang A, Siddiqui S, Sherwani Y, Ahmed M, et al. Long-term effectiveness of a clinician-assisted digital cognitive behavioral therapy intervention for smoking cessation: secondary outcomes from a randomized controlled trial. Nicotine Tob Res. Oct 26, 2022;24(11):1763-1772. [FREE Full text] [CrossRef] [Medline]
- Beerse ME, van Lith T, Stanwood G. Therapeutic psychological and biological responses to mindfulness-based art therapy. Stress Health. Oct 2020;36(4):419-432. [CrossRef] [Medline]
- Finnerty R, McWeeny S, Trainor L. Online group music therapy: proactive management of undergraduate students' stress and anxiety. Front Psychiatry. 2023;14:1183311. [FREE Full text] [CrossRef] [Medline]
- Schakel L, Veldhuijzen DS, van Middendorp H, Prins C, Drittij AMHF, Vrieling F, et al. An internet-based psychological intervention with a serious game to improve vitality, psychological and physical condition, and immune function in healthy male adults: randomized controlled trial. J Med Internet Res. Jul 24, 2020;22(7):e14861. [FREE Full text] [CrossRef] [Medline]
- Heckenberg RA, Hale MW, Kent S, Wright BJ. An online mindfulness-based program is effective in improving affect, over-commitment, optimism and mucosal immunity. Physiol Behav. Feb 01, 2019;199:20-27. [CrossRef] [Medline]
- Laufer S, Schulze L, Engel S, Klusmann H, Skoluda N, Nater UM, et al. The effect of an internet-based intervention for depression on cortisol and alpha-amylase. Psychoneuroendocrinology. Jun 2023;152:106082. [CrossRef] [Medline]
- Park HY, Lee H, Jhee JH, Park KM, Choi EC, An SK, et al. Changes in resting-state brain connectivity following computerized cognitive behavioral therapy for insomnia in dialysis patients: A pilot study. Gen Hosp Psychiatry. 2020;66:24-29. [FREE Full text] [CrossRef] [Medline]
- Kern D, Ljótsson B, Bonnert M, Lindefors N, Kraepelien M. Online guided self-help cognitive behavioral therapy with exposure to anxiety and problem solving in type 1 diabetes mellitus: case study. JMIR Form Res. Jul 13, 2022;6(7):e32950. [FREE Full text] [CrossRef] [Medline]
- Calati R. Augmentation/combination strategies in psychotherapy: the need of clear guidelines and future research. Neuropsychobiology. 2021;80(6):516-517. [CrossRef] [Medline]
- Meier PS, Donmall MC, Barrowclough C, McElduff P, Heller RF. Predicting the early therapeutic alliance in the treatment of drug misuse. Addiction. Apr 2005;100(4):500-511. [FREE Full text] [CrossRef] [Medline]
- Melville KM, Casey LM, Kavanagh DJ. Dropout from Internet-based treatment for psychological disorders. Br J Clin Psychol. Nov 2010;49(Pt 4):455-471. [CrossRef] [Medline]
- Kaufman KR, Petkova E, Bhui KS, Schulze TG. A global needs assessment in times of a global crisis: world psychiatry response to the COVID-19 pandemic. BJPsych Open. Apr 06, 2020;6(3):e48. [FREE Full text] [CrossRef] [Medline]
Abbreviations
AA: α amylase |
BP: blood pressure |
CBT: cognitive behavioral therapy |
CRP: C-reactive protein |
CRT: cognitive remediation therapy |
FDA: US Food and Drug Administration |
HbA1c: glycated hemoglobin |
HCC: hair cortisol concentration |
HR: heart rate |
ITT: intention-to-treat |
NIH: National Institutes of Health |
PCC: posterior cingulate cortex |
PPA: point prevalence abstinence |
PRISMA: Preferred Reporting Items for Systematic Reviews and Meta-Analysis |
SBP: systolic blood pressure |
sCort: salivary cortisol |
Edited by A Coristine; submitted 22.12.23; peer-reviewed by L Guo, A Hassan, N Cera; comments to author 11.05.24; revised version received 29.06.24; accepted 24.09.24; published 29.11.24.
Copyright©Giulia Gotti, Chiara Gabelli, Sophia Russotto, Fabio Madeddu, Philippe Courtet, Jorge Lopez-Castroman, Patrizia Zeppegno, Carla Maria Gramaglia, Raffaella Calati. Originally published in the Journal of Medical Internet Research (https://www.jmir.org), 29.11.2024.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research (ISSN 1438-8871), is properly cited. The complete bibliographic information, a link to the original publication on https://www.jmir.org/, as well as this copyright and license information must be included.