Published on in Vol 22, No 1 (2020): January

A Web- and Mobile App–Based Mental Health Promotion Intervention Comparing Email, Short Message Service, and Videoconferencing Support for a Healthy Cohort: Randomized Comparative Study

A Web- and Mobile App–Based Mental Health Promotion Intervention Comparing Email, Short Message Service, and Videoconferencing Support for a Healthy Cohort: Randomized Comparative Study

A Web- and Mobile App–Based Mental Health Promotion Intervention Comparing Email, Short Message Service, and Videoconferencing Support for a Healthy Cohort: Randomized Comparative Study

Original Paper

Corresponding Author:

Melanie Elise Renfrew, BEd, Grad Dip

Lifestyle and Health Research Centre

Avondale University College

582 Freemans Drive

Cooranbong, New South Wales,

Australia

Phone: 61 405445151

Email: melrenfrew@gmail.com


Background: The rapid increase in mental health disorders has prompted a call for greater focus on mental health promotion and primary prevention. Web- and mobile app–based interventions present a scalable opportunity. Little is known about the influence of human support on the outcomes of these interventions.

Objective: This study aimed to compare the influence of 3 modes of human support on the outcomes (ie, mental health, vitality, depression, anxiety, stress, life satisfaction, and flourishing) of a 10-week, Web- and mobile app–based, lifestyle-focused mental health promotion intervention among a healthy adult cohort.

Methods: Participants were recruited voluntarily using a combination of online and offline advertising. They were randomized, unblinded into 3 groups differentiated by human support mode: Group 1 (n=201): standard—fully automated emails (S); Group 2 (n=202): standard plus personalized SMS (S+pSMS); and Group 3 (n=202): standard plus weekly videoconferencing support (S+VCS), hosted by 1 trained facilitator. Participants accessed the intervention, including the questionnaire, on a Web-based learning management system or through a mobile app. The questionnaire, administered at pre- and postintervention, contained self-reported measures of mental well-being, including the “mental health” and “vitality” subscales from the Short Form Health Survey-36, Depression Anxiety and Stress Scale-21, Diener Satisfaction With Life Scale (SWLS), and Diener Flourishing Scale.

Results: Of 605 potential participants, 458 (S: n=157, S+pSMS: n=163, and S+VCS: n=138) entered the study by completing registration and the preintervention questionnaire. At post intervention, 320 out of 458 participants (69.9%; S: n=103, S+pSMS: n=114, and S+VCS: n=103) completed the questionnaire. Significant within-group improvements were recorded from pre- to postintervention in all groups and in every outcome measure (P≤.001). No significant between-group differences were observed for outcomes in any measure: mental health (P=.77), vitality (P=.65), depression (P=.93), anxiety (P=.25), stress (P.57), SWLS (P=.65), and Flourishing Scale (P=.99). Adherence was not significantly different between groups for mean videos watched (P=.42) and practical activity engagement (P=.71). Participation in videoconference support sessions (VCSSs) was low; 37 out of 103 (35.9%) participants did not attend any VCSSs, and only 19 out of 103 (18.4%) attended 7 or more out of 10 sessions. Stratification within the S+VCS group revealed that those who attended 7 or more VCSSs experienced significantly greater improvements in the domains of mental health (P=.006; d=0.71), vitality (P=.005; d=0.73), depression (P=.04; d=0.54), and life satisfaction (P=.046; d=0.50) compared with participants who attended less than 7.

Conclusions: A Web- and mobile app–based mental health promotion intervention enhanced domains of mental well-being among a healthy cohort, irrespective of human support. Low attendance at VCSSs hindered the ability to make meaningful between-group comparisons. Supplementing the intervention with VCSSs might improve outcomes when attendance is optimized.

Trial Registration: Australian New Zealand Clinical Trials Registry (ANZCTR): 12619001009101; http://www.anzctr.org.au/ACTRN12619001009101.aspx

J Med Internet Res 2020;22(1):e15592

doi:10.2196/15592

Keywords



Background

In 2012, the World Health Assembly requested the development of a plan to address escalating mental distress, resulting in the Mental Health Action Plan 2013-2020, which asserts that there is “no health without mental health” [1]. However, as we approach 2020, mental well-being continues to deteriorate. Depression is the leading cause of disability worldwide [2,3], and its prevalence is rising [4], evidenced by increasing antidepressant use [5] and the high rate of suicide—the second leading cause of death in the 15 to 29 years age group internationally [3]. Comorbidity is common [6], and those with major depression have a 40% to 60% risk of dying prematurely [1]. A 2018 review [7] of 12 countries revealed that depression and anxiety are the third most common reason for visits to a general practitioner in the developed world.

Mental well-being, even in the seemingly healthy population, is compromised by mounting stress and anxiety. In the 2015 Australian Psychological Society’s stress and well-being survey [8], 35% of those surveyed reported significant distress levels, 26% reported above normal anxiety, and 26% described themselves as having moderate to extreme depression levels. Therefore, provision of mental health promotion interventions (MHPIs) may be a vital approach to enhance mental well-being among healthy (ie, nonclinical), community-based cohorts.

There is a growing evidence base supporting the efficacy of MHPIs to improve the mental well-being of nonclinical population groups. These include interventions to alleviate stress [9-11], mindfulness training [12-15], lifestyle medicine strategies such as nutrition [16,17], and exercise [18,19] and an array of positive psychology interventions [20-22]. A recent analytic review [23] highlighted strategies from the fields of positive psychology and lifestyle medicine that have demonstrated effectiveness in enhancing mental well-being. Combining strategies from both fields, the same author devised a lifestyle-focused, multimodal intervention that has been piloted among university students on 2 occasions [24,25] and more recently as a Web-based randomized controlled trial (RCT) for a healthy community cohort [26]. The Web-based RCT demonstrated significantly greater improvements (P<.001) than the control group for all outcomes, with medium effect size improvements for the intervention arm in mental health (d=0.52), vitality (d=0.56), and stress (d=0.45). The same intervention was used for this study.

Web- and mobile app–based technology offers an unprecedented opportunity for disseminating MHPIs to healthy cohorts in community settings. Advantages, when compared with face-to-face interventions, include cost-effectiveness [27,28], accessibility, and scalability [29,30]. Furthermore, up to 80% of potential users are “e-preferers” [31]. However, digital delivery also poses unique challenges (eg, quality control, data control, high dropout attrition, and low adherence) that require creative solutions [32,33]. Notably, provision of human support (ie, guidance) is recognized as a possible modulating influence on adherence and outcomes [33,34].

Human Support

Human support provision in Web-based interventions has generally being associated with improved adherence and outcomes in clinical cohorts [32,35-39]. A meta-analysis of 12 studies treating depression found effect sizes for studies that included human support were larger (d=0.61) in comparison with unsupported studies (d=0.25) [38]. Nevertheless, some studies have found that the level of human support does not significantly influence outcomes [40-44]. Furthermore, variability in the provision of human support (eg, mode, intensity, and synchronicity) results in high heterogeneity, which makes comparisons between studies problematic [33,39].

It is imperative to investigate the role of human support among nonclinical groups. Support requirements may be markedly different among healthy cohorts. Symptomatic factors (eg, apathy, weakened motivation, and general malaise) that could impede a clinical cohort from completing a program may be nonexistent or differ considerably for a nonclinical group. Conceivably, MHPIs may prove to be a credible pathway to enhance mental well-being and serve as a vital buffer to protect healthy populations against mental distress [45].

Studies comparing human support factors for healthy cohorts engaging in Web- or mobile app–based mental well-being interventions are scarce, and outcomes are mixed. Several primary prevention studies (all classified as “indicated” prevention) have reported no significant difference between supported and unsupported arms [46-48]. Zarski et al [49] examined 3 support approaches and compared the effects on adherence with a stress management intervention. Monitoring and written feedback improved adherence. However, administrative support (ie, access to a support team for technical assistance) had no positive effect [49]. Allexandre et al [50] compared no support, group support, and group support with added expert clinical support for a stress management intervention. Group support was beneficial, but added clinical care contributed no extra benefit. However, the program content was Web-based, and support was provided face-to-face in a work setting, making comparison problematic. Finally, a review and metanalysis of 23 Web- and computer-based interventions to alleviate stress found that supported interventions demonstrated greater effects on outcomes (d=0.64) than unsupported (d=0.33) [51].

A confounder when drawing conclusions about the impact of human support on the effectiveness of Web- and computer-based programs is that there are many modes and delivery styles classified as human support, which differ markedly in their resource requirements (eg, time, cost, and intensity). For this study, we chose 3 support modes to compare, based on low (automated emails), medium (personalized SMS messaging), and high (facilitated videoconference) resource requirements.

Email Support

Emails are widely used [33] and easily incorporated into a Web-based intervention as an asynchronous, low intensity, low cost support method [52]. Notwithstanding, heterogeneity in the way emails are utilized makes comparison difficult, and results are mixed in clinical settings [46,53-55]. For instance, automated emails, often used as engagement prompts, may be built into the system design and require virtually no monitoring once set up. Conversely, personally tailored, individually written emails require effort and time on behalf of the support person and may be considered a more intense mode of support [52].

Short Message Service Support

SMS support varies in intensity depending on the method of dissemination (ie, automated or individualized), however, it is easily accessible and portable [56] through the widespread use of mobile phones. Researchers have used SMS support to aid adherence to medication [57,58], support asthma treatment [59], and promote adherence to healthy lifestyle practices [60] among other uses. A systematic review and meta-analysis of Web-based interventions, that used additional support modes demonstrated that SMS had large effects (d=0.81) compared with phone (d=0.35) and email (d=0.18) [61]. Nevertheless, users may ignore SMS prompts when they are perceived as impersonal, too frequent, or automated [62].

Videoconferencing Support

Videoconferencing most closely replicates the face-to-face setting; however, it requires a greater investment of time, cost, and human resources. Notwithstanding, it may provide a feasible, personal, and acceptable mode of support, similar to face-to-face settings, as long as technical assistance is available [63]. Participants value ease of accessibility and are still able to bond as a group despite lack of various communication cues (eg, body language) [63]. Videoconferencing has been successfully used to support caregivers [64], patients with chronic disease [65], new parents [66], and bariatric surgery patients [67], among others.

Identifying the optimum input of human support resources to maximize program effectiveness is an important consideration for researchers designing MHPIs for nonclinical cohorts. This comparative study seeks to add to the evidence base by asking the question: “What is the influence of different modes of human support on the outcomes of a Web- and mobile app–based MHPI for a healthy, community-based cohort?”


Recruitment

Participants were recruited from an Australian and New Zealand faith-based cohort. Advertising, conducted from July to September 2018, included offline marketing through periodicals, magazines, and bulletins of the faith-based organization and online marketing using a combination of website, social media, and email strategies. Advertising material directed potential applicants to a Web page to examine the inclusion criteria (Textbox 1), acquaint themselves with participation expectations, and fill out an enrollment application.

Approved applicants were randomized into 1 of 3 intervention groups (Figure 1) using computer-generating software. An email notified applicants of acceptance into the study, group allocation, instructions detailing the steps to complete registration on the Web-based electronic learning management system (eLMS), and a unique link to activate the registration process. Informed consent was gained as part of the registration procedure. Once registered, users could opt to download the mobile app and access all features of the intervention, including self-reported questionnaires, from either the eLMS or from the mobile app.

To provide anonymity, participants were permitted to use a pseudo name for the duration of the intervention, if desired. In the S+VCS group, which involved videoconferencing using the app “Zoom,” the participants were given the option to choose a pseudo name and have the camera switched off.

Inclusion criteria.
  • Aged 18 years or older
  • Mobile phone with SMS capability
  • Internet access
  • Australian or New Zealand resident
  • Fluent in English
  • Acceptance to provide informed consent
  • Permission given for anonymous data to be used for research
Textbox 1. Inclusion criteria.
Figure 1. Flow of participants.
View this figure

Study Design

The study was a multiarm, randomized comparative design with 3 intervention groups that differed according to modes of human support:

  1. Group 1: Standard—fully automated emails (S).
  2. Group 2: Standard plus personalized SMS support (S+pSMS).
  3. Group 3: Standard plus videoconferencing support (S+VCS).

Figure 1 shows that participants in each group accessed the intervention simultaneously, from September to December 2018.

Intervention

The 10-week intervention is presented in an audio-visual format and was initially administered in 2017 as a Web-based program on an eLMS. Version 2, released immediately before commencement of this study (August 2018), included an updated eLMS and a mobile app called “MyWellness.” See Multimedia Appendix 1 for screenshots. No new features were introduced during the study period.

The lifestyle-focused intervention is underpinned by the theory of planned behavior (TPB), which has demonstrated substantial health behavior change benefits [61]. The intervention actively seeks to change behavior through education and increase perceived control through easily attainable weekly challenges [24]. Using the pedagogical framework of Learn, Experience, Think, Share, the participants were introduced to basic neuroscience and explored 10 evidence-based strategies from lifestyle medicine and positive psychology for improving mental well-being. Table 1 outlines the weekly topics covered throughout the intervention [68-91].

Participants accessed the intervention free of charge by logging onto the eLMS or the mobile app. Each participant’s personal dashboard provided access to the weekly session, which included approximately 30 min of audio-visual content, a downloadable workbook, and extra reading materials relating to the topic [92]. The intervention emphasized experiential learning by encouraging participants to engage in daily and weekly challenges through which they could log their activity to earn challenge points. Participants were emailed a “timetable overview” (Multimedia Appendix 2), which outlined the recommended schedule to complete the intervention within the 10-week timeframe.

Table 1. Intervention overview.
WeekTopicOverviewDaily challengeWeekly challenge
1Speak positively (your limbo is listening)
  • Limbic system introduction—the “emotional brain”
  • Limbic system is “wired” to language area of brain [68,69]
Offer a genuine compliment.Memorize an inspirational text or saying.
2Move dynamically (motion creates emotion)
  • Proprioceptors (nerve cells that detect movement) pass through the limbic system
  • Movement (even just 10 min) improves mood [70-73]
Complete 30 min of moderate-intensity activity.Perform resistance exercises once during week (exercises demonstrated on video).
3Immerse in an uplifting natural environment (blue and green should often be seen)
  • The limbic system receives messages from all the senses
  • The limbic system likes blue and green spaces (ie, natural settings)
  • The limbic system needs about 30 min of 10,000 LUX of light daily [74-76]
Immerse in an uplifting natural environment for 30 min daily.Watch a sunrise from an appealing blue or green location.
4Immerse in a positive social environment (together feels better)
  • Limbic systems communicate
  • Create positive social environments by making new friends or strengthening existing relationships
  • Forgiveness [77-79]
Daily, do something intentional to show a friend or family member they are loved (use their love language).Give up your right to hurt someone who has hurt you (Act of forgiveness).
5Look to the positive (feelings follow your focus)
  • “Emotional brain” is wired to “Thinking brain”
  • What you focus on affects how you feel
  • Upward or downward spirals [21,45,80-82]
Write down 3 things that went well today “What Went Well?”Gratitude visit—identify someone you are grateful to, write a gratitude letter to them, deliver and read in person, if possible.
6Eat nutritiously (food feeds your mood)
  • Gut bacteria linked to mood
  • Feed gut bacteria high fiber diet
  • Plant-based foods are high fiber
  • Eat a wide variety of fruit, vegetables, legumes, and grains [16,17,83,84]
Eat 8 fists full of fiber daily.Prepare and share a high-fiber plant-based meal with one or more friends.
7Rest—sleep (rest to feel your best)
  • Sleep is fundamental for feeling upbeat (7-8 hours optimal)
  • Blue light vs yellow/orange light
  • Caffeine, lack of physical activity, and blue light—deprived sleep [85,86]
Spend 8 hours in bed every night.Spend an evening by firelight.
8Rest—from stress (stress less)
  • SMILERS strategies “open the valves”
  • Physical activity, practicing mindfulness, laughing, and rest day [13,51,87,88]
15-min “sit in silence” mindful activity.Take a “guilt-free” day off.
9Serve others (giving is living)
  • Contributing/serving is emotionally uplifting
  • Serve sustainably using signature strengths [89-91]
Perform 1 or more random acts of kindness each day.Use your significant strength to perform a significant act of service.
10What does it take to flourish?Five areas to flourish: PEARM—positive emotions, engagement, achievement, relationships, and meaning [90]Spend time engaging in something you enjoy.Create a list of goals and an action plan to achieve them.

Persuasive Systems Design Features

Features of Persuasive Systems Design (PSD) were key to the intervention, and numerous support principles were utilized on the Web platform and mobile app to encourage behavior change. The PSD model, developed by Oinas-Kukkonen and Harjumaa [93], is largely based on earlier work by Fogg [94]. The model outlines a taxonomy of 28 principles, classified under 4 key areas of support, for designing completely digital, behavioral change interventions. “Primary Task Support” components of PSD included the use of “reduction” to simplify key learnings into practical strategies for implementation, along with “self-monitoring” and “rehearsing” desired behaviors in the form of daily and weekly challenges that were recorded on the eLMS or app. An element of “Dialogue Support” [93] utilized was “rewards” in the form of badge icons. “Social Support” elements of PSD [93] provided opportunities for various forms of interaction. Participants could choose to post challenge activity to a public “feed” (viewable by other group members) providing “social learning” and “social facilitation” opportunities. Furthermore, challenges posted as “public” provided opportunity for interaction between group members. “Competition” and “social comparison” were aroused through a challenge points leader board.

Human Support

Human support was crafted to reflect values of the Supportive Accountability Model (SAM), developed by Mohr et al [34]. They propose a range of support measures to improve adherence, including focusing on process expectations rather than outcome expectations, positive feedback provision, avoidance of controlling behavior, timely communication, being trustworthy, facilitating engaging discussions, and avoidance of pressure tactics [34].

Advertising Period

During the advertising period, the mobile app “Hitemup” was used to send enrollees (ie, those who had registered interest in joining the study) weekly, personalized SMS communication to remind them of the upcoming program.

Orientation and Registration Period

During orientation week, all enrollees were sent an email link to register onto the eLMS to finalize registration and complete the preintervention questionnaire. A total of 2 SMS reminders were sent, several days apart, as reminders to register.

On the intervention start date, a “welcome” email and SMS were sent to all registered participants outlining the steps to access the first session. In addition, within the first 2 weeks of the intervention, those who had not yet completed registration were sent 4 reminder SMSs and email messages inviting them to access the provided link to complete registration. Once participants completed registration, human support reverted to the constraints outlined for each group, and the eLMS was used to send SMS and automated email messages to registered participants.

Group 1 Support: Automated Emails—Standard

Automated emails, which are the routine communication mode outside the research setting, were set up as part of the eLMS. All participants received a weekly email on the day before the next session commencing. The email included a link to a 20 to 25 second video by the presenter, inviting them to engage with the next presentation. A total of 3 days after a lesson was released, the system checked to see if the participant had logged any challenges: if “yes,” participants were sent an email validating their participation, if “no,” an email prompted the participant to complete the relevant challenge. A total of 8 days after a new lesson was released, participants who had not watched the video were sent an email reminder.

Group 2 Support: Standard Plus Personalized SMS Messages)

The S+pSMS group received automated emails plus SMS messages that were sent 3 times weekly for the first 3 weeks and then 2 times weekly for the remaining 7 weeks. The reduction from 3 messages per week to 2 messages per week recognized the notion that support may have a threshold [34]; too many messages may be seen as controlling and undermine the commitment of individuals, therefore impairing engagement [34]. The messages focused on process accountability (ie, completing target behaviors such as viewing content and engaging in experiential learning) as opposed to outcome accountability, which may be detrimental and beyond an individual’s control [34].

Each SMS included the participant’s first name, a predetermined message to prompt engagement, and was signed by the research team member (MR) who also provided technical assistance. Specific message content included different combinations of the following: a brief hook sentence (eg, Lesson 2—Learn 3 practical tips to calm your nerves, Lesson 3—Have you had your dose of lux today?), the link to log into the eLMS, an inspiring quote, tips for implementing challenge activity, and a phone number for technical assistance.

Group 3 Support: Standard Plus Videoconference Support

As well as automated email support, participants in the S+VCS group were invited to attend a synchronous, videoconference session using the app “Zoom.” A weekly timetable (Multimedia Appendix 3) provided 9 different time possibilities, and participants were invited to attend any one of these. During orientation week, participants were encouraged to attend 1 of 9 available “tech check” sessions. Each week, participants were sent 1 reminder SMS and an email with a link to the online meeting. Discussion sessions lasted 20 to 30 min and were led by an experienced educator who holds a post-graduate degree in lifestyle medicine. The facilitator had previously hosted many preventative health videoconferences for participant groups doing the renowned Complete Health Improvement Program. Prior training included 6 mentoring sessions on how to facilitate successful videoconferences in a Web-based setting. The videoconference support sessions included a recap of the weekly content by the facilitator, sharing new learnings and challenge experiences, plus dialogue on ways to incorporate strategies learned into everyday life.

Measurement—Outcomes

Participants completed a self-report questionnaire, the “7 Dimensions of Wellness Index” (7DWI), at preintervention (week 0) and postintervention (week 12). The 7DWI combines demographic- and lifestyle-related questions with various, freely available, validated instruments that measure 7 well-being domains (emotional, physical, social, spiritual, vocational, intellectual, and environmental). For the purpose of this study, the following instruments were utilized from the 7DWI to measure aspects of mental well-being:

36-Item Short Form Survey

The 36-item Short Form Health Survey (SF-36) is suitable for use in general population surveys [95], and 2 subscales of the SF-36 were used for this study: mental health (5 items) and vitality (4 items) [96]. Good internal consistency and reliability across the whole survey and subscales have been reported [97]. Cronbach alpha scores of .90 for the mental health subscale and .87 for the vitality subscale are well above the minimum reliability standard (.50-.70) [98].

21-Item Depression Anxiety and Stress Scale

The 21-item Depression Anxiety and Stress Scale (DASS-21) is widely used to measure depression, anxiety, and stress (7 items per factor), and satisfactory reliability has been demonstrated for both clinical and nonclinical samples [99-101]. The DASS has demonstrated adequate internal consistency as a total scale (Cronbach alpha >.90) [102] and for the 3 subscales, with Cronbach alpha scores ranging from .76 to .91 [99,101].

Satisfaction With Life Scale

Diener 5-item Satisfaction With Life Scale (SWLS) measures global life satisfaction and was initially tested on a nonclinical group of university students [103]. Good internal consistency was found (Cronbach alpha .87) [103], and the SWLS was deemed suitable for a wide range of age groups and settings [104]. Data from 6 studies indicated that the scale has high internal consistency (Cronbach alpha ranged from .79-.89) [105]. Furthermore, a meta-analysis of 62 articles provided 76 reliability coefficients testing the SWLS. The mean Cronbach alpha was .78—signifying good internal consistency [106].

Flourishing Scale (Diener)

Diener brief 8-item Flourishing Scale, designed to measure ”social-psychological prosperity,” is suitable for nonclinical cohorts, correlates highly with other measures of well-being, and demonstrates good internal consistency under initial analysis (Cronbach alpha .87) [107]. The Flourishing Scale has a unidimensional factor structure, and more recent analysis, across 2 samples, also showed good consistency (.78 and .83) [108].

Measurement—Adherence

Primary adherence was measured as the total number of weekly videos viewed out of a possible ten presentations. Challenge adherence was also measured, with participants able to accumulate points through practical daily and weekly challenge activities. Each daily challenge was worth 10 points, and weekly challenges were worth 30 points. Participants could score a maximum of 100 points each week throughout the 10-week intervention, thereby accumulating a total of 1000 points to be considered fully adherent. In addition, for the S+VCS group, videoconference attendance was recorded as a score out of 10.

Sample Size

The a priori power analysis indicated a required sample size of 148 participants in each arm of the study. This calculation was based on the following assumptions or requirements and relied on data from previous studies [24,26]: (1) participants were to be allocated equally between the 3 arms; (2) an ability to detect a 15% improvement in the mental health and vitality scales, as this was considered a clinically significant outcome [24]; (3) a 30% attrition rate, based on attrition rates observed in a prior similar study [26]; (4) a power level of ≥80%; (5) significance level of 0.05 (95% CI); and (6) a distribution SD of 16.1 in the mental health subscale, based on a prior study [24].

Randomization

Participants were randomized by a person not on the research team using computer random number generation. Equitable distribution of age and gender was tested and confirmed, negating the need for further stratification. The 3 randomized groups were allocated to a study arm by the person who conducted randomization. Researchers and participants were unblinded, and participants were notified of the mode of support they would receive during registration. As there was no control group, all groups were comparators of interest.

Statistical Analysis

Data were analyzed using the IBM SPSS Statistics Software (version 25). Within-group changes from baseline to post intervention were calculated using paired t tests, and repeated measures generalized linear models were used to measure analysis of variance between groups, taking into account time and group effects. Cohen d was used to measure effect size, and Fisher Exact test was used to test for relationships between the categorical variables. The 458 participants who completed the preintervention questionnaire were included in the analysis of baseline characteristics. All remaining analyses included only the participants who completed both preintervention and postintervention measures (n=320). This manuscript was prepared according to Consolidated Standards of Reporting Trials (CONSORT) guidelines [109] and utilized the CONSORT-EHEALTH checklist (Multimedia Appendix 4).

Ethics and Informed Consent

Ethics approval was granted from the Avondale Human Research Ethics Committee (Approval No. 2018.09). Prospective participants were emailed an “information statement” outlining the details of the study and an “informed consent statement” notifying them that choosing to register onto the eLMS would signify informed consent.


Participants

Figure 1 records the flow of participants throughout the intervention period. Potential participants (n=605) were enrolled through the information Web page and were randomized into 3 groups: S (n=202), S+pSMS (n=202), and S+VCS (n=201). A total of 458 participants registered on the eLMS, completed the preintervention questionnaire, and were analyzed for baseline characteristics (S=157, S+pSMS=163, and S+VCS=138). At 12 weeks, 320 out of 458 (69.9%) participants had completed both the pre- and postintervention questionnaire required for postanalysis (S=103, S+pSMS=114, and S+VCS=103).

Baseline Characteristics

Table 2 describes the demographic and mental health characteristics of the study group at baseline. Fisher Exact tests demonstrated no significant between-group differences in any of the categorical characteristics of the study population. With a mean age of 45.5 (SD 13.7) years, participants were predominantly female (77.7%, 356/458), white (76.9%, 352/458), and had a tertiary education (78.0%, 357/458). There were no significant differences between the groups in any of the psychometric measures at baseline (Table 2).

Table 2. Baseline characteristics of the study population.
FactorStandard automated email group (S; n=157)Standard plus SMS message group (S+pSMS; n=163)Standard plus videoconference support group (S+VCS; n=138)Combined groups (N=458)Analysis of variance or Fisher Exact test, P value
Age (years), mean (SD) 45.6 (13.9)46.5 (13.4)44.3 (13.9)45.5 (13.7).19
Gender, n (%)



.82

Female124 (79.0)126 (77.3)106 (76.8)356 (77.7)

Male33 (21.0)37 (22.7)31 (22.5)101 (22.1)

Other0 (0)0 (0)1 (0.7)1 (0.2)
Education, n (%)



.16

Primary or elementary0 (0)2 (1.2)0 (0)2 (0.4)

Secondary or high school36 (22.9)39 (23.9)24 (17.4)99 (21.6)

Tertiary undergraduate74 (47.2)65 (39.9)75 (54.3)214 (46.7)

Tertiary postgraduate47 (29.9)57 (35.0)39 (28.3)143 (31.3)
Ethnicity, n (%)



.34

White124 (79.0)118 (72.4)110 (79.7)352 (76.9)

Maori/Pacific Islander12 (7.6)16 (9.8)7 (5.1)35 (7.6)

Asian5 (3.2)11 (6.7)2 (1.4)18 (3.9)

Black African/American4 (2.5)3 (1.8)3 (2.2)10 (2.2)

Indigenous0 (0)0 (0)1 (0.7)1 (0.2)

Spanish, Hispanic, Latino5 (3.2)3 (1.8)4 (2.9)12 (2.6)

Other7 (4.5)12 (7.5)11 (8.0)30 (6.6)
Outcome measures, mean (SD)




Mental Health64.4 (17.3)65.7 (17.5)64.6 (16.5)64.9 (17.1)>.99

Vitality58.5 (17.4)60.2 (17.4)58.6 (17.2)59.1 (17.3).59

Depression3.8 (3.7)4.0 (4.1)3.9 (3.5)3.9 (3.8).50

Anxiety2.8 (2.9)2.5 (2.6)2.5 (2.8)2.6 (2.7).83

Stress5.7 (3.6)5.7 (3.6)5.9 (3.4)5.7 (3.5).67

Flourishing45.2 (7.1)45.1 (6.8)44.5 (6.3)45.0 (6.7).10

Satisfaction With Life23.4 (6.9)22.5 (7.3)22.5 (7.0)22.8 (7.1).73

Measurement—Outcomes

Significant within-group improvements were recorded from pre- to postintervention in all groups and across all domains of mental well-being measured (Table 3). Within-group improvements ranged from medium to large effect sizes (Cohen d), with flourishing (d=0.64), mental health (d=0.67), and vitality (d=0.74) demonstrating the largest effect. No significant between-group differences were observed for any of the outcome measures (Table 3).

Table 3. Pre- to postchanges in outcome measures of participants and between-group differences.
Outcome MeasureNPre, mean (SD)Post, mean (SD)Mean changeChange (%)Within-group change, P value Within-group change, Cohen dBetween-group difference, P value
Mental health






.77

Gr 1 standard—Emails10365.2 (16.4)74.8 (15.2)9.614.7<.0010.72

Gr 2 Standard plus pSMSa11467.3 (16.7)76.1 (13.3)8.813.1<.0010.69

Gr 3 Standard plus VCSb10366.0 (15.3)74.2 (14.9)8.212.4<.0010.61

Combined32066.2 (16.1)75.1 (14.4)8.913.4<.0010.67
Vitality






.65

Gr 1 Standard—Emails10358.7 (16.8)69.6 (15.8)10.918.6<.0010.78

Gr 2 Standard plus pSMS11461.8 (16.5)71.9 (13.7)10.116.3<.0010.81

Gr 3 Standard plus VCS10360.1 (16.1)69.2 (15.4)9.115.1<.0010.63

Combined32060.3 (16.5)70.3 (15.0)10.016.6<.0010.74
Depression






.93

Gr 1 Standard—Emails1033.5 (3.4)2.2 (2.6) −1.3−37.1<.0010.44

Gr 2 Standard plus pSMS1143.5 (3.5)2.1 (2.7)−1.4−40.0<.0010.51

Gr 3 Standard plus VCS1033.6 (3.3)2.2 (2.7)−1.4−38.9<.0010.50

Combined3203.5 (3.4)2.2 (2.7)−1.3−37.1<.0010.48
Anxiety






.25

Gr 1 Standard—Emails1032.7 (2.6)1.5 (1.8)−1.2−44.4<.0010.52

Gr 2 Standard plus pSMS1142.1 (2.1)1.4 (1.8)−0.7−33.3<.0010.35

Gr 3 Standard plus VCS1032.2 (2.5)1.3 (1.6)−0.9−40.9<.0010.43

Combined3202.3 (2.4)1.4 (1.7)−0.9−39.1<.0010.43
Stress






.57

Gr 1 Standard—Emails1035.8 (3.5)4.3 (3.1)−1.5−25.9<.0010.46

Gr 2 Standard plus pSMS1145.5 (3.4)4.1 (3.0)−1.4−25.5<.0010.47

Gr 3 Standard plus VCS1036.0 (3.2)4.2 (3.0)−1.8−30.0<.0010.60

Combined3205.7 (3.4)4.2 (3.0)−1.5−26.3<.0010.51
Satisfaction With Life






.65

Gr 1 Standard – Emails10323.2 (6.8)25.6 (6.3)2.410.3<.0010.50

Gr 2 Standard plus pSMS11423.1 (7.2)26.0 (6.6)2.912.6<.0010.64

Gr 3 Standard plus VCS10322.9 (6.9)25.5 (6.5)2.611.4<.0010.57

Combined32023.1 (6.9)25.7 (6.5)2.611.3<.0010.58
Flourishing






.99

Gr 1 Standard—Emails10345.2 (6.7)48.1 (5.0)2.96.4<.0010.61

Gr 2 Standard plus pSMS11445.1 (7.0)48.1 (6.1)3.06.7<.0010.65

Gr 3 Standard plus VCS10344.8 (6.2)47.8 (5.9)3.06.7<.0010.64

Combined32045.0 (6.6)48.0 (5.7)3.06.7<.0010.64

apSMS: personalized SMS.

bVCS: videoconferencing support.

Measurement—Adherence

Adherence was not significantly different between groups for mean videos watched (P=.42) or mean total challenge points scored (P=.71). However, there was notable variability in responses as indicated by the large SDs: videos watched out of 10 (S=6.05 (SD 4.0), S+pSMS=6.48 (SD 3.9), S+VCS=6.75 (SD 3.8); challenge scores out of 1000 (S=369 (SD 362), S+pSMS=340 (SD 339), S+VCS=377 (SD 354).

In the S+VCS group, mean VCSS attendance was 2.8 out of 10, and 37 out of 103 participants (35.9%) had zero attendance. Just 19 out of 103 participants (18.4%) attended 7 or more VCSSs. Secondary analysis revealed participants who attended more than 7 VCSSs, compared with those who attended 6 or less, demonstrated significantly greater improvements in the measures of mental health (P=.006; d=0.71), vitality (P=.005; d=0.73) depression (P=.04; d=0.54), and satisfaction with life (P=.046; d=0.50).


Principal Findings

This study compared the influence of 3 modes of human support on the outcomes of a Web- and mobile app–based, lifestyle-focused mental health intervention for a healthy adult cohort. Significant improvements in all domains of mental well-being were recorded in all groups, but the mode of human support had no effect. However, attendance at the VCSSs was low, hindering the ability to draw comparisons.

The study population could be classified as healthy (ie, normal), as evidenced by baseline DASS scores that were within the normal range: depression, mean=3.5 (normal 0-4); anxiety, mean=2.1 (normal 0-3); stress, mean=5.7 (normal 0-7). Notably, despite the “healthy” starting point, medium to large effect size improvements were observed. The results of this study are similar to 2 pilot trials [24,25] and an RCT [26] using the same intervention. Medium to large effects may be due, at least in part, to the multimodal nature of the intervention producing a compounding effect [24]. As the intervention embeds a combination of evidence-based strategies from lifestyle medicine and positive psychology for improving mental well-being, the overall effect of the intervention could be expected to exceed that of a single modality approach.

Videoconferencing has been successfully used as a form of support in various settings, but the sessions were not well attended in this study. Previous research highlights the benefits of videoconferencing as a feasible and acceptable mode of support as long as technology assistance is provided [63]. Benefits include enhanced group bonding, peer observation, personal sharing, and a higher social presence when compared with other forms of digital support [63]. However, although videoconferencing has been used as an effective method to support caregivers [64], chronic disease patients [65], new mothers [66], and postsurgical patients [67], it was underutilized in this intervention.

Several factors may have contributed to the underutilization of the VCSSs. First, Web-based interventions are essentially “pull” technologies, relying on the participant to initiate access to the intervention [110]. Conversely, human support features generally “push” participants to engage with a digital intervention [110]. Within this study, automated emails and SMS messages served as “push” strategies, requiring no effort on the part of the participant. However, videoconferencing support is a “pull” device that required participants to actively seek engagement by attending the scheduled session, and this may have been a contributing factor in low engagement. Second, to overcome potential scheduling barriers, 9 sessions were offered within a week, but this did not translate into higher levels of participation and may have negatively impacted development of group dynamics and peer interaction. Participants could choose to attend any of the 9 sessions offered, which meant group bonding, a known videoconference advantage [63], may have been impeded by a lack of continuity in attendance within each time slot. Notwithstanding, a myriad of other factors may have negatively impacted VCSS engagement, such as time constraints, confidence to use technology, privacy or exposure concerns, and perceptions about effectiveness [63,111]. Undoubtedly, adherence is dynamic in nature [56], and many interindividual variations are still unexplained [49]. The low attendance at the VCSSs highlights the need to investigate engagement facilitators and barriers more thoroughly. Given that the majority of the S+VCS group participants (82%) did not engage regularly with the support provided, this group, in effect, received a comparable level of support with the S group (automated emails), hampering between-group comparability.

Stratified within-group analysis in the S+VCS group showed significantly greater improvement in depression, mental health, vitality, and satisfaction with life metrics for those who attended 7 or more VCSSs. Nevertheless, the results need to be treated with caution because the stratified subgroup is self-selected, no longer randomized, and therefore subject to bias. In addition, the small number of participants and unknown contributing factors (eg, motivation) make drawing conclusions problematic. Elucidating the reasons why participants chose to engage, or not, with videoconferencing support would be an important topic for further research.

Despite the lack of influence of human support in this study, the multimodal intervention demonstrated statistically significant improvement across all groups in all outcome measures, with medium to large effect sizes. Strengthened by results of previous pilot studies [24,25] and the RCT in 2017 [26], it may be feasible to trial the lifestyle-based intervention in primary prevention or clinical settings in the future to attenuate symptoms for those who are at high risk or already suffering from a disorder.

Strengths and Limitations

The intervention, Web design, and additional human support used in this study were underpinned by theoretical models, including the TPB [112], a framework for PSD [93], and key principles of the SAM [34]. Consistency in the VCSSs was enhanced by using 1 experienced, online group facilitator rather than multiple facilitators of varying skill levels. In addition, the study population included a large homogenous cohort, and this was further strengthened by a wide range of age groups from 18 to 81 years.

Limitations included low attendance at VCSSs, which meant that many S+VCS group members probably experienced the intervention similarly to the S group (automated emails), negatively impacting the ability to make meaningful between-group comparisons. Notably, the previous RCT in 2017 [26] demonstrated similar statistically significant improvements within the intervention group to what was seen within the 3 groups of this study. Both the RCT and this study commenced with cohorts who were considered “normal” (indicated by the DASS scores). Conceivably, in adding human support, a ceiling effect was observed, and gauging further improvements above and beyond the benefits of the intervention itself were not realistically measurable.

The cohort were predominantly Seventh-day Adventist church members, which diminishes generalizability to other population groups because of commonly held lifestyle practices (eg, no alcohol or tobacco). Furthermore, participants were skewed toward white females and those who held a tertiary qualification. Although such demographics are commonly portrayed in digital interventions [113,114], these factors limit the generalizability of findings to the broader population. Participants were unblinded, and the study relied on self-reporting for all instruments, which comes with risk of reporting biases (eg, poor recall), and participants are sometimes unaware of their own personal motives and behavior [56].

Other limitations include the failure to measure how participants engaged with automated emails or SMS messages. In addition, we did not gather data regarding the proportion of participants who accessed the program using the mobile app as an alternative to the Web-based platform, which would have been a useful comparison. In future applications, a postintervention survey should include questions regarding the use and preferences for the delivery systems (ie, computer or mobile app), plus participant perceptions regarding the influence of and personal engagement with email and SMS messaging. It would also be important to administer the intervention to a broader population sample to improve generalizability.

Conclusions

The findings of this study strengthen the rationale for Web- and mobile app–based interventions as easily accessible and scalable mental health promotion initiatives. The study demonstrated that a lifestyle-focused intervention improved the mental well-being of a healthy cohort, irrespective of human support. Low VCSS attendance reduced the ability to draw meaningful between-group comparisons, and hence, the influence of different human support modes, although SMS messages provided no significant benefit over automated email support. Stratified analysis demonstrated that regular attendance at a VCSS might be a possible method to enhance outcomes; however, more research is needed regarding factors that influence engagement with that mode of support.

Acknowledgments

The authors would like to thank the volunteer participants, the Web development team, and the Seventh-day Adventist Church Health department of the South Pacific Division that provided technical support and free access to the intervention on the eLMS and mobile app.

Conflicts of Interest

GP is employed by the South Pacific Division of the Seventh-day Adventist Church, which promotes and directs the intervention among members and the wider community. DM administers a “profit-for-purpose” Trust using a version of the intervention; he receives no personal financial remuneration. No authors have a financial interest in the intervention and no other authors have conflicts of interest to declare.

Multimedia Appendix 1

Website and app screenshots.

PPTX File , 4354 KB

Multimedia Appendix 2

Timetable overview.

DOCX File , 14 KB

Multimedia Appendix 3

Videoconference meeting schedule.

PDF File (Adobe PDF File), 178 KB

Multimedia Appendix 4

CONSORT-EHEALTH checklist (V1.6.1).

PDF File (Adobe PDF File), 283 KB

  1. World Health Organization. 2013. Comprehensive Mental Health Action Plan 2013-2020   URL: https://www.who.int/mental_health/action_plan_2013/en/ [accessed 2019-07-17]
  2. World Health Organization. 2018. Mental Disorders   URL: https://www.who.int/en/news-room/fact-sheets/detail/mental-disorders [accessed 2019-07-17]
  3. World Health Organization. 2018. Depression   URL: https://www.who.int/en/news-room/fact-sheets/detail/depression [accessed 2019-07-11]
  4. Jorm AF, Patten SB, Brugha TS, Mojtabai R. Has increased provision of treatment reduced the prevalence of common mental disorders? Review of the evidence from four countries. World Psychiatry 2017 Feb;16(1):90-99 [FREE Full text] [CrossRef] [Medline]
  5. Stephenson CP, Karanges E, McGregor IS. Trends in the utilisation of psychotropic medications in Australia from 2000 to 2011. Aust N Z J Psychiatry 2013 Jan;47(1):74-87. [CrossRef] [Medline]
  6. O'Neil A, Jacka FN, Quirk SE, Cocker F, Taylor CB, Oldenburg B, et al. A shared framework for the common mental disorders and Non-Communicable Disease: key considerations for disease prevention and control. BMC Psychiatry 2015 Feb 5;15:15 [FREE Full text] [CrossRef] [Medline]
  7. Finley CR, Chan DS, Garrison S, Korownyk C, Kolber MR, Campbell S, et al. What are the most common conditions in primary care? Systematic review. Can Fam Physician 2018 Nov;64(11):832-840 [FREE Full text] [Medline]
  8. Australian Psychological Society. Heads Up. Stress & Wellbeing: How Australians Are Coping With Life   URL: https:/​/www.​headsup.org.au/​docs/​default-source/​default-document-library/​stress-and-wellbeing-in-australia-report.​pdf?sfvrsn=7f08274d_4 [accessed 2017-07-25]
  9. Hu C, Kung S, Rummans TA, Clark MM, Lapid MI. Reducing caregiver stress with internet-based interventions: a systematic review of open-label and randomized controlled trials. J Am Med Inform Assoc 2015 Apr;22(e1):e194-e209. [CrossRef] [Medline]
  10. Harrer M, Adam SH, Fleischmann RJ, Baumeister H, Auerbach R, Bruffaerts R, et al. Effectiveness of an internet- and app-based intervention for college students with elevated stress: randomized controlled trial. J Med Internet Res 2018 Apr 23;20(4):e136 [FREE Full text] [CrossRef] [Medline]
  11. Hintz S, Frazier PA, Meredith L. Evaluating an online stress management intervention for college students. J Couns Psychol 2015 Apr;62(2):137-147. [CrossRef] [Medline]
  12. Bhayee S, Tomaszewski P, Lee DH, Moffat G, Pino L, Moreno S, et al. Attentional and affective consequences of technology supported mindfulness training: a randomised, active control, efficacy trial. BMC Psychol 2016 Nov 29;4(1):60 [FREE Full text] [CrossRef] [Medline]
  13. Keng S, Smoski MJ, Robins CJ. Effects of mindfulness on psychological health: a review of empirical studies. Clin Psychol Rev 2011 Aug;31(6):1041-1056 [FREE Full text] [CrossRef] [Medline]
  14. Galante J, Dufour G, Vainre M, Wagner AP, Stochl J, Benton A, et al. A mindfulness-based intervention to increase resilience to stress in university students (the Mindful Student Study): a pragmatic randomised controlled trial. Lancet Public Health 2018 Feb;3(2):e72-e81 [FREE Full text] [CrossRef] [Medline]
  15. Wahbeh H, Oken BS. Internet mindfulness meditation intervention for the general public: pilot randomized controlled trial. JMIR Ment Health 2016 Aug 8;3(3):e37 [FREE Full text] [CrossRef] [Medline]
  16. Blanchflower DG, Oswald AJ, Stewart-Brown S. Is psychological well-being linked to the consumption of fruit and vegetables? Soc Indic Res 2012 Oct;114(3):785-801. [CrossRef]
  17. White BA, Horwath CC, Conner TS. Many apples a day keep the blues away--daily experiences of negative and positive affect and food consumption in young adults. Br J Health Psychol 2013 Nov;18(4):782-798. [CrossRef] [Medline]
  18. Mammen G, Faulkner G. Physical activity and the prevention of depression: a systematic review of prospective studies. Am J Prev Med 2013 Nov;45(5):649-657. [CrossRef] [Medline]
  19. Stubbs B, Vancampfort D, Rosenbaum S, Ward PB, Richards J, Ussher M, et al. Challenges establishing the efficacy of exercise as an antidepressant treatment: a systematic review and meta-analysis of control group responses in exercise randomised controlled trials. Sports Med 2016 May;46(5):699-713. [CrossRef] [Medline]
  20. Lyubomirsky S, Dickerhoof R, Boehm JK, Sheldon KM. Becoming happier takes both a will and a proper way: an experimental longitudinal intervention to boost well-being. Emotion 2011 Apr;11(2):391-402 [FREE Full text] [CrossRef] [Medline]
  21. Proyer RT, Gander F, Wellenzohn S, Ruch W. Positive psychology interventions in people aged 50-79 years: long-term effects of placebo-controlled online interventions on well-being and depression. Aging Ment Health 2014;18(8):997-1005. [CrossRef] [Medline]
  22. Gander F, Proyer RT, Ruch W. Positive psychology interventions addressing pleasure, engagement, meaning, positive relationships, and accomplishment increase well-being and ameliorate depressive symptoms: a randomized, placebo-controlled online study. Front Psychol 2016;7:686 [FREE Full text] [CrossRef] [Medline]
  23. Morton DP. Combining Lifestyle Medicine and Positive Psychology to Improve Mental Health and Emotional Well-being. Am J Lifestyle Med 2018;12(5):370-374 [FREE Full text] [CrossRef] [Medline]
  24. Morton DP, Hinze J, Craig B, Herman W, Kent L, Beamish P, et al. A multimodal intervention for improving the mental health and emotional well-being of college students. Am J Lifestyle Med 2017. [CrossRef]
  25. Hinze J, Morton D. Wellbeing education for educators. TEACH J Christian Educ 2017;11(2):50-57 [FREE Full text]
  26. Przybylko G, Morton D, Kent L, Morton J, Hinze J, Beamish P, et al. The effect of an online multimodal lifestyle intervention on mental health and emotional wellness: A randomised control trial. 2018 Presented at: Poster presented at the American College of Lifestyle Medicine Conference; Oct 21-24; Indianapolis, Indiana.
  27. Romero-Sanchiz P, Nogueira-Arjona R, García-Ruiz A, Luciano JV, Campayo JG, Gili M, et al. Economic evaluation of a guided and unguided internet-based CBT intervention for major depression: results from a multi-center, three-armed randomized controlled trial conducted in primary care. PLoS One 2017;12(2):e0172741 [FREE Full text] [CrossRef] [Medline]
  28. Woodworth RJ, O'Brien-Malone A, Diamond MR, Schüz B. Web-based positive psychology interventions: a reexamination of effectiveness. J Clin Psychol 2017 Mar;73(3):218-232. [CrossRef] [Medline]
  29. Choi I, Sharpe L, Li S, Hunt C. Acceptability of psychological treatment to Chinese- and Caucasian-Australians: internet treatment reduces barriers but face-to-face care is preferred. Soc Psychiatry Psychiatr Epidemiol 2015 Jan;50(1):77-87. [CrossRef] [Medline]
  30. Ebert DD, Cuijpers P, Muñoz RF, Baumeister H. Prevention of mental health disorders using internet- and mobile-based interventions: a narrative review and recommendations for future research. Front Psychiatry 2017;8:116 [FREE Full text] [CrossRef] [Medline]
  31. Apolinário-Hagen J, Harrer M, Kählke F, Fritsche L, Salewski C, Ebert DD. Public attitudes toward guided internet-based therapies: web-based survey study. JMIR Ment Health 2018 May 15;5(2):e10735 [FREE Full text] [CrossRef] [Medline]
  32. Ebert DD, van Daele T, Nordgreen T, Karekla M, Compare A, Zarbo C, et al. Internet- and mobile-based psychological interventions: applications, efficacy, and potential for improving mental health. Eur Psychol 2018;23(2):167-187. [CrossRef]
  33. Shim M, Mahaffey B, Bleidistel M, Gonzalez A. A scoping review of human-support factors in the context of Internet-based psychological interventions (IPIs) for depression and anxiety disorders. Clin Psychol Rev 2017 Nov;57:129-140. [CrossRef] [Medline]
  34. Mohr DC, Cuijpers P, Lehman K. Supportive accountability: a model for providing human support to enhance adherence to eHealth interventions. J Med Internet Res 2011 Mar 10;13(1):e30 [FREE Full text] [CrossRef] [Medline]
  35. Baumeister H, Reichler L, Munzinger M, Lin J. The impact of guidance on Internet-based mental health interventions — A systematic review. Internet Interv 2014;1(4):205-215 [FREE Full text] [CrossRef]
  36. Richards D, Richardson T. Computer-based psychological treatments for depression: a systematic review and meta-analysis. Clin Psychol Rev 2012 Jun;32(4):329-342. [CrossRef] [Medline]
  37. Johansson R, Andersson G. Internet-based psychological treatments for depression. Expert Rev Neurother 2012 Jul;12(7):861-9; quiz 870. [CrossRef] [Medline]
  38. Andersson G, Cuijpers P. Internet-based and other computerized psychological treatments for adult depression: a meta-analysis. Cogn Behav Ther 2009;38(4):196-205. [CrossRef] [Medline]
  39. Alkhaldi G, Hamilton FL, Lau R, Webster R, Michie S, Murray E. The effectiveness of prompts to promote engagement with digital interventions: a systematic review. J Med Internet Res 2016 Jan 8;18(1):e6 [FREE Full text] [CrossRef] [Medline]
  40. Josephine K, Josefine L, Philipp D, David E, Harald B. Internet- and mobile-based depression interventions for people with diagnosed depression: a systematic review and meta-analysis. J Affect Disord 2017 Dec 1;223:28-40. [CrossRef] [Medline]
  41. Mohr DC, Duffecy J, Ho J, Kwasny M, Cai X, Burns MN, et al. A randomized controlled trial evaluating a manualized TeleCoaching protocol for improving adherence to a web-based intervention for the treatment of depression. PLoS One 2013;8(8):e70086 [FREE Full text] [CrossRef] [Medline]
  42. Titov N, Dear BF, Staples LG, Terides MD, Karin E, Sheehan J, et al. Disorder-specific versus transdiagnostic and clinician-guided versus self-guided treatment for major depressive disorder and comorbid anxiety disorders: A randomized controlled trial. J Anxiety Disord 2015 Oct;35:88-102 [FREE Full text] [CrossRef] [Medline]
  43. Titov N, Fogliati VJ, Staples LG, Gandy M, Johnston L, Wootton B, et al. Treating anxiety and depression in older adults: randomised controlled trial comparing guided . self-guided internet-delivered cognitive-behavioural therapy. BJPsych Open 2016 Jan;2(1):50-58 [FREE Full text] [CrossRef] [Medline]
  44. Dear BF, Staples LG, Terides MD, Fogliati VJ, Sheehan J, Johnston L, et al. Transdiagnostic versus disorder-specific and clinician-guided versus self-guided internet-delivered treatment for Social Anxiety Disorder and comorbid disorders: A randomized controlled trial. J Anxiety Disord 2016 Aug;42:30-44 [FREE Full text] [CrossRef] [Medline]
  45. Garland EL, Fredrickson B, Kring AM, Johnson DP, Meyer PS, Penn DL. Upward spirals of positive emotions counter downward spirals of negativity: insights from the broaden-and-build theory and affective neuroscience on the treatment of emotion dysfunctions and deficits in psychopathology. Clin Psychol Rev 2010 Nov;30(7):849-864 [FREE Full text] [CrossRef] [Medline]
  46. Christensen H, Batterham P, Mackinnon A, Griffiths KM, Hehir KK, Kenardy J, et al. Prevention of generalized anxiety disorder using a web intervention, iChill: randomized controlled trial. J Med Internet Res 2014 Sep 2;16(9):e199 [FREE Full text] [CrossRef] [Medline]
  47. Saulsberry A, Marko-Holguin M, Blomeke K, Hinkle C, Fogel J, Gladstone T, et al. Randomized clinical trial of a primary care internet-based intervention to prevent adolescent depression: one-year outcomes. J Can Acad Child Adolesc Psychiatry 2013 May;22(2):106-117 [FREE Full text] [Medline]
  48. Aardoom JJ, Dingemans AE, Spinhoven P, van Ginkel JR, de Rooij M, van Furth EF. Web-based fully automated self-help with different levels of therapist support for individuals with eating disorder symptoms: a randomized controlled trial. J Med Internet Res 2016 Jun 17;18(6):e159 [FREE Full text] [CrossRef] [Medline]
  49. Zarski A, Lehr D, Berking M, Riper H, Cuijpers P, Ebert DD. Adherence to internet-based mobile-supported stress management: a pooled analysis of individual participant data from three randomized controlled trials. J Med Internet Res 2016 Jun 29;18(6):e146 [FREE Full text] [CrossRef] [Medline]
  50. Allexandre D, Bernstein AM, Walker E, Hunter J, Roizen MF, Morledge TJ. A web-based mindfulness stress management program in a corporate call center: a randomized clinical trial to evaluate the added benefit of onsite group support. J Occup Environ Med 2016 Mar;58(3):254-264 [FREE Full text] [CrossRef] [Medline]
  51. Heber E, Ebert DD, Lehr D, Cuijpers P, Berking M, Nobis S, et al. The benefit of web- and computer-based interventions for stress: a systematic review and meta-analysis. J Med Internet Res 2017 Feb 17;19(2):e32 [FREE Full text] [CrossRef] [Medline]
  52. Lancee J, van den Bout J, Sorbi MJ, van Straten A. Motivational support provided via email improves the effectiveness of internet-delivered self-help treatment for insomnia: a randomized trial. Behav Res Ther 2013 Dec;51(12):797-805. [CrossRef] [Medline]
  53. Stefanopoulou E, Lewis D, Taylor M, Broscombe J, Ahmad J, Larkin J. Are digitally delivered psychological interventions for depression the way forward? A review. Psychiatr Q 2018 Dec;89(4):779-794. [CrossRef] [Medline]
  54. Kelders SM, Bohlmeijer ET, Pots WT, van Gemert-Pijnen JE. Comparing human and automated support for depression: fractional factorial randomized controlled trial. Behav Res Ther 2015 Sep;72:72-80. [CrossRef] [Medline]
  55. Titov N, Andrews G, Choi I, Schwencke G, Johnston L. Randomized controlled trial of web-based treatment of social phobia without clinician guidance. Aust N Z J Psychiatry 2009;43(10):913-919 [FREE Full text] [CrossRef]
  56. Yardley L, Spring BJ, Riper H, Morrison LG, Crane DH, Curtis K, et al. Understanding and promoting effective engagement with digital behavior change interventions. Am J Prev Med 2016 Nov;51(5):833-842. [CrossRef] [Medline]
  57. Park LG, Howie-Esquivel J, Chung ML, Dracup K. A text messaging intervention to promote medication adherence for patients with coronary heart disease: a randomized controlled trial. Patient Educ Couns 2014 Feb;94(2):261-268. [CrossRef] [Medline]
  58. Quilici J, Fugon L, Beguin S, Morange PE, Bonnet J, Alessi M, et al. Effect of motivational mobile phone short message service on aspirin adherence after coronary stenting for acute coronary syndrome. Int J Cardiol 2013 Sep 20;168(1):568-569. [CrossRef] [Medline]
  59. Strandbygaard U, Thomsen SF, Backer V. A daily SMS reminder increases adherence to asthma treatment: a three-month follow-up study. Respir Med 2010 Feb;104(2):166-171 [FREE Full text] [CrossRef] [Medline]
  60. Akhu-Zaheya LM, Shiyab WY. The effect of short message system (SMS) reminder on adherence to a healthy diet, medication, and cessation of smoking among adult patients with cardiovascular diseases. Int J Med Inform 2017 Feb;98:65-75. [CrossRef] [Medline]
  61. Webb TL, Joseph J, Yardley L, Michie S. Using the internet to promote health behavior change: a systematic review and meta-analysis of the impact of theoretical basis, use of behavior change techniques, and mode of delivery on efficacy. J Med Internet Res 2010 Feb 17;12(1):e4 [FREE Full text] [CrossRef] [Medline]
  62. Wang JB, Cadmus-Bertram LA, Natarajan L, White MM, Madanat H, Nichols JF, et al. Wearable Sensor/Device (Fitbit One) and SMS text-messaging prompts to increase physical activity in overweight and obese adults: a randomized controlled trial. Telemed J E Health 2015 Oct;21(10):782-792 [FREE Full text] [CrossRef] [Medline]
  63. Banbury A, Nancarrow S, Dart J, Gray L, Parkinson L. Telehealth interventions delivering home-based support group videoconferencing: systematic review. J Med Internet Res 2018 Feb 2;20(2):e25 [FREE Full text] [CrossRef] [Medline]
  64. Damianakis T, Tough A, Marziali E, Dawson DR. Therapy online: a web-based video support group for family caregivers of survivors with traumatic brain injury. J Head Trauma Rehabil 2016;31(4):E12-E20. [CrossRef] [Medline]
  65. Marziali E. E-health program for patients with chronic disease. Telemed J E Health 2009 Mar;15(2):176-181. [CrossRef] [Medline]
  66. Nyström K, Ohrling K. Parental support: mothers' experience of electronic encounters. J Telemed Telecare 2006;12(4):194-197. [CrossRef] [Medline]
  67. Wild B, Hünnemeyer K, Sauer H, Hain B, Mack I, Schellberg D, et al. A 1-year videoconferencing-based psychoeducational group intervention following bariatric surgery: results of a randomized controlled study. Surg Obes Relat Dis 2015;11(6):1349-1360. [CrossRef] [Medline]
  68. Carrère S, Buehlman KT, Gottman JM, Coan JA, Ruckstuhl L. Predicting marital stability and divorce in newlywed couples. J Fam Psychol 2000 Mar;14(1):42-58. [Medline]
  69. Losada M. The complex dynamics of high performance teams. Math Comput Model 1999;30(9-10):179-192 [FREE Full text] [CrossRef]
  70. Nair S, Sagar M, Sollers J, Consedine N, Broadbent E. Do slumped and upright postures affect stress responses? A randomized trial. Health Psychol 2015 Jun;34(6):632-641. [CrossRef] [Medline]
  71. Josefsson T, Lindwall M, Archer T. Physical exercise intervention in depressive disorders: meta-analysis and systematic review. Scand J Med Sci Sports 2014 Apr;24(2):259-272. [CrossRef] [Medline]
  72. Lathia N, Sandstrom GM, Mascolo C, Rentfrow PJ. Happier people live more active lives: using smartphones to link happiness and physical activity. PLoS One 2017;12(1):e0160589 [FREE Full text] [CrossRef] [Medline]
  73. Richards J, Jiang X, Kelly P, Chau J, Bauman A, Ding D. Don't worry, be happy: cross-sectional associations between physical activity and happiness in 15 European countries. BMC Public Health 2015 Jan 31;15:53 [FREE Full text] [CrossRef] [Medline]
  74. Barton J, Pretty J. What is the best dose of nature and green exercise for improving mental health? A multi-study analysis. Environ Sci Technol 2010 May 15;44(10):3947-3955. [CrossRef] [Medline]
  75. Mantler A, Logan AC. Natural environments and mental health. Adv Integr Med 2015;2(1):5-12 [FREE Full text] [CrossRef]
  76. McMahan E, Estes D. The effect of contact with natural environments on positive and negative affect: a meta-analysis. J Posit Psychol 2015;10(6):507-519 [FREE Full text] [CrossRef]
  77. Fowler JH, Christakis NA. Dynamic spread of happiness in a large social network: longitudinal analysis over 20 years in the Framingham Heart Study. Br Med J 2008 Dec 4;337:a2338 [FREE Full text] [CrossRef] [Medline]
  78. Toussaint LL, Worthington E, Williams DR, editors. Forgiveness and Health Scientific Evidence and Theories Relating Forgiveness to Better Health. New York: Springer; 2015.
  79. Toussaint L, Shields GS, Dorn G, Slavich GM. Effects of lifetime stress exposure on mental and physical health in young adulthood: How stress degrades and forgiveness protects health. J Health Psychol 2016 Jun;21(6):1004-1014 [FREE Full text] [CrossRef] [Medline]
  80. Emmons RA, McCullough ME. Counting blessings versus burdens: an experimental investigation of gratitude and subjective well-being in daily life. J Pers Soc Psychol 2003 Feb;84(2):377-389. [CrossRef] [Medline]
  81. Froh JJ, Sefick WJ, Emmons RA. Counting blessings in early adolescents: an experimental study of gratitude and subjective well-being. J Sch Psychol 2008 Apr;46(2):213-233. [CrossRef] [Medline]
  82. Seligman ME, Steen TA, Park N, Peterson C. Positive psychology progress: empirical validation of interventions. Am Psychol 2005;60(5):410-421. [CrossRef] [Medline]
  83. Jacka FN, O'Neil A, Opie R, Itsiopoulos C, Cotton S, Mohebbi M, et al. A randomised controlled trial of dietary improvement for adults with major depression (the 'SMILES' trial). BMC Med 2017 Jan 30;15(1):23 [FREE Full text] [CrossRef] [Medline]
  84. Quirk SE, Williams LJ, O'Neil A, Pasco JA, Jacka FN, Housden S, et al. The association between diet quality, dietary patterns and depression in adults: a systematic review. BMC Psychiatry 2013 Jun 27;13:175 [FREE Full text] [CrossRef] [Medline]
  85. Neckelmann D, Mykletun A, Dahl AA. Chronic insomnia as a risk factor for developing anxiety and depression. Sleep 2007 Jul;30(7):873-880 [FREE Full text] [CrossRef] [Medline]
  86. Bedrosian TA, Nelson RJ. Influence of the modern light environment on mood. Mol Psychiatry 2013 Jul;18(7):751-757. [CrossRef] [Medline]
  87. Cornélissen G, Watson D, Mitsutake G, Fišer B, Siegelová J, Dušek J, Vohlídalová, et al. Mapping of circaseptan and circadian changes in mood. Scr Med (Brno) 2005;78(2):89-98 [FREE Full text] [Medline]
  88. Smith-Gabai H, Ludwig F. Observing the Jewish sabbath: a meaningful restorative ritual for modern times. J Occup Sci 2011;18(4):347-355 [FREE Full text] [CrossRef]
  89. Buchanan KE, Bardi A. Acts of kindness and acts of novelty affect life satisfaction. J Soc Psychol 2010;150(3):235-237. [CrossRef] [Medline]
  90. Seligman ME. Flourish: A Visionary New Understanding of Happiness and Well-being. New York: Free Press; 2013.
  91. Tkach CT. Unlocking the treasury of human kindness: enduring improvements in mood, happiness, and self-evaluations. Diss Abstr Int 2006;67(1-B):603 [FREE Full text]
  92. Morton D. Live More Happy: Scientifically Proven Ways to Lift Your Mood and Your Life. Warburton, Australia: Signs Publishing; 2018.
  93. Oinas-Kukkonen H, Harjumaa M. Persuasive systems design: key issues, process model, and system features. Commun Assoc Inform Syst 2009;24(1):485-500. [CrossRef]
  94. Fogg BJ. Persuasive Technology: Using Computers to Change What We Think and Do. San Francisco: Elsevier Science; 2003.
  95. Ware JE, Sherbourne CD. The MOS 36-item short-form health survey (SF-36). I. Conceptual framework and item selection. Med Care 1992 Jun;30(6):473-483. [Medline]
  96. Brazier JE, Harper R, Jones NM, O'Cathain A, Thomas KJ, Usherwood T, et al. Validating the SF-36 health survey questionnaire: new outcome measure for primary care. Br Med J 1992 Jul 18;305(6846):160-164 [FREE Full text] [CrossRef] [Medline]
  97. Jenkinson C, Wright L, Coulter A. Criterion validity and reliability of the SF-36 in a population sample. Qual Life Res 1994 Feb;3(1):7-12. [CrossRef] [Medline]
  98. McHorney CA, Ware JE, Lu JF, Sherbourne CD. The MOS 36-item Short-Form Health Survey (SF-36): III. Tests of data quality, scaling assumptions, and reliability across diverse patient groups. Med Care 1994 Jan;32(1):40-66. [CrossRef] [Medline]
  99. Lovibond PF, Lovibond SH. The structure of negative emotional states: comparison of the Depression Anxiety Stress Scales (DASS) with the Beck Depression and Anxiety Inventories. Behav Res Ther 1995 Mar;33(3):335-343. [CrossRef] [Medline]
  100. Randall D, Thomas M, Whiting D, McGrath A. Depression Anxiety Stress Scales (DASS-21): factor structure in traumatic brain injury rehabilitation. J Head Trauma Rehabil 2017;32(2):134-144. [CrossRef] [Medline]
  101. Le MT, Tran TD, Holton S, Nguyen HT, Wolfe R, Fisher J. Reliability, convergent validity and factor structure of the DASS-21 in a sample of Vietnamese adolescents. PLoS One 2017;12(7):e0180557 [FREE Full text] [CrossRef] [Medline]
  102. Osman A, Wong JL, Bagge CL, Freedenthal S, Gutierrez PM, Lozano G. The Depression Anxiety Stress Scales-21 (DASS-21): further examination of dimensions, scale reliability, and correlates. J Clin Psychol 2012 Dec;68(12):1322-1338. [CrossRef] [Medline]
  103. Diener E, Emmons R, Larsen R, Griffin S. The satisfaction with life scale. J Pers Assess 1985 Feb;49(1):71-75. [CrossRef] [Medline]
  104. Pavot W, Diener E, Colvin CR, Sandvik E. Further validation of the Satisfaction with Life Scale: evidence for the cross-method convergence of well-being measures. J Pers Assess 1991 Aug;57(1):149-161. [CrossRef] [Medline]
  105. Pavot WD, Diener E. Review of the satisfaction with life scale. Psychol Assess 1993;5(2):164-172 [FREE Full text] [CrossRef]
  106. Vassar M. A note on the score reliability for the Satisfaction With Life Scale: an RG study. Soc Indic Res 2008;86(1):47-57 [FREE Full text] [CrossRef]
  107. Diener E, Wirtz D, Tov W, Kim-Prieto C, Choi D, Oishi S, et al. New well-being measures: short scales to assess flourishing and positive and negative feelings. Soc Indic Res 2010;97(2):143-156 [FREE Full text] [CrossRef]
  108. Silva AJ, Caetano A. Validation of the flourishing scale and scale of positive and negative experience in Portugal. Soc Indic Res 2013;110(2):469-478 [FREE Full text] [CrossRef]
  109. Eysenbach G, CONSORT-EHEALTH Group. CONSORT-EHEALTH: improving and standardizing evaluation reports of Web-based and mobile health interventions. J Med Internet Res 2011 Dec 31;13(4):e126 [FREE Full text] [CrossRef] [Medline]
  110. Mohr DC, Burns MN, Schueller SM, Clarke G, Klinkman M. Behavioral intervention technologies: evidence review and recommendations for future research in mental health. Gen Hosp Psychiatry 2013;35(4):332-338 [FREE Full text] [CrossRef] [Medline]
  111. Christensen H, Griffiths KM, Farrer L. Adherence in internet interventions for anxiety and depression. J Med Internet Res 2009 Apr 24;11(2):e13 [FREE Full text] [CrossRef] [Medline]
  112. Ajzen I. From intentions to actions: a theory of planned behavior. In: Kuhl J, Beckmann J, editors. Action Control. Berlin, Heidelberg: Springer; 1985:11-39.
  113. Mitchell J, Stanimirovic R, Klein B, Vella-Brodrick D. A randomised controlled trial of a self-guided internet intervention promoting well-being. Comput Hum Behav 2009;25(3):749-760 [FREE Full text] [CrossRef]
  114. Waters LA, Galichet B, Owen N, Eakin E. Who participates in physical activity intervention trials? J Phys Act Health 2011 Jan;8(1):85-103. [Medline]


7DWI: 7 Dimensions of Well-Being Index
CONSORT: Consolidated Standards of Reporting Trials
DASS: Depression, Anxiety and Stress Scale
eLMS: electronic learning management system
MHPI: mental health promotion intervention
PSD: persuasive systems design
RCT: randomized controlled trial
S: standard group
S+pSMS: standard plus personalized short message service group
S+VCS: standard plus videoconferencing support group
SAM: supportive accountability model
SF-36: Short Form Health Survey
SWLS: Satisfaction With Life Scale
TPB: theory of planned behavior


Edited by G Eysenbach; submitted 24.07.19; peer-reviewed by JR Bautista, C Salewski, S Poduval; comments to author 21.09.19; revised version received 14.10.19; accepted 20.10.19; published 06.01.20

Copyright

©Melanie Elise Renfrew, Darren Peter Morton, Jason Kyle Morton, Jason Scott Hinze, Peter James Beamish, Geraldine Przybylko, Bevan Adrian Craig. Originally published in the Journal of Medical Internet Research (http://www.jmir.org), 06.01.2020.

This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on http://www.jmir.org/, as well as this copyright and license information must be included.