This paper is in the following e-collection/theme issue:

Randomized trials (Editor: G. Eysenbach)* (33) Web-based and Mobile Health Interventions (3114) Anxiety and Stress Disorders (1005)

Published on in Vol 24, No 7 (2022): July

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/26569, first published .
A Technology-Assisted Telephone Intervention for Work-Related Stress Management: Pilot Randomized Controlled Trial

A Technology-Assisted Telephone Intervention for Work-Related Stress Management: Pilot Randomized Controlled Trial

A Technology-Assisted Telephone Intervention for Work-Related Stress Management: Pilot Randomized Controlled Trial

Authors of this article:

Salla Tuulikki Muuraiskangas1 Author Orcid Image ;   Anita Marianne Honka2 Author Orcid Image ;   Ulla-Maija Junno3 Author Orcid Image ;   Hannu Olavi Nieminen4, 5 Author Orcid Image ;   Jouni Kalevi Kaartinen1 Author Orcid Image
Article Authors Cited by (1) Tweetations (4) Metrics

    Original Paper

    1Smart Health, VTT Technical Research Centre of Finland Ltd, Oulu, Finland

    2Smart Health, VTT Technical Research Centre of Finland Ltd, Tampere, Finland

    3Luona Hoiva Ltd, Helsinki, Finland

    4Movendos Ltd, Tampere, Finland

    5Faculty of Medicine and Health Technology, Tampere university, Tampere, Finland

    Corresponding Author:

    Salla Tuulikki Muuraiskangas, MHSc

    Smart Health

    VTT Technical Research Centre of Finland Ltd

    Kaitoväylä 1

    Oulu, 90590

    Finland

    Phone: 358 408350169

    Email: salla.muuraiskangas@gmail.com


    Background: Stress management interventions combining technology with human involvement have the potential to improve the cost-effectiveness of solely human-delivered interventions, but few randomized controlled trials exist for assessing the cost-effectiveness of technology-assisted human interventions.

    Objective: The aim of this study was to investigate whether a technology-assisted telephone intervention for stress management is feasible for increasing mental well-being or decreasing the time use of coaches (as an approximation of intervention cost) while maintaining participants’ adherence and satisfaction compared with traditional telephone coaching.

    Methods: A 2-arm, pilot randomized controlled trial of 9 months for stress management (4-month intensive and 5-month maintenance phases) was conducted. Participants were recruited on the web through a regional occupational health care provider and randomized equally to a research (technology-assisted telephone intervention) and a control (traditional telephone intervention) group. The coaching methodology was based on habit formation, motivational interviewing, and the transtheoretical model. For the research group, technology supported both coaches and participants in identifying behavior change targets, setting the initial coaching plan, monitoring progress, and communication. The pilot outcome was intervention feasibility, measured primarily by self-assessed mental well-being (WorkOptimum index) and self-reported time use of coaches and secondarily by participants’ adherence and satisfaction.

    Results: A total of 49 eligible participants were randomized to the research (n=24) and control (n=25) groups. Most participants were middle-aged (mean 46.26, SD 9.74 years) and female (47/49, 96%). Mental well-being improved significantly in both groups (WorkOptimum from “at risk” to “good” Â>0.85; P<.001), and no between-group differences were observed in the end (Â=0.56, 95% CI 0.37-0.74; P=.56). The total time use of coaches did not differ significantly between the groups (366.0 vs 343.0 minutes, Â=0.60, 95% CI 0.33-0.85; P=.48). Regarding adherence, the dropout rate was 13% (3/24) and 24% (6/25), and the mean adherence rate to coaching calls was 92% and 86% for the research and control groups, respectively; the frequency of performing coaching tasks was similar for both groups after both phases; and the diligence in performing the tasks during the intensive phase was better for the research group (5.0 vs 4.0, Â=0.58, 95% CI 0.51-0.65; P=.03), but no difference was observed during the maintenance phase. Satisfaction was higher in the research group during the intensive phase (5.0 vs 4.0, Â=0.66, 95% CI 0.58-0.73; P<.001) but not during the maintenance phase.

    Conclusions: The technology-assisted telephone intervention is feasible with some modifications, as it had similar preliminary effectiveness as the traditional telephone intervention, and the participants had better satisfaction with and similar or better adherence to the intervention, but it did not reduce the time use of coaches. The technology should be improved to provide more digested information for action planning and templates for messaging.

    Trial Registration: ClinicalTrials.gov NCT02445950; https://www.clinicaltrials.gov/ct2/show/study/NCT02445950

    J Med Internet Res 2022;24(7):e26569

    doi:10.2196/26569

    Keywords

    health behavior change intervention; telephone coaching; technology-assisted coaching; remote coaching; occupational health; mental well-being; stress management; feasibility; randomized controlled trial 


    Background

    Work-related stress and its indirect consequences for physical, mental, and social well-being are serious threats to public health. Long-term stress increases the risk of sleep problems [1,2], coronary heart disease [3,4], and various mental health problems [5], such as burnout [6,7], anxiety [8], and depression [9,10]. Stress is also linked to an increased number of sick days [11-15], lost productivity, inability to work, and presenteeism at work [16-18]. The estimated stress-related health, economic, and social costs are considerable [13,14,19]. Hence, reducing work-related stress effectively can have a major positive impact on individuals, companies, and society as a whole.

    Various interventions have been developed for stress management and mental well-being. Traditionally, interventions have been delivered by human coaches or therapists through face-to-face or telephone sessions, but such interventions are not easily scalable. Nowadays, interventions are often supported by technology, or they can even be delivered fully and automatically by technology without human involvement. The use of technology can decrease human involvement and thus costs [20], which enables scaling up the intervention for a larger population, and therefore, it holds a promise for a healthier population.

    Stress management interventions that blend technology and human effort have been found in several studies to be effective at reducing stress compared with no treatment [21-23]. In addition, there is evidence from the mental health perspective that blended interventions are more effective at reducing symptoms of anxiety, distress, and negative thoughts than, for example, fully human interventions [24,25]. Fully automatized interventions without human involvement have also been found to be effective in reducing stress [23,26-30]. However, there are studies indicating that blended stress management interventions can be more effective at reducing stress or stress-related mental health problems than fully technological interventions [31,32].

    The level of human and technology involvement and the terminology used to describe the blend varies in health intervention studies [20,33]. In this study, we focus on technology-assisted human interventions, where the intervention is produced by a human (therapist, coach, etc) with the assistance of technology. Technology assists the human by facilitating the coaching process or by providing additional insights regarding the participant via automatic analyses of electronic questionnaire responses or passively collected data (eg, via wearables). An example of this kind of intervention is telephone coaching, where technology provides additional insights (eg, participants’ self-monitoring data or intervention component suggestions) to support the decision-making of coaches [23,34].

    There are only a few randomized controlled trials (RCTs) studying the cost-effectiveness of blended stress management interventions. These studies have shown blended stress management interventions to have an acceptable likelihood for cost-effectiveness compared with waiting list control [35-37], fully human interventions with no technology involved, [38] and fully technological interventions [39]. In addition, blended interventions for mental health are cost-effective compared with fully human interventions, at least from the care provider perspective if not from the societal perspective [40]. In these studies, cost-effectiveness was calculated by comparing medical and societal costs to the measured health improvements [36-38,40] or to the number of patients with a symptom-free status [35]. For instance, cost-effectiveness was evaluated based on the total therapist time spent compared with the measured health improvements in the study by Kaldo et al [38].

    Participants’ intervention adherence is an important determinant of intervention effectiveness [41] and feasibility, as it defines participants’ exposure to the intervention. It is necessary to distinguish between at least two types of adherence, the adherence to the research study and its questionnaires (conversely called dropout attrition) and adherence to the intervention itself, that is, to what extent the components of the intervention are being used (conversely called nonuse attrition) [42]. Previous studies on mental health suggest that intervention adherence (both regarding the study and the use) is higher when human guidance is involved in the intervention [20,41,43-45].

    Participants’ satisfaction with the intervention is important for intervention feasibility, and it is associated with sustained adherence [46]. Therefore, studying satisfaction sheds light on understanding intervention adherence and effectiveness. The scientific publications studying participant satisfaction in blended stress management interventions are scarce. Earlier studies on mental health [47] have shown that in interventions in which the technology is used more and human assistance is less, the participants are less satisfied than in fully human interventions [47], but there is also evidence of equal satisfaction among the participants in blended interventions and group-based, fully human interventions [48].

    In summary, previous research suggests that blended stress management interventions have the potential to be effective, but cost-effectiveness studies are lacking. Furthermore, adherence and satisfaction are important for evaluating the feasibility of interventions in more detail and for helping to refine their implementation for future large-scale RCTs.

    Objectives

    The primary objective of this study was to investigate whether a technology-assisted telephone intervention for stress management is feasible for increasing participants’ well-being or decreasing the time use of coaches while maintaining participants’ adherence and satisfaction compared with a traditional telephone intervention (without technology assistance) in an occupational health care setting. The primary trial outcomes were mental well-being and time use of coaches as an approximation of the intervention cost (ClinicalTrials.gov NCT02445950). As primary analyses, we assessed whether the participants in the research group (technology-assisted telephone intervention) reported a greater improvement in well-being, measured by the WorkOptimum index [49,50], and whether the time use of coaches was lower than that of the control group (telephone intervention). As secondary outcomes, we assessed participants’ adherence and satisfaction in both groups. The secondary outcomes mentioned in the trial registration related to the evaluation of the used technology (usefulness, ease of use, and accuracy) will be reported in another paper (Honka, MSc, unpublished data, December 2021).


    Trial Design

    A nonblinded, parallel-group, 2-arm pilot RCT was conducted for 9 months in Oulu, Finland, to explore whether a technology-assisted telephone intervention for stress management is feasible for increasing mental well-being or decreasing the time use of coaches while maintaining adherence and satisfaction. The trial registration opened in November 2014, and the trial started in February 2015 and ended in October 2015.

    Participants

    Participants were recruited from among the employees of the City of Oulu, Finland, via the channels of the regional occupational health care provider. The recruitment announcement was published on the intranet pages of the City of Oulu and the occupational health care provider, and in the magazines of the City of Oulu (to staff) and the occupational health care provider (to customers). The staff of the occupational health care provider also recruited participants personally and via email. The registration of the study was conducted on the web via a link in the announcement. Registered employees received informed consent through regular mail, where information regarding the 2 study groups was provided: intervention, data collection, data processing, data privacy, research partners, and contact details. Signed consent was collected by a research partner who provided the coaching service for the intervention. An electronic eligibility survey was sent to the employees who returned signed consent forms, after which they were informed whether they were accepted to the study or not. The eligibility criteria are presented in Textbox 1. As the quality of romantic relationships substantially influences mental well-being [51], this was selected as one of the intervention areas; therefore, being in a relationship was part of the inclusion criteria.

    Eligibility criteria for the study.

    Inclusion criteria

    • Own assessment of decreased psychophysical state (based on a subset of items of the WorkOptimum questionnaire)
    • Customers of the occupational health care provider who work full-time for the City of Oulu (in the area of information technology, education, culture, social, health, and customer service)
    • Age >18 years
    • In a relationship, motivated to enhance own well-being by making lifestyle changes or performing exercises related to mental well-being or relationships (based on 1 question in the eligibility survey)

    Exclusion criteria

    • Night shifts included in the work schedule
    • Acute health condition or a serious disease
    • Chronic pain affecting physical function
    • Long period of absence (eg, long vacation, alternation leave, parental leave, or pension) from work during the intervention period
    • Participation in other studies
    Textbox 1. Eligibility criteria for the study.

    Randomization

    The eligible participants were randomly allocated to either a research (technology-assisted telephone intervention) or control (traditional telephone intervention) group in a 1:1 ratio through stratified block randomization. Group allocation was stratified based on socioeconomic status and having minors as family members, since these factors were anticipated to influence the mental well-being and adherence outcomes of the study owing to challenges in meeting the demands of work and family responsibilities [52-54]. Socioeconomic status was categorized as “lower-level employees” (eg, secretaries, nurses, childminders, and customer servants) or “upper-level employees” (eg, managers, doctors, psychologists, teachers, and information technology professionals) based on job descriptions and the required education level [55]. Having minors in the family was described using 3 categories: “no children,” “at least one child below school age (<7 years),” and “only school-aged children.”

    The participants were randomized simultaneously into the 2 groups via Microsoft Excel (version 2010) using its random number generator. The randomization was conducted by a researcher who was not involved in the study as an investigator. The study investigators were aware of the group to which each participant belonged.

    Sample Size

    Available coaching resources defined the number of participants that could be enrolled in the study. At the time of the study, the participating coaching service provider used 3 coaches who could use an average of 20% of their time for the study participants. Therefore, the objective was to have 40 participants in the study. As a dropout rate of 20% is common in telephone interventions [34,56], the aim was to recruit 50 participants.

    Interventions

    Common Intervention Components

    There were 2 interventions: a technology-assisted telephone intervention and a traditional telephone intervention. The interventions lasted for 9 months, and they were divided into a 4-month intensive phase and a 5-month maintenance phase (Figure 1).

    Coaching was performed by 3 coaches recruited by the research partner, Mawell Care Limited, so that each of them had an equal number of clients from both the control and research groups. The participants were allocated to the coaches based on mutual availability for the first telephone call. Coaching is based on the habit formation theory, according to which small, regularly repeating behavioral actions or tasks support long-term behavior change [57]. The tasks were related to different topics relevant to well-being, namely sleep, physical activity, eating, alcohol consumption, smoking, recovery from stress, anxiety, personal values, workload management, quality of relationship, self-esteem, and weight management. The tasks could be, for example, “take at least 7000 steps a day,” “practice relaxation with the help of audio exercises,” and “keep a diary of personal eating habits for some days.” Some of these tasks included links to external web resources, such as “read information about the consequences of sleep deprivation from [webpage],” and “practice mindful eating with Oiva at a weekly basis.” Oiva is a web portal that includes exercises for mental well-being, which are based on Acceptance and Commitment Therapy [58]. Oiva contains short few-minute exercises under the themes of well-being of mind and body, values, and everyday choices. The number of study participants per study group, working on different task areas, is presented in Table 1.

    Behavioral strategies were based on motivational interviewing and the transtheoretical model of Prochaska et al [59,60]. The interventions included several behavior change techniques, as categorized in the study by Michie et al [61]. The applied behavior change techniques are presented in Table 2.

    The main difference between the interventions was the number of telephone calls and the use of technology in coaching. The research group had 5 coaching calls during the intensive phase and 1 at the end. The control group had 5 coaching calls in the intensive phase and 3 in the maintenance phase.

    ‎
    Figure 1. Intervention timeline with intervention components. HRS: health recommender system.
    View this figure
    Table 1. Task areas and selection frequency for both groups.
    Task areasGroup, na (%)Total, n (%)

    		ResearchControl
    Sleep7 (58)5 (42)12 (100)
    Physical activity23 (55)19 (45)42 (100)
    Eating9 (47)10 (53)19 (100)
    Alcohol consumption1 (50)1 (50)2 (100)
    Smoking1 (50)1 (50)2 (100)
    Recovery from stress, anxiety, or personal values20 (63)12 (37)32 (100)
    Workload management9 (53)8 (47)17 (100)
    Quality of relationship3 (100)0 (0)3 (100)
    Self-esteem3 (100)0 (0)3 (100)
    Weight management5 (45)6 (55)11 (100)

    aNumber of participants in a group who selected a task from a specific area.

    Table 2. Behavior change techniques used in both interventions.
    Phase of the interventionBehavior change technique
    Beginning
    • Goal setting of behavior
      • ‎
    • Goal setting of outcome
      • ‎
    • Problem solving
      • ‎
    • Action planning
      • ‎
    • Behavioral contact
      • ‎
    • Information about health consequences
      • ‎
    • Pros and cons
      • ‎
    • Comparative imagining of future outcomes
      • ‎
    Coaching during intensive and maintenance phases
    • Reviewing behavior goals
      • ‎
    • Feedback on behavior
      • ‎
    • Self-monitoring of behavior
      • ‎
    • Social support (unspecified)
      • ‎
    • Instructions on how to perform the behavior
      • ‎
    • Habit formation
      • ‎
    • Credible source
      • ‎
    • Social reward
      • ‎
    • Reduce negative emotions
      • ‎
    • Verbal persuasion about capability
      • ‎
    Final call
    • Reviewing outcome goals
      • ‎
    Technology-Assisted Telephone Intervention
    Overview

    In the research group, technology was used for supporting both the coach and participants throughout the intervention. Web tools and wearables were used to support the identification of the participants’ behavior change targets, the creation of the initial intervention plan, progress monitoring, and communication. Technology was designed to help coaches obtain an accurate and comprehensive picture of the participants’ situation (needs and motivation) efficiently in a systematic manner to enhance coaching quality and reduce the time needed to acquire this in-depth knowledge, as well as to empower the participants to be more active in planning and performing their behavior change actions. These technological tools were new to coaches. Before using the tools, the coaches were offered training during four 6-hour information sessions, where the study protocol and other practical issues were also presented. The technology used was free for the participants, and they were encouraged to use it in their everyday lives.

    At the beginning of the intensive phase, the research group received Firstbeat heart rate variability (HRV) sensors and wore them for 3 days (Firstbeat Technologies Ltd, see more details below in Firstbeat Well-being Analysis section) [62]. The coach prepared for the first coaching call by reviewing the results of the Firstbeat well-being analysis and the health recommender system’s (HRS’s) behavior change needs analysis (see more details below in HRS: Behavior Change Needs Analysis and Coaching Task Recommendation section). The first call was about discussing the change needs (based on Firstbeat well-being analysis and the HRS’s behavior change need analysis), agreeing with a high-level behavior change goal (eg, sleep better and manage workload), and guiding the participant to select up to 3 coaching tasks via the HRS before the next call. The participants could select tasks either from a recommended list of items or from a task library that includes all the task items available or create their own tasks. After each call, the coaches made notes related to the call (what was agreed and how long the call lasted). Before the second call, the coach reviewed the preselected tasks. During the second call, the preselected tasks were adjusted and the coaching plan was finalized (selecting goals and tasks). If physical activity tasks were selected and the participant wanted a wearable, a Fitbit activity bracelet (Fitbit Inc) [63] was provided. The selected tasks were transferred automatically to the Movendos coaching web service (more details below in Movendos Coaching Service section) [64,65]. For stress management tasks, the Oiva stress management web service was offered to the participants [58]. Coaching calls 2 to 5 were used to discuss the suitability of the goals, supporting the change through motivational interviewing, and updating the coaching plan. Before each call, the coach reviewed the progress from Movendos regarding performing the agreed coaching tasks.

    During the maintenance phase, the research group received coaching only via Movendos messages. The coaches were expected to send group messages to the research group once a month and personal coaching messages every 2 weeks in addition to replying to any messages from the participants weekly. Before sending the messages, the coaches checked the progress of the participants on Movendos. The coaching messages then focused on motivating them to perform tasks that did not progress. The research group repeated the Firstbeat well-being analysis at the end of the maintenance phase, and the appropriate timings for the Firstbeat measurements and the final coaching call were agreed upon over a phone conversation between the coach and participant. The sixth and the last coaching call was used for going through the results (Firstbeat well-being analysis), the coaching experience, and forming a plan for the time after coaching. In the following section, we describe each of the technologies used in greater detail.

    Firstbeat Well-being Analysis

    Firstbeat well-being analysis (Firstbeat Technologies Ltd) [62] provides an analysis of the balance between stress and recovery based on HRV. The participants wore the electrodes for 3 days, and based on the HRV data, their physiological well-being was assessed.

    HRS: Behavior Change Needs Analysis and Coaching Task Recommendation

    During the project, a web-based HRS was developed to analyze participants’ behavior change need areas and to provide personalized recommendations for suitable behavior change actions, that is, coaching tasks, based on the identified needs. The HRS evaluated several well-being–related or lifestyle-related areas (sleep sufficiency and quality, eating rhythm, balanced diet, emotional eating, physical activity, alcohol consumption, smoking, workload management, recovery from stress, anxiety, personal values, quality of relationship, and self-esteem) based on questionnaires and the results of the Firstbeat well-being analysis. As a result, the HRS provided a report summarizing for each of these areas the strength of the behavior change need (on a scale of 1 to 5) and the readiness to change the behavior categorized by the transtheoretical model’s stages of change [66]. On the basis of the behavior change needs analysis, the HRS provided a list of coaching tasks recommended for inclusion in the coaching plan. In addition, the complete list of available coaching tasks can be explored via the HRS, which includes >100 tasks regarding different areas of well-being and health behaviors. Both the coach and participants could access the information provided by the HRS.

    Movendos Coaching Service

    The research group used the Movendos coaching web service (version 1.27; Movendos Ltd) [64,65] for (1) communicating with the coach via messages (eg, feedback), (2) progress monitoring, and (3) receiving reminders from the coach and setting reminders for themselves if they wished. The coaches had access to a wide library of tasks in the Movendos coaching service, which they could assign to participants, and the service provided them information on the participants’ progress regarding the selected tasks.

    Telephone Intervention

    The control group received 8 coaching calls in total: 5 in the intensive phase and 3 in the maintenance phase. Before the first coaching call, the coaches reviewed the WorkOptimum questionnaire results (administered as a part of the eligibility questionnaire) [49,50]. The first call was about discussing change needs (based on the WorkOptimum index) and forming the coaching plan (selecting goals and tasks). After each call, the coaches made notes related to the call (what was agreed and how long the call lasted). Calls 2 to 7 were used for discussing the suitability of the tasks, supporting the change through motivational interviewing, and updating the coaching plan. The eighth and final call was used for going through the repeated WorkOptimum questionnaire results, the coaching experience, and forming a plan for the time after coaching.

    Outcome Measures

    Overview

    The pilot outcome was intervention feasibility measured primarily by the participants’ self-assessed mental well-being and the total time use of the coaches for the complete coaching period and secondarily by participants’ adherence to and satisfaction with coaching.

    The feasibility criteria are formulated in the following manner:

    • Stop—main study not feasible if the research group has lower well-being than the control group.
    • Continue, but modify intervention—feasible with modifications if the research group has in comparison with the control group (1) similar well-being and similar or increased time use of coaches, (2) similar well-being and decreased time use of coaches but poorer adherence or satisfaction, or (3) improved well-being and increased time use of coaches.
    • Continue without modifications—feasible but monitor closely if the research group has in comparison with the control group (1) improved well-being and similar or decreased time use of coaches or (2) similar well-being, decreased time use of coaches, and similar or better adherence or satisfaction.
    • Continue without modifications—feasible as is if the research group has improved well-being and decreased time use of coaches in combination with similar or better adherence and satisfaction.
    Mental Well-being

    Mental well-being was assessed using the WorkOptimum index, which is a measure of occupational health, and aims to detect work-related cognitive decline and decrease in mental well-being before developing mental health problems (Multimedia Appendix 1 [49,50]). The scoring of the index is divided into 4 categories with the following interpretations: exhaustion (score −4 or less), high-risk (score −3.9 to −2.5), at risk (score −2.4 to −1.0), and good (score −0.9 to 0.0). The WorkOptimum questionnaire evaluates the ability to recover from work and perceived mental and physical resources as well as the perceived energy level and workload. The electronic questionnaire was administered to the participants at baseline (month 0) and at the end of the intensive (month 4) and maintenance (month 9) phases.

    Time Use of Coaches

    The total time use of coaches was tracked during the entire intervention regarding (1) preparation time for the coaching calls, (2) duration of the coaching calls (ie, 6 calls for the research group and 8 calls for the control group), and (3) the time spent on writing personal coaching messages to the research group. For each coaching call, the coaches were asked to manually record the duration of the call and the time spent preparing for it (in minutes). On the basis of these results, the total time spent on coaching calls per participant was computed. The time spent on messaging had to be estimated, as the coaches considered it too laborious to record the time used for messages. The estimate was computed based on the total number of messages sent to each of the research group participants (recorded by the Movendos system log) and the results of previous studies. For the intensive phase, 5 minutes was considered as the time estimate for responding to a participant's message, which is comparable with the time it took physicians to address emails in the study by Leong et al [67]. For the maintenance phase, 10 minutes were assigned as the time estimate per message [68], as coaches were required to initiate motivating coaching messages in addition to just responding to participants. The total time used by coaches was computed by adding the total time spent on coaching calls and messages together, per participant. In addition, the mean preparation time and mean duration per coaching call were computed for each participant.

    Only participants for whom all the planned coaching calls were realized and the time-keeping records were complete for both call-preparation time and call duration were included in the analysis of the total time use of coaches. For 14 participants (7 participants from both groups), the time records for the coaching calls were incomplete because one of the coaches recorded only the time spent on preparation activities but missed recording the duration of the calls. Hence, complete data were available only for 11 participants per group.

    Adherence

    Adherence was assessed by the dropout attrition, describing how many participants quit the intervention, and by the use adherence (inversely nonuse attrition). The use adherence comprised (1) the proportion of realized coaching calls, (2) the frequency of performing the selected coaching tasks, and (3) diligence in performing the tasks. During the intensive phase, the coaches evaluated the task performance adherence (frequency and diligence) 3 times for the research group (during coaching calls 3-5) and 4 times for the control group (during calls 2-5) via a structured interview (Multimedia Appendix 2). For each coaching task, the following 3 items were assessed: “the client performed the task less frequently than agreed,” “the client performed the task more frequently than agreed,” and “the client performed the task with diligence,” with a 5-point Likert scale (1=“strongly disagree”; 5=“strongly agree”) also having the option “I don’t know.” For the statistical analyses, the answers to the items related to task performance frequency (2 items) were combined and transformed to a scale from 1 to 9 with the following meaning: 1=“the task was performed less frequently than agreed,” 5=“the task was performed as agreed,” and 9=“the task was performed more frequently than agreed.” During the maintenance phase, the participants self-assessed their task performance adherence for each coaching task via 3 electronic questionnaires administered at months 5, 7, and 9 (after calls 6-8 for the control group; Multimedia Appendix 2). The task performance frequency was assessed with the item “how actively did you perform the coaching task?” with a 5-point Likert scale (1=“less frequently than agreed,” 3=“as agreed,” 5=“more frequently than agreed”). The task performance diligence was assessed with the item “I performed the task with diligence” with a 5-point Likert scale (1=“strongly disagree”; 5=“strongly agree”). Both items included the response option “I don’t know.” For each assessment point, the evaluations for the 2 best-evaluated tasks were considered in the analyses, as the number of selected tasks varied per person and per coaching phase. Group-level medians were calculated for the intensive and maintenance phases over all the tasks considered.

    Satisfaction With Coaching

    Participants’ satisfaction with coaching was assessed using 1 question in different phases of the trial. For the research group, during the intensive phase, the statement was “I was satisfied with the coaching call,” and during the maintenance phase, the statement was “I was satisfied with the coaching received via Movendos messages.” For the control group, the statement remained the same throughout the intervention, that is, “I was satisfied with the coaching call.” The 5-point Likert scale was used (1 = “Strongly disagree”; 5 = “Strongly agree”). Group-level medians were calculated over all the assessments available for each group for the intensive and maintenance phases, as well as for the entire intervention. Satisfaction was assessed at 4 time points (after calls 2-5 for the research group, and after calls 3-5 for the control group) during the intensive phase and 4 time points in the maintenance phase (after calls 6-8 for the control group).

    Statistical Methods

    For the primary trial outcome (WorkOptimum index for mental well-being), Mann-Whitney U tests were conducted on the follow-up scores measured at the end of the intensive and maintenance phases to determine the statistical significance of the between-group differences. Analysis of covariance was considered for the statistical tests, but as the residuals were not normally distributed, it was more appropriate to use nonparametric tests instead of parametric ones. Similar between-group analyses were performed for the time use of coaches and participants’ adherence to (frequency and diligence) and satisfaction with coaching. In addition, the statistical significance of the within-group changes in mental well-being from baseline (month 0) to the end of the intensive (month 4) and maintenance phases (month 9) were determined using the Sign test. For both groups, the number of participants with positive changes (N+) was reported as a test statistic for the Sign test. For the different outcomes, all participants with relevant data available were included in the analyses (available-case analysis). A significance level (α) of .05 was used for the statistical tests. Statistical tests were performed using IBM SPSS Statistics (version 25).

    The Vargha-Delaney A measure of stochastic superiority [69] was reported as an indicator of the effect size. For the between-group analyses, 95% CIs of the effect sizes were reported. The effect size computations were performed with free R (version 4.0.5) statistical software by using the rcompanion package. The 95% CIs were computed using the bootstrap procedure [70].

    Ethics Approval

    This study was approved by the Ethics Committee of Human Sciences at the University of Oulu. The RCT was registered at ClinicalTrials.gov (NCT02445950). Informed consent was obtained from interested individuals through regular mail before administering the electronic eligibility survey via email.


    Participants

    In total, 131 volunteers registered for the study, of which 56 (42.7%) met the inclusion criteria and were randomized equally to the research and control groups. Of the 56 randomized group of participants, 50 (89%) were chosen to be enrolled in the study based on the order of registration. The remaining 6 participants were put on a waiting list in case of last-minute changes in participation before starting the coaching program. At the beginning of the coaching program, 1 participant in the research group was no longer eligible for the study because of a change in their employment status and was therefore omitted from the statistical analyses. Figure 2 summarizes the participant flow from registration to available-case analysis for mental well-being (primary outcome) and the attrition numbers for the intensive and maintenance phases together with the reasons for withdrawal.

    The baseline characteristics of the study participants are presented in Table 3. Most participants (47/49, 96%) were female, and the 2 (4%) male participants were allocated to the control group. More than half (28/49, 57%) of the participants were aged between 46 and 60 years (mean age 46.26, SD 9.74 years). A majority had at least a bachelor’s degree (41/49, 84%). More than half (28/49, 57%) of the participants had a lower socioeconomic status, and approximately half (25/49, 51%) of the participants had children (school-aged or younger). The 2 groups had similar characteristics apart from education level, which was higher in the control group (4/24, 17%, vs 10/25, 40% having a graduate or doctoral degree). Mental well-being at the baseline was at the “at risk” level for both groups (−2.38 vs −2.14) in terms of the interpretation of the median WorkOptimum index (primary outcome).

    ‎
    Figure 2. Participant flow for the primary analysis regarding mental well-being.
    View this figure
    Table 3. Baseline characteristics.

    		Research (n=24), n (%)Control (n=25), n (%)All (n=49), n (%)
    Gender

    		Female24 (100)23 (92)47 (96)
    Age (years)

    		26-355 (21)4 (16)9 (18)

    		36-456 (25)6 (24)12 (24)

    		46-6013 (54)15 (60)28 (57)
    Education

    		Secondary school5 (21)3 (12)8 (16)

    		Bachelor’s degree15 (63)12 (48)27 (55)

    		Graduate or doctoral degree4 (17)10 (40)14 (29)
    Socioeconomic statusa

    		Lower-level employees13 (54)15 (60)28 (57)

    		Upper-level employees11 (46)10 (40)21 (43)
    Family

    		No children13 (54)11 (44)24 (49)

    		At least 1 child below school age (<7 years)4 (17)5 (20)9 (18)

    		Only school-aged children7 (29)9 (36)16 (33)

    aSocioeconomic groups are based on the classification of Statistics Finland [55]. Lower-level employees include, for example, secretaries, nurses, childminders, customer service staff, and assistants. Upper-level employees include, for example, managers, doctors, psychologists, teachers, and information technology professionals.

    Mental Well-being

    The follow-up scores for the mental well-being measure, WorkOptimum index (primary outcome), at the end of intensive (month 4: −0.95 vs −1.09, Â=0.53, 95% CI 0.34-0.72; P=.74) and maintenance (month 9: −0.47 vs −0.44, Â=0.56, 95% CI 0.37-0.74; P=.56) phases were not statistically significantly different between the research and control groups (Table 4). At month 9, the WorkOptimum index had improved from the baseline’s “at risk” level (−2.4 to −1.0) to a “good” (−0.9 to 0.0) level in both groups. The within-group improvements were strong for both groups (Â>0.85, P≤.001 at month 9; Table 5). The distribution of WorkOptimum value categories across time points is presented in Table 6.

    Table 4. Between-group differences of the outcome measures.
    OutcomeResearchControlMann-Whitney U statisticP valueÂa (95% CI)

    		Median (25th; 75th) or % (range)nMedian (25th; 75th) or % (range)n
    Mental well-beingb

    		Month 0−2.38 (−3.09; −1.19)24−2.14 (−5.50; −1.28)25N/AcN/AN/A

    		Month 4−0.95 (−1.33; −0.50)16−1.09 (−1.80; −0.46)22188.00.740.53 (0.34-0.72)

    		Month 9−0.47 (−0.72; −0.15)21−0.44 (−1.73; −0.26)19221.50.560.56 (0.37-0.74)
    Time use of the coaches (minutes)

    		Total time use


    		Months 0-9366.0 (320.0; 427.0)11343.0 (268.0; 489.0)1149.0.480.60 (0.33-0.85)

    		Mean preparation time per call


    		Months 0-930.00 (24.0; 32.60)1117.57 (16.14; 23.0)1112.50.0010.90 (0.75-1.0)

    		Mean duration per call


    		Months 0-925.50 (20.33; 30.50)1722.44 (17.28; 32.44)1497.0.400.59 (0.37-0.80)
    Adherence

    		Dropout attrition (%)


    		Months 0-412.5d248d25N/AN/AN/A


    		Months 4-90d2416d25N/AN/AN/A


    		Months 0-913d2424d25N/AN/AN/A

    		Mean adherence to coaching calls (%)


    		Month 992 (50.0-100.0)2486 (25.0-100.0)25N/AN/AN/A

    		Frequency of performing the tasks


    		Month 4 (scale 1 to 9)5.0 (2.0; 5.0)235.0 (2.0; 5.0)246543.50.950.50 (0.42-0.57)


    		Month 9 (scale 1 to 5)3.0 (2.0; 3.0)203.0 (2.0; 3.0)162126.0.370.54 (0.45-0.62)

    		Diligence in performing the tasks (scale 1 to 5)


    		Month 45.0 (4.0; 5.0)244.0 (3.0; 5.0)255282.50.030.58 (0.51-0.65)


    		Month 94.0 (30; 5.0)204.0 (3.0; 5.0)151973.50.150.57 (0.47-0.66)

    		Satisfaction with coaching (scale 1 to 5)


    		Months 0-45.0 (4.0; 5.0)244.0 (4.0; 5.0)251923.50<.0010.66 (0.58-0.73)


    		Months 4-94.50 (3.25; 5.0)245.0 (4.0; 5.0)25938.0.330.55 (0.45-0.67)


    		Months 0-95.0 (4.0; 5.0)244.0 (4.0; 5.0)255729.50.030.58 (0.51-0.65)

    aVargha-Delaney A measure of stochastic superiority for effect size estimation. Limits for interpretation: 0.56 (small), 0.64 (medium), 0.71 (large). Between-group differences are observed when the lower bound of the 95% CI is >0.5 [69].

    bThe scoring of the index is divided into 4 categories with the following interpretations: exhaustion (score −4 or less), high-risk (score −3.9 to −2.5), at risk (score −2.4 to −1.0), and good (score −0.9–0.0).

    cN/A: not applicable.

    dRange is not applicable (dropout attrition describes how many people dropped out of the study).

    Table 5. Changes in well-being over time.
    Outcome, group, and periodChangeN+ (Sign test)P value (exact)Âa

    		Median (25th; 75th)n


    Mental well-being

    		Research


    		Months 0-40.54 (0.12; 1.33)1613.0.020.81


    		Months 0-90.98 (0.29; 2.33)2118.0.0010.86

    		Control


    		Months 0-42.11 (0.43; 4.60)2220.0<.0010.91


    		Months 0-92.41 (1.01; 4.56)1918.0<.0010.95

    aVargha-Delaney A measure of stochastic superiority for effect size estimation. Limits for interpretation: 0.56 (small), 0.64 (medium), 0.71 (large) [69].

    Table 6. Distribution of WorkOptimum value categories at different time points for both groups (n=49).
    Time pointResearch (n=24), n (%)Control (n=25), n (%)
    Month 0

    		Exhaustion5 (21)7 (28)

    		High risk6 (25)4 (16)

    		At risk9 (38)12 (48)

    		Good4 (17)2 (8)

    		Missing0 (0)0 (0)
    Month 4

    		Exhaustion2 (8)3 (12)

    		High risk1 (4)0 (0)

    		At risk5 (20)9 (36)

    		Good8 (33)10 (40)

    		Missing8 (33)3 (12)
    Month 9

    		Exhaustion2 (8)1 (4)

    		High risk0 (0)2 (8)

    		At risk2 (8)4 (16)

    		Good17 (79)12 (48)

    		Missing3 (12.5)6 (24)

    Time Use of Coaches

    The total time use of coaches during the 9-month coaching period was not statistically significantly different between the 2 groups (366.0 vs 343.0 minutes, Â=0.60, 95% CI 0.33-0.85; P=.48; Table 4). However, the mean preparation time per coaching call was considerably higher in the research group (Â=0.90, 95% CI 0.75-1.0; P=.001). The mean duration per call did not differ between the groups (Â=0.59, 95% CI 0.37-0.80; P=.40). Regarding personal coaching messages, the coaches sent a total of 60 and 102 personal coaching messages to the research group participants during the intensive and maintenance phases, respectively. The median number of messages sent per participant was 2.0 (range 0-6) for the intensive and 4.0 (range 0-19) for the maintenance phase. Therefore, the estimated median time used for coaching messaging per participant was 10.0 minutes in the intensive phase and 40.0 minutes in the maintenance phase.

    Adherence

    The dropout attrition rates differed between the study groups: 13% (3/24) in the research group and 24% (6/25) in the control group.

    The use adherence differed somewhat between the study groups. Owing to the higher dropout attrition in the control group, the mean proportion of realized coaching calls was lower compared with the research group (86% vs 92%). There were no between-group statistical differences in task performance frequency for either phase (Â=0.50, 95% CI 0.42-0.57; P=.95, and Â=0.54, 95% CI 0.45-0.63; P=.37). The research group performed the tasks with slightly better diligence (Â=0.58, 95% CI 0.51-0.65; P=.03) during the intensive phase, but no differences were observed in the maintenance phase (Â=0.57, 95% CI 0.47-0.66; P=.15).

    Satisfaction With Coaching

    During the intensive phase (months 0-4), the research group was moderately more satisfied with the coaching program than the control group (Â=0.66, 95% CI 0.58-0.73; P<.001). During the maintenance phase (months 4-9), satisfaction did not differ between the groups (Â=0.55, 95% CI 0.45-0.67; P=.33). In general, participant satisfaction was high throughout the coaching program in both groups (Table 4).


    The aim of this study was to investigate whether technology-assisted telephone intervention is feasible for increasing well-being or decreasing the time use of coaches while maintaining participants’ adherence and satisfaction compared with traditional telephone intervention in an occupational health care setting.

    Principal Findings

    The technology-assisted telephone intervention was similarly effective in increasing well-being as traditional telephone coaching while having better adherence in 2 of the 4 metrics (lower dropout rate and higher adherence to calls) and higher satisfaction during the intensive phase. However, technology-assisted telephone coaching was unable to demonstrate savings in the time use of coaches. Therefore, the intervention is feasible, but some modifications are needed before moving on to a large-scale RCT.

    The similar well-being improvements in both groups might be due to the similarities in coaching content and having human contact in both groups. In addition, it might be due to the similar baseline well-being state being only at the “at risk” level for both groups. If a person is in a poorer condition, it might be more difficult to improve mental well-being with technology or less intensive coaching, but this remains to be studied among people with poorer well-being. It is noteworthy that for the technology-assisted group, the improvement in well-being holds, although the coaching calls were replaced with personal coaching messages during the maintenance phase. Therefore, it seems feasible to replace at least some of the coaching calls with messages.

    Although the total time use of coaches was similar for the 2 groups, the coaches spent more time preparing for the coaching calls of the technology-assisted group participants. The potential reason for this could be that the used technology components generated additional information on the participant’s situation, which the coaches had to review before the coaching calls (Firstbeat well-being analysis, HRS’s behavior change needs analysis and coaching task recommendations, and participants’ progress in the Movendos Coaching Platform). However, the use of technology for providing a comprehensive picture of participants’ situations (needs, motivation, and progress) should be considered an advantage, as this supports coaches in making better decisions when identifying suitable behavior change goals and activities for the coaches; this type of information could also help coaches gain a better understanding of coaches’ motivation levels and the appropriate means to motivate them. Therefore, using analytical technological tools could lead to improved coaching quality and intervention effectiveness. This line of thinking is also supported by the observation that participants in the technology-assisted group reported higher satisfaction with coaching during the intensive phase than did the traditional intervention group. In addition, the used technology and technology-assisted coaching process were new to the coaches. Learning to use the new tools effectively as part of their coaching process must have taken extra time, while following the familiar telephone coaching process was obviously more efficient. There will be potential to enhance the use efficiency of new technology as they become familiar to end users.

    The technology-assisted group was more persistent at staying in the intervention until the end and adhering to the coaching calls considering the dropout attrition rate was higher in the fully human intervention group. This might be due to the generally less effort needed from the technology-assisted group participants because there were no coaching calls in the maintenance phase. Perhaps it is easier to adhere to the lower number of calls. However, after the intensive phase, the technology-assisted group had a higher dropout rate than the traditional intervention group, but this difference was due to only 1 person. Moving to another town was the reason for 1 of 3 dropouts. The satisfaction for the 2 other dropouts was good and, therefore, does not explain the dropout. The task performance frequency was similar between the 2 groups. Better diligence in the technology-assisted group in the intensive phase could have been because of extensive analysis of behavior change needs at the beginning, which might have increased the personal understanding of why the tasks were important, thus leading to higher levels of diligence in performing them.

    The higher levels of satisfaction for the technology-assisted group in the intensive phase might be explained by the technology providing the coaches with a deeper understanding of participants’ situations and needs, which in turn may have facilitated coaches to provide the right kind of support. From this perspective, technology was fulfilling one of its goals in creating a comprehensive picture of the participant and enhancing coaching quality. However, satisfaction did not differ between the 2 groups during the maintenance phase, which is a good result because the coaching took place via messaging instead of phone calls for the technology-assisted group during this phase.

    It is also interesting that 86% (42/49) of participants chose a task related to physical activity as part of the coaching plan. There are several potential reasons for this finding. One reason could be that many of the participants were employed by the health care sector and, hence, had knowledge of the basic principles of a healthy lifestyle. Coaches noted that participants commonly felt that they did not have enough time for physical activity. In Finnish culture, it is typical to think that exercise is a medicine for almost anything. Furthermore, the Fitbit wrist device offered to the technology-assisted group might have encouraged the focus on physical activity, as it enabled easy and motivating self-monitoring of activity.

    Comparison With Previous Studies

    Our findings strengthen the evidence for technology-assisted human interventions being equally effective as traditional human interventions. However, the majority of the studies compared interventions with a different level of human-technology involvement from ours, where human coaching was partly or entirely replaced by technology.

    Only 1 study considered the effectiveness of an intervention similar to this study, but it was compared with a fully technological intervention [23]. In this study, the technology-assisted intervention supported the coaches by providing comprehensive knowledge regarding the participant’s situation and was used as communication media, but it did not provide coaching without the coach.

    Our findings could not confirm earlier claims of saving time with technology use [20]. However, earlier approaches were also different from this study in the way that technology usually replaced or automated coaching tasks. This study, however, provides more information on the coaches’ time use for the preparation of coaching calls and the actual call durations, which helps target changes to the intervention so that it might save time.

    Adherence in both groups in terms of dropout rate (13% and 24%) was good. The adherence to earlier well-being interventions varied significantly. In another technology-assisted human (physical activity) intervention study, adherence to the intervention was 28.4% (dropout rate was 71.6%) [23]. In human-assisted technological stress management interventions, adherence varied between 69.7% and 96% [31,71,72] and, in fully technological interventions, it varied between 25% and 90.6% [23,30,31]. Thus, our findings indicate a high level of adherence.

    This study provides new knowledge on satisfaction with stress management technology-assisted human interventions, showing that interventions with less intensive human involvement can lead to similar or even better participant satisfaction than more intensive human involvement.

    Limitations

    There were several limitations to this study. One limitation is the narrow approximation of costs based on the time use of coaches. For a comprehensive cost-effectiveness study, costs should be studied more widely from both the care provider and societal perspectives. In addition, the technology itself incurs costs that have to be considered.

    Considering the study was not blinded to the participants and they knew the intervention of interest and the intervention they were participating in, it is possible that participants may have sought additional help, for example, from occupational health care to which all participants had access. Providing sufficient information is the result of balancing a valid research setting and ethics. Moreover, participants in the traditional telephone intervention group were more highly educated, which could have a positive impact on their motivation and ability to seek additional help. These issues may have affected our results, perhaps by improving the well-being of the control group.

    As the used technology components and technology-assisted coaching process were new to the coaches, the study might not provide realistic results on the time use of coaches. Our study also showed that there can be many problems with human-reported metrics. There can be challenges in advising procedures, which in our case caused a misunderstanding between researchers and coaches regarding the proper procedures to record the time used for coaching. In addition, there is a risk of measurement errors when relying on self-reporting instead of objective measurements. In addition, the data collection metrics for adherence had to be improved during the pilot because the measurement scales for evaluating adherence during the intensive phase turned out to be ambiguous. The recording of time used was also stated by the coaches to be too laborious. Future studies should ensure that time logging is easy, preferably even automatic, and that it is performed consistently throughout the study.

    The sample size was small, which makes the results only preliminary and must be confirmed in a larger RCT. With a small number of participants, unexpected events during the study and participant-specific variations in the selected intervention areas may have influenced the study results. The sample was also quite biased, containing mostly middle-aged, highly educated women because of the recruitment methodology. The participants were recruited from the municipal sector (employees of the City of Oulu, Finland), where especially in education, health care and social sectors, highly educated women are in majority, so it is obvious that these women are also well represented in this study. In addition, women are generally more interested in their health and more eager to participate in studies [73]. For better generalizability of the results, it would be essential to recruit participants from a group that has more variety in terms of age, gender, and education level. This could be achieved using several occupational care providers that have customers from different industries (eg, also including the manufacturing industry, where most of the employees are men).

    The results were obtained in the coaching environment in which phone calls were the primary means of coaching and may not be generalized to other forms of coaching. In addition, coaching can be implemented in various ways, which makes proper comparison of different interventions or studies difficult. Individual situations and health statuses vary considerably between people, and here the participants had moderate baseline well-being. Therefore, it is difficult to generalize any results from this study, and the results only hold for this particular sample, set of tools, and processes. In addition, in the absence of a no-treatment group, the role of other factors, such as the research setting itself, cannot be quantified.

    Implications

    The feasibility of the technology-assisted intervention was compromised because of the inability to show a decrease in the time use of coaches. This may be due to an inefficient coaching process or unfamiliarity with the used technology, subjective (error-prone) data collection methods, and the small sample size.

    It is expected that the process can save coaches’ time once the technology and its optimal use practices have been honed and become more of a routine. Therefore, coaching technology should be used for some time before starting a larger RCT. Studies should also explore which coaching activities could be further automated to maintain the effects but decrease the time use of coaches. During action planning, it is important to provide concise reports that are easy and quick for coaches to read and understand. In addition, using templates for messaging can be helpful in decreasing the time use of coaches.

    There is a need for reliable objective data collection methods for the time use of coaches. It would be ideal if the data could be collected automatically, and with digital interventions, this becomes possible. Technology can support research data collection by prompting the coach after each coaching event to note how much time was used for preparation and by automatically recording the coaching call durations and writing messages, for example.

    The effect size and adherence rates allowed for an estimation of the number of participants to be enrolled in the fully powered RCT. A small effect size (Â=0.56) was obtained for the difference in well-being between the groups in the end. Thus, it would be required to enroll 125 (58+67) participants (considering 13%-24% dropouts; power=0.80; significance level, α=.05) in a fully powered 2-arm RCT to study the difference in effects on well-being [74].

    Conclusions

    The studied technology-assisted telephone intervention is feasible with some modifications by showing similar preliminary effectiveness as the traditional telephone intervention, better satisfaction, and better adherence in 2 out of 4 adherence indicators. However, because it did not reduce the time use of coaches, it requires modifications before conducting a large-scale RCT. On the one hand, these adjustments should include adding features to the technology components to support further the work of coaches, for instance, by providing the available data regarding participants’ situation in a more digested format that is fast to comprehend and providing templates for personal coaching messages. On the other hand, the protocol should be improved by recruiting more participants, using objective and automatic time-tracking methods and starting the study once the coaches have established a routine of using the technology components as part of the coaching process. Technology seems promising in terms of facilitating less resource-intensive personal coaching by replacing some coaching calls with coaching messages, but further studies are required to confirm this.

    Acknowledgments

    This study was supported by ARTEMIS-IA (Advanced Research & Technology for Embedded Intelligent Systems Industry Association) and TEKES (currently Business Finland) under grant 332885 (WITH-ME). The authors warmly thank Juha Leppänen and Hannu Mikkola for implementing the health recommender system and its interface on the Movendos Coaching Platform. Special thanks to Tero Myllymäki (Firstbeat Technologies Ltd) and Firstbeat for providing the Firstbeat well-being analysis technology for the project and for supporting its use in the health recommender system and the intervention. The authors also thank Miikka Ermes, PhD, for his valuable guidance on the randomized controlled trial study design; Anna-Leena Orsama, PhD, for conducting the randomization for the study, providing guidance on the statistical methods, and reviewing the manuscript; Juho Merilahti, PhD, for his support in realizing this research; Mikko Lindholm, Licentiate of Science (Technology), for his analyses on the task statistics; and Elina Mattila, PhD, for reviewing the early version of the manuscript and providing helpful comments. The authors further extend their thanks to the coaches and participants.

    Authors' Contributions

    AMH, HON, U-MJ, and JKK contributed to the design of the randomized controlled trial study; STM, U-MJ, and AMH were involved in conducting the study; AMH and STM performed the statistical analyses and interpretation; AMH, HON, and U-MJ specified algorithms or content for the health recommender system; STM and AMH drafted the paper, and all coauthors critically revised the paper and approved the final version for publication.

    Conflicts of Interest

    U-MJ works at Luona Hoiva Ltd (previously Mawell Care Ltd), which provided coaching for the intervention. HON works at Movendos Ltd, which provided the web coaching platform for the intervention.

    ‎
    Multimedia Appendix 1

    Mental well-being—WorkOptimum.

    DOCX File , 18 KB
    ‎
    Multimedia Appendix 2

    Use adherence—frequency of and diligence in performing the tasks.

    DOCX File , 23 KB
    ‎
    Multimedia Appendix 3

    CONSORT-eHEALTH checklist (V 1.6.1).

    PDF File (Adobe PDF File), 378 KB
    1. Akerstedt T. Psychosocial stress and impaired sleep. Scand J Work Environ Health 2006 Dec;32(6):493-501 [FREE Full text] [Medline]
    2. Van Laethem M, Beckers DG, Kompier MA, Dijksterhuis A, Geurts SA. Psychosocial work characteristics and sleep quality: a systematic review of longitudinal and intervention research. Scand J Work Environ Health 2013 Nov;39(6):535-549 [FREE Full text] [CrossRef] [Medline]
    3. Kivimäki M, Nyberg S, Batty G, Fransson E, Heikkilä K, Alfredsson L, IPD-Work Consortium. Job strain as a risk factor for coronary heart disease: a collaborative meta-analysis of individual participant data. Lancet 2012 Oct 27;380(9852):1491-1497 [FREE Full text] [CrossRef] [Medline]
    4. Cohen BE, Edmondson D, Kronish IM. State of the art review: depression, stress, anxiety, and cardiovascular disease. Am J Hypertens 2015 Nov;28(11):1295-1302 [FREE Full text] [CrossRef] [Medline]
    5. Stansfeld S, Candy B. Psychosocial work environment and mental health--a meta-analytic review. Scand J Work Environ Health 2006 Dec;32(6):443-462 [FREE Full text] [CrossRef] [Medline]
    6. Wu S, Zhu W, Wang Z, Wang M, Lan Y. Relationship between burnout and occupational stress among nurses in China. J Adv Nurs 2007 Aug;59(3):233-239. [CrossRef] [Medline]
    7. Khalatbari J, Ghorbanshiroudi S, Firouzbakhsh M. Correlation of job stress, job satisfaction, job motivation and burnout and feeling stress. Procedia Social Behav Sci 2013 Jul;84:860-863. [CrossRef]
    8. Chandola T. Stress at Work. London, UK: The British Academy; 2010.
    9. Bonde JP. Psychosocial factors at work and risk of depression: a systematic review of the epidemiological evidence. Occup Environ Med 2008 Jul;65(7):438-445. [CrossRef] [Medline]
    10. Madsen IE, Nyberg ST, Magnusson Hanson LL, Ferrie JE, Ahola K, Alfredsson L, IPD-Work Consortium. Job strain as a risk factor for clinical depression: systematic review and meta-analysis with additional individual participant data. Psychol Med 2017 Jun;47(8):1342-1356 [FREE Full text] [CrossRef] [Medline]
    11. Bourbonnais R, Mondor M. Job strain and sickness absence among nurses in the province of Québec. Am J Ind Med 2001 Feb;39(2):194-202. [CrossRef] [Medline]
    12. Moreau M, Valente F, Mak R, Pelfrene E, de Smet P, De Backer G, et al. Occupational stress and incidence of sick leave in the Belgian workforce: the Belstress study. J Epidemiol Community Health 2004 Jun;58(6):507-516 [FREE Full text] [CrossRef] [Medline]
    13. Stress and Psychological Disorders in Great Britain 2013. Health and Safety Executive. 2013.   URL: https://static.guim.co.uk/ni/1412687972727/stress-1.pdf [accessed 2022-06-22]
    14. Van den Broek K, Hassard J, Flemming D, Gründler R, Dewe P, Teoh K, et al. Calculating the costs of work-related stress and psychosocial risks : literature review. European Agency for Safety and Health at Work 2015 [FREE Full text] [CrossRef]
    15. Götz S, Hoven H, Müller A, Dragano N, Wahrendorf M. Age differences in the association between stressful work and sickness absence among full-time employed workers: evidence from the German socio-economic panel. Int Arch Occup Environ Health 2018 May;91(4):479-496 [FREE Full text] [CrossRef] [Medline]
    16. Brborovic H, Brborovic O, Mustajbegovic J. Looking for the possible association between stress, presenteeism and absenteeism among Croatian nurses: a cross-sectional study. Iran J Psychiatry Behav Sci 2016 Oct 24;10(4):e4587. [CrossRef]
    17. Cooper CL, Lu L. Presenteeism at Work. Cambridge, UK: Cambridge University Press; 2018.
    18. Schmidt B, Schneider M, Seeger P, van Vianen A, Loerbroks A, Herr R. A comparison of job stress models: associations with employee well-being, absenteeism, presenteeism, and resulting costs. J Occup Environ Med 2019 Jul;61(7):535-544. [CrossRef] [Medline]
    19. Mariné A, Seyrl B, Samele C, Breucker G, Miniska I, Scheftlein J, et al. Economic analysis of workplace mental health promotion and mental disorder prevention programm. Matrix Insight. 2012.   URL: http://www.mentalhealthpromotion.net/resources/matrix_2012-economic-analysis-of-wmhp-programmes.pdf [accessed 2022-06-22]
    20. Erbe D, Eichert H, Riper H, Ebert D. Blending face-to-face and Internet-based interventions for the treatment of mental disorders in adults: systematic review. J Med Internet Res 2017 Sep 15;19(9):e306 [FREE Full text] [CrossRef] [Medline]
    21. Jonas B, Leuschner F, Tossmann P. Efficacy of an internet-based intervention for burnout: a randomized controlled trial in the German working population. Anxiety Stress Coping 2017 Mar;30(2):133-144. [CrossRef] [Medline]
    22. Ebert D, Heber E, Berking M, Riper H, Cuijpers P, Funk B, et al. Self-guided Internet-based and mobile-based stress management for employees: results of a randomised controlled trial. Occup Environ Med 2016 May;73(5):315-323. [CrossRef] [Medline]
    23. Prochaska JO, Evers KE, Castle PH, Johnson JL, Prochaska JM, Rula EY, et al. Enhancing multiple domains of well-being by decreasing multiple health risk behaviors: a randomized clinical trial. Popul Health Manag 2012 Oct;15(5):276-286. [CrossRef] [Medline]
    24. Sethi S, Campbell AJ, Ellis LA. The use of computerized self-help packages to treat adolescent depression and anxiety. J Technol Human Service 2010 Aug 31;28(3):144-160. [CrossRef]
    25. Ebert DD, Van Daele T, Nordgreen T, Karekla M, Compare A, Zarbo C, et al. Internet- and mobile-based psychological interventions: applications, efficacy, and potential for improving mental health. Eur Psychol 2018 May;23(2):167-187. [CrossRef]
    26. Zetterqvist K, Maanmies J, Ström L, Andersson G. Randomized controlled trial of Internet-based stress management. Cogn Behav Ther 2003;32(3):151-160. [CrossRef] [Medline]
    27. Proudfoot J, Clarke J, Birch M, Whitton AE, Parker G, Manicavasagar V, et al. Impact of a mobile phone and Web program on symptom and functional outcomes for people with mild-to-moderate depression, anxiety and stress: a randomised controlled trial. BMC Psychiatry 2013 Nov 18;13:312 [FREE Full text] [CrossRef] [Medline]
    28. Drozd F, Raeder S, Kraft P, Bjørkli CA. Multilevel growth curve analyses of treatment effects of a Web-based intervention for stress reduction: randomized controlled trial. J Med Internet Res 2013 Apr 22;15(4):e84 [FREE Full text] [CrossRef] [Medline]
    29. Wiegand B, Luedtke K, Friscia D, Nair M, Aleles M, McCloskey R. Efficacy of a comprehensive program for reducing stress in women: a prospective, randomized trial. Curr Med Res Opin 2010 Apr;26(4):991-1002. [CrossRef] [Medline]
    30. Fuller-Tyszkiewicz M, Richardson B, Little K, Teague S, Hartley-Clark L, Capic T, et al. Efficacy of a smartphone app intervention for reducing caregiver stress: randomized controlled trial. JMIR Ment Health 2020 Jul 24;7(7):e17541 [FREE Full text] [CrossRef] [Medline]
    31. Rose RD, Buckey JC, Zbozinek TD, Motivala SJ, Glenn DE, Cartreine JA, et al. A randomized controlled trial of a self-guided, multimedia, stress management and resilience training program. Behav Res Ther 2013 Feb;51(2):106-112. [CrossRef] [Medline]
    32. Heber E, Ebert D, Lehr D, Cuijpers P, Berking M, Nobis S, et al. The benefit of Web- and computer-based interventions for stress: a systematic review and meta-analysis. J Med Internet Res 2017 Feb 17;19(2):e32 [FREE Full text] [CrossRef] [Medline]
    33. Wentzel J, van der Vaart R, Bohlmeijer E, van Gemert-Pijnen JE. Mixing online and face-to-face therapy: how to benefit from blended care in mental health care. JMIR Ment Health 2016 Feb 09;3(1):e9 [FREE Full text] [CrossRef] [Medline]
    34. Karhula T, Vuorinen A, Rääpysjärvi K, Pakanen M, Itkonen P, Tepponen M, et al. Telemonitoring and mobile phone-based health coaching among Finnish diabetic and heart disease patients: randomized controlled trial. J Med Internet Res 2015 Jun 17;17(6):e153 [FREE Full text] [CrossRef] [Medline]
    35. Ebert DD, Kählke F, Buntrock C, Berking M, Smit F, Heber E, et al. A health economic outcome evaluation of an Internet-based mobile-supported stress management intervention for employees. Scand J Work Environ Health 2018 Mar 01;44(2):171-182 [FREE Full text] [CrossRef] [Medline]
    36. Kählke F, Buntrock C, Smit F, Berking M, Lehr D, Heber E, et al. Economic evaluation of an Internet-based stress management intervention alongside a randomized controlled trial. JMIR Ment Health 2019 May 15;6(5):e10866 [FREE Full text] [CrossRef] [Medline]
    37. Lindsäter E, Axelsson E, Salomonsson S, Santoft F, Ljótsson B, Åkerstedt T, et al. Cost-effectiveness of therapist-guided Internet-based cognitive behavioral therapy for stress-related disorders: secondary analysis of a randomized controlled trial. J Med Internet Res 2019 Sep 13;21(9):e14675 [FREE Full text] [CrossRef] [Medline]
    38. Kaldo V, Levin S, Widarsson J, Buhrman M, Larsen H, Andersson G. Internet versus group cognitive-behavioral treatment of distress associated with tinnitus: a randomized controlled trial. Behav Ther 2008 Dec;39(4):348-359. [CrossRef] [Medline]
    39. Buntrock C, Ebert DD, Lehr D, Cuijpers P, Riper H, Smit F, et al. Evaluating the efficacy and cost-effectiveness of Web-based indicated prevention of major depression: design of a randomised controlled trial. BMC Psychiatry 2014 Jan 31;14(1):25. [CrossRef]
    40. Kooistra L, Wiersma J, Ruwaard J, Neijenhuijs K, Lokkerbol J, van Oppen P, et al. Cost and effectiveness of blended versus standard cognitive behavioral therapy for outpatients with depression in routine specialized mental health care: pilot randomized controlled trial. J Med Internet Res 2019 Oct 29;21(10):e14261 [FREE Full text] [CrossRef] [Medline]
    41. Hilvert-Bruce Z, Rossouw PJ, Wong N, Sunderland M, Andrews G. Adherence as a determinant of effectiveness of Internet cognitive behavioural therapy for anxiety and depressive disorders. Behav Res Ther 2012 Aug;50(7-8):463-468. [CrossRef] [Medline]
    42. Eysenbach G. The law of attrition. J Med Internet Res 2005 Mar 31;7(1):e11 [FREE Full text] [CrossRef] [Medline]
    43. Carolan S, Harris P, Cavanagh K. Improving employee well-being and effectiveness: systematic review and meta-analysis of Web-based psychological interventions delivered in the workplace. J Med Internet Res 2017 Jul 26;19(7):e271 [FREE Full text] [CrossRef] [Medline]
    44. Eisen K, Allen G, Bollash M, Pescatello L. Stress management in the workplace: a comparison of a computer-based and an in-person stress-management intervention. Comput Human Behav 2008 Mar;24(2):486-496. [CrossRef]
    45. Zarski A, Lehr D, Berking M, Riper H, Cuijpers P, Ebert D. Adherence to Internet-based mobile-supported stress management: a pooled analysis of individual participant data from three randomized controlled trials. J Med Internet Res 2016 Jun 29;18(6):e146 [FREE Full text] [CrossRef] [Medline]
    46. Ovbiosa-Akinbosoye O, Long D. Wellness program satisfaction, sustained coaching participation, and achievement of health goals. J Occup Environ Med 2012 May;54(5):592-597. [CrossRef] [Medline]
    47. Jacobs MK, Christensen A, Snibbe JR, Dolezal-Wood S, Huber A, Polterok A. A comparison of computer-based versus traditional individual psychotherapy. Professional Psychol Res Pract 2001;32(1):92-96. [CrossRef]
    48. Dolezal-Wood S, Belar C, Snibbe J. A comparison of computer-assisted psychotherapy and cognitive-behavioral therapy in groups. J Clin Psychol Med Settings 1998;5:103-115. [CrossRef]
    49. Ahveninen H, Rintala J, Ollikainen J, Suohonen J, Arola H. Työoptimi-kysely auttaa tunnistamaan työssäkäyvän kognitiivisia ja muistioireita. Lääkärilehti 2014;4:2017-2014 [FREE Full text]
    50. Ahveninen C. TyöOptimi tunnistaa tuen tarpeessa olevan työntekijän. University of Helsinki. 2016.   URL: https://helda.helsinki.fi/handle/10138/163425 [accessed 2022-06-22]
    51. Nordenmark M, Almén N, Vinberg S. Work/family conflict of more importance than psychosocial working conditions and family conditions for mental wellbeing. Societies 2020 Sep 14;10(3):67. [CrossRef]
    52. Miettinen A, Rotkirch A. Yhteistä aikaa etsimässä: lapsiperheiden ajankäyttö 2000-luvulla. Helsinki, Finland: Väestöliitto; 2012.
    53. Modern Parenthood. Pew Research Center. 2013 Mar 14.   URL: https:/​/www.​pewresearch.org/​social-trends/​2013/​03/​14/​modern-parenthood-roles-of-moms-and-dads-converge-as-they-balance-work-and-family/​ [accessed 2022-06-22]
    54. American time use survey — 2017 results. News Release Bureau of Labor Statistics. 2018.   URL: https://www.bls.gov/news.release/archives/atus_06282018.pdf [accessed 2022-06-22]
    55. Classification of socio-economic groups. Statistics Finland. 1989.   URL: http://www.stat.fi/meta/luokitukset/sosioekon_asema/001-1989/koko_luokitus_en.html [accessed 2019-05-21]
    56. Patja K, Absetz P, Auvinen A, Tokola K, Kytö J, Oksman E, et al. Health coaching by telephony to support self-care in chronic diseases: clinical outcomes from the TERVA randomized controlled trial. BMC Health Serv Res 2012 Jun 10;12:147 [FREE Full text] [CrossRef] [Medline]
    57. Lally P, van Jaarsveld C, Potts H, Wardle J. How are habits formed: modelling habit formation in the real world. Eur J Soc Psychol 2009 Jul 16;40(6):998-1009. [CrossRef]
    58. Tietoisuutta arkeen. OIVA.   URL: https://oivamieli.fi/ [accessed 2022-06-22]
    59. Treasure J. Motivational interviewing. Adv Psychiatr Treat 2018 Jan 02;10(5):331-337. [CrossRef]
    60. Prochaska JO, Redding CA, Evers KE. The transtheoretical model and stages of change. In: Glanz K, Rimer BK, Viswanath K, editors. Health Behavior: Theory, Research, and Practice. Hoboken, NJ, USA: Wiley; 2015:125-148.
    61. Michie S, Richardson M, Johnston M, Abraham C, Francis J, Hardeman W, et al. The behavior change technique taxonomy (v1) of 93 hierarchically clustered techniques: building an international consensus for the reporting of behavior change interventions. Ann Behav Med 2013 Aug;46(1):81-95. [CrossRef] [Medline]
    62. Firstbeat.   URL: https://www.firstbeat.com/en/ [accessed 2020-07-09]
    63. Fitbit.   URL: https://www.fitbit.com/ [accessed 2020-07-09]
    64. Nieminen H, Baggström S, Lehtonen H, Mikkola H, Leppisaari A, Korhonen I. Mobile solution for increasing the efficiency of health coaching for preventative health care and chronic disease management. Trans Japanese Soc Med Biol Eng 2013;51(Supplement):153. [CrossRef]
    65. Movendos.   URL: https://www.movendos.com/ [accessed 2020-07-09]
    66. Prochaska J, Velicer W. The transtheoretical model of health behavior change. Am J Health Promot 1997;12(1):38-48. [CrossRef] [Medline]
    67. Leong S, Gingrich D, Lewis P, Mauger D, George J. Enhancing doctor-patient communication using email: a pilot study. J Am Board Fam Pract 2005;18(3):180-188 [FREE Full text] [CrossRef] [Medline]
    68. Rosen P, Kwoh C. Patient-physician e-mail: an opportunity to transform pediatric health care delivery. Pediatrics 2007 Oct;120(4):701-706. [CrossRef] [Medline]
    69. Vargha A, Delaney H, Vargha A. A critique and improvement of the "CL" common language effect size statistics of McGraw and Wong. J Educ Behav Stat 2000 Feb;25(2):101. [CrossRef]
    70. Li JC. Effect size measures in a two-independent-samples case with nonnormal and nonhomogeneous data. Behav Res Methods 2016 Dec;48(4):1560-1574. [CrossRef] [Medline]
    71. Heber E, Lehr D, Ebert D, Berking M, Riper H. Web-based and mobile stress management intervention for employees: a randomized controlled trial. J Med Internet Res 2016 Jan 27;18(1):e21 [FREE Full text] [CrossRef] [Medline]
    72. Hedman E, Andersson E, Ljótsson B, Axelsson E, Lekander M. Cost effectiveness of internet-based cognitive behaviour therapy and behavioural stress management for severe health anxiety. BMJ Open 2016 Apr 25;6(4):e009327 [FREE Full text] [CrossRef] [Medline]
    73. Honka A, Helander E, Pavel M, Jimison H, Mustonen P, Korhonen I, et al. Exploring associations between the self-reported values, well-being, and health behaviors of Finnish citizens: cross-sectional analysis of more than 100,000 web-survey responses. JMIR Ment Health 2019 Apr 22;6(4):e12170 [FREE Full text] [CrossRef] [Medline]
    74. Sample Size Calculators for designing clinical research. University of California San Francisco.   URL: https://sample-size.net/sample-size-means/ [accessed 2021-05-14]

    ‎
    HRS: health recommender system
    HRV: heart rate variability
    RCT: randomized controlled trial

    Edited by G Eysenbach; submitted 17.12.20; peer-reviewed by S Broetje, K Knittle, S Wen; comments to author 02.04.21; revised version received 24.06.21; accepted 19.05.22; published 13.07.22

    Copyright

    ©Salla Tuulikki Muuraiskangas, Anita Marianne Honka, Ulla-Maija Junno, Hannu Olavi Nieminen, Jouni Kalevi Kaartinen. Originally published in the Journal of Medical Internet Research (https://www.jmir.org), 13.07.2022.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on https://www.jmir.org/, as well as this copyright and license information must be included.