This paper is in the following e-collection/theme issue:

Web-based and Mobile Health Interventions (3297) mHealth for Wellness, Behavior Change and Prevention (2871) Engagement with and Adherence to Digital Health Interventions, Law of Attrition (491) Mobile Health (mhealth) (2939) Innovations and Technology for Physical Activity Education (742) Fitness Trackers and Smart Pedometers/Accelerometers (561) Wearable Devices and Sensors (888) Behavior Change (712)

Published on in Vol 24, No 3 (2022): March

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/32130, first published .
Increasing the Effectiveness of a Physical Activity Smartphone Intervention With Positive Suggestions: Randomized Controlled Trial

Increasing the Effectiveness of a Physical Activity Smartphone Intervention With Positive Suggestions: Randomized Controlled Trial

Increasing the Effectiveness of a Physical Activity Smartphone Intervention With Positive Suggestions: Randomized Controlled Trial

Authors of this article:

Aleksandrina Skvortsova1, 2 Author Orcid Image ;   Talia Cohen Rodrigues2 Author Orcid Image ;   David de Buisonjé2 Author Orcid Image ;   Tobias Kowatsch3, 4 Author Orcid Image ;   Prabhakaran Santhanam3 Author Orcid Image ;   Dieuwke S Veldhuijzen2 Author Orcid Image ;   Henriët van Middendorp2 Author Orcid Image ;   Andrea Evers2, 5, 6 Author Orcid Image
Article Authors Cited by (7) Tweetations (7) Metrics

    Original Paper

    1Department of Psychology, McGill University, Montreal, QC, Canada

    2Health, Medical and Neuropsychology, Faculty of Social and Behavioural Sciences, Leiden, Netherlands

    3Centre for Digital Health Interventions, Department of Management, Technology, and Economics, ETH Zurich, Zurich, Switzerland

    4Centre for Digital Health Interventions, Institute of Technology Management, University of St.Gallen, St.Gallen, Switzerland

    5Department of Psychiatry, Leiden University Medical Center, Leiden, Netherlands

    6Medical Delta, Leiden University, Technical University Delft and Erasmus University, Leiden, Delft, Rotterdam, Netherlands

    Corresponding Author:

    Aleksandrina Skvortsova, PhD

    Department of Psychology

    McGill University

    1205 avenue du Docteur-Penfield

    Montreal, QC, H3A 1B1

    Canada

    Phone: 1 4386303664

    Email: a.skvortsova@fsw.leidenuniv.nl


    Background: eHealth interventions have the potential to increase the physical activity of users. However, their effectiveness varies, and they often have only short-term effects. A possible way of enhancing their effectiveness is to increase the positive outcome expectations of users by giving them positive suggestions regarding the effectiveness of the intervention. It has been shown that when individuals have positive expectations regarding various types of interventions, they tend to benefit from these interventions more.

    Objective: The main objective of this web-based study is to investigate whether positive suggestions can change the expectations of participants regarding the effectiveness of a smartphone physical activity intervention and subsequently enhance the number of steps the participants take during the intervention. In addition, we study whether suggestions affect perceived app effectiveness, engagement with the app, self-reported vitality, and fatigue of the participants.

    Methods: This study involved a 21-day fully automated physical activity intervention aimed at helping participants to walk more steps. The intervention was delivered via a smartphone-based app that delivered specific tasks to participants (eg, setting activity goals or looking for social support) and recorded their daily step count. Participants were randomized to either a positive suggestions group (69/133, 51.9%) or a control group (64/133, 48.1%). Positive suggestions emphasizing the effectiveness of the intervention were implemented in a web-based flyer sent to the participants before the intervention. Suggestions were repeated on days 8 and 15 of the intervention via the app.

    Results: Participants significantly increased their daily step count from baseline compared with 21 days of the intervention (t107=−8.62; P<.001) regardless of the suggestions. Participants in the positive suggestions group had more positive expectations regarding the app (B=−1.61, SE 0.47; P<.001) and higher expected engagement with the app (B=3.80, SE 0.63; P<.001) than the participants in the control group. No effects of suggestions on the step count (B=−22.05, SE 334.90; P=.95), perceived effectiveness of the app (B=0.78, SE 0.69; P=.26), engagement with the app (B=0.78, SE 0.75; P=.29), and vitality (B=0.01, SE 0.11; P=.95) were found. Positive suggestions decreased the fatigue of the participants during the 3 weeks of the intervention (B=0.11, SE 0.02; P<.001).

    Conclusions: Although the suggestions did not affect the number of daily steps, they increased the positive expectations of the participants and decreased their fatigue. These results indicate that adding positive suggestions to eHealth physical activity interventions might be a promising way of influencing subjective but not objective outcomes of interventions. Future research should focus on finding ways of strengthening the suggestions, as they have the potential to boost the effectiveness of eHealth interventions.

    Trial Registration: Open Science Framework 10.17605/OSF.IO/CWJES; https://osf.io/cwjes

    J Med Internet Res 2022;24(3):e32130

    doi:10.2196/32130

    Keywords

    eHealth; mobile health; physical activity; walking; positive suggestions; outcome expectations; mobile phone 


    Background

    eHealth interventions use information and communications technology, such as mobile phones and computers, to improve or enable health care. The widespread availability of smartphones and computers makes it possible to provide eHealth interventions to broad populations without significant financial costs. A large fraction of eHealth interventions focus on behavioral change and implementing healthy lifestyle habits such as an increase in physical activity and diet change [1]. Accumulating literature shows that eHealth apps can increase physical activity in various groups of the population, including adolescents [2], working-age women [3], older people [4], patients with cardiovascular diseases [5], and survivors of cancer [6]. At the same time, multiple meta-analyses and literature reviews have demonstrated that the effectiveness of various eHealth interventions varies and that the effects of these interventions decrease over time [2,4,7,8]. Several characteristics of the interventions have been proposed to increase their effectiveness: user-friendly design, real-time feedback, and health professional involvement [1].

    A possible way of increasing the effectiveness of eHealth interventions, which has not yet been investigated, is to manipulate the expectations of users regarding the intervention. This can be accomplished by providing users with positive suggestions that emphasize the effectiveness of the intervention. Positive outcome expectations are one of the primary mechanisms of placebo effects. A lot of research has been conducted on the effects of positive suggestions on the outcomes of various interventions [9-11]. For example, it has been demonstrated that optimizing the expectations of patients undergoing bypass surgery leads to lower disability in these patients 6 months after surgery [10]. Placebo effects induced by enhancing positive expectations of patients have also been found in pain, itch, depression, fatigue, and nausea [12-15]. In addition to changing the expectations of users, positive suggestions about the intervention can also increase the perceived credibility of the intervention and adherence of the users to the intervention [9,16].

    Although placebo effects induced by positive suggestions have been extensively investigated in various areas of health care, studies that look at the potential of using placebo effects in eHealth remain scarce. A recent study has used several types of positive suggestions to change the expectations of participants regarding a smartphone-delivered placebo intervention aimed at improving mood [17] and has found that expectations about the app and its credibility decreased during the 20 days of the placebo intervention. However, this decrease was less prominent in a combined suggestions condition in which participants were informed about the positive effects of the app before the start of the intervention and provided with positive feedback during the intervention [17]. Although this previous study aimed to increase positive expectations regarding a placebo intervention, no study to date has aimed to increase the effectiveness of an active eHealth intervention by changing the expectations of participants.

    Objectives

    This study investigates whether positive suggestions can influence the expectations of participants and increase the effectiveness of a physical activity smartphone intervention. We look at the effects of positive suggestions given before and during the intervention on several outcomes. The primary outcomes are (1) expectations of the participants regarding the effectiveness of the app and (2) the number of steps participants took during the intervention. The secondary outcomes are the perceived effectiveness of the app, engagement with the app, and vitality and fatigue of participants during the intervention.


    Ethics Approval

    This study was approved by the psychology research ethics committee of Leiden University (2020-09-14-AWMEvers- V2-2625). The study protocol was preregistered on Open Science Framework [18].

    Study Design

    A randomized, between-subjects study design was used. Participants were randomly allocated to one of the two conditions: (1) positive suggestions group (intervention with positive suggestions) and (2) control group (intervention without suggestions). A random number generator was used to block randomize participants to their condition with a block size of 6.

    The study was web based, and all measurements were performed via the internet. During the intervention, participants did not have direct contact with the researchers; however, in case they had questions, they could get in touch with the research team via email.

    Participants

    Healthy participants aged between 18 and 40 years were recruited for this study. Recruitment was conducted across the campus of Leiden University and using social media such as Facebook and WhatsApp groups of students. Inclusion criteria were the ability to sufficiently understand, read, and write English; ability to use smartphones and the internet; being in possession of a smartphone; and being willing to increase physical activity. Participants with medical conditions that could hinder a normal physical activity pattern (eg, joint problems or heart disease) were excluded from this study. Participants received €10 (US $11.43) or 8 study credit points for participating in the study in case they completed the whole intervention, €6 (US $6.86) or 6 study credits in case they completed 2 weeks, and €3 (US $3.43) or 3 credits if they completed the first week of the intervention. The reward was given after the end of the study.

    As no research so far has been performed on the effects of positive suggestions on the step count during an eHealth intervention, a study on the effects of positive suggestions on physical performance (weightlifting exercises) was chosen for the sample size calculation [19]. The power calculation, conducted with G*Power 3.1 [20], indicated that to detect a difference between positive suggestions and a control group using analysis of covariance, with an estimated effect size of Cohen f=0.47 [19], a critical α level of α=.05, and a power of β=.95, 31 participants per group, that is, 62 participants in total, would be needed. In a similar study by our laboratory, which used the same eHealth intervention in healthy volunteers, the dropout rate from the moment of recruitment until the end of the study was 33.6% (46/140). Therefore, we aimed to recruit 93 participants in this study.

    Procedure

    The study was advertised as a study testing a mobile phone physical activity intervention. Participants interested in the study were sent an information letter with the details about the study and were asked to digitally sign an informed consent form on the Qualtrics platform (Qualtrics International Inc). Participants were asked to ensure that they had either Google Fit or Apple Health apps installed on their phones at least 1 week before the start of the intervention. The step count data from these apps from the week preceding the intervention were retrieved by the study app and used as a baseline measurement of the average number of steps taken by the participants.

    Participants were sent a download link on Apple’s App Store and Google Play Store 1 week before the start of the intervention. After downloading the app, they were asked to fill in several baseline web-based questionnaires measuring their expectations about the app, vitality and fatigue they experienced during the past 2 weeks, motivation to exercise, anxiety, and expected engagement with the app. At this point, they were also asked to give permission to retrieve their step count from Google Fit or Apple Health and send them push notifications.

    On day 1 of the intervention, participants were randomly allocated to one of the following intervention conditions: intervention with positive suggestions or control intervention (without suggestions). On the morning of day 1 of the intervention, participants in the positive suggestions group received a web-based flyer with positive suggestions (Figure 1, left). Participants in the control group received a similar flyer describing the technical details of the study app (Figure 1, right). Participants were asked to read the flyers carefully, as the information given on them would be needed during the intervention. After reading the flyers, participants were asked to fill in a questionnaire measuring their expectations regarding the intervention. Every day of the intervention, at 9 AM, participants received a push notification from the study app. In addition, the study app retrieved the step data from Google Fit or Apple Health and tracked the number of steps participants took daily. On days 8 and 15 of the intervention, participants in the positive suggestions group were given brief booster suggestions regarding the intervention (Figure 2), and participants in both groups were asked to fill in short questionnaires about how effective and engaging they found the intervention. After the last day of the intervention, participants were asked to fill in several questionnaires that measured their perceived effectiveness of the intervention, engagement with the app, vitality, and fatigue. The flowchart with the steps of the study is presented in Multimedia Appendix 1.

    ‎
    Figure 1. The flyers with positive (left) and control (right) suggestions.
    View this figure
    ‎
    Figure 2. The screenshot of the short suggestions repeated on days 8 and 15 of the intervention.
    View this figure

    Experimental Interventions

    Study Conditions
    Positive Suggestions Group

    In the positive suggestions group, before the start of the intervention, participants received a leaflet with information regarding the effectiveness of the intervention. It emphasized that the study app has been shown to successfully motivate people to be more physically active and listed various positive effects of using the app. The flyer with positive suggestions is presented in Figure 1 (left).

    In addition, the suggestions were implemented in the study app and given to the participants again (booster suggestions) on days 8 and 15 of the intervention (end of the first and second weeks of the intervention). Only 2 very short boosters were given to avoid introducing too much difference in the amount of information that the control and experimental groups had to read. A screenshot of the booster suggestions is presented in Figure 2.

    Control Group

    In the control group, participants received a leaflet with the technical details about the study app. The information was similar in length to the information in the positive suggestions group but did not aim to influence the expectations of participants regarding the effectiveness of the intervention. The control leaflet is presented in Figure 1 (right).

    The Study App and Intervention

    The study app was developed with MobileCoach [21,22], an open-source software platform for smartphone-based and chatbot-delivered behavioral health interventions and ecological momentary assessments. MobileCoach-based interventions [23,24] have been used in various studies for, for example, stress management [25], personality change [26], promotion of health literacy [23], or physical activity [24]. The graphical user interface of the app is similar to WhatsApp or other messaging apps to leverage participants’ expertise in already-existing and well-known communication and interaction paradigms. The app connected to the Apple Health or Google Fit apps on the smartphone of a user and retrieved the step count from these apps every day of the intervention. Moreover, the app had integrated LimeSurvey questionnaires (LimeSurvey GmbH) that allowed the questionnaires to be sent to the users directly through the study app. The MobileCoach-based app of this study aimed to increase the physical activity of its users by increasing their daily step count. The app was tested in other research projects of our laboratory. No bugs or inconsistencies were found in the intervention during the trial. The step data of the participants who finished the intervention were fully available. The step data of participants who stopped with the intervention and did not open the app anymore were not available from the moment they stopped opening the app.

    The study intervention included onboarding and 21 days of active intervention. During the 21 intervention days, every morning, participants received several messages from the chatbot of the app, framed as a mobile step coach. These messages contained short psychological exercises that helped users set reasonable activity goals and think about reasons for participating in the intervention, possible barriers, and ways to overcome these barriers. Similar to other MobileCoach-based interventions [23,24], participants could communicate with the chatbot and type their responses in the app or use predefined answer options. The app used both predefined scripts and predefined answer options for maximum safety and traceability of the intervention progress. The conversational turns with the chatbot included human cues, for example, a picture of the coach, humor, and references to the personal life of the coach, to make the chatbot more human-like [27,28] and trigger a working alliance [23,29,30], which is robustly linked to intervention outcomes [31-33]. A screenshot of the app is presented in Figure 3. As the chatbot was not preprogrammed to converse on topics not related to the intervention, it was not able to reply to the spontaneous questions of participants. If participants needed assistance with the app or had any questions, they could get in touch with the researchers via email.

    ‎
    Figure 3. The screenshots of the app.
    View this figure

    The intervention was based on the Transtheoretical Model of Health Behavior Change [34]. This model views behavioral change as an upward spiraling process involving progress through five stages: precontemplation, contemplation, preparation, action, and maintenance. Each exercise of the intervention targeted one of the stages. In addition, several behavior change techniques were incorporated into the intervention, such as prompts, cues, information about health consequences, review of goals, and social rewards [35]. An overview of the intervention is presented in Multimedia Appendix 2 (including the stages of the health behavior change targeted by the exercises).

    Measurements and Questionnaires

    Demographic Characteristics

    Participants were asked about their age, gender, nationality, and height and weight. BMI was calculated based on the height and weight of participants using the following formula: weight (kg) divided by height (m2).

    Primary Outcomes

    Steps were measured by Google Fit or Apple Health on the phone of the participants and retrieved from these apps into the study app. Steps were measured for 1 week before the start of the intervention and for the 21 days of the intervention. The mean number of steps from the week before the start of the intervention was used as a baseline step measure. The number of steps on each day of the intervention was used in the analyses as the main outcome measure.

    Expectations regarding the effectiveness of the app were measured with six statements created for this study: (1) the app will help me become more physically active; (2) the app will motivate me to increase my step count; (3) the app will help me enjoy moving more; (4) the app will help me develop and maintain healthy habits; (5) using the app will make me feel more energized; and (6) using the app will make me sleep better. Participants were asked to evaluate these statements using a 5-point Likert scale (1=strongly disagree, 2=disagree, 3=neutral, 4=agree, and 5=strongly agree). Expectations were measured twice—at baseline before the flyer was given and after participants read the flyers with positive or control suggestions. The total score of the 6 statements was used in the analysis. The score could range between 6 and 30, with a higher score indicating more positive expectations. The internal consistencies of both baseline (α=.79) and day 1 (α=.80) measures were acceptable and good, respectively.

    Secondary Outcomes

    Perceived app effectiveness was measured with six statements created for this study that mirrored the questions about expectations: (1) the app helps me become more physically active; (2) the app motivates me to increase my step count; (3) the app helps me enjoy moving more; (4) the app helps me develop and maintain healthy habits; (5) using the app makes me feel more energized; and (6) using the app makes me sleep better. Participants were asked to evaluate these statements using a 5-point Likert scale (1=strongly disagree, 2=disagree, 3=neutral, 4=agree, and 5=strongly agree). The total score of the 6 statements was used in the analysis. The score could range between 6 and 30, with higher scores indicating more positive expectations. Perceived effectiveness was measured three times: on days 8 and 15 and after the last day of the intervention. The internal consistencies of day 8 (α=.86) and day 15 (α=.87) measures were good and excellent (α=.90), respectively.

    (Expected) Engagement with the app was measured with the TWente Engagement with EHealth Technologies Scale [36]. Two versions of the questionnaire were used: 1 measuring expected engagement and 1 measuring current engagement. The questionnaire contained 9 statements. The expected engagement questionnaire, measured at baseline and on day 1, asked users about how engaging they thought they would find the app. The engagement questionnaire, measured on days 8 and 15 and at the end of the intervention, asked about how engaging the users found the intervention. Participants were asked to rate the statements using a 5-point Likert scale (1=strongly disagree, 2=disagree, 3=neutral, 4=agree, and 5=strongly agree). The total score could range between 9 and 45, with higher scores on the questionnaire indicating higher engagement with the app. The internal consistency of the baseline measure was questionable (α=.69); however, the day 1 measure was of acceptable consistency (α=.79), and the day 8, day 15, and last day measures had good internal consistency (α=.83, .85, and .83, respectively).

    Vitality was measured using the Subjective Vitality Scale [37]. The Subjective Vitality Scale comprises 7 statements and measures the subjective feeling of being alive and alert during the past 2 weeks. Participants were asked to rate how true they found the statements on a 7-point Likert scale (1=not at all; 7=very true). The score could range between 7 and 49; higher scores on the composite scale could be interpreted as representing higher self-reported vitality. Vitality was measured at baseline before the start of the intervention and after the last day of the intervention.

    Fatigue was measured using the Checklist Individual Strength [38]. The Checklist Individual Strength comprises 20 statements that measure four dimensions of fatigue experienced during the past two weeks: fatigue severity, concentration problems, reduced motivation, and activity. Participants were asked to rate how true they found the statements on a 7-point Likert scale (1=yes, that is true; 7=no, that is not true). The score ranged between 20 and 140, and higher scores could be interpreted as higher fatigue. Fatigue was measured at baseline before the start of the intervention and after the last day of the intervention.

    The motivation to exercise was measured using the Behavioral Regulation in Exercise Questionnaire-2 [39]. The scale comprises 19 items. Participants were asked to indicate how true they found the statements on a 7-point Likert scale (1=not true for me; 7=very true for me). The questionnaire comprises five subscales: amotivation, external regulation, introjected regulation, identified regulation, and intrinsic regulation. Higher scores indicate higher motivation. The motivation to exercise was measured once at the baseline.

    Anxiety was measured using the Generalized Anxiety Disorder 7-item scale [40]. Participants were asked to indicate how often they had been bothered by a list of problems in the past 2 weeks on a 4-point Likert scale (0=not at all; 3=nearly every day). The score ranged between 0 and 21, with higher scores indicating higher levels of anxiety. Anxiety was measured once at baseline.

    Statistical Analysis

    Statistical analyses were performed using RStudio (version 1.1.447; R version 4.0.4). The data and the R code are made available on the web [18]. All tests were performed 2-tailed.

    To compare groups on baseline characteristics (age, BMI, steps during the week before the start of the intervention, baseline expectations, fatigue, vitality, baseline expected engagement with the MobileCoach, and motivation to exercise), independent-sample 2-tailed t tests or nonparametric Wilcoxon tests (in case of violations of assumptions) were used. To examine whether participants enrolled in the first and second rounds of the recruitment differed on the baseline measurements and the study outcomes (baseline steps, baseline and postintervention vitality and fatigue, steps during the intervention, and postintervention vitality and fatigue), independent-sample t tests or nonparametric Wilcoxon tests (in case of violations of assumptions) were used.

    To investigate whether the MobileCoach intervention had an effect on the number of steps participants took daily, we compared the mean of daily steps participants took in the week before the intervention with the mean of daily steps during the intervention with a paired-sample t test.

    The lmer function of the nlme package in R (R Core Team, 2013) was used for the linear mixed effects model analyses to test the main hypotheses of the study. The multilevel structure of the data was defined by day (level 1) nested in participants (level 2). Parameters were estimated using the full maximum-likelihood procedure. In all models, the intercept was allowed to vary randomly across participants. Random slopes did not improve the fit of the models; therefore, they were removed from the final analysis. The effect sizes (Cohen d) of all linear mixed effects models were calculated using the EMAtools package. Cohen d=0.2 was interpreted as a small effect size, Cohen d=0.5 as a medium effect size, and Cohen d=0.8 as a large effect size [41].

    To investigate whether the suggestions had an effect on the expectations of the participants regarding the effectiveness of the intervention, we used a linear mixed effects model. The expectations of day 1 (postsuggestions) were the dependent variable, and the independent variables were group and baseline expectations (presuggestions).

    To examine whether the suggestions had an effect on the steps taken during the intervention, we used a linear mixed effects model approach. Steps per each of the 21 days of the intervention were used as the dependent variable, and group, baseline steps (to control for the individual baseline differences in walking), and day were the independent variables.

    To examine whether the suggestions had an effect on the perceived effectiveness of the intervention, a linear mixed effects model was used with the effectiveness of the intervention as the dependent variable and group and day as independent variables.

    To examine whether the suggestions had an effect on the expected engagement with the app, a linear mixed effects model was used with postsuggestions expected engagement as the dependent variable and group and presuggestions expected engagement as independent variables. To investigate whether suggestions had an effect on engagement with the app during the intervention, a linear mixed effects model was used with engagement as the dependent variable and day and group as independent variables.

    To examine whether the suggestions had an effect on vitality and fatigue, 2 separate linear mixed effects models were used with vitality or fatigue during the intervention as the dependent variable and group and baseline vitality or fatigue as independent variables.

    To examine whether postsuggestion expectations had an effect on the dependent variables, several similar models were created with postsuggestion expectations instead of the group as an independent variable and step count, perceived app effectiveness, (expected) engagement, vitality, and fatigue as dependent variables.


    Participants

    In the first round of the study, 93 participants were recruited between November 2020 and December 2020. As the inclusion criteria were presented in the advertisement, no participants had to be excluded based on not meeting the inclusion criteria. However, the dropout rate was larger than expected, and full data of only 39.8% (37/93) participants were available after the first round of data collection. Therefore, the intervention was performed again in February 2021, with 45 more participants recruited into the study to reach the intended sample size. No follow-up was conducted with the participants who stopped prematurely because of the web-based nature of the study. Therefore, the reasons why the participants dropped out remain unknown.

    In total, 138 participants were randomized between 2 groups; 133 (96.4%) participants started the study, and the full data of 79 (57.2%) participants were available. The flowchart of the participants included in each step and dropouts is presented in Multimedia Appendix 3. An overview of the missing data is presented in Multimedia Appendix 4. All available data were included in the analyses, and the number of participants included in each analysis is presented in the results.

    Demographics and Baseline Characteristics

    Of the 133 participants, 69 (51.9%) participants (n=55, 80% women; n=13, 19% men; and n=1, 1% other) were assigned to the positive suggestions group and 64 (48.1%; n=56, 88% women and n=8, 13% men) to the control group. The mean age of the sample was 23.3 (SD 6.1) years. An overview of the baseline characteristics across the groups with comparison tests is presented in Table 1. No differences in characteristics were found between any of the groups. No differences were found in the baseline measurements and the outcomes of the study between the participants who took part in the first and second rounds of the recruitment.

    Table 1. Mean scores of the baseline variables per group and the comparison statistics (N=133).
    VariablePositive suggestions group (n=69)Control group (n=64)t test (df)Wilcoxon testaP value

    		Value,
    mean (SD)    		Value,
    n (%)    		Value,
    mean (SD)    		Value,
    n (%)


    Age (years)24.00 (6.79)69 (100)22.45 (5.26)64 (100)—a1939.22
    BMI (kg/m2)23.08 (4.52)66 (96)22.71 (3.38)61 (95)—2004.97
    Steps4060.47 (2271.2)55 (80)4172.77 (2576.11)53 (83)—1457.99
    Expectations about app effectiveness21.29 (2.87)69 (100)21.05 (3.12)64 (100)—2171.87
    Expected engagement with the study app30.06 (2.75)69 (100)30.20 (2.86)64 (100)0.30 (131)—.77
    Vitality4.25 (0.88)69 (100)4.28 (0.87)64 (100)0.25 (131)—.81
    Fatigue30.12 (9.61)69 (100)30.98 (8.95)64 (100)0.54 (131)—.59
    Anxiety5.49 (3.97)69 (100)6.05 (4.7)64 (100)—2279.75
    Motivation to exercise

    		Amotivation5.61 (2.49)69 (100)5.62 (2.57)64 (100)—2170.85

    		External6.04 (2.65)69 (100)6.23 (3.16)64 (100)—2178.89

    		Introjected8.54 (3.37)69 (100)9.45 (3.27)64 (100)—2508.18

    		Identified14.46 (3.72)69 (100)14.59 (3.82)64 (100)—2255.83

    		Intrinsic13.94 (4.6)69 (100)13.59 (4.36)64 (100)—2256 .83

    aWilcoxon test coefficient was used in case a variable was not normally distributed.

    Primary Analyses

    Expectations

    Expectations significantly differed between groups, with a medium effect size (B=−1.61, SE 0.47; t124=−3.40; P<.001; Cohen d=0.61; 125/133, 94%) when controlling for the presuggestion expectations: participants in the positive suggestions group (mean 21.82, SD 2.64) expected the app to be more effective than participants in the control group (mean 20.98, SD 3.23). The mean expectations for each group are presented in Figure 4.

    ‎
    Figure 4. Mean expectations scores per group at baseline and after the flyer with suggestions was sent to participants on day 1. The error bars indicate SDs.
    View this figure
    Steps

    Irrespective of the group, participants significantly increased the number of daily steps during the intervention (mean 5689.6, SD 2718.3) compared with the mean number of daily steps during the week before the intervention (mean 4115.5, SD 2414.9; t107=−8.62; P<.001; 108/133, 81.2%).

    The difference between the steps performed on each day of the intervention and the mean number of steps from the baseline week is shown in Figure 5. The multilevel model with the number of steps during the intervention as a dependent variable; baseline steps, day, and group as predictors; and a random intercept (108/133, 81.2%) demonstrated no significant effect of the group on the number of steps (B=−22.05, SE 334.90; t105=−0.07; P=.95; Cohen d=0.01). The model showed that the variable day significantly predicted the number of steps: participants in both groups increased the number of steps they took daily during the intervention (B=37.47, SE 12.51; t2009=2.99; P=.003). However, the effect size of the day as a predictor was negligible (Cohen d=0.13). Baseline steps also significantly predicted the steps taken during the intervention with a large effect size (B=0.71, SE 0.07; t105=10.48; P<.001; Cohen d=1.97): participants who took more steps in the baseline week also took more steps during the intervention.

    ‎
    Figure 5. The difference between the mean number of steps taken during the intervention per day and the baseline mean steps per group. The error bars indicate SDs.
    View this figure

    The model with postsuggestion expectations instead of the group (108/133, 81.2%) demonstrated that expectations did not influence the number of steps taken during the intervention (B=−44.06, SE 59.68; t105=−0.74; P=.46; Cohen d=0.14). The effects of the day (B=37.56, SE 12.51; t2009=3; P=.003; Cohen d=0.13) and baseline steps (B=0.70, SE 0.07; t105=10.08; P<.001; Cohen d=1.97) were also significant in this model.

    Secondary Analyses

    Perceived App Effectiveness

    The reported effectiveness of the app is presented in Multimedia Appendix 5.

    The multilevel model with the app effectiveness as a dependent variable, group and day number as predictors, and a random intercept (122/133, 91.7%) demonstrated that the group did not influence the perceived app effectiveness (B=0.78, SE 0.69; t120=1.12; P=.26; Cohen d=0.21). The day variable had an effect on the effectiveness: participants reported an increase in the effectiveness of the app during the intervention (B=0.06, SE 0.02; t210=2.81; P=.005; Cohen d=0.39).

    (Expected) Engagement With the App

    The multilevel model with group and baseline (presuggestions) expected engagement as predictors and random intercept varying across participants (127/133, 95.5%) demonstrated that the group had a significant effect on the postsuggestions expected engagement (B=3.80, SE 0.63; t124=6.04; P<.001; Cohen d=1.09) when controlling for the presuggestions expected engagement: participants in the positive suggestions group (mean 31.62, SD 3.31) expected the app to be more engaging than participants in the control group (mean 30.41, SD 3.26).

    Another model with engagement as a dependent variable, and group (122/133, 91.7%) and day number as predictors demonstrated that neither group (B=0.78, SE 0.75; t120=1.06; P=.29; Cohen d=0.19) nor day (B=0.042, SE 0.03; t210=1.60; P=.11; Cohen d=0.22) had an effect on the reported engagement.

    Vitality

    The multilevel model with vitality during the intervention as a dependent variable, group and baseline vitality as predictors, and a random intercept (117/133, 88%) demonstrated that the group did not have an effect on vitality during the intervention (B=0.01, SE 0.11; t114=−0.07; P=.95; Cohen d=0.01). Baseline vitality was positively associated with vitality during the intervention (B=0.20, SE 0.02; t114=11.11; P<.001; Cohen d=2.08).

    Fatigue

    The multilevel model with fatigue during the intervention as a dependent variable and group and baseline fatigue as predictors (133/133, 100%) demonstrated that the group significantly predicted fatigue (B=3.09, SE 0.59; t130=5.22; P<.001; Cohen d=0.92): participants in the positive suggestions group (mean 23.49, SD 12.47) reported lower fatigue than participants in the control group (mean 24.94, SD 11.62). Baseline fatigue positively predicted fatigue during the intervention (B=0.11, SE 0.02; t130=6.68; P<.001; Cohen d=1.17).

    Postsuggestion Expectations

    Postsuggestions expectations significantly influenced the perceived app effectiveness (B=0.62, SE 0.10; t119=6.13; P<.001; Cohen d=1.12; 121/133, 91%): the higher expectations participants had about the app on day 1, the higher the app effectiveness they reported during the intervention. Postsuggestion expectations also significantly, and with a large effect size, influenced the vitality of participants (B=0.02, SE 0.004; t114=5.09; P<.001; Cohen d=0.95; 117/133, 88%): higher expectations were linked to higher vitality during the intervention. The postsuggestion expectations had no effect on fatigue (B=−0.04, SE 0.02; t124=−1.79; P=.08; Cohen d=0.32, 127/133, 95.5%).


    Principal Findings

    The aim of this study was to investigate whether it is possible to improve the effectiveness of a physical activity smartphone intervention through positive suggestions. We demonstrated that positive suggestions affected the expectations of participants regarding the effectiveness of the app; however, they were not effective enough to affect the main outcome; that is, daily step count. In addition, participants in the positive suggestions group reported higher expected engagement with the app and lower fatigue during the intervention than the participants in the control group.

    The smartphone intervention was effective in helping people increase their physical activity. Participants in both groups walked on average 1500 (SD 2517) steps more during the intervention than before the intervention. Moreover, there was some indication that participants increased their daily steps as the intervention progressed; however, despite the significant effect, the effect size was negligible. This result was expected as the intervention included the phases of the Transtheoretical Model of Health Behavior Change that starts with precontemplation and contemplation about the behavior change and ends with the maintenance of new health behavior [34]. A number of studies demonstrated that physical activity interventions based on the Transtheoretical Model of Health Behavior Change could efficiently increase physical activity in various populations [42-44]. In addition, multiple other smartphone interventions based on different theoretical approaches were shown to increase the physical activity of app users [2,3,8]. Therefore, our results are in line with the literature showing that a psychological smartphone intervention can be successful in helping people increase their physical activity, at least in the short term.

    Two outcomes were considered primary in this study: expectations of participants regarding the effectiveness of the intervention and the number of steps taken during the intervention. We hypothesized that positive suggestions would change the expectations of participants, and these increased positive expectations, in turn, would lead to a better outcome of the intervention—an increase in the daily step count. This model is often described in the literature as a working mechanism of placebo effects: positive suggestions induce a change in expectations, and positive expectations lead to better treatment outcomes [16]. The first part of our primary hypothesis was supported by the data: participants in the positive suggestions group indeed reported expecting better effectiveness of the app than the control group. Although the change in the expectations score was quite small, the effect size was shown to be medium. This result is in line with the broad literature on placebo effects: multiple studies demonstrated that positive suggestions given by a health care professional, or an experimenter, can change the expectations of people regarding various types of interventions—in pain [45,46], itch [47,48], nausea [49,50], and many other symptoms [13,15,51].

    Despite the effectiveness of the expectancy manipulation, changing the expectations of participants was not enough to influence their daily step count: no difference was found between the groups in their number of steps during the 21 days of the intervention. Moreover, expectations regarding app effectiveness were not predictive of the number of steps participants made, which may explain why an increase in expectations did not affect the step count. These results do not support our main hypothesis and contradict the literature on treatment expectations [52]. The reason for this contradiction can be that our study differs from other studies that used positive suggestions. Most of the research applied positive suggestions focused on symptom-reducing interventions, such as interventions decreasing pain [45,46], itch [53], or nausea [54] or improving mood [55,56]. The intervention that we used in our study aimed to change the behavioral habits of people and required active action from users. Different mechanisms might be involved in interventions that relieve subjective symptoms, such as pain, and interventions that target to change behavior. We can speculate that expecting an overall positive change is not specific enough to improve the outcomes of such interventions and affect their behavior. According to the self-efficacy theory of Bandura [57,58], self-efficacy beliefs have to be very specific to successfully influence behavior, and possibly this specificity was lacking in the suggestions we gave. Generic positive suggestions about an intervention might be more powerful for some subjective outcomes, such as fatigue, which was influenced by positive suggestions in our study. Similar results were found in previous research aimed at influencing food choices by positive suggestions: suggestions influenced subjective food preferences but not actual behavior [59,60]. Our results confirm the results of multiple studies that have demonstrated that fatigue can be decreased by positive suggestions regarding various placebo treatments [19,61].

    Another explanation for the failure to confirm the main hypothesis for step count could be the fact that the suggestions given in this study were quite minor. Participants received a flyer with suggestions at the beginning of the study, and the suggestions were briefly repeated on days 8 and 15 of the intervention. It is possible that if the suggestions were more extensive and implemented in each element of the intervention itself, they might have affected the physical activity of the participants.

    Finally, the possibility exists that the suggestions did not influence the number of steps but some other parameters that, in turn, could have affected fatigue. The app was not able to measure the pace of walking or the frequency of walking of participants. If positive suggestions affected the walking pace and frequency, these increases in physical activity could have caused the experimental group to experience less fatigue during the intervention.

    Limitations

    Several limitations of this study have to be addressed. First, the participants of this study were young and healthy university students. This group is very familiar and comfortable with using mobile phone apps. Therefore, the effects found in this study might not be generalizable to older and less technically experienced populations. It can be that older and less technically experienced people would find it harder to use the app, and therefore, the effects of the app could be smaller in this group of people. At the same time, our main goal was to investigate the effects of positive suggestions on app effectiveness, and there is no particular reason for assuming that computer literacy would influence these effects. Second, several other control groups could have been included in the study to enable us to interpret the results more fully. For example, this study did not include a control group that did not participate in the intervention. This fact makes it impossible to pinpoint whether the intervention was the reason for the increase in physical activity of participants. However, as the main aim was to investigate the effect of positive suggestions, we omitted this experimental condition. In addition, a comparison was made between a group that received a flyer with positive suggestions and a group that received a flyer with technical details. The possibility remains that the fact of presenting users technical versus nontechnical information influenced the study results on top of the presentation of positive versus neutral information. Future research should investigate whether nontechnical neutral information about eHealth apps differently influences their effectiveness. Another limitation of the study is that no follow-up was performed. It remains unknown whether participants would maintain the new habits that they developed during the intervention or the positive effects would disappear quickly after the intervention’s end. Moreover, a selection bias may have been present in this study. It was advertised as a study aimed at increasing physical activity, which might have attracted participants who were already interested in changing their lifestyles. It would be interesting to see how effective the suggestions would be in less motivated or less healthy participants, particularly as a recent meta-analysis of the effects of physical activity eHealth interventions demonstrated that clinical and at-risk groups benefit from such interventions more than healthy volunteers [8]. Another possible limitation of this study is that social desirability might have played a role in the effects we have found. Studies show that similar social desirability patterns occur in interactions with conversational agents, especially when the conversational agent is more human-like [62,63]. The study app used human cues to establish a better working alliance with the participants. However, it could have triggered the participants to give more socially desirable answers on subjective self-report measures.

    Conclusions

    In summary, we have demonstrated that short positive suggestions regarding the effectiveness of a mobile health app can affect the expectations of users and decrease their fatigue. Although no effect was found on the main outcome—the step count—these results indicate that eHealth interventions might benefit from adding positive suggestions to the description of the apps. Suggestions are an easy and effective way of giving an extra boost to the effectiveness of eHealth interventions, which does not require extra time or investment. Future research should focus on optimizing such suggestions to achieve actual behavior changes.

    Acknowledgments

    The authors would like to acknowledge bachelor’s students Ivana Dumucic, Vanessa Eastick, Emma Franke, Nicola Hughes, Katja Salauyova, Ines Sánchez-Saura, and Rasa Urbanaviciutes for their help with data collection. The authors would also like to thank the members of BENEFIT Consortium. This work was supported by an NWO Vici Grant (016.Vici.170.152) granted to AE, the Dutch Heart Foundation, and ZonMw (The Netherlands Organization for Health Research and Development). The funders had no role in data acquisition, data analyses, or the content of the manuscript.

    Authors' Contributions

    AS, DSV, HvM, and AE developed the idea of the study. TCR, TK, and PS designed and implemented the MobileCoach-based intervention. AS collected the data and performed the statistical analysis. AS wrote the first version of the manuscript with input from all authors. AE supervised the entire project.

    Conflicts of Interest

    PS and TK are affiliated with the Centre for Digital Health Interventions, a joint initiative of the Department of Management, Technology, and Economics at ETH Zürich and the Institute of Technology Management at the University of St Gallen, which is funded in part by the Swiss health insurer CSS. TK is also a cofounder of Pathmate Technologies, a university spinoff company that creates and delivers digital clinical pathways and has used the open-source MobileCoach platform for that purpose as well. However, neither CSS nor Pathmate Technologies were involved in the design, data analysis, or results reported in this study.

    ‎
    Multimedia Appendix 1

    The flowchart of the study methods.

    PNG File , 39 KB
    ‎
    Multimedia Appendix 2

    Overview of the intervention.

    PNG File , 1336 KB
    ‎
    Multimedia Appendix 3

    Study flowchart depicting the number of participants in each step of the study.

    PNG File , 36 KB
    ‎
    Multimedia Appendix 4

    Overview of the missing data per outcome variable.

    PNG File , 35 KB
    ‎
    Multimedia Appendix 5

    Mean perceived effectiveness of the app score per group with SDs.

    PNG File , 19 KB
    ‎
    Multimedia Appendix 6

    CONSORT-eHEALTH checklist (V 1.6.1).

    PDF File (Adobe PDF File), 1216 KB
    1. Zhao J, Freeman B, Li M. Can mobile phone apps influence people's health behavior change? An evidence review. J Med Internet Res 2016;18(11):e287 [FREE Full text] [CrossRef] [Medline]
    2. Rose T, Barker M, Maria Jacob C, Morrison L, Lawrence W, Strömmer S, et al. A systematic review of digital interventions for improving the diet and physical activity behaviors of adolescents. J Adolesc Health 2017;61(6):669-677. [CrossRef] [Medline]
    3. Cotie LM, Prince SA, Elliott CG, Ziss MC, McDonnell LA, Mullen KA, et al. The effectiveness of eHealth interventions on physical activity and measures of obesity among working-age women: a systematic review and meta-analysis. Obes Rev 2018;19(10):1340-1358. [CrossRef] [Medline]
    4. Jonkman NH, van Schooten KS, Maier AB, Pijnappels M. eHealth interventions to promote objectively measured physical activity in community-dwelling older people. Maturitas 2018;113:32-39. [CrossRef] [Medline]
    5. Duff OM, Walsh DM, Furlong BA, O'Connor NE, Moran KA, Woods CB. Behavior change techniques in physical activity eHealth interventions for people with cardiovascular disease: systematic review. J Med Internet Res 2017;19(8):e281 [FREE Full text] [CrossRef] [Medline]
    6. Haberlin C, O'Dwyer T, Mockler D, Moran J, O'Donnell DM, Broderick J. The use of eHealth to promote physical activity in cancer survivors: a systematic review. Support Care Cancer 2018;26(10):3323-3336. [CrossRef] [Medline]
    7. Oosterveen E, Tzelepis F, Ashton L, Hutchesson MJ. A systematic review of eHealth behavioral interventions targeting smoking, nutrition, alcohol, physical activity and/or obesity for young adults. Prev Med 2017;99:197-206. [CrossRef] [Medline]
    8. Mönninghoff A, Kramer JN, Hess AJ, Ismailova K, Teepe GW, Tudor Car L, et al. Long-term effectiveness of mHealth physical activity interventions: systematic review and meta-analysis of randomized controlled trials. J Med Internet Res 2021;23(4):e26699. [CrossRef] [Medline]
    9. Spagnolo PA, Colloca L, Heilig M. The role of expectation in the therapeutic outcomes of alcohol and drug addiction treatments. Alcohol Alcohol 2015;50(3):285-285. [CrossRef] [Medline]
    10. Rief W, Shedden-Mora MC, Laferton JA, Auer C, Petrie KJ, Salzmann S, et al. Preoperative optimization of patient expectations improves long-term outcome in heart surgery patients: results of the randomized controlled PSY-HEART trial. BMC Med 2017;15(1):4. [CrossRef] [Medline]
    11. Enck P, Bingel U, Schedlowski M, Rief W. The placebo response in medicine: minimize, maximize or personalize? Nat Rev Drug Discov 2013;12(3):191-204. [CrossRef] [Medline]
    12. Bartels DJ, van Laarhoven AI, Haverkamp EA, Wilder-Smith OH, Donders AR, van Middendorp H, et al. Role of conditioning and verbal suggestion in placebo and nocebo effects on itch. PLoS One 2014;9(3):e91727. [CrossRef] [Medline]
    13. Benedetti F, Pollo A, Lopiano L, Lanotte M, Vighetti S, Rainero I. Conscious expectation and unconscious conditioning in analgesic, motor, and hormonal placebo/nocebo responses. J Neurosci 2003;23(10):4315-4323. [CrossRef] [Medline]
    14. Mondloch MV, Cole DC, Frank JW. Does how you do depend on how you think you'll do? A systematic review of the evidence for a relation between patients' recovery expectations and health outcomes. CMAJ 2001;165(2):174-179. [Medline]
    15. Wolters F, Peerdeman KJ, Evers AW. Placebo and nocebo effects across symptoms: from pain to fatigue, dyspnea, nausea, and itch. Front Psychiatry 2019;10:470 [FREE Full text] [CrossRef] [Medline]
    16. Colloca L, Miller FG. How placebo responses are formed: a learning perspective. Philos Trans R Soc Lond B Biol Sci 2011;366(1572):1859-1869 [FREE Full text] [CrossRef] [Medline]
    17. Stalujanis E, Neufeld J, Glaus Stalder M, Belardi A, Tegethoff M, Meinlschmidt G. Induction of efficacy expectancies in an ambulatory smartphone-based digital placebo mental health intervention: randomized controlled trial. JMIR Mhealth Uhealth 2021;9(2):e20329 [FREE Full text] [CrossRef] [Medline]
    18. Increasing the efficiency of the Mobile Step Coach with positive verbal suggestions. Osf registries. 2020.   URL: https://osf.io/cwjes [accessed 2022-02-07]
    19. Pollo A, Carlino E, Benedetti F. The top-down influence of ergogenic placebos on muscle work and fatigue. Eur J Neurosci 2008;28(2):379-388. [CrossRef] [Medline]
    20. Faul F, Erdfelder E, Lang AG, Buchner A. G*Power 3: a flexible statistical power analysis program for the social, behavioral, and biomedical sciences. Behav Res Methods 2007;39(2):175-191. [CrossRef] [Medline]
    21. Filler A, Kowatsch T, Haug S, Wahle F, Staake T, Fleisch E. MobileCoach: a novel open source platform for the design of evidence-based, scalable and low-cost behavioral health interventions: overview and preliminary evaluation in the public health context. In: 2015 Wireless Telecommunications Symposium. Piscataway: IEEE; 2015 Presented at: WTS '15; April 15-17, 2015; New York p. 1-6. [CrossRef]
    22. Kowatsch T, Volland D, Shih I, Rüegger D, Künzler F, Barata F, et al. Design and evaluation of a mobile chat app for the open source behavioral health intervention platform MobileCoach. In: Proceedings of the 12th International Conference on Design Science Research in Information System and Technology. 2017 Presented at: DESRIST '17; May 30-June 1, 2017; Karlsruhe p. 485-489. [CrossRef]
    23. Kowatsch T, Schachner T, Harperink S, Barata F, Dittler U, Xiao G, et al. Conversational agents as mediating social actors in chronic disease management involving health care professionals, patients, and family members: multisite single-arm feasibility study. J Med Internet Res 2021;23(2):e25060. [CrossRef] [Medline]
    24. Kramer JN, Künzler F, Mishra V, Smith SN, Kotz D, Scholz U, et al. Which components of a smartphone walking app help users to reach personalized step goals? Results from an optimization trial. Ann Behav Med 2020;54(7):518-528. [CrossRef] [Medline]
    25. Hauser-Ulrich S, Künzli H, Meier-Peterhans D, Kowatsch T. A smartphone-based health care chatbot to promote self-management of chronic pain (SELMA): pilot randomized controlled trial. JMIR Mhealth Uhealth 2020;8(4):e15806. [CrossRef] [Medline]
    26. Stieger M, Flückiger C, Rüegger D, Kowatsch T, Roberts BW, Allemand M. Changing personality traits with the help of a digital personality change intervention. Proc Natl Acad Sci U S A 2021;118(8):e2017548118. [CrossRef] [Medline]
    27. Nass C, Steuer J, Tauber ER. Computers are social actors. In: Proceedings of the SIGCHI conference on human factors in computing systems. 1994 Presented at: CHI '94; April 24-28, 1994; Boston p. 72-78. [CrossRef]
    28. ter Stal S, Kramer LL, Tabak M, op den Akker H, Hermens H. Design features of embodied conversational agents in eHealth: a literature review. Int J Hum-Comput Stud 2020;138:102409. [CrossRef]
    29. Horvath AO, Greenberg LS. Development and validation of the Working Alliance Inventory. J Couns Psychol 1989;36(2):223-233. [CrossRef]
    30. Bickmore T, Gruber A, Picard R. Establishing the computer-patient working alliance in automated health behavior change interventions. Patient Educ Couns 2005;59(1):21-30. [CrossRef] [Medline]
    31. Del Re AC, Flückiger C, Horvath AO, Wampold BE. Examining therapist effects in the alliance-outcome relationship: a multilevel meta-analysis. J Consult Clin Psychol 2021;89(5):371-378. [CrossRef] [Medline]
    32. Flückiger C, Del Re AC, Wampold BE, Horvath AO. The alliance in adult psychotherapy: a meta-analytic synthesis. Psychotherapy (Chic) 2018;55(4):316-340. [CrossRef] [Medline]
    33. Flückiger C, Del Re AC, Wampold BE, Symonds D, Horvath AO. How central is the alliance in psychotherapy? A multilevel longitudinal meta-analysis. J Couns Psychol 2012;59(1):10-17. [CrossRef] [Medline]
    34. Prochaska JO, Velicer WF. The transtheoretical model of health behavior change. Am J Health Promot 1997;12(1):38-48. [CrossRef] [Medline]
    35. Michie S, Johnston M. Behavior change techniques. In: Gellman MD, Turner RJ, editors. Encyclopaedia of Behavioral Medicine. New York: Springer; 2013:182-187.
    36. Kelders SM, Kip H. Development and initial validation of a scale to measure engagement with eHealth technologies. In: Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems. 2019 Presented at: CHI EA '19; May 4-9, 2019; Glasgow p. 1-6. [CrossRef]
    37. Ryan RM, Frederick C. On energy, personality, and health: subjective vitality as a dynamic reflection of well-being. J Pers 1997;65(3):529-565. [CrossRef] [Medline]
    38. Vercoulen JH, Alberts M, Bleijenberg G. De checklist individuele spankracht (CIS). Gedragstherapie 1999;32(131):6 [FREE Full text]
    39. Markland D, Tobin V. A modification to the behavioural regulation in exercise questionnaire to include an assessment of amotivation. J Sport Exerc Psychol 2004;26(2):191-196. [CrossRef]
    40. Spitzer RL, Kroenke K, Williams JB, Löwe B. A brief measure for assessing generalized anxiety disorder: the GAD-7. Arch Intern Med 2006;166(10):1092-1097. [CrossRef] [Medline]
    41. Cohen J. Statistical Power Analysis for the Behavioral Sciences. 2nd Edition. Milton Park: Routledge; 1988.
    42. Marcus BH, Banspach SW, Lefebvre RC, Rossi JS, Carleton RA, Abrams DB. Using the stages of change model to increase the adoption of physical activity among community participants. Am J Health Promot 1992;6(6):424-429. [CrossRef] [Medline]
    43. Calfas KJ, Sallis JF, Oldenburg B, Ffrench M. Mediators of change in physical activity following an intervention in primary care: PACE. Prev Med 1997;26(3):297-304. [CrossRef] [Medline]
    44. Steptoe A, Kerry S, Rink E, Hilton S. The impact of behavioral counseling on stage of change in fat intake, physical activity, and cigarette smoking in adults at increased risk of coronary heart disease. Am J Public Health 2001;91(2):265-269. [CrossRef] [Medline]
    45. Peerdeman KJ, van Laarhoven AI, Peters ML, Evers AW. An integrative review of the influence of expectancies on pain. Front Psychol 2016;7:1270 [FREE Full text] [CrossRef] [Medline]
    46. Vase L, Wartolowska K. Pain, placebo, and test of treatment efficacy: a narrative review. Br J Anaesth 2019;123(2):e254-e262 [FREE Full text] [CrossRef] [Medline]
    47. Meeuwis SH, van Middendorp H, Veldhuijzen DS, van Laarhoven AI, De Houwer J, Lavrijsen AP, et al. Placebo effects of open-label verbal suggestions on itch. Acta Derm Venereol 2018;98(2):268-274. [CrossRef] [Medline]
    48. Meeuwis SH, van Middendorp H, van Laarhoven AI, Veldhuijzen DS, Lavrijsen AP, Evers AW. Effects of open- and closed-label nocebo and placebo suggestions on itch and itch expectations. Front Psychiatry 2019;10:436 [FREE Full text] [CrossRef] [Medline]
    49. Müller V, Remus K, Hoffmann V, Tschöp MH, Meissner K. Effectiveness of a placebo intervention on visually induced nausea in women – a randomized controlled pilot study. J Psychosom Res 2016;91:9-11. [CrossRef] [Medline]
    50. Weimer K, Schulte J, Maichle A, Muth ER, Scisco JL, Horing B, et al. Effects of ginger and expectations on symptoms of nausea in a balanced placebo design. PLoS One 2012;7(11):e49031. [CrossRef] [Medline]
    51. Isenberg SA, Lehrer PM, Hochron S. The effects of suggestion on airways of asthmatic subjects breathing room air as a suggested bronchoconstrictor and bronchodilator. J Psychosom Res 1992;36(8):769-776. [CrossRef] [Medline]
    52. Bingel U. Placebo 2.0: the impact of expectations on analgesic treatment outcome. Pain 2020;161 Suppl 1:S48-S56. [CrossRef] [Medline]
    53. Darragh M, Chang JW, Booth RJ, Consedine NS. The placebo effect in inflammatory skin reactions: the influence of verbal suggestion on itch and weal size. J Psychosom Res 2015;78(5):489-494. [CrossRef] [Medline]
    54. Quinn VF, Colagiuri B. Placebo interventions for nausea: a systematic review. Ann Behav Med 2015;49(3):449-462. [CrossRef] [Medline]
    55. Sher L. The placebo effect on mood and behavior: the role of the endogenous opioid system. Med Hypotheses 1997;48(4):347-349. [CrossRef] [Medline]
    56. Kirsch I. Response expectancy and the placebo effect. Int Rev Neurobiol 2018;138:81-93. [CrossRef] [Medline]
    57. Bandura A. Self-efficacy: toward a unifying theory of behavioral change. Psychol Rev 1977;84(2):191-215. [CrossRef] [Medline]
    58. Bandura A, Freeman WH, Lightsey R. Self-efficacy: the exercise of control. J Cogn Psychother 1999;13(2):158-166. [CrossRef]
    59. Schakel L, Veldhuijzen DS, van Middendorp V, Van Dessel P, De Houwer J, Bidarra R, et al. The effects of a gamified approach avoidance training and verbal suggestions on food outcomes. PLoS One 2018;13(7):e0201309. [CrossRef] [Medline]
    60. Schakel L, Veldhuijzen DS, Manai M, van Beugen S, van der Vaart R, van Middendorp H, et al. Editor's choice: optimizing healthy food preferences by serious gaming. Psychol Health 2020;35(4):405-424. [CrossRef] [Medline]
    61. Fiorio M, Emadi Andani M, Marotta A, Classen J, Tinazzi M. Placebo-induced changes in excitatory and inhibitory corticospinal circuits during motor performance. J Neurosci 2014;34(11):3993-4005. [CrossRef] [Medline]
    62. Schuetzler RM, Giboney JS, Grimes GM, Nunamaker Jr JF. The influence of conversational agent embodiment and conversational relevance on socially desirable responding. Decis Support Syst 2018;114:94-102. [CrossRef]
    63. Pickard MD, Roster CA. Using computer automated systems to conduct personal interviews: does the mere presence of a human face inhibit disclosure? Comput Hum Behav 2020;105:106197. [CrossRef]

    Edited by A Mavragani; submitted 15.07.21; peer-reviewed by J Trevino, M Barroso Hurtado, M Khokhar; comments to author 18.08.21; revised version received 29.09.21; accepted 07.12.21; published 01.03.22

    Copyright

    ©Aleksandrina Skvortsova, Talia Cohen Rodrigues, David de Buisonjé, Tobias Kowatsch, Prabhakaran Santhanam, Dieuwke S Veldhuijzen, Henriët van Middendorp, Andrea Evers. Originally published in the Journal of Medical Internet Research (https://www.jmir.org), 01.03.2022.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on https://www.jmir.org/, as well as this copyright and license information must be included.