This paper is in the following e-collection/theme issue:

Web-based and Mobile Health Interventions (3297)

Published on in Vol 17, No 10 (2015): October

Comparing a Video and Text Version of a Web-Based Computer-Tailored Intervention for Obesity Prevention: A Randomized Controlled Trial

Comparing a Video and Text Version of a Web-Based Computer-Tailored Intervention for Obesity Prevention: A Randomized Controlled Trial

Comparing a Video and Text Version of a Web-Based Computer-Tailored Intervention for Obesity Prevention: A Randomized Controlled Trial

Authors of this article:

Michel Jean Louis Walthouwer1, 2 Author Orcid Image ;   Anke Oenema1, 2 Author Orcid Image ;   Lilian Lechner2, 3 Author Orcid Image ;   Hein de Vries1, 2 Author Orcid Image
Article Authors Cited by (36) Tweetations (4) Metrics

    Original Paper

    1Maastricht University, Department of Health Promotion, Maastricht, Netherlands

    2School for Public Health and Primary Care (CAPHRI), Maastricht University, Maastricht, Netherlands

    3Open University, Heerlen, Netherlands

    Corresponding Author:

    Michel Jean Louis Walthouwer, MSc

    Maastricht University

    Department of Health Promotion

    PO Box 616

    Maastricht, 6200 MD

    Netherlands

    Phone: 31 43 3882402

    Fax:31 43 3882402

    Email: michel.walthouwer@maastrichtuniversity.nl


    Background: Web-based computer-tailored interventions often suffer from small effect sizes and high drop-out rates, particularly among people with a low level of education. Using videos as a delivery format can possibly improve the effects and attractiveness of these interventions

    Objective: The main aim of this study was to examine the effects of a video and text version of a Web-based computer-tailored obesity prevention intervention on dietary intake, physical activity, and body mass index (BMI) among Dutch adults. A second study aim was to examine differences in appreciation between the video and text version. The final study aim was to examine possible differences in intervention effects and appreciation per educational level.

    Methods: A three-armed randomized controlled trial was conducted with a baseline and 6 months follow-up measurement. The intervention consisted of six sessions, lasting about 15 minutes each. In the video version, the core tailored information was provided by means of videos. In the text version, the same tailored information was provided in text format. Outcome variables were self-reported and included BMI, physical activity, energy intake, and appreciation of the intervention. Multiple imputation was used to replace missing values. The effect analyses were carried out with multiple linear regression analyses and adjusted for confounders. The process evaluation data were analyzed with independent samples t tests.

    Results: The baseline questionnaire was completed by 1419 participants and the 6 months follow-up measurement by 1015 participants (71.53%). No significant interaction effects of educational level were found on any of the outcome variables. Compared to the control condition, the video version resulted in lower BMI (B=-0.25, P=.049) and lower average daily energy intake from energy-dense food products (B=-175.58, P<.001), while the text version had an effect only on energy intake (B=-163.05, P=.001). No effects on physical activity were found. Moreover, the video version was rated significantly better than the text version on feelings of relatedness (P=.041), usefulness (P=.047), and grade given to the intervention (P=.018).

    Conclusions: The video version of the Web-based computer-tailored obesity prevention intervention was the most effective intervention and most appreciated. Future research needs to examine if the effects are maintained in the long term and how the intervention can be optimized.

    ClinicalTrial: Netherlands Trial Register: NTR3501; http://www.trialregister.nl/trialreg/admin/rctview.asp?TC=3501 (Archived by WebCite at http://www.webcitation.org/6cBKIMaW1)

    J Med Internet Res 2015;17(10):e236

    doi:10.2196/jmir.4083

    Keywords

    randomized controlled trial; web-based; computer-tailoring; obesity; educational level; delivery strategy 


    Overweight and obesity rates have increased rapidly during the last 30 years [1,2]. In 2008, around 900 million adults were overweight and 502 million were obese [3,4]. In many Western countries, these figures are significantly higher among people with a low level of education [5-9]. For example, in the Netherlands the prevalence of overweight is 64.4% among adults with a low level of education compared with 40.1% among adults with a high level of education [10].

    Because overweight and obesity affect large numbers of people, these interventions should have the possibility to reach many people in an efficacious yet cost-effective manner [11]. Web-based computer-tailored interventions meet this requirement. These interventions aim to change people’s health behavior by providing individually adapted information via the Internet [12]. Hence, they can be disseminated easily among a large target population for relatively low costs [11]. Research has already shown that Web-based computer-tailored interventions can have positive effects on physical activity, dietary intake, and body weight [11-16] and that they can be cost-effective [17,18]. Yet, the current evidence for the effectiveness for these interventions is inconclusive as effects are mostly small and are found only in the short term [19,20]. Moreover, Web-based computer-tailored interventions often suffer from high dropout rates that reach up to around 50% [21-24]. These interventions in particular have problems reaching people with a low educational level—the people most in need of change [25]. Hence, to optimize the potential of Web-based computer-tailored obesity prevention interventions, it is necessary to examine how their impact and attractiveness can be improved [25-27].

    One possible solution may be to provide the information within these interventions by means of a delivery format that better fits the receivers’ preferences [28,29]. Nearly all previous Web-based computer-tailored interventions have primarily used text-driven messages to provide information. However, particularly people with a low educational level generally are less text oriented [30]. Recent studies provide indications that the delivery of intervention content via videos may improve the effectiveness of Web-based computer-tailored interventions [26,31]. Although the current evidence for this hypothesis is not compelling, video messages could be more appropriate because people with a low educational level typically have more difficulties processing large amounts of text [32]. Videos may work better because they reduce the cognitive effort needed to process information, which can lead to better comprehension [33].

    To examine whether the use of videos can indeed improve the effectiveness and attractiveness, we developed 2 versions of a Web-based computer-tailored intervention. This intervention aimed to achieve small changes in dietary intake and physical activity in order to prevent weight gain among Dutch adults with a healthy weight or with overweight, specifically, a body mass index (BMI) between 18.5 and 30 kg/m2. Both versions of the intervention had exactly the same content but had a different information delivery format. One version was fully text based, without the use of visual elements (text version), and the other provided the core tailored information by means of videos (video version).

    The main aim of this study was to examine the effects of the video and text version in comparison to a waiting list control condition on dietary intake, physical activity, and BMI among Dutch adults at 6 months’ follow-up. A second study aim was to examine potential differences in participants’ appreciation of the intervention between the video and text version. The final study aim was to examine possible differences in efficacy and appreciation per educational level. We hypothesized that the video version would be more effective and better appreciated, particularly among people with a low level of education.


    The Ethical Committee of the Open University Heerlen reviewed the study protocol and had no objections. The study is registered in the Dutch Trial Register (NTR3501). See Multimedia Appendix 1 for the CONSORT EHEALTH checklist [34].

    Study Design and Respondents

    A three-armed randomized controlled trial was conducted with 2 experimental conditions (video and text intervention) and a waiting list control group that had the opportunity to use one of the interventions after the study. Measurements took place at baseline (T0) and 6 months (T1) after baseline. Criteria for participation were being at least 18 years old, having a paid job (because of initial recruitment procedure), a BMI between 18.5 and 30 kg/m2, and sufficient command of the Dutch language. People with a physical condition that severely influenced their dietary or physical activity pattern (eg, diabetes) were not eligible to participate.

    It was estimated that 2000 participants were needed to complete the baseline questionnaire in order to be able to detect a medium-sized effect (d=0.5) on BMI and behavior with a power of .90, a significance level of .05, and taking into account a dropout percentage of 50% between baseline and follow-up. This number of participants would also allow testing interaction effects between participants with a low, medium, and high level of education [26].

    Procedure

    Participants were recruited from September 2012 until February 2013. Participants were recruited during medical screenings by various occupational health centers, directly through companies, and via advertisements in national and local newspapers. All recruitment materials (ie, brochures, emails, advertisements) included information about the intervention study as well as a hyperlink to the study website where participants could register to participate. After registration and giving online informed consent, participants were randomly assigned to one of the 3 study conditions (ie, video version, text version, and control group) in a computer-determined sequence. After randomization, participants received a username and password by email. Participants were unaware of which study condition they were allocated to until they accessed the baseline questionnaire (T0). Two weeks after completion of this questionnaire, participants in the intervention conditions were given access to the intervention. Participants could use the assigned intervention for a maximum period of 3 months. Six months after baseline, participants were asked by email to fill out the online follow-up questionnaire (T1). To decrease the likelihood of attrition, participants were informed that they could win one of hundred cash prizes of €100 if they completed all questionnaires [35].

    Intervention

    The Web-based computer-tailored intervention was developed systematically using the Intervention Mapping protocol [36]. Detailed information about the development process and the content of the intervention can be found elsewhere [26]. The objective of the intervention was to prevent weight gain or achieve modest weight loss by making small changes in dietary intake and/or physical activity. In the video version, about 75% of the educational content was delivered via videos. The remaining 25% consisted of text-based content to give instructions about setting goals and making action and coping plans as well as for the delivery of optional in-depth information. The videos had a news-driven format in which professional actors read aloud the tailored information. This information was exactly the same as the information that could be read in text in the text version of the intervention. In both the video and text versions, the tailored information was based on participants’ answers to online questions about their dietary intake, physical activity level, and sociocognitive beliefs (eg, self-efficacy). The feedback was very specific and, for example, clearly indicated which specific behavior changes participants could make (eg, decrease intake of chocolate with X per day).

    The theoretical framework of the intervention consisted of a combination of self-regulation theories [37,38] and the I-Change Model [39]. Self-regulation theories were in particular used as input for the general framework for the intervention. Accordingly, the intervention aimed to create awareness of behavior, identify areas for change, set goals and make plans, and finally start and monitor the behavior change. The I-Change Model has mainly been used to make people aware of their behavior and for indicating which behavior change participants were most motivated to do. In these sessions, participants received feedback about their motivational beliefs (eg, attitude and self-efficacy) and could make action plans. In line with these theories, the following behavior change methods were used: consciousness raising, tailored feedback on behavior and cognitions, goal setting, action and coping planning, and evaluation of goal pursuit.

    The intervention consisted of 6 weekly sessions, and each session lasted about 15 minutes. After Session 1, participants could continue to Session 2 directly. Hence, between Sessions 1 and 2 there was no mandatory waiting period (in contrast to the subsequent sessions). Figures 1 and 2 provide an example of the video and text versions, respectively.

    ‎
    Figure 1. Example of the video version of the intervention.
    View this figure
    ‎
    Figure 2. Example of the text version of the intervention.
    View this figure
    Session 1

    The aim of Session 1 was to inform participants about the different intervention sessions. Next, participants were provided with tailored feedback about their weight, behavior (dietary intake and physical activity), and sociocognitive beliefs toward improving their diet and physical activity level (risk perception, attitude, self-efficacy, and social influence). The aim of this feedback was to indicate which changes would best fit the participant. After receiving this information, participants subsequently had to set a goal by deciding if they wanted to maintain their current weight or lose a little weight. Participants also had to decide if they wanted to improve their physical activity level, their dietary intake, or both. To help participants with setting these 2 goals, they received information about the purpose of setting goals and examples of adequate goals.

    Session 2

    The aim of Session 2 was to provide participants with detailed feedback on the chosen behavior in order to inform them which small changes they could make to achieve their weight goal. Based on this information, participants could make “if then” plans by specifying when, where, and how they were going to undertake the behavior change. To further help participants with this, they received instructions about how to make appropriate plans as well as examples of good plans. After Session 2, participants could start realizing their goals and plans.

    Session 3

    The aim of Session 3 was to help participants carry out and maintain the behavior change. For this purpose, participants first received tailored feedback about their behavior change progress. This feedback was given by assessing participants’ current behavior and comparing this to their weight and behavior reported in Session 1. Based on this comparison, it was indicated whether or not participants’ behavior had improved and if they had achieved their goal. In addition, participants were also given the option to make coping plans. For this purpose, participants first received information about the purpose of coping planning. Next, participants could indicate which difficult situations they had encountered. For each selected situation (eg, being hungry), participants received tips about how to deal with this situation (eg, eat something with fewer calories such as fruit). Based on this feedback, participants could eventually make their own coping plan by selecting their own preferred coping response from a list with predefined options.

    Sessions 4-6

    The last 3 sessions were identical to the third session, but each new session also consisted of 1 or 2 new elements. Session 4, for example, also consisted of narratives in which a role model told how their behavior change was going and how they dealt with difficult situations. Participants were also given the possibility to change their goals and action plans. Session 5 was similar to Session 4, but in this session, participants received tailored feedback for the first time on their weight change by indicating whether or not they had achieved their weight goal. Finally, Session 6 was again similar to the previous session but additionally addressed the topic of how to maintain behavior changes in the long term. For this purpose, participants had the possibility of setting a long-term weight goal and making an action plan for achieving this goal. This last session ended with a review of the essential elements of the whole intervention.

    Measurements

    Outcome Variables

    All outcome variables (ie, BMI, dietary intake, and physical activity) were assessed using online self-reports at both T0 and T1. Participants who had not completed the online follow-up questionnaire (T1) after several email reminders were contacted by telephone to assess their body weight.

    First, participants’ body weight in kilograms and height in meters were assessed in order to calculate their BMI. To improve the adequacy of reporting, participants were asked to indicate their weight in the morning without clothes and shoes.

    Dietary intake was assessed by means of a food frequency questionnaire consisting of 66 items, which was based on a validated questionnaire to assess fat intake [40]. The intake levels of mainly energy-dense products from 6 different food categories were assessed (ie, dairy products, sandwiches and fillings, food at dinner, sweet and savory snacks, hot and cold beverages, and alcohol). For each food product, the frequency (ie, number of days per week) and quantity (ie, servings per day) were assessed. When applicable, type of product (eg, use of skimmed, semi-skimmed, or whole milk) and portion size (eg, size of candy bar) were assessed as well. For each food product, the average daily intake was calculated. This was subsequently combined with the energy value of each food product [41] in order to calculate a score for the average daily intake of calories from energy-dense food products.

    Physical activity was assessed using the Short Questionnaire to Assess Health-Enhancing Physical Activity (SQUASH) [42]. This questionnaire has proven to be a reliable and valid tool to estimate the level of physical activity among Dutch adults [43]. The SQUASH assesses participants’ level of physical activity per category (ie, commuting activities, leisure time activities, household activities, and activities at work). For each activity, participants had to indicate how many days per week they engaged in this activity, average time per day spent in doing this activity, and the intensity of the activity (light, moderate, or vigorous). Based on these questions, a total score was calculated for the average daily minutes of moderate-to-vigorous intensity physical activity.

    Demographics

    All demographics were assessed at T0. Demographic variables consisted of gender, age, and educational level (ie, the highest level of education completed), which was categorized into low (primary or basic vocational school), medium (secondary vocational school or high school), and high (higher vocational school or university) [44].

    Sociocognitive Variables

    All sociocognitive variables (ie, self-efficacy, intention, and self-regulation skills) were assessed at T0. For this purpose, adapted measures of previous studies [27,45,46] were used, including a 5-point Likert answering scale ranging from 1 (low) to 5 (high). A scale was computed by calculating a mean score.

    Participants’ self-efficacy was measured separately for physical activity (alpha=.83) and dietary intake (alpha=.81) using 4 items per behavior. Participants were asked, for example, about their confidence and ability to improve their diet and physical activity level.

    Intention was measured with 1 item per behavioral outcome by asking participants if they intended to improve their diet and physical activity level within the next 6 months.

    Self-regulation skills were measured for the types of skills that are important for successfully translating intentions into behavior change (ie, goal setting, action planning, monitoring, and coping planning). Items were derived from existing instruments [47,48]. Goal setting (alpha=.72) was measured with 3 items by asking participants if they set a goal in advance when, for example, they want to manage their weight. Next, action planning was measured with 3 items per behavioral outcome. Participants were asked if they had a clear plan when, where, and how they wanted to improve their diet (alpha=.90) and physical activity level (alpha=.94). Monitoring (alpha=.74) was measured using 4 items that assessed to which degree participants monitored their weight and behavior on a regular basis. Finally, 2 items per behavioral outcome were used to assess coping planning. Participants were asked to which degree they were able to identify hindering situations in advance and thought that they were able to deal with these situations for both dietary intake (alpha=.70) and physical activity (alpha=.72).

    Process Evaluation

    Appreciation of the intervention was assessed at T1 using a 5-point Likert scale ranging from 1 (low) to 5 (high). Using 1 item per variable, participants were first asked to indicate to which degree they thought the information and feedback in the intervention was interesting, useful, understandable, and fitted to their own situation. Participants were also asked to give an overall rating of the intervention on a scale ranging from 1 (low) to 10 (high). Last, participants were asked about their feelings of autonomy, relatedness, and competence during the intervention. These concepts were derived from Self-Determination Theory [49], and the items were developed using existing questionnaires [21,27,45]. For these 3 concepts, average scale scores were computed. Autonomy (alpha=.88) was assessed by 2 items. Participants were asked if they had the feeling that they could decide by themselves which goals they could set and which information they could read in the intervention. Relatedness (alpha=.92) was assessed with 3 items by asking participants if they felt involved and supported by the intervention. Competence (alpha=.93) was assessed with 3 items by asking participants if the intervention had increased their confidence in their ability to manage their weight, dietary intake, and physical activity behavior. Finally, login data was used to assess use of the intervention.

    Statistical Analyses

    At both T0 and T1, multiple imputation was used to replace missing values [50,51]. Descriptive statistics and frequencies were used to describe the characteristics of the study population and the overall flow through the study. Baseline differences between the 3 study conditions were examined using analyses of variance with Tukey post hoc tests for continuous variables and chi-square tests with Bonferroni correction (P=.05/P=.017) for categorical variables. To examine the possible presence of selective attrition between baseline and follow-up, a logistic regression analysis was performed with attrition at follow-up as outcome (completed T1=0, not completed T1=1) and study condition and all baseline variables as predictors.

    The effect analyses were conducted for each outcome variable separately (BMI, dietary intake, physical activity) using linear regression analyses with the enter method. The effects of the intervention conditions were compared to the control condition for which the study condition variable was recoded into 2 dummies (ie, video versus control and text versus control). The analyses were adjusted for potential confounders (ie, baseline behavior, predictors of attrition, and baseline differences) by including these variables as covariates. The analyses also included study condition × educational level interaction terms to assess potential educational differences in intervention effects. Cohen’s d effect sizes were calculated for all outcome variables [52]. As secondary analyses, we also compared the effects of the intervention conditions with each other. Moreover, the analyses were performed with both a complete case and multiple imputation dataset.

    Finally, the process evaluation data were analyzed using linear regression analyses with the enter method. These analyses included study condition × educational level interaction terms to identify potential educational differences in appreciation. When no interaction effects were found, independent samples t tests were conducted to examine differences between the video and text conditions on the process evaluation variables (ie, appreciation).

    All statistical analyses were conducted using SPSS 20.0, applying a significance level of .05 for single variables and .10 for interaction terms [53].


    Study Sample, Baseline Differences, and Attrition Analysis

    The CONSORT-EHEALTH flowchart [34] (Figure 3) shows the number of participants who were randomly assigned to one of the 3 study conditions as well as their flow through the study. In total, 1419 participants completed the baseline questionnaire. At 6 months follow-up, data from 1015 (71.53%) participants were collected. In the video condition, only 328 (70.54%) participants had completed the first session of the intervention, whereas 364 (74.13%) did in the text condition. Overall, the average number of completed sessions was 2.15 (SD 1.94) sessions. In total, 10.88% (104/956) of the participants had completed the intervention fully (ie, use of all 6 sessions).

    Table 1 provides a comprehensive overview of all baseline characteristics of the study sample, including baseline differences between the 3 study conditions. Participants’ mean age was 48.13 (SE 0.31) and 58.56% (831/1419) were female. The mean BMI was 26.42 (SE 0.06), and 73.50% (1043/1419) of the study sample was overweight. The majority had a high level of education (769/1419=54.19%), while fewest participants had a low level of education (214/1419=15.08%). The distribution of educational level differed significantly between the 3 study conditions (Pearson χ24=10.380, P=.004). Compared to the text and video conditions, significantly more participants in the control condition had a low educational level. Moreover, the number of participants with a medium level of education was significantly higher in the text and control conditions in comparison to the video condition. Last, participants’ mean score on goal setting in the video condition was significantly higher in comparison to the text and control conditions (F2,2415=4.740, P=.009). No other baseline differences were observed.

    Attrition analysis identified several significant predictors of dropout. Participants in the video (OR 2.11, 95% CI 1.48-3.00, P<.001) and text conditions (OR 3.23, 95% CI 2.29-4.54, P<.001) were significantly more likely to drop out compared to participants in the control condition. Attrition was further significantly higher among participants with a low (OR 2.15, 95% CI 1.46-3.16, P<.001) and medium (OR 1.37, 95% CI 1.02-1.85, P=.037) educational level in comparison to highly educated participants. Older participants were more likely to complete the follow-up questionnaire (OR 0.97, 95% CI 0.96-0.98, P<.001). Finally, participants who had lower levels of self-efficacy to improve their diet (OR 1.36, 95% CI 1.06-1.76, P=.016), intention to improve their diet (OR 1.22, 95% CI 1.02-1.46, P=.031), and coping planning regarding physical activity (OR 1.31, 95% CI 1.04–1.64, P=.022) were significantly more likely to drop out.

    Table 1. Characteristics of the study sample and differences between the study conditions.

    		Overall sample
    (n=1419)    		Video
    (n=465)    		Text
    (n=491)    		Control
    (n=463)    		F / Pearson χ2dfP
    Baseline characteristics

    		Gender (female), n (%)831 (58.56)273 (58.71)284 (57.84)274 (59.18)0.1822.913

    		Educational level, n (%)



    		10.3804.004b


    		Low214 (15.08)75 (16.13)67 (13.65)a72 (15.55)a




    		Medium436 (30.73)118 (25.38)a161 (32.79)a157 (33.91)a




    		High769 (54.19)272 (58.49)a263 (53.56)234 (50.54)a



    		Age, mean (SE)48.13 (0.31)48.06 (0.09)47.84 (0.08)48.51 (0.08)0.40522,415.667

    		Self-efficacy improve physical activity, mean (SE)3.33 (0.02)3.35 (0.01)3.35 (0.01)3.30 (0.01)0.56022,415.571

    		Self-efficacy improve diet, mean (SE)3.25 (0.02)3.28 (0.00)3.25 (0.00)3.23 (0.00)0.83122,415.436

    		Intention improve physical activity, mean (SE)3.97 (0.03)3.99 (0.01)3.97 (0.01)3.96 (0.01)0.04822,415.953

    		Intention improve diet, mean (SE)4.09 (0.03)4.09 (0.01)4.12 (0.01)4.04 (0.01)0.65422,415.520

    		Goal setting, mean (SE)3.50 (0.02)3.60 (0.01)a3.47 (0.01)a3.45 (0.01)a4.74022,415.009b

    		Action planning improve physical activity, mean (SE)3.35 (0.02)3.34 (0.01)3.33 (0.01)3.37 (0.01)0.21422,415.808

    		Action planning improve diet, mean (SE)3.22 (0.02)3.24 (0.01)3.19 (0.01)3.25 (0.01)0.69022,415.502

    		Monitoring, mean (SE)3.32 (0.02)3.31 (0.01)3.30 (0.01)3.36 (0.01)0.65522,415.520

    		Coping planning improve physical activity, mean (SE)3.37 (0.02)3.35 (0.00)3.36 (0.01)3.40 (0.01)0.74522,415.475

    		Coping planning improve diet, mean (SE)3.33 (0.02)3.32 (0.01)3.32 (0.01)3.34 (0.01)0.06122,415.941

    		BMI, mean (SE)26.42 (0.06)26.43 (0.02)26.45 (0.02)26.37 (0.02)0.13122,348.878

    		Average daily energy-intake, mean (SE)1296.91 (13.40)1308.36 (3.56)1314.70 (3.51)1266.51 (3.75)1.32522,420.266

    		Average daily minutes moderate and vigorous physical activity, mean (SE)78.23 (2.21)74.43 (0.53)76.84 (0.57)83.52 (0.69)1.48122,378.228
    Follow-up characteristics

    		BMI, mean (SE)26.07 (0.08)25.94 (0.02)26.11 (0.02)26.15 (0.02)



    		Average daily energy-intake, mean (SE)1072.57 (20.79)1016.45 (3.56)1032.77 (3.60)1170.70 (3.56)



    		Average daily minutes moderate and vigorous physical activity, mean (SE)107.73 (5.71)103.17 (0.80)108.39 (0.80)111.77 (0.88)


    aValues within a row with identical letters were significantly different as determined by analyses of variance with Tukey post-hoc test (for continuous variables) or chi-square tests with Bonferroni correction (for categorical variables).

    bP<.05.

    ‎
    Figure 3. Flowchart of the enrollment, allocation, and participation of respondents.
    View this figure

    Intervention Effects on Body Mass Index, Dietary Intake, and Physical Activity

    There were no significant interaction effects between type of study condition and educational level for any of the outcome measures.

    The regression analyses without interaction terms showed several main intervention effects (Table 2). The video intervention had resulted in a significantly lower BMI compared to the control condition (B=-0.25, P=.049), with a small Cohen’s d effect size of 0.10 [52]. No significant difference was found between the text and control condition regarding BMI (B=-0.09, P=.474). Moreover, both the video (B=-175.58, P<.001) and text interventions (B=-163.05, P=.001) resulted in a significantly lower average daily intake of calories from energy-dense food products compared to the control condition, with medium Cohen’s d effect sizes of respectively 0.40 and 0.36 [52]. For physical activity, no intervention effects were found for both the video (B=-1.45, P=.900) and text conditions (B=1.88, P=.863) in comparison to the control condition. In the additional analyses comparing the 2 intervention conditions, no significant differences were found for any of the outcome measures. The complete cases analyses resulted in the same significant findings as the effect analyses with the multiple imputation data described earlier.

    Table 2. Intervention effects on the outcome variables at follow-up as assessed by linear regression analyses.
    Outcome variablesVideo (1) versus control (0)
    (n=928)a    		Text (1) versus control (0)
    (n=954)a
    BbSEP95% CIdBbSEP95% CId
    BMI-0.250.13.049c-0.50 to 0.000.10-0.090.13.474-0.35 to 0.160.03
    Average daily energy-intake-175.5845.13.000c-265.24 to -85.920.40-163.0548.57.001c-259.78 to -66.320.36
    Average daily minutes moderate and vigorous physical activity-1.4511.48.900-24.28 to 21.380.011.8810.88.863-19.75 to 23.500.02

    aIn the linear regression analyses, the following covariates were included: baseline behavior, educational level, age, goal setting, self-efficacy to improve diet, coping planning regarding physical activity, and intention to improve diet.

    bB=unstandardized regression coefficient.

    cP<.05.

    Process Evaluation

    Table 3 provides an overview of the results from the process evaluation. In total, 355 participants completed the process evaluation questionnaire. Overall, the mean scores of the process evaluation variables represented neutral to slightly positive scores for both versions of the intervention, without remarkable low scores. The intervention scored best on usefulness, understandability, and autonomy. The mean score for assessment of the intervention as a whole was 6.85 (SD 1.14).

    Regression analyses showed that there was no significant interaction effect of educational level regarding the process evaluation variables. Independent sample t tests showed that the information in the video condition was rated as more useful compared to the information provided in the text condition (t354=1.992, P=.047). Feelings of relatedness were also significantly higher among participants in the video condition (t354=2.056, P=.041) as compared to the text condition. Finally, participants in the video condition rated the intervention significantly better than participants in the text condition (t354=2.388, P=.018).

    Table 3. Mean and standard deviation of process evaluation variables at follow-up, including differences between the video and text conditions.
    Process evaluation variablesComplete cases
    (n=355)    		Video
    (n=177)    		Text
    (n=178)    		T (df=354)P
    The feedback messages fit to my own situation3.36 (0.94)3.41 (0.94)3.32 (0.94)0.865.387
    The feedback messages were understandable3.88 (0.82)3.91 (0.82)3.84 (0.82)0.771.441
    The feedback messages were useful3.54 (0.92)3.63 (0.91)a3.44 (0.93)a1.992.047b
    The feedback messages were interesting3.38 (1.00)3.47 (1.01)3.30 (0.98)1.616.107
    Feelings of autonomy3.98 (0.75)4.05 (0.74)3.90 (0.75)1.815.070
    Feelings of relatedness3.04 (1.02)3.15 (1.01)a2.93 (1.02)a2.056.041b
    Feelings of competence3.15 (0.99)3.23 (0.95)3.08 (1.03)1.497.135
    Overall grade intervention (1-10)6.85 (1.14)7.00 (1.15)a6.70 (1.12)a2.388.018b

    aValues within a row with identical letters were significantly different as determined by independent samples t tests.

    bP<.05.


    Principal Findings

    The aim of this study was to examine the effects and appreciation of video and text versions of a Web-based computer-tailored obesity prevention intervention among Dutch adults with low and high levels of education.

    Our results showed no significant group × education interaction effects. This implies that both versions of the intervention were equally effective for all educational levels. The video version was the most effective intervention because it resulted in both a lower BMI and lower energy intake (compared to the control condition), while the text version had only a lower energy intake. No intervention effects on physical activity were found. Appreciation of the 2 intervention versions also did not differ per educational level. Yet the video version was appreciated more than the text version on usefulness of messages, feelings of relatedness, and grade given to intervention. Overall, it can be concluded that the video intervention performed better than the text intervention regardless of participants’ educational level.

    The fact that we did not find support for our hypothesis that the video version would be more effective for people with a low educational level is not surprising. A recent similar study into a smoking cessation intervention has, for example, also only found a main effect of the video condition and no differential effects per educational level [45]. Furthermore, our hypothesis that video messages may work better for lower educated people [26] was based on indications and assumptions derived from a few previous studies but the evidence for this hypothesis was not compelling. Nevertheless, our study provides preliminary evidence that the use of videos in a Web-based computer-tailored intervention can be effective in the prevention of obesity regardless of people’s educational level [45].

    Both the video and text versions had the strongest effects on dietary intake, which is a finding in line with 2 reviews on Web-based computer-tailored interventions [12,16]. The medium effect size indicates that this effect is of clinical relevance [52] and may suggest important public health potential when the intervention is implemented at a large scale. In line with other studies [11,15], only a small effect size was found regarding BMI (of the video version). However, even small intervention effects on BMI can have a large public health impact resulting in a significant reduction of many health problems, an improved quality of life, and cost savings [54-57]. The fact that the text version did not have a significant effect on BMI can possibly be explained by the fact that the effect size for dietary intake (0.36) was somewhat smaller compared to the effect size of the video version (0.40). The fact that no intervention effect was found on physical activity is not surprising. Many reviews have reported mixed findings of Web-based computer-tailored interventions for physical activity [12,19,20]. One explanation for this finding could be that we encountered problems with the measurement of physical activity in our study. The average daily minutes of moderate-to-vigorous intensity physical activity scores were unrealistically high. Consequently, many participants did not receive the advice to increase their physical activity level within the intervention, resulting in little improvement for this behavior. Recently, this problem has also been identified in a similar efficacy study. Hence, future studies should take this problem into account when assessing physical activity and developing algorithms to deliver tailored messages [46].

    In line with two recent studies [21,45], it can further be concluded that a Web-based computer-tailored intervention consisting of videos is appreciated better than an identical intervention that consists of merely text. This difference in appreciation can possibly also explain why the video version was more effective than the text version. The Elaboration Likelihood Model [58], for example, suggests that when information is perceived as interesting and attractive, it is more likely that central route processing will occur. Information that is processed via this central path will have a more long-lasting persuasive effect on the receiver [32]. The better appreciation of the video version may therefore have resulted in more central route information processing. The fact that there were no differential effects in appreciation per educational level can also possibly explain the absence of educational differences in effects. This explanation is supported by the Communication Persuasion Matrix [59], which assumes that effective persuasion is the result of, among others, a suitable media channel. Yet our results demonstrate that the video version (ie, delivery format) is not more attractive for people with a low educational level (ie, user), and therefore no differences in outputs (ie, intervention outcomes) per educational level can be expected.

    Strengths and Limitations

    An important strength is that this is one of the first studies that has examined whether the use of videos can improve the effectiveness and attractiveness of Web-based computer-tailored interventions. Another strength is that our intervention met several criteria related to higher effectiveness of weight management interventions, such as the use of self-regulation theories [25,37,38], the small changes approach [54], and the Intervention Mapping protocol [36]. A final strength is that we found exactly the same results with the multiple imputation data and the complete cases data.

    A limitation of this study is that all outcome measures were self-reported [60,61]. For example, it would have been better to measure BMI objectively. However, research has shown that self-reported BMI does not affect results when used as a continuous variable in a longitudinal study [62]. In addition, the SQUASH resulted in unrealistically high physical activity scores. As these scores were used to provide tailored feedback, it is likely that participants may have received inadequate feedback about their physical activity level. Future interventions should therefore aim to correct for this overestimation in tailoring algorithms or use objective measurements. Moreover, it should be noted that only a relatively small number of participants had completed the process evaluation questionnaire. Yet it is unclear if the inclusion of dropouts would have led to lower or higher scores. For example, participants may have dropped out because they had achieved their goal or because they did not enjoy the intervention. Finally, the relatively short follow-up period of 6 months can be regarded as a limitation. Research with a longer follow-up period is necessary to examine whether or not the effects will be maintained long term.

    Conclusions

    The video version of the intervention was more effective and better appreciated than the text version, regardless of participants’ educational level. Hence, our study provides evidence that the effectiveness of future Web-based computer-tailored obesity prevention interventions can possibly be improved by including videos as a delivery format in tailored health information. Our study shows that this is feasible and effective for Dutch adults with a healthy weight and limited overweight. However, more research is needed to study the long-term effects of the video version.

    Acknowledgments

    The study was funded by ZonMw, the Netherlands Organization for Health Research and Development (Grant No 200110001).

    Conflicts of Interest

    HdV is the scientific director of Vision2Health, a company that licenses evidence-based innovative computer-tailored health communication tools.

    ‎

    Multimedia Appendix 1

    CONSORT-EHEALTH checklist V1.6.2 [34].

    PDF File (Adobe PDF File), 673KB
    1. Stevens GA, Singh GM, Lu Y, Danaei G, Lin JK, Finucane MM, Global Burden of Metabolic Risk Factors of Chronic Diseases Collaborating Group (Body Mass Index). National, regional, and global trends in adult overweight and obesity prevalences. Popul Health Metr 2012;10(1):22 [FREE Full text] [CrossRef] [Medline]
    2. World Health Orgnaization. Obesity: Situation and trends. 2014.   URL: http://www.who.int/gho/ncd/risk_factors/obesity_text/en/ [accessed 2014-11-17] [WebCite Cache]
    3. World Health Organization. Obesity and overweight. 2014.   URL: http://www.who.int/mediacentre/factsheets/fs311/en/ [WebCite Cache]
    4. Finucane MM, Stevens GA, Cowan MJ, Danaei G, Lin JK, Paciorek CJ, Global Burden of Metabolic Risk Factors of Chronic Diseases Collaborating Group (Body Mass Index). National, regional, and global trends in body-mass index since 1980: systematic analysis of health examination surveys and epidemiological studies with 960 country-years and 9.1 million participants. Lancet 2011 Feb 12;377(9765):557-567 [FREE Full text] [CrossRef] [Medline]
    5. Bemelmans W, Hoogenveen R, Visscher T, Verschuren W. Toekomstige ontwikkelingen in overgewicht - Inschatting effecten op de volksgezondheid. Bilthoven: Rijksinstituut voor Volksgezondheid en Milieu (RIVM); 2004.
    6. van Bakel AM, Zantinge EM. Neemt het aantal mensen met obesitas toe of af?. Bilthoven: RIVM; 2014.
    7. McLaren L. Socioeconomic status and obesity. Epidemiol Rev 2007;29:29-48. [CrossRef] [Medline]
    8. Devaux M, Sassi F. Social inequalities in obesity and overweight in 11 OECD countries. Eur J Public Health 2013 Jun;23(3):464-469 [FREE Full text] [CrossRef] [Medline]
    9. Roskam AR, Kunst AE, Van OH, Demarest S, Klumbiene J, Regidor E, et al. Comparative appraisal of educational inequalities in overweight and obesity among adults in 19 European countries. Int J Epidemiol 2010 Apr;39(2):392-404 [FREE Full text] [CrossRef] [Medline]
    10. Uiters E, Verweij A. Overgewicht: Zijn er verschillen naar sociaaleconomische status?. Bilthoven: RIVM; 2012.
    11. Wieland LS, Falzon L, Sciamanna CN, Trudeau KJ, Brodney S, Schwartz JE, et al. Interactive computer-based interventions for weight loss or weight maintenance in overweight or obese people. Cochrane Database Syst Rev 2012;8:CD007675 [FREE Full text] [CrossRef] [Medline]
    12. Kroeze W, Werkman A, Brug J. A systematic review of randomized trials on the effectiveness of computer-tailored education on physical activity and dietary behaviors. Ann Behav Med 2006 Jun;31(3):205-223. [CrossRef] [Medline]
    13. Kayman S, Bruvold W, Stern JS. Maintenance and relapse after weight loss in women: behavioral aspects. Am J Clin Nutr 1990 Nov;52(5):800-807 [FREE Full text] [Medline]
    14. Klem ML, Wing RR, McGuire MT, Seagle HM, Hill JO. A descriptive study of individuals successful at long-term maintenance of substantial weight loss. Am J Clin Nutr 1997 Aug;66(2):239-246 [FREE Full text] [Medline]
    15. Broekhuizen K, Kroeze W, van Poppel MNM, Oenema A, Brug J. A systematic review of randomized controlled trials on the effectiveness of computer-tailored physical activity and dietary behavior promotion programs: an update. Ann Behav Med 2012 Oct;44(2):259-286 [FREE Full text] [CrossRef] [Medline]
    16. Neville LM, O'Hara B, Milat AJ. Computer-tailored dietary behaviour change interventions: a systematic review. Health Educ Res 2009 Aug;24(4):699-720 [FREE Full text] [CrossRef] [Medline]
    17. Schulz DN, Smit ES, Stanczyk NE, Kremers SPJ, de Vries H, Evers SM. Economic evaluation of a web-based tailored lifestyle intervention for adults: findings regarding cost-effectiveness and cost-utility from a randomized controlled trial. J Med Internet Res 2014;16(3):e91 [FREE Full text] [CrossRef] [Medline]
    18. Smit ES, Evers SM, de Vries H, Hoving C. Cost-effectiveness and cost-utility of Internet-based computer tailoring for smoking cessation. J Med Internet Res 2013;15(3):e57 [FREE Full text] [CrossRef] [Medline]
    19. Enwald HPK, Huotari MA. Preventing the obesity epidemic by second generation tailored health communication: an interdisciplinary review. J Med Internet Res 2010;12(2):e24 [FREE Full text] [CrossRef] [Medline]
    20. Neville LM, O'Hara B, Milat A. Computer-tailored physical activity behavior change interventions targeting adults: a systematic review. Int J Behav Nutr Phys Act 2009;6:30 [FREE Full text] [CrossRef] [Medline]
    21. Soetens KC, Vandelanotte C, de VH, Mummery KW. Using online computer tailoring to promote physical activity: a randomized trial of text, video, and combined intervention delivery modes. J Health Commun 2014 Dec;19(12):1377-1392. [CrossRef] [Medline]
    22. Eysenbach G. The law of attrition. J Med Internet Res 2005;7(1):e11 [FREE Full text] [CrossRef] [Medline]
    23. Evers KE, Cummins CO, Prochaska JO, Prochaska JM. Online health behavior and disease management programs: are we ready for them? Are they ready for us? J Med Internet Res 2005 Jul 1;7(3):e27 [FREE Full text] [CrossRef] [Medline]
    24. Bennett GG, Glasgow RE. The delivery of public health interventions via the Internet: actualizing their potential. Annu Rev Public Health 2009;30:273-292. [CrossRef] [Medline]
    25. Magnée T, Burdorf A, Brug J, Kremers SP, Oenema A, van AP, et al. Equity-specific effects of 26 Dutch obesity-related lifestyle interventions. Am J Prev Med 2013 Jun;44(6):e57-e66. [CrossRef] [Medline]
    26. Walthouwer MJL, Oenema A, Soetens K, Lechner L, De VH. Systematic development of a text-driven and a video-driven web-based computer-tailored obesity prevention intervention. BMC Public Health 2013;13:978 [FREE Full text] [CrossRef] [Medline]
    27. van GL, van EP, Boon B, Borsboom G, Visscher T, Oenema A. Results from an online computer-tailored weight management intervention for overweight adults: randomized controlled trial. J Med Internet Res 2012;14(2):e44 [FREE Full text] [CrossRef] [Medline]
    28. Brouwer W, Kroeze W, Crutzen R, de NJ, de Vries NK, Brug J, et al. Which intervention characteristics are related to more exposure to Internet-delivered healthy lifestyle promotion interventions? A systematic review. J Med Internet Res 2011;13(1):e2 [FREE Full text] [CrossRef] [Medline]
    29. Wilson EAH, Park DC, Curtis LM, Cameron KA, Clayman ML, Makoul G, et al. Media and memory: the efficacy of video and print materials for promoting patient education about asthma. Patient Educ Couns 2010 Sep;80(3):393-398. [CrossRef] [Medline]
    30. Paasche-Orlow MK, Parker RM, Gazmararian JA, Nielsen-Bohlman LT, Rudd RR. The prevalence of limited health literacy. J Gen Intern Med 2005 Feb;20(2):175-184 [FREE Full text] [CrossRef] [Medline]
    31. Stanczyk NE, Bolman C, Muris JWM, de Vries H. Study protocol of a Dutch smoking cessation e-health program. BMC Public Health 2011;11:847 [FREE Full text] [CrossRef] [Medline]
    32. Petty R, Cacioppo J. Communication and persuasion: Central and peripheral routes to attitude change. New York, NY: Springer-Verlag; 1986.
    33. Sweller J. Cognitive load theory, learning difficulty, and instructional design. Learning and Instruction 1994 Jan;4(4):295-312. [CrossRef]
    34. Eysenbach G, CONSORT- E. CONSORT-EHEALTH: improving and standardizing evaluation reports of Web-based and mobile health interventions. J Med Internet Res 2011;13(4):e126 [FREE Full text] [CrossRef] [Medline]
    35. Robroek SJ, van Lenthe FJ, van Empelen P, Burdorf A. Determinants of participation in worksite health promotion programmes: a systematic review. Int J Behav Nutr Phys Act 2009;6:26 [FREE Full text] [CrossRef] [Medline]
    36. Bartholomew L, Parcel G, Kok G, Gottlieb N, Fernandez M. Planning health promotion programs: An intervention mapping approach. 3rd ed. San Francisco, CA: Jossey-Bass; 2011.
    37. Zimmerman B, Boekaerts M, Pintrich P, Zeidner M. Attaining self-regulation: A social cognitive perspective. In: Handbook of self-regulation. San Diego, CA: Raven Press; 2000.
    38. Leventhal H, Leventhal EA, Contrada RJ. Self-regulation, health, and behavior: A perceptual-cognitive approach. Psychology & Health 1998 Jul;13(4):717-733. [CrossRef]
    39. de VH, Mudde A, Leijs I, Charlton A, Vartiainen E, Buijs G, et al. The European Smoking Prevention Framework Approach (EFSA): an example of integral prevention. Health Educ Res 2003 Oct;18(5):611-626 [FREE Full text] [Medline]
    40. van AP, Brug J, Ronda G, Steenhuis I. The relative validity of a short Dutch questionnaire as a means to categorize adults and adolescents to total and saturated fat intake. J Hum Nutr Diet 2001 Oct;14(5):377-390. [Medline]
    41. EuroFIR AISBL. Dutch Food Composition Database (NEVO). Brussels: RIVM; 2013.   URL: http://www.rivm.nl/en/Topics/D/Dutch_Food_Composition_Database/Access_NEVO_data/NEVO_e_book [accessed 2015-10-15] [WebCite Cache]
    42. Wendel-Vos W, Schuit J. Short Questionnaire to Assess Health Enhancing Physical Activity. In: SQUASH. Bilthoven: Netherlands Institute for Public Health and Environment; 2002.
    43. Wendel-Vos GCW, Schuit AJ, Saris WHM, Kromhout D. Reproducibility and relative validity of the short questionnaire to assess health-enhancing physical activity. J Clin Epidemiol 2003 Dec;56(12):1163-1169. [Medline]
    44. UNESCO Institute for Statistics. International Standard Classification of education 2011. UNESCO Institute for Statistics 2012.
    45. Stanczyk N, Bolman C, van AM, Candel M, Muris J, de VH. Comparison of text and video computer-tailored interventions for smoking cessation: randomized controlled trial. J Med Internet Res 2014;16(3):e69 [FREE Full text] [CrossRef] [Medline]
    46. Schulz DN, Kremers SPJ, Vandelanotte C, van Adrichem MJG, Schneider F, Candel MJ, et al. Effects of a web-based tailored multiple-lifestyle intervention for adults: a two-year randomized controlled trial comparing sequential and simultaneous delivery modes. J Med Internet Res 2014;16(1):e26 [FREE Full text] [CrossRef] [Medline]
    47. Carey KB, Neal DJ, Collins SE. A psychometric analysis of the self-regulation questionnaire. Addict Behav 2004 Feb;29(2):253-260. [Medline]
    48. Brown J, Miller W, Lawendowski L, VandeCreek L, Jackson T. The Self-Regulation Questionnaire. In: Innovations in clinical practice: A source book. Sarasota, FL: Professional Resource Press; 1999:281-289.
    49. Deci E, Ryan R. Self-determination. New Jersey: Wiley Online Library; 2010.
    50. Bodner TE. What improves with increased missing data imputations? Struct Equ Modeling 2008 Oct 22;15(4):651-675. [CrossRef]
    51. Graham JW, Olchowski AE, Gilreath TD. How many imputations are really needed? Some practical clarifications of multiple imputation theory. Prev Sci 2007 Sep;8(3):206-213. [CrossRef] [Medline]
    52. Cohen J. Statistical power analysis for the behavioral sciences. New York, NY: Routledge Taylor and Francis Group; 1988.
    53. Rosnow RL, Rosenthal R. Statistical procedures and the justification of knowledge in psychological science. Am Psychol 1989;44(10):1276-1284. [CrossRef]
    54. Hill JO. Can a small-changes approach help address the obesity epidemic? A report of the Joint Task Force of the American Society for Nutrition, Institute of Food Technologists, and International Food Information Council. Am J Clin Nutr 2009 Feb;89(2):477-484 [FREE Full text] [CrossRef] [Medline]
    55. Finkelstein EA, Khavjou OA, Thompson H, Trogdon JG, Pan L, Sherry B, et al. Obesity and severe obesity forecasts through 2030. Am J Prev Med 2012 Jun;42(6):563-570. [CrossRef] [Medline]
    56. Verkleij SPJ, Adriaanse MC, Wendel-Vos GCW, Schuit AJ. Longitudinal relation between weight change and quality of life in a community-based population: a prospective cohort study. Eur J Public Health 2013 Apr;23(2):285-290 [FREE Full text] [CrossRef] [Medline]
    57. Stevens VJ, Obarzanek E, Cook NR, Lee IM, Appel LJ, Smith WD, Trials for the Hypertension Prevention Research Group. Long-term weight loss and changes in blood pressure: results of the Trials of Hypertension Prevention, phase II. Ann Intern Med 2001 Jan 2;134(1):1-11. [Medline]
    58. Petty R, Cacioppo J. The elaboration likelihood model of persuasion. Adv Exp Soc Psychol 1986;19:123-205. [CrossRef]
    59. McGuire WJ. Theoretical foundations of campaigns. Public communication campaigns 1981:43-66.
    60. Schwarz N. Self-reports: How the questions shape the answers. Am Psychol 1999;54(2):93-105. [CrossRef]
    61. Matthews C. Use of self-report instruments to assess physical activity. In: Welk GJ, editor. Physical activity assessments for health-related research. Champaign, IL: Human Kinetics; 2002:107-121.
    62. Dahl AK, Hassing LB, Fransson EI, Pedersen NL. Agreement between self-reported and measured height, weight and body mass index in old age—A longitudinal study with 20 years of follow-up. Age and Ageing 2010;39(4):445-451. [CrossRef]

    ‎
    BMI: Body Mass Index
    SQUASH: Short Questionnaire to Assess Health-Enhancing Physical Activity

    Edited by G Eysenbach; submitted 27.11.14; peer-reviewed by D Thompson, G O'Reilly, M Hingle; comments to author 25.05.15; revised version received 29.07.15; accepted 18.08.15; published 19.10.15

    Copyright

    ©Michel Jean Louis Walthouwer, Anke Oenema, Lilian Lechner, Hein de Vries. Originally published in the Journal of Medical Internet Research (http://www.jmir.org), 19.10.2015.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on http://www.jmir.org/, as well as this copyright and license information must be included.