Original Paper
Abstract
Background: The Active Plus project is a systematically developed theory- and evidence-based, computer-tailored intervention, which was found to be effective in changing physical activity behavior in people aged over 50 years. The process and effect outcomes of the first version of the Active Plus project were translated into an adapted intervention using the RE-AIM framework. The RE-AIM model is often used to evaluate the potential public health impact of an intervention and distinguishes five dimensions: reach, effectiveness, adoption, implementation, and maintenance.
Objective: To gain insight into the systematic translation of the first print-delivered version of the Active Plus project into an adapted (Web-based) follow-up project. The focus of this study was on the reach and effectiveness dimensions, since these dimensions are most influenced by the results from the original Active Plus project.
Methods: We optimized the potential reach and effect of the interventions by extending the delivery mode of the print-delivered intervention into an additional Web-based intervention. The interventions were adapted based on results of the process evaluation, analyses of effects within subgroups, and evaluation of the working mechanisms of the original intervention. We pretested the new intervention materials and the Web-based versions of the interventions. Subsequently, the new intervention conditions were implemented in a clustered randomized controlled trial.
Results: Adaptations resulted in four improved tailoring interventions: (1) a basic print-delivered intervention, (2) a basic Web-based intervention, (3) a print-delivered intervention with an additional environmental component, and (4) a Web-based version with an additional environmental component. Pretest results with participants showed that all new intervention materials had modest usability and relatively high appreciation, and that filling in an online questionnaire and performing the online tasks was not problematic. We used the pretest results to improve the usability of the different interventions. Implementation of the new interventions in a clustered randomized controlled trial showed that the print-delivered interventions had a higher response rate than the Web-based interventions. Participants of both low and high socioeconomic status were reached by both print-delivered and Web-based interventions.
Conclusions: Translation of the (process) evaluation of an effective intervention into an adapted intervention is challenging and rarely reported. We discuss several major lessons learned from our experience.
Trial Registration: Nederlands Trial Register (NTR): 2297; http://www.trialregister.nl/trialreg/admin/rctview.asp?TC=2297 (Archived by WebCite at http://www.webcitation.org/65TkwoESp).
doi:10.2196/jmir.1742
Keywords
Introduction
Regular physical activity reduces the risks of multiple health problems, which often become more prevalent when people age [
- ]. An international guideline for physical activity recommends that older adults should be physically active at moderate to vigorous intensity for at least 5 days a week, for a minimum of 30 minutes a day [ , ]. Regular physical activity is also particularly important for older adults to enable them to maintain their mobility and independence; to improve muscle strength, cognitive functioning, and mental and emotional well-being; and to prevent falls [ , - ]. Because of the aging population in the Netherlands, stimulating physical activity among people over 50 years of age is of major relevance.The Active Plus project is a computer-tailored, theory-driven, evidence-based intervention aimed at increasing physical activity in people aged over 50 years. The intervention, consisting of print-delivered tailored advice to improve the level of physical activity, has proven to be effective in changing physical activity behavior in the short and long terms, and was effective in reaching and affecting high-risk groups such as people of low socioeconomic status (SES) [
, ]. The purpose of this study was to gain insight into the translation of the first print-delivered version of the Active Plus project into an adapted (Web-based) follow-up project based on evaluation results, by using the RE-AIM framework.The Active Plus project consisted of two phases: (1) systematic development and evaluation of the first version of the Active Plus project, which was completed in 2009 and has proven to be effective, and (2) translation of process and effect evaluation outcomes of the first Active Plus project into an adapted project using the RE-AIM framework to further increase the reach and effect of the project and its implementation in a clustered randomized controlled trial (RCT).
In the first phase of the Active Plus project (2005–2009), interventions were systematically developed using the intervention mapping protocol [
]. Development was based on a literature review [ ], a Delphi study among experts in the field [ ], focus group interviews, and a review of theoretical models, such as the I-Change Model [ ], the Health Action Process Approach [ ], self-regulation theory [ , ], and self-determination theory [ , ], to assess the most relevant and changeable personal and environmental determinants associated with changing physical activity behavior [ ]. A complete description of the development and characteristics of the first version of the Active Plus project can be found elsewhere [ ]. The first version of the Active Plus project consisted of two print-delivered, tailored physical activity interventions: (1) a basic computer-tailored intervention (to raise awareness of lack of physical activity, and to stimulate initiation and maintenance of physical activity), and (2) an intervention with additional environmental components that focused on giving tailored personalized advice on local possibilities and initiatives for being physically active for people over 50 years of age. The additional environmental component was intended to positively change people’s perceptions of the opportunities to be physically active in their own environment [ ]. Both interventions included three tailored letters, based on the answers individuals gave in previous assessment, delivered by mail over 4 months [ ]: (1) 2 weeks after the baseline assessment, (2) 2 months after the baseline assessment, and (3) 4 months after baseline assessment, based on the second assessment. The third tailored advice contained ipsative feedback about the changes in the respondents’ physical activity behavior and the psychosocial determinants in the previous 4 months. This means that improvements in (determinants of) physical activity were rewarded and possible relapses were addressed appropriately with additional suggestions to increase physical activity levels again.Both original Active Plus interventions have proven effective in changing physical activity behavior [
, ]. Results showed that participants in the intervention groups increased their physical activity by 14%, from 4.2 days per week of at least 30 minutes of physical activity at baseline to 4.9 days per week at 6 months, while the control group did not change. At 12 months, the intervention groups were still physically active for 4.7 days per week. Further, both interventions were effective in reaching low-SES groups: 48% of all participants had a low level of education. Effects on physical activity were similar among different SES groups, but the low-SES group evaluated both interventions significantly more positively than did the high-SES group [ , ]. At 3 (ie, during the intervention), 6 (ie, 2 months postintervention), and 12 months (ie, 8 months postintervention), a process evaluation, an effect evaluation, and an evaluation of the working mechanisms of the intervention (ie, analyses of mediators) and less-responsive subgroups (ie, analyses of moderators) were conducted [ , ]. The results of these evaluations were the starting point for the second phase of this project.In the second phase of the project, we translated the process and effect outcomes of the first version of the Active Plus project into an adapted intervention using the RE-AIM framework [
- ] and implemented the new interventions in a clustered RCT. The RE-AIM model is often used to evaluate the potential public health impact of an intervention [ ]. The model distinguishes five different dimensions: (1) reach: the number and representativeness of individuals willing to participate, (2) effectiveness: the impact of the intervention on target outcomes, (3) adoption: the proportion and representativeness of settings that adopt the intervention, (4) implementation: the extent to which the interventions are delivered as intended, and (5) maintenance: the extent to which individual participants maintain behavior change in the long term and the extent to which the intervention is sustained over time within the organizations that deliver the intervention [ - ].The aim of this study was to systematically translate the results of the (process) evaluation of the first version of the Active Plus project into an adapted follow-up (Web-based) project using the RE-AIM framework. Our focus was on the reach and effectiveness dimensions, since these dimensions are most influenced by the results from the original Active Plus project. Although relevant, the adoption, implementation, and maintenance dimensions depend on evaluation of the effectiveness of the new (Web-based) interventions, and were therefore beyond the scope of this paper. Additional evaluation results and response rates of the adapted interventions will be shown.
Methods
Results of the process and effect evaluation of the original Active Plus project [
, , ] were translated into a new (Web-based) project using the RE-AIM framework. We briefly outline the methods that we used to evaluate and adapt the Active Plus interventions according to the RE-AIM framework; we describe the actual adaptations in the Results section.We improved the potential reach of the intervention by extending the delivery mode of the print-delivered intervention into an additional Web-based intervention with lower implementation costs. Furthermore, we used the process evaluation results of the original project [
] to detect how subgroups appreciated the intervention and thereby to subsequently adapt the interventions to optimize appreciation among certain groups and to increase the potential reach of the interventions.To improve effectiveness, we used results of the process evaluation, analyses of effects within subgroups (ie, analyses of moderators [
]), and evaluation of the working mechanisms of the original intervention (ie, analyses of mediators [ , ]) to adapt and develop new intervention materials to eventually increase the potential effect of the intervention.A quantitative pretest was performed using a questionnaire among 30 participants to study the appreciation and usability of all new intervention materials. Appreciation of the new intervention materials was assessed with 5 items per intervention element. Participants were asked whether they perceived the intervention materials as interesting, understandable, pleasant, advantageous, and motivating, using a 5-point Likert scale (ranging from 1, totally disagree, to 5, totally agree). We assessed usability using a 10-point Likert scale (ranging from 1, not useful, to 10, very useful). Additional in-depth open-ended questions were used to provide insight into the reasons why people gave certain ratings, and respondents were asked to write down their remarks regarding the new intervention strategies. The intervention strategies were subsequently adjusted according to the preferences of the pilot group.
A qualitative in-depth pretest (3 expert users and 7 nonexpert users) was performed to assess the usability of the new Web-based intervention as a whole. The expert users (all working in the field of health psychology) were asked to review the content of the intervention. All nonexpert participants were older than 50 years with little to average experience with Internet use, and were monitored while filling in the online questionnaire and reading the online advice. We used the results from this second pretest to further improve the Web-based intervention.
Study Design
To study the effectiveness of the new interventions, and to monitor their adoption by the target population, we implemented the adapted interventions (a basic print-delivered intervention; a print-delivered intervention with environmental information; a basic Web-based intervention; and a Web-based intervention with environmental information) in a clustered RCT, including a control group that received no advice.
The main study parameters were changes in physical activity behavior (measured using the self-administered Dutch Short Questionnaire to Assess Health-Enhancing Physical Activity [
]), and determinants of changing and maintaining physical activity behavior.Participants and Procedure in the Clustered RCT
For the follow-up clustered RCT of the new interventions, we selected six municipal health council regions that had not participated in the first phase of the Active Plus project. To prevent participants from different intervention conditions contaminating each other (especially regarding whether they received environmental information), randomization was at the municipal health council region level, which means that each region was randomly assigned to one of the intervention conditions. This ensured that all participants were randomly assigned through their region to one of the conditions and were not able to choose the delivery mode (print delivered vs Web based) of the intervention. For each intervention condition, we selected seven (matched) neighborhoods to participate in the RCT. Neighborhoods were matched on their urbanization, percentage of people with a low SES, percentage of people with a high SES, percentage of immigrants, and percentage of people aged over 50 years. Each municipal health council provided a random sample of eligible participants living in the selected matched neighborhoods, after stratification for age.
provides an overview of the selection of participants and of the number of participants for each intervention condition.A power calculation (effect size = 0.4, power = 80%, intracluster correlation coefficient = .1) showed that at baseline about 420 participants were needed for each intervention condition (considering a dropout rate of 40% during the 1-year follow-up based on the original Active Plus project, and accounting for the multilevel design based on an estimate of the intracluster correlation coefficient). Because of an expected response rate of 23% (based on the previous Active Plus study [
]), our starting point was to distribute 1850 invitations in participating regions of the print-delivered intervention. Because the use of a Web-based intervention among persons aged over 50 years is less established, 2775 (50% extra) invitations were originally distributed in each Web-based intervention condition.We recorded response rates for the different intervention conditions in SES groups.
This study was in accordance with the CONSORT checklist and is approved by the Medical Ethics Committee of Atrium–Orbis–Zuyd (METC code 10-N-36) and was registered with the Dutch Trial Register (NTR 2297).
The print-delivered intervention groups received their advice by mail, within 2 weeks after they returned the questionnaire. The Web-based intervention groups received an email, with a link that directly connected them with their tailored advice, immediately after filling in the questionnaire (see
for the timeline of this clustered RCT).Results
This section describes the results of (1) the evaluation of the process and effect outcomes of the first version of the Active Plus project across the reach and effectiveness dimension of the RE-AIM framework, and (2) the adaptations in the intervention and delivery mode based on this process.
provides an overview of the results. Furthermore, this section shows the pretest results and response characteristics of the Active Plus follow-up project.RE-AIM dimension | Definition | Adaptation for the Active Plus project |
Reach | Number and representativeness of individuals willing to participate | Extending the delivery mode to a Web-based version |
Providing additional information to reach both low- and high-socioeconomic status groups | ||
Providing additional information to reach participants with physical disabilities | ||
Effectiveness | Impact of the intervention on target outcomes | Translating the print-delivered interventions into Web-based interventions |
Adding information to increase intervention effects in the subgroups that were less affected by the original intervention (persons with a normal body mass index and persons aged over 65 years) | ||
Improving intervention strategies | ||
Stimulating self-efficacy and strategic planning | ||
Stimulating intrinsic motivation | ||
Reinforcing and extending environmental information | ||
Adoption | Proportion and representativeness of settings that adopt the intervention | Translating the print-delivered interventions into Web-based interventions. Response rates to the print-delivered interventions are higher than response rates to the Web-based interventionsa |
Implementation | Extent to which the interventions are delivered as intended | a |
Maintenance | Extent to which individual participants maintain behavior change long term and the extent to which the intervention is sustained over time within the organizations that deliver the intervention | Improvements made to the original interventions are expected to further increase the effects on physical activity behaviora |
a Further research is beyond the scope of the current study.
Reach
Several efforts were made to increase the potential reach of the intervention. The delivery mode of the intervention was extended, and tailored advice was adapted to reach both low-and high-SES participants and to reach participants with physical disabilities.
Extending the Delivery Mode
The original Active Plus interventions were print delivered, distributed through written letters. In 2005 (the start of the original project) only a limited proportion of the older age groups had access to the Internet. However, in recent years Internet use among (older) adults has increased enormously. In 2010, 94% of all Dutch adults has access to the Internet at their home [
]. Although home Internet access is still lower in the age group 65+ years, with 68% access, the age group 55–65 years increased their home Internet access substantially to 91% in 2010. Furthermore, the differences in Internet access between SES groups have become much smaller (low SES 87%, high SES 98% in the general population), indicating that Web-based interventions are no longer a barrier to reaching low-SES groups or older adults [ ].Web-based tailoring offers several advantages over print-delivered tailoring, not only within the scope of reach but also in increasing the potential effects (which is the second dimension of the RE-AIM model and described in the next section). The main advantages of Web-based tailoring are that it provides options for more interactive applications (such as Google Maps, and meeting and discussion forums) and the opportunity to use more multimedia components (eg, physical activity options illustrated by videos, which should lead to better learning effects than static pictures [
]). Further, the Internet can deliver tailored feedback immediately, eliminating a time lag between assessment and feedback. The implementation costs of Web-based interventions are much lower, and they require less intensive manual labor than print-delivered interventions. Data from the print-delivered questionnaires need to be entered, and the letters need to be printed and sent by mail, which requires postage and portage. Translating the print-delivered interventions into Web-based interventions makes the interventions less expensive and less work intensive, and the project can be made more easily available to larger populations. Web-based interventions are therefore expected to have a larger reach. Other studies also showed that Web-based interventions have the potential to reach large audiences, with low costs per participant [ ].Reaching Low- and High-SES Groups
Both original interventions were effective in reaching low-SES groups: 48% of all participants had a low level of education [
, ]. As described above, it is expected that low-SES groups can be reached by a Web-based intervention. Furthermore, the process evaluation of the first project [ ] showed that high-SES participants felt the need to receive more in-depth information about the effects of physical activity on health-related aspects. Therefore, we developed tailored messages with more in-depth information (such as the possible consequences of insufficient physical activity), especially for the more highly educated participants.Reaching Participants With Physical Disabilities
Unpublished data from the first project showed that persons with physical disabilities had a lower appreciation of the original interventions. Because many people aged over 50 years have chronic physical disabilities (30% in the original Active Plus project), in the follow-up project we paid special attention to possible physical impairments of the participants. In the Netherlands, 38.1% of all people aged between 55 and 64 years have a chronic disease, increasing to 57.7% of all people aged above 75 years [
]. Therefore, being physically active with a chronic disease needs more attention, and the advice was tailored to certain physical disabilities. Participants with arthritis, cardiovascular diseases, depression, respiratory diseases, rheumatism, stroke, diabetes, osteoporoses, or severe back pain received additional tailored information about being physically active with their disability, since these disabilities have the highest prevalence among older persons in the Netherlands. This additional (existing) information was developed by the Dutch Institute for Sports and Movement and the Dutch Organization for Sports With Physical Impairments.Effectiveness
To increase effectiveness, we improved the original Active Plus interventions by translating the print-delivered interventions into Web-based interventions, by targeting nonresponsive subgroups, and by improving the intervention strategies based on the results of the effect and process evaluation (see
).Web-Based Interventions
Because of several advantages, noted above, of Web-based interventions, we translated the print-delivered interventions into Web-based interventions. Research showed that Web-based interventions can be effective in changing health behaviors such as physical activity [
]. The Web-based interventions included more multimedia components. In the print-delivered Active Plus advice, a practical strategy to target modeling was to include role model statements in the letters, by using pictures of active similar others (same age and gender) combined with text describing the motivation and experiences of each person. For the Web-based version, we replaced these role model pictures and statements, as well as the traditional pictures to explain specific physical activity exercises, with short videos. Research has shown that video animations lead to better learning effects than static pictures [ ].We developed a website to provide the respondents with the opportunity to find information about physical activities in their own local surroundings, and to exchange information with other respondents. A meeting and discussion forum, an e-card facility, and Google Maps showing opportunities to be physically active in their own surroundings were developed specifically for participants in the environmental intervention conditions. We also added several hyperlinks to the website to provide participants with additional information about local physical activity possibilities. Participants in the Web-based intervention received an email with a copy (pdf format) of the personal advice they had received on the website directly after filling in the questionnaire. The advice sent by email had the same format as the print-delivered version.
Targeting Nonresponsive Subgroups
Moderation analyses showed that the interventions were not effective in persons with a healthy body mass index (<25 kg/m2) and adults 65 years and older [
]. Therefore, we added information on the advantages of physical activity for persons with a healthy body mass index and adults older than 65 years. The importance of physical activity when having a healthy weight was emphasized, and extra information was added about the benefits of physical activity especially for older adults, such as the importance of physical activity to maintain a healthy cognitive state.Improving Intervention Strategies
We adapted some intervention strategies based on the process evaluation of the first project [
]. Regarding some of the original intervention strategies incorporated into the tailored letters (ie, role model statements, action planning post-its, and coping planning tables), the majority of the participants had read the materials and perceived the materials as interesting. However, when intervention components asked participants to actively participate (eg, filling in an action plan or coping plan), only a minority of them actually filled in the materials [ ]. In the original interventions, action plans had to be written down on post-its. For this new intervention, the post-its were replaced by large and more appealing schemes, on which participants could plan and write down their weekly physical activities, with a more extensive and more motivating explanation. These schemes were integrated into several parts of the tailored advice, and participants were actively stimulated to work with these schemes.Strategic Planning and Self-efficacy
Mediation analyses showed that strategic planning and self-efficacy were important in changing physical activity behavior [
]. Therefore, we provided more elaborated tailored advice on strategic planning in the improved interventions. The self-efficacy advice was formulated in a more empathetic way. Furthermore, more in-depth analyses showed that for some self-efficacy concepts (age, being physically active alone, and having less money), the transition from “being able to do it” to “being sure that they were able to do it” is of great importance. In the adapted interventions, the participants therefore also receive tailored text messages for these concepts when they answered “maybe” or “being able to do it,” whereas, in the original project, participants received self-efficacy messages only when they answered that they were “not (sure about) being able to do it.” In addition, participants received a logbook with instructions to encourage them to monitor their own physical activity behavior and thereby to increase their awareness of such behavior and to stimulate maintenance of being physically active.Intrinsic Motivation
Mediation analyses of the original Active Plus project showed that the intervention had only a minimal effect on the participants’ intrinsic motivation to be physically active [
]. By integrating some concepts of the self-determination theory into the current intervention, we attempted to increase the participants’ intrinsic motivation. The self-determination theory emphasizes the importance of intrinsic motivation in engaging in and maintaining health-related behaviors. Motivation is autonomous or self-determined when a person’s perceived locus of causality is internal. Intrinsic motivation implies that the behavior is engaged in for enjoyment and satisfaction [ - ]. Several studies have shown the importance of intrinsic motivation as a predictor in exercise participation [ - ]. People will develop and maintain more self-determined motivation when their environment supports autonomy. This implies that people’s perspective should be acknowledged, their initiatives should be supported, a choice and relevant information should be provided, and pressure and control should be minimized [ - ]. To create an autonomy-supportive environment, we adapted text messages to comply with the self-determination theory [ ]. A clear rationale to adopt the behavior was provided by presenting a more elaborated knowledge component about the contingencies between behavior and health outcomes to support informed choices. Also, participants’ feelings and perspectives were acknowledged more by showing more empathy. Participants were stimulated to think and write down their personal most important reasons to be sufficiently physically active. Furthermore, the participants’ own initiatives were more supported. For example, on every improvement, positive feedback was given even when the physical activity behavior still did not comply with the international physical activity guidelines. Participants were also offered a choice of options giving them control over their own physical activity behavior (eg, physical activity in their daily activities, during their leisure time, or by exercising). Finally, we checked all text messages for the use of neutral language: “should” and “must” were replaced by “may” and “could.”Reinforcing and Extending Environmental Information
Previous studies have emphasized the importance of focusing on enhancing participants’ perceptions of their environment [
- ]. Unfortunately, we found no overall differences in physical activity effects between the environment-based Active Plus intervention and the basic tailored intervention [ , ]. However, perceptions of the environment changed positively: participants perceived significantly more opportunities to engage in physical activity in their immediate environment. Furthermore, at 6 months the intervention additionally focusing on environmental aspects increased the amount of certain types of physical activities such as walking and cycling more than did the basic intervention [ , ]. Mediation analyses showed that the positive effect of the environmentally tailored intervention on physical activity was mediated by changes in environmental perceptions [ , ]. This emphasizes the importance of including aspects such as enhancing participants’ perceptions of their environment in tailored interventions. Adding environmental information to the intervention is supposed to further increase the intervention effects. Therefore, an extended version of the environment-based intervention was developed for this follow-up project.In the original Active Plus project, participants in the environmental intervention conditions received information on walking and cycling routes in their own neighborhoods, written examples of exercises to do at home, contact information for neighborhood sport clubs, a roadmap of their immediate neighborhood on which walking and cycling possibilities were highlighted, and access to a forum and e-buddy system on a website. In the adapted follow-up intervention, we emphasized the environmental approach, making it more personalized and extended with additional options. Information about local opportunities to be physically active was added on three levels: (1) in their own district (sport clubs or sport accommodations matching with their own preferences, existing walking and cycling routes, and options to develop their own walking and cycling routes), (2) in their immediate neighborhood (walking routes to stores within 1 km of their own house, using Google Maps), and (3) in their own home (options for being more physically active in their daily life activities and seven different home exercises).
Furthermore, we paid more attention to the participants’ social environment. Although the original environmental Active Plus intervention contained an option to visit a website to contact other adults to be physically active together, little emphasis was placed on this opportunity, resulting in very low participation. In the new intervention, we put greater emphasis on opportunities to get together with others in the neighborhood to be physically active. We developed an online forum with a variety of topics, actively promoted the use of a well-known website to find a sport mate (www.beweegmaatje.nl), and developed several postcards and e-cards that the participant could use to invite someone to be physically active together. Participants also received tailored feedback about the social modeling and social support they receive from their immediate social environment.
Pretest
All of the new intervention materials were quantitatively and qualitatively evaluated for appreciation and usability. Results of the quantitative pretest showed (see
) that the new strategies had modest usability (scores between 5.3 and 6.4 on a scale of 1, not useful, to 10, very useful) and relatively high appreciation (scores between 3.7 and 4.1 on a scale of 1, low appreciation, to 5, high appreciation). Based on these results and the remarks of the participants on the materials, we subsequently adjusted the intervention strategies according to the preferences of the pilot group.The qualitative pretest assessing the usability of the Web-based intervention (see
) showed that filling in an online questionnaire and performing the online tasks (such as sending e-cards, filling in pdf forms, or watching videos) was not problematic for the nonexpert users. Although filling in the questionnaire and reading the advice took a considerable amount of time, the participants did not mention this as a constraint.Determinant | Theoretical method | Intervention strategy | Intervention materials | Appreciation score (1–5) | Usability score (1–10) |
Action planning | Active learning | Invite to formulate action plan | Weekly schema to write down plans to be physically active (when, what, where, with whom) | 3.89 | 5.93 |
Coping planning | Active learning | Invite to formulate coping plans | Coping planning schema | 3.72 | 5.78 |
Perceived social environment or having a sports partner | Linking members to networks of people | Provide the opportunity to contact others | Post card to invite someone to be physically active together | 3.96 | 5.32 |
Perceived physical environment | Facilitating | Provide exercises to do at home | Physical activity exercises | 4.06 | 6.64 |
Awareness | Self-monitoring | Encourage monitoring of own behavior | Logbook | 3.73 | 5.79 |
General findings | Adaptations |
The website address is often typed in into the Google search window instead of the website address window. | The website was made findable in the Google search results, and an information form was developed on how to enter the website. |
Average duration of filling in the online questionnaire was 50 minutes. The participants did not mention this as a constraint. | No adaptations were made to the length of the questionnaire. |
People perceived difficulties in how to fill in certain questions. | An information form was developed on how to fill in this questionnaire. This information was also added to the help section of the website. |
People appreciated the large letter type. | The letter type size was not changed. |
All people were able to use the scrolling methods, but scrolling both up and down, and to the left and to the right is too difficult. | Layout of the webpage was adapted to prevent too much scrolling. |
By clicking on other website links, participants lost track of their own tailored advice. | Website links mentioned in the advice opened in a new window, to prevent participants from loosing track of their personal advice. |
Some technical errors and errors in tailoring algorithms were found. | All errors were adjusted. |
Adoption, Implementation, and Maintenance
To study effectiveness and to monitor adoption of the interventions by the target population, the interventions were implemented in a clustered RCT. Since the response percentages were lower than expected, in a second recruitment round we sent additional invitations to reach similar absolute numbers of respondents in all intervention groups.
shows that the response rate to the print-delivered intervention was higher than the response rate to the Web-based intervention among people aged over 50 years. As expected, both low- and high-SES participants were reached by both print-delivered and Web-based interventions.Changes made in the intervention strategies to increase the intervention effects (eg, stimulating intrinsic motivation) were also expected to further increase the maintenance of physical activity behavior among the target population.
Discussion
This paper describes the systematic translation of the results of the (process) evaluation of the original version of the Active Plus project into an adapted (Web-based) intervention using the RE-AIM framework. Our focus was on the reach and effectiveness dimensions of the RE-AIM framework, since these dimensions are most influenced by the results from the original Active Plus project.
We optimized the potential reach and effect of the Active Plus interventions by translating the print-delivered interventions into Web-based interventions. We also improved the potential reach of the intervention by adapting the tailored advice to reach both low- and high-SES participants and to reach participants with physical disabilities. To further increase the effectiveness of the original Active Plus interventions, we adapted them to appeal to subgroups that did not respond to the effect in the original intervention (ie, persons with a healthy body mass index and adults older the 65 years). Furthermore, several intervention strategies were improved. Because results from the original project showed that strategic planning, self-efficacy, intrinsic motivation, and the environmental component were important in changing physical activity behavior, these concepts were more strongly targeted in the new interventions. We made the adaptations based on the results of the first Active Plus project, such as the process evaluation [
], analyses of effects within subgroups (ie, analyses of moderators [ ]), and evaluation of the working mechanisms of the original interventions (ie, analyses of mediators [ , ]).Pretest results showed that all of the new intervention materials had modest usability and relatively high appreciation, and that filling in an online questionnaire and performing the online tasks was not problematic for adults aged over 50 years. We subsequently adjusted the intervention strategies according to the preferences of the pilot group and then implemented the interventions in a clustered RCT. Our first results showed a higher response rate for the print-delivered interventions than for the Web-based interventions. However, different SES groups were equally reached.
We have identified several major lessons from our experience of translating the original intervention into a Web-based intervention targeted at older adults. First, it is essential to use a theoretical framework such as the RE-AIM model when evaluating and adapting an original intervention, since it ensures that all important points that can determine the impact of an intervention are systematically addressed. Second, it is of major importance to use process evaluation data, and mediation and moderation results to redesign and strengthen an effective intervention. Finally, it is imperative to thoroughly pretest the new interventions. The combination of quantitative and qualitative pretests used in this study was very useful to gain a broad insight into user experiences and preferences, and thereby to improve the usability of the intervention.
Translating the (process) evaluation of an effective intervention into an adapted intervention is very challenging and rarely reported. Evaluation studies seldom lead to adaptations in the evaluated interventions, at least not ones that are scientifically monitored and reported, which results in a gap between research insights and practice. Evidence on how to effectively facilitate this adaptation process is also limited [
]. Providing more insight into intervention evaluations and adaptations could help future research in systematically (re)evaluating and (re)designing interventions, without reinventing the wheel.Our adaptations led to four versions of the intervention: basic or with additional environmental information, and print delivered or Web based. In future evaluations, it will be important to consider the differences in cost and effects of the different interventions as well. The potential reach of the Web-based interventions is expected to be higher than the print-delivered intervention because of the lower implementation cost. Furthermore, the effect of the Web-based intervention on behavioral change might be better due to the advantages of the Internet (eg, the possibility of immediate feedback and multimedia use). Response rates showed that both low- and high-SES participants can be reached by both print-delivered and Web-based interventions. The continuing study of the Active Plus project aims to provide more insights into the cost effectiveness of the adapted interventions.
The RE-AIM framework was perceived as a very useful guideline for evaluating the original intervention and translating it into a new intervention. We emphasized the reach and effectiveness dimensions in our study. However, gaining insight into the most relevant conditions for the adoption and implementation of an intervention is also of major importance and will be the focus of future research. The adoption, implementation, and maintenance dimensions would depend on the cost-effectiveness evaluation of the new (Web-based) interventions, and will therefore be studied in a later stage of this project. Results of the effect evaluation of the new interventions and experiences of the target population and intermediaries with the intervention may serve as input for future studies. Careful administration of all costs and time needed for the development, recruitment, and implementation of the interventions is important to enable different intermediaries to judge whether they would have the capacity to implement these interventions in a nonexperimental setting.
Future studies should also provide insight into the feasibility and relevant conditions for accepting and implementing the interventions (by the intermediaries) or for participating in the interventions (target group). Since Web-based interventions among persons aged over 50 years can be regarded as an innovation, a study to inform the adaption, implementation, and maintenance of the intervention could be guided by Rogers’ theory of innovations [
], for example, by using focus group interviews or in-depth interviews.This paper provides insight into the processes leading to future effects of the intervention and could help future researchers in systematically developing or reevaluating their intervention.
Acknowledgments
This study was funded by The Netherlands Organization for Health Research and Development (ZonMw, 200110006) and publication was supported by The Netherlands Organization for Scientific Research (NWO).
Conflicts of Interest
None declared.
References
- Rodgers A, Vaughan P, Prentice T, Tan-Torres Edejer T, Evans D, Lowe J. World Health Organization. 2002. The World Health Report 2002: Reducing Risks, Promoting Healthy Life URL: http://www.who.int/whr/2002/en/whr02_en.pdf [accessed 2011-08-12] [WebCite Cache]
- Department of Health, Physical Activity, Health Improvement and Prevention. At Least Five a Week: Evidence on the Impact of Physical Activity and its Relationship to Health. London: Department of Health; 2004. At least five a week: Evidence on the impact of physical activity and its relationship to health URL: http://www.dh.gov.uk/prod_consum_dh/groups/dh_digitalassets/@dh/@en/documents/digitalasset/dh_4080981.pdf [accessed 2012-02-21] [WebCite Cache]
- The Swedish National Institute of Public Health. Healthy Ageing: A Challenge for Europe. Stockholm: Swedish National Institute of Public Health; 2006. URL: http://ec.europa.eu/health/archive/ph_projects/2003/action1/docs/2003_1_26_sum_en.pdf
- Nelson ME, Rejeski WJ, Blair SN, Duncan PW, Judge JO, King AC, et al. Physical activity and public health in older adults: recommendation from the American College of Sports Medicine and the American Heart Association. Med Sci Sports Exerc 2007 Aug;39(8):1435-1445. [CrossRef] [Medline]
- Haskell WL, Lee IM, Pate RR, Powell KE, Blair SN, Franklin BA, American College of Sports Medicine, American Heart Association. Physical activity and public health: updated recommendation for adults from the American College of Sports Medicine and the American Heart Association. Circulation 2007 Aug 28;116(9):1081-1093 [FREE Full text] [CrossRef] [Medline]
- Janssen I, Jolliffe CJ. Influence of physical activity on mortality in elderly with coronary artery disease. Med Sci Sports Exerc 2006 Mar;38(3):418-417. [CrossRef] [Medline]
- Kesaniemi YK, Danforth E, Jensen MD, Kopelman PG, Lefèbvre P, Reeder BA. Dose-response issues concerning physical activity and health: an evidence-based symposium. Med Sci Sports Exerc 2001 Jun;33(6 Suppl):S351-S358. [Medline]
- Ooijendijk WTM, Hildebrandt VH, Hopman-Rock M. Trendrapport Bewegen en Gezondheid 2004/2005. Leiden: TNO; 2007.
- van Stralen MM, de Vries H, Mudde AN, Bolman C, Lechner L. Efficacy of two tailored interventions promoting physical activity in older adults. Am J Prev Med 2009 Nov;37(5):405-417. [CrossRef] [Medline]
- van Stralen MM, de Vries H, Mudde AN, Bolman C, Lechner L. The long-term efficacy of two computer-tailored physical activity interventions for older adults: main effects and mediators. Health Psychol 2011 Jul;30(4):442-452. [CrossRef] [Medline]
- Barthelomew LK, Parcel GS, Kok G, Gottlieb NH. Planning Health Promotion Programs: An Intervention Mapping Approach. 2nd edition. San Francisco, CA: Jossey-Bass; 2006.
- Van Stralen MM, De Vries H, Mudde AN, Bolman C, Lechner L. Determinants of initiation and maintenance of physical activity in older adults: a literature review. Health Psychol Rev 2009;3(2):147-207. [CrossRef]
- van Stralen MM, Lechner L, Mudde AN, de Vries H, Bolman C. Determinants of awareness, initiation and maintenance of physical activity among the over-fifties: a Delphi study. Health Educ Res 2010 Apr;25(2):233-247 [FREE Full text] [CrossRef] [Medline]
- de Vries H, Mesters I, Riet JV, Willems K, Reubsaet A. Motives of Belgian adolescents for using sunscreen: the role of action plans. Cancer Epidemiol Biomarkers Prev 2006 Jul;15(7):1360-1366 [FREE Full text] [CrossRef] [Medline]
- Schwarzer R. Modeling health behavior change: how to predict and modify the adoption and maintenance of health behaviors. Appl Psychol 2008;57(1):1-29. [CrossRef]
- Baumeister RF, Vohs KD. Handbook of Self-regulation: Research, Theory, and Applications. New York, NY: Guilford Press; 2004.
- Boekaerts M, Pintrich PR, Zeidner M. Handbook of Self-regulation. San Diego, CA: Academic Press; 2000.
- Hagger MS, Chatzisarantis NLD. Intrinsic Motivation and Self-determination in Exercise and Sport. Champaign, IL: Human Kinetics; 2007.
- Hagger M, Chatzisarantis N. Active human nature: self-determination theory and the promotion and maintenance of sport, exercise and health. In: Hagger MS, Chatzisarantis NLD, editors. Intrinsic Motivation and Self-determination in Exercise and Sport. Champaign, IL: Human Kinetics; 2007:1-19.
- van Stralen MM, Kok G, de Vries H, Mudde AN, Bolman C, Lechner L. The Active plus protocol: systematic development of two theory- and evidence-based tailored physical activity interventions for the over-fifties. BMC Public Health 2008;8:399 [FREE Full text] [CrossRef] [Medline]
- van Stralen MM, de Vries H, Mudde AN, Bolman C, Lechner L. The working mechanisms of an environmentally tailored physical activity intervention for older adults: a randomized controlled trial. Int J Behav Nutr Phys Act 2009;6:83 [FREE Full text] [CrossRef] [Medline]
- van Stralen MM, de Vries H, Bolman C, Mudde AN, Lechner L. Exploring the efficacy and moderators of two computer-tailored physical activity interventions for older adults: a randomized controlled trial. Ann Behav Med 2010 May;39(2):139-150. [CrossRef] [Medline]
- Glasgow RE, Klesges LM, Dzewaltowski DA, Estabrooks PA, Vogt TM. Evaluating the impact of health promotion programs: using the RE-AIM framework to form summary measures for decision making involving complex issues. Health Educ Res 2006 Oct;21(5):688-694 [FREE Full text] [CrossRef] [Medline]
- Glasgow RE, Nelson CC, Strycker LA, King DK. Using RE-AIM metrics to evaluate diabetes self-management support interventions. Am J Prev Med 2006 Jan;30(1):67-73. [CrossRef] [Medline]
- Glasgow RE, McKay HG, Piette JD, Reynolds KD. The RE-AIM framework for evaluating interventions: what can it tell us about approaches to chronic illness management? Patient Educ Couns 2001 Aug;44(2):119-127. [Medline]
- Glasgow RE, Vogt TM, Boles SM. Evaluating the public health impact of health promotion interventions: the RE-AIM framework. Am J Public Health 1999 Sep;89(9):1322-1327. [Medline]
- Wendel-Vos GC, Schuit AJ, Saris WH, Kromhout D. Reproducibility and relative validity of the short questionnaire to assess health-enhancing physical activity. J Clin Epidemiol 2003 Dec;56(12):1163-1169. [Medline]
- Centraal Bureau voor de Statistiek. 2011. Statline URL: http://statline.cbs.nl/statweb/ [accessed 2011-08-12] [WebCite Cache]
- Paas F. Neem Eens een Voorbeeld aan Anderen: Nieuwe Impulsen voor Onderzoek Naar Leren en Instructie. Heerlen: Open Universiteit Nederland; 2007.
- Griffiths F, Lindenmeyer A, Powell J, Lowe P, Thorogood M. Why are health care interventions delivered over the internet? A systematic review of the published literature. J Med Internet Res 2006;8(2):e10 [FREE Full text] [CrossRef] [Medline]
- Hoeymans N, Schellevis FC, Wolters I. Rijksinstituut voor Volksgezondheid en Milieu. 2011 Jul 15. [How Many Persons Have One or More Chronic Diseases?] URL: http://www.nationaalkompas.nl/gezondheid-en-ziekte/ziekten-en-aandoeningen/chronische-ziekten-en-multimorbiditeit/hoeveel-mensen-hebben-een-of-meer-chronische-ziekten/ [accessed 2011-08-12] [WebCite Cache]
- van den Berg MH, Schoones JW, Vliet Vlieland TP. Internet-based physical activity interventions: a systematic review of the literature. J Med Internet Res 2007;9(3):e26 [FREE Full text] [CrossRef] [Medline]
- Deci EL, Ryan RM. Intrinsic Motivation and Self-determination in Human Behavior. New York, NY: Plenum; 1985.
- Deci EL, Eghrari H, Patrick BC, Leone DR. Facilitating internalization: the self-determination theory perspective. J Pers 1994 Mar;62(1):119-142. [Medline]
- Ryan RM, Deci EL. Self-determination theory and the facilitation of intrinsic motivation, social development, and well-being. Am Psychol 2000 Jan;55(1):68-78. [Medline]
- Thøgersen-Ntoumani C, Ntoumanis N. The role of self-determined motivation in the understanding of exercise-related behaviours, cognitions and physical self-evaluations. J Sports Sci 2006 Apr;24(4):393-404. [CrossRef] [Medline]
- Wilson PM, Rodgers WM. The relationship between perceived autonomy support, exercise regulations and behavioral intentions in women. Psychol Sport Exerc 2004;5(3):229-242. [CrossRef]
- Rose EA, Parfitt G, Williams S. Exercise causality orientations, behavioral regulation for exercise and stage of change for exercise: exploring their relationships. Psychol Sport Exerc 2005;6(4):399-414. [CrossRef]
- Silva MN, Vieira PN, Coutinho SR, Minderico CS, Matos MG, Sardinha LB, et al. Using self-determination theory to promote physical activity and weight control: a randomized controlled trial in women. J Behav Med 2010 Apr;33(2):110-122. [CrossRef] [Medline]
- Silva MN, Markland D, Minderico CS, Vieira PN, Castro MM, Coutinho SR, et al. A randomized controlled trial to evaluate self-determination theory for exercise adherence and weight control: rationale and intervention description. BMC Public Health 2008;8:234 [FREE Full text] [CrossRef] [Medline]
- Owen N, Humpel N, Leslie E, Bauman A, Sallis JF. Understanding environmental influences on walking; Review and research agenda. Am J Prev Med 2004 Jul;27(1):67-76. [CrossRef] [Medline]
- Humpel N, Owen N, Iverson D, Leslie E, Bauman A. Perceived environment attributes, residential location, and walking for particular purposes. Am J Prev Med 2004 Feb;26(2):119-125. [Medline]
- Sallis JF, King AC, Sirard JR, Albright CL. Perceived environmental predictors of physical activity over 6 months in adults: activity counseling trial. Health Psychol 2007 Nov;26(6):701-709. [CrossRef] [Medline]
- Kremers SP, de Bruijn GJ, Droomers M, van Lenthe F, Brug J. Moderators of environmental intervention effects on diet and activity in youth. Am J Prev Med 2007 Feb;32(2):163-172. [CrossRef] [Medline]
- Humpel N, Marshall AL, Leslie E, Bauman A, Owen N. Changes in neighborhood walking are related to changes in perceptions of environmental attributes. Ann Behav Med 2004 Feb;27(1):60-67. [CrossRef] [Medline]
- Harrington DW, Elliott SJ. Weighing the importance of neighbourhood: a multilevel exploration of the determinants of overweight and obesity. Soc Sci Med 2009 Feb;68(4):593-600. [CrossRef] [Medline]
- De Bourdeaudhuij I, Sallis JF, Saelens BE. Environmental correlates of physical activity in a sample of Belgian adults. Am J Health Promot 2003;18(1):83-92. [Medline]
- Armstrong R, Waters E, Crockett B, Keleher H. The nature of evidence resources and knowledge translation for health promotion practitioners. Health Promot Int 2007 Sep;22(3):254-260 [FREE Full text] [CrossRef] [Medline]
- Rogers EM. Diffusion of Innovations. New York, NY: Free Press; 2003.
Abbreviations
RCT: randomized controlled trial |
SES: socioeconomic status |
Edited by G Eysenbach; submitted 27.01.11; peer-reviewed by I DeBourdeaudhuij; comments to author 27.07.11; revised version received 31.08.11; accepted 16.01.12; published 02.03.12
Copyright©Denise A Peels, Maartje M van Stralen, Catherine Bolman, Rianne HJ Golsteijn, Hein de Vries, Aart N Mudde, Lilian Lechner. Originally published in the Journal of Medical Internet Research (http://www.jmir.org), 02.03.2012.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on http://www.jmir.org/, as well as this copyright and license information must be included.