Published on in Vol 22, No 7 (2020): July

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/16380, first published .
Evaluation of a Blended Physical Activity Intervention for Older Adults: Mixed Methods Study

Evaluation of a Blended Physical Activity Intervention for Older Adults: Mixed Methods Study

Evaluation of a Blended Physical Activity Intervention for Older Adults: Mixed Methods Study

Original Paper

1Applied Psychology, Faculty of Applied Social Sciences and Law, Amsterdam University of Applied Sciences, Amsterdam, Netherlands

2CREATE-IT Applied Research, Faculty of Digital Media and Creative Industries, Amsterdam University of Applied Sciences, Amsterdam, Netherlands

3Informatics Institute, Faculty of Science, University of Amsterdam, Amsterdam, Netherlands

4Center of Expertise Urban Vitality, Faculty of Health, Amsterdam University of Applied Sciences, Amsterdam, Netherlands

5Center of Expertise Urban Vitality, Faculty of Sports and Nutrition, Amsterdam University of Applied Sciences, Amsterdam, Netherlands

6Department of Rehabilitation, Amsterdam University Medical Centers, University of Amsterdam, Amsterdam, Netherlands

7Department of Nutrition and Dietetics, Amsterdam University Medical Centers, VU University, Amsterdam, Netherlands

8Amsterdam Public Health Research Institute, Amsterdam University Medical Centers, VU University, Amsterdam, Netherlands

Corresponding Author:

Sumit Mehra, MSc

Applied Psychology

Faculty of Applied Social Sciences and Law

Amsterdam University of Applied Sciences

Wibautstraat 3b

Amsterdam, 1091 GH

Netherlands

Phone: 31 0621156956

Email: s.mehra@hva.nl


Background: Physical activity can prolong the ability of older adults to live independently. Home-based exercises can help achieve the recommended physical activity levels. A blended intervention was developed to support older adults in performing home-based exercises. A tablet and a personal coach were provided to facilitate the self-regulation of exercise behavior.

Objective: In line with the Medical Research Council framework, this study aimed to carry out process evaluation of a blended intervention. The objectives were (1) to assess the long-term usability of the tablet adopted in the blended intervention and (2) to explore how the tablet, in conjunction with a personal coach, supported older adults in performing home-based exercises.

Methods: The process evaluation was conducted with a mixed-methods approach. At baseline, older adults participating in the blended intervention were asked to fill out a questionnaire about their general experience with information and communication technology (ICT) devices and rate their own skill level. After 6 months, participants filled out the Usefulness, Satisfaction, and Ease of use (USE) questionnaire to assess the usefulness, satisfaction, and ease of use of the tablet. With a random selection of participants, in-depth interviews were held to explore how the tablet and coach supported the self-regulation. The interviews were double coded and analyzed with the directed content analysis method.

Results: At baseline, 29% (65/224) of participants who started the intervention (mean age 72 years) filled out the ICT survey and 36% (37/103) of participants who used the tablet for 6 months (mean age 71 years) filled out the USE questionnaire. Furthermore, with 17% (18/103) of participants (mean age 73 years), follow-up interviews were held. The results of the baseline questionnaire showed that the large majority of participants already had experience with a tablet, used it regularly, and reported being skillful in operating ICT devices. After 6 months of use, the participants rated the usefulness, satisfaction, and ease of use of the tablet on average as 3.8, 4.2, and 4.1, respectively, on a 5-point scale. The analysis of the interviews showed that the participants felt that the tablet supported action planning, behavior execution, and self-monitoring. On the other hand, especially during the first few months, the personal coach added value during the goal setting, behavior execution, and evaluation phases of self-regulation.

Conclusions: The results of the process evaluation showed that older adults who participated in the study were positive about the blended intervention that was designed to support them in performing home-based exercises. Participants reported that the tablet helped them to perform the exercises better, more frequently, and safely. It supported them in various phases of self-regulation. The availability of a personal coach was nevertheless crucial. To support physical activity in older adults, a blended approach is promising.

J Med Internet Res 2020;22(7):e16380

doi:10.2196/16380

Keywords



Background

As people age, they face a decline in daily functioning and mobility [1,2]. Physical activity can delay the onset and slow the decline associated with aging [3,4]. Older adults who exercise on a regular basis can prevent impairments and remain self-reliant for a longer period of time [5,6]. Accordingly, various community centers around the world offer senior citizens the opportunity to participate in group-based exercise classes under the guidance of an instructor [7-9]. For instance, in the Netherlands, over 400,000 older adults participate in the weekly activities of “More Exercise for Seniors” (“Meer Bewegen voor Ouderen,” which is abbreviated as MBvO in Dutch). Despite the popularity of this program, its effects on physical health are limited. A previous study has shown that older adults who participate once a week in the exercise classes, do not achieve a higher health-related quality of life or an increased ability to perform daily tasks [10]. In order to capitalize on the health benefits of physical activity, the frequency, intensity, and duration of exercises have to be sufficient [9,11].

Older adults can increase the level of physical activity by doing exercises at home, either as an independent program or in conjunction with group-based classes [12-16]. The latter approach combines the motivational aspects of exercising along with peers with the flexibility of a home-based exercise program that is tailored to individual needs. However, in the absence of an instructor, older adults may have adherence and safety concerns about home-based exercises [17]. The use of mobile technology (mobile health [mHealth]) can help overcome these issues by providing detailed instructions, offering tailored programs, and tracking progress [18-23] for individuals, including older adults [24,25].

Development of a Blended Intervention

In order to enhance community-based exercise programs like MBvO, a blended intervention was developed as part of the MOTO-B (Motivating Technology for Older Adults’ Behavior) and VITAMIN (VITal AMsterdam older adults IN the city) research projects. The aim of the intervention was to support older adults in performing home-based exercises. In line with the self-determination theory [26,27], the intervention was conceived to increase competence and stimulate the autonomy of older adults, but at the same time, to maintain relatedness with peers [17]. The intervention consisted of a home-based exercise program that was supported by a tablet and a personal coach, and could be followed alongside community-based exercise programs or other sport activities.

Objective

According to the UK Medical Research Council (MRC), complex interventions need to be evaluated systematically [28]. Three different types of evaluations can be distinguished as follows: (1) assessing the feasibility, (2) assessing the effectiveness, and (3) understanding the underlying change process.

First, prior to assessing effectiveness, feasibility should be investigated thoroughly. For the blended intervention described here, a previous usability study that was conducted in a laboratory showed that older adults (age ranging from 69 to 99 years) who used the app for the first time during a 45-minute session could operate it without any relevant problems [29], suggesting that the blended intervention is feasible. However, a more thorough evaluation is needed to account for the long-term use in a real-world setting. The usability of mHealth apps is often not tested sufficiently, thereby limiting their effectiveness [30,31].

Second, the effectiveness of a complex intervention can be assessed with randomized controlled trials (RCTs). To assess the effectiveness of the blended intervention in terms of health outcomes, a trial study is currently ongoing and will be reported in the future elsewhere [32].

Third, an explorative process evaluation can provide insights into the underlying change process. By exploring the mechanisms of action, a process evaluation is a valuable extension of effectiveness studies. The aim of this study was to conduct such an evaluation. The objectives were as follows: (1) to assess the long-term usability of the tablet in a real-world setting and (2) to explore how the tablet, in conjunction with a personal coach, supported older adults in performing home-based exercises.


Intervention

The intervention consisted of two components to support older adults in performing exercises at home. The first component was the tablet containing a custom-developed app that was designed to ensure behavior change by facilitating self-regulation. Self-regulation is the process of consciously guiding one’s own behavior in order to achieve goals. In particular, behavior change techniques that support goal setting, action planning, behavior execution, self-monitoring, and evaluation appear to be important for the self-regulation of behavior [33-35]. Figure 1 presents a schematic representation. The app supported self-regulation by allowing older adults to set goals, tailor a weekly schedule to their individual needs, and watch video instructions. It also tracked their progress and facilitated remote guidance by a personal coach. An elaborate description of the app and its theoretical underpinning have been presented previously [36].

The second component of the intervention was counselling. Each participant was appointed a personal coach. The coach paid house visits, helped the participants to get acquainted with the tablet, and counselled, either remotely or face-to-face, the participants in setting up and following the tailored exercise schedule. The coaches were third- and fourth-year physical therapy bachelor students. Prior to taking on their responsibilities, the coaches received a 2-week training on functional exercises, good clinical practice, and e-coaching by faculty staff members. Furthermore, during their 6-month internship, they received weekly supervision from faculty staff members. When the responsibilities of a coach ended at the end of a teaching semester, ongoing cases were transferred to a new coach. As a result, participants received in sequence counselling by two personal coaches during a 6-month period. The complete details of the intervention have been reported previously [32].

Figure 1. Behavior change through self-regulation.
View this figure

Study Design and Participants

An RCT was conducted to assess the effectiveness of the blended intervention in terms of health outcomes. Older adults were recruited from the surroundings of Amsterdam, the Netherlands, through postal mailing and local community-based centers offering weekly exercise programs. Applicants were included in the trial if they met the following criteria: (1) age 55 years or older, (2) ability to understand the Dutch language, and (3) absence of specific cognitive or physical impairments. The protocol that describes the RCT has been published, including detailed methods, inclusion criteria, measurement procedures, and interventions [32].

To increase the fidelity of the trial, an additional nested mixed-methods study was set up (described in this paper) by administering questionnaires to the participants who received a tablet and coaching, as well as conducting follow-up interviews among a random selection of those participants [37].

Measurements

Before commencing the intervention, at baseline, the trial participants filled out a three-item questionnaire about their general experience with information and communication technology (ICT) devices, such as computers, smartphones, and tablets. To assess the long-term usability of a tablet (objective 1), after 6 months, participants who received a tablet were asked to fill out a usability questionnaire that was based on the Usefulness, Satisfaction, and Ease of use (USE) questionnaire [38]. The first part of the questionnaire consists of 23 items (Likert) that measure the following three components of usability: usefulness, satisfaction, and ease of use. Each item consists of a statement with the following five response options: strongly disagree, disagree, neither agree or disagree, agree, and strongly agree. The second part of the questionnaire contains three general questions about tablet use in the past 6 months, whether participants would recommend the tablet to friends, and an item participants could use for general remarks. All questionnaires were administered by paper and pencil in the Dutch language.

Furthermore, to explore how the tablet, in conjunction with the coach, supported the self-regulation of exercise behavior (objective 2), 18 participants were randomly selected for an in-depth interview. The interview questions were previously piloted among two participants. The interviews were conducted in a home setting, were held in Dutch, and lasted for about 45 minutes. All interviews were recorded.

Analysis

The questionnaires were processed with double-entry verification. For usefulness, satisfaction, and ease of use, separate mean scores were calculated. The mean scores could range from 1 (very low) to 5 (very high). The interviews were transcribed verbatim and subsequently double coded by two researchers. The directed content analysis method was used to explore how the participant’s experience related to the five key constructs of self-regulation that the intervention was based upon (goal setting, action planning, behavior execution, self-monitoring, and evaluation). Directed content analysis was deemed more appropriate than conventional content analysis, because of the focus on existing theoretical constructs [39-41]. To minimize differences in interpretation, first calibration sessions were held. Subsequently, both researchers coded all the transcripts independently with the key constructs of self-regulation and then compared the results. Differences were resolved via discussion. In the rare case no interrater consensus was reached, the first author settled the dispute.


Questionnaire About ICT Experience and Skills

In total, 224 older adults with a mean age of 72 years (SD 7 years; 71% female) participated in the RCT at baseline. The questionnaire about the prior use of ICT devices and self-reported skill level was filled out by 29% (65/224) of the participants, of which 72% (47/65) were female. Their mean age was 71 years (SD 5.8 years). The tablet was one of the most popular devices among the participants. A large majority of the participants used this device several times a week. See Table 1 for the results.

Most participants rated themselves as somewhat skilled with ICT devices. Specifically, 6% (4/65) of the participants rated themselves as very unskilled, 2% (1/65) as unskilled, 38% (25/65) as somewhat skilled, 40% (26/65) as skilled, and 6% (4/65) as very skilled.

Table 1. Prior use of information and communication technology devices (N=65).
DeviceaUse, n (%)

NeverRarelybSometimescRegularlydOftene
Personal computer17 (26%)1 (2%)3 (5%)8 (12%)24 (37%)
Laptop17 (26%)3 (5%)3 (5%)7 (11%)25 (39%)
Tablet16 (25%)2 (3%)3 (5%)3 (5%)35 (59%)
Smartphone13 (20%)0 (0%)2 (3%)3 (5%)41 (63%)
Mobile phonef25 (39%)1 (2%)2 (3%)5 (8%)14 (22%)

aThe values of individual items are less as some items were skipped by the participants.

bOnce a year or less.

cFew times a year.

dFew times a month.

eFew times a week.

fDevice without touchscreen.

Usability Questionnaire

The usability questionnaire was filled out by 36% (37/103) of the participants who had used the tablet for 6 months, of which 60% (22/37) were female. The mean age was 71 years (SD 5.1 years). The questionnaire had excellent internal consistency with Cronbach α of .89. The internal consistencies for the subscales were as follows: usefulness, .82; ease of use, .89; and satisfaction, .71.

Participants indicated that they found the tablet very useful (item 1) and it helped them to perform their exercises better (item 3) and safely (item 4). They were, however, neutral about how this affected their daily lives (item 6 and item 7). Overall, they were satisfied with the tablet and found it easy to use. Table 2 presents the results of the USE items. Finally, 68% (25/37) of the participants indicated that they would recommend the tablet to friends. Participants who indicated that they would not recommend the tablet provided varying reasons like “it didn’t work properly,” “I don’t need it to be active,” or “it’s too noncommittal.”

Table 2. Scores of usefulness, ease of use, and satisfaction items (5-point Likert scale) (N=37).
Questionnaire itemaScoreb, mean (SD)
Usefulness3.8 (0.6)

1. The tablet is useful.4.5 (0.6)

2. With the tablet, I can follow an individual exercise program that suits me.4.0 (0.7)

3. The tablet helps me to perform my exercises better.4.2 (0.7)

4. With the tablet, I can perform exercises safely.3.9 (0.9)

5. The tablet helps me to perform exercises more often.3.8 (1.1)

6. Since using the tablet, I have a more active life.2.9 (1.0)

7. The tablet supports my daily activities.3.0 (1.1)

8. The tablet has everything I need to be physically active.3.6 (1.1)

9. The information about the exercises is understandable.4.4 (0.6)
Ease of use4.2 (0.6)

10. I learned to use the tablet quickly.3.9 (1.1)

11. I easily remember how to use the tablet.4.3 (0.9)

12. I am capable of using the tablet.4.2 (0.8)

13. I can use the tablet without any help.4.3 (0.7)

14. I understand how the tablet operates.4.3 (0.7)

15. I can easily find what I am looking for on the tablet.4.2 (0.9)

16. The tablet is easy to use.4.4 (0.7)

17. Using the tablet is effortless.4.4 (0.5)
Satisfaction4.1 (0.6)

18. I am satisfied with the tablet.4.2 (0.7)

19. The tablet is pleasant to use.4.1 (0.8)

20. The tablet is fun to use.4.0 (0.7)

21. I am going to keep on using the tablet.4.0 (1.1)
Miscellaneous

22. Family and friends believe I should use the tablet.1.9 (0.9)

23. The trainer/coach believes that I should use the tablet.3.3 (1.3)

aTranslated from Dutch.

bThe minimum score is 1, and the maximum score is 5.

Interviews

In total, 17% (18/103) of the participants who used the tablet for 6 months were approached for a follow-up interview. One participant declined without giving a specific reason. The interviews were conducted with the remaining 17 participants, of which 53% (9/17) were female. Their mean age was 73 years (SD 7.0 years). The results of the interviews are described below according to the following five phases of self-regulation: goal setting, action planning, behavior execution, self-monitoring, and evaluation.

Goal Setting

Goal setting involves the process of determining the objective a person aspires. Setting goals was the departure point of the blended intervention. The tablet was designed to support the participants by letting them rank a set of daily activities and subsequently formulating their goals. It was also the main topic of the first two meetings with the coach.

The participants’ goals varied greatly (ie, from decreasing backache to improving balance). For some participants, the goal was not to improve physical health but to maintain it. Occasionally, participants formulated the goals with only the tablet, but most participants first consulted with the coach to explore related issues and translate top-level goals to specific and challenging, but realistic and measurable, goals. The attention the coach paid to the individual situation of the participant was appreciated. For instance, participants commented as follows:

…then we looked what is useful for me, what will help me to improve?... well, this was decided in consultation.
[Participant #14]
I believe it is important that the coach kept in mind: what does this person want to achieve?
[Participant #6]
well… they asked me about everything… which problems do I face?
[Participant #1]

In summary, the tablet, in conjunction with the coach, supported the participants in setting goals. The sensitivity of the coach for the personal circumstances was valued by the participants.

Action Planning

Action planning involves the process of making a plan regarding how the goals will be achieved. After determining the goals, participants could draw up a personal exercise schedule on the tablet. They could select functional exercises that would increase balance, strength, flexibility, and endurance. Each exercise was available in three variations that differed in difficulty.

The choice of different exercises was valued. For instance, participants commented as follows:

... then you always can choose your own exercises. I think it is great you have a lot of choice.
[Participant #4]
That’s good. Then I can adjust it entirely to my own needs.
[Participant #6]

Some participants commented that customizing the exercise schedule was not easy to do, either because of technical limitations of the tablet or because of limited knowledge about the benefits of each exercise. In those cases, the coach was available to help. For instance, participants commented as follows:

…well, which exercise should you choose? … that I could do this together with my coach was very effective.
[Participant #4]
with his help I had in no time an entire exercise program.
[Participant #3]

The weekly overview of planned exercises helped the participants to be physically active. The majority of participants exercised daily. They commented that this was due to the intervention as follows:

I am chaotic and have no discipline, this helped me a lot!
[Participant #17]
I do the exercises every day at home. I did not do that before.
[Participant #13]
now I am consistently doing exercises, every day. Actually, because of this [tablet].
[Participant #10]

When asked about the underlying reason for this, they mentioned different aspects. Several participants indicated that the tablet provided them structure to build a routine. For many, this was doing the exercises at a fixed time of day, generally in the morning. Participants commented as follows:

before taking a shower and getting dressed, first those exercises. A fixed structure, that helped.
[Participant #2]
…well, that rhythm is a good feeling.
[Participant #15]

Others commented that the exercises were more integrated in their daily activities as follows:

…sometimes I also do the exercises as I go; then I walk step by step back into the living room after a visit to the bathroom.
[Participant #11]
…I do the exercises in between times. I stand on one leg when I am brushing my teeth for instance. Well, I kind of integrate it.
[Participant #14]

Besides providing structure, some participants mentioned that the tablet also acted as a cue to action as follows:

...when I sit down and see it [tablet] I think ‘ah, a reminder!
[Participant #16]

In summary, participants felt that the blended intervention supported them in action planning. It provided them with structure to develop a routine. Several participants indicated that it helped them to do exercises daily, a frequency they previously did not achieve. They valued the possibility to personalize the exercise schedule to their own needs. The help of the coach was essential for some participants.

Behavior Execution

Behavior execution involves performing the actual behavior that should lead to achieving the goals. The tablet was designed to support this by various features like giving an overview of today’s exercises, providing background information about each exercise along with video demonstrations, and providing a countdown timer or the ability to modify each exercise with three parameters (duration, number of repetitions, and intensity level).

Participants found the daily overview of exercises to be useful. It provided them in a brief glance which exercise had to be performed today and with what duration, repetition, and intensity level. The countdown timer was used especially in the beginning when participants had to familiarize themselves with the exercise routine. The same applied for the video demonstrations. It helped them to see how the exercises could be performed correctly. For instance, participants remarked as follows:

…but I did need it [video demonstration] to do it [the exercise] in the correct manner.
[Participant #6]
…that was nice, I could perform the exercises better this way.
[Participant #7]

Additionally, attention to safety was valued, with the following statements:

the exercises are safe. Well, at least a lot safer than riding a bike. Biking is dangerous.
[Participant #12]
…yes, attention was paid to this [safety]. That you had to hold on to something, when you stand on one leg, for instance.
[Participant #6]

One of the participants stressed the benefit of using a tablet for the instructions as follows:

I can write it down, but it’s nice to have visual image of what is meant…. instructions written down are always subject to different interpretations. I think, as it has been done now, is very instructive.
[Participant #4]

Nevertheless, numerous participants mentioned that the additional instructions of the coach were also valuable as follows:

I also asked the coach, “am I doing it right?” He said “yes, that’s right” or “you have to do it like this and that”.
[Participant #11]
…that was nice. Sometimes he would demonstrate the exercise, or I would demonstrate it and ask him if I was doing it correct.
[Participant #6]

The coach also helped participants modify exercises if they were struggling with limitations or wanted more of a challenge. The latter was often needed. Many participants stressed that the exercises were too easy, despite the possibility to increase the difficulty level with the tablet. Apparently, this was not sufficient for numerous participants. An illustrative remark was as follows:

…yes, I can say that I wished they were a bit more challenging.
[Participant #10]

Some felt very strongly about this. For instance, a participant remarked as follows:

Look, I believe these exercises are meant for people who are in a retirement home and, more or less, don’t do anything the entire day.
[Participant #15]

Two participants indicated that they stopped doing the exercises because of this reason. Others found creative ways, together with their coach, to increase the intensity level, for instance, by increasing the repetitions, skipping breaks, or adding weight. For instance, a participant commented as follows:

…such as the exercise with shopping bags… I added dumb-bells to it, now it’s really challenging.
[Participant #10]

Finally, as participants developed a routine, they relied less on the tablet and on the coach for performing the exercises. Some participants kept on having the tablet in sight during the performance of the exercises, while others merely glanced at which exercises had to performed today and then executed them without the tablet. Watching the video demonstrations or using the countdown timer was not needed anymore. In some cases, participants even did all the exercises by heart, and one participant mentioned the following:

... I can do the exercises when I am at work, in between times. I just count the exercises myself.
[Participant #8]

When asked about the necessity of a coach, most of the participants felt that after 2 or 3 months, the coach’s help was not needed anymore.

In summary, the video demonstrations and countdown timer helped the participants to perform the exercises safely and correctly, especially during the early stages of the intervention. The coach played an important role in adapting the exercises to meet the capacity of the participants, as many of them sought a bigger challenge. In time, the participants developed a routine and performed the exercises more autonomously.

Self-Monitoring

Self-monitoring involves the process of keeping track of one’s progress. The tablet was designed to support this by letting users tick off exercises that had been completed. In a weekly overview, users could see which exercises had been done and which had not been done. Additionally, a progress bar indicated how many exercises still had to be done today and for the current week. Furthermore, the coach could remotely monitor the progress of the participants.

The moment at which participants ticked off exercises varied. Some did this directly after completing the exercises, whereas others did it at the end of the day. The majority of participants felt that keeping track in this manner gave them insights into their own behavior and was motivating. For instance, one participant made the following statement:

…for me it’s very easy…it gives insight and lets me follow what I have done.
[Participant #9]

Remarkably, various participants expressed that the mere action of ticking off exercises was not only easy but also rewarding. It left them with a feeling of accomplishment. For instance, one participant made the following statement:

…look, in the end you want to finish off your list.
[Participant #8]

However, the progress bar, which indicated how many exercises were completed, was hardly used. Many participants did not seem to have noticed this feature, indicating a usability issue. A couple of participants also expressed the desire for more advance features to investigate their progress, like graphs and tables.

Several participants mentioned that remote monitoring by the coach was an important factor for them to keep doing the exercises. For instance, some participants remarked as follows:

…the tablet motivates me, but…I must say. I think this is also because…that it is being monitored.
[Participant #7]
…I think it helps… there is someone keeping an eye on you.
[Participant #14]
you are participating in study, you want to show that you are cooperating.
[Participant #10]

On the other hand, other participants indicated that this was not the case for them. They would keep doing the exercises if there was no coach involved.

In summary, keeping track of progress with the tablet was easy and motivating. Ticking off completed exercises was experienced as rewarding and gave participants insights into their progress. For some participants, the fact that they were remotely being monitored was motivating, while for others, the social presence of a coach was not important.

Evaluation

Evaluation involves the process of reflecting on the effort and the progress that has been made in relation to the goals that were set out to be achieved. First, the tablet was designed to support the evaluation process by letting participants rate each exercise on three aspects (effort, complexity, and enjoyment). Second, either via video calls on the tablet or with face-to-face meetings, the participants had the opportunity to reflect on the progress together with their personal coach.

The ability to rate exercises with the tablet was superfluous according to several participants. The need to evaluate each exercise after completion seemed tedious. One participant made the following statement:

Well, look. This bothers me. I think ‘come on guys. Everything is so easy and simple. For me there is no difference in it [the effort, complexity or enjoyment of the various exercises].
[Participant #2]

Some participants suggested that it would have been better if they could rate exercises on a weekly basis instead of on a daily basis or only when they felt the need to do so. In contrast, the participants were more positive about the evaluation with the coach. They felt that it helped them to identify issues. Several participants mentioned, however, that toward the end of the 6-month intervention, the coaching was not needed anymore.

Finally, some participants reported that they experienced an improvement in vitality. They found themselves to be in a better shape than before and attributed this to the blended intervention. One participant made the following comment:

…yes, I now really get up without any backache, although this was previously the case. The pain returns in the evening when I am tired, but in the morning it’s different. That is a huge benefit.
[Participant #5]

Others did not notice an improvement, despite performing exercises, but also expressed more modest expectations. Maintaining their health status was more important than achieving progress for them, as indicated by the following remarks:

Do I notice an improvement in the gym? No. But if I don’t do my exercises for a week or two…then I can notice the difference.
[Participant #6]
I notice, I am 85, that I am declining… my goal is to stay steady.
[Participant #4]

Another participant mentioned the following:

…when you are 18 you can expect to keep on getting better, but for me, after one year I am even more old again… Can I perform some exercises that I couldn’t do before? Sure. In that sense there is progress. But it isn’t so that I am going to keep on improving.
[Participant #16]

When asked if they would like to keep the tablet for exercising, the vast majority of participants expressed the wish to do so, regardless of whether they notice an improvement.

In summary, the blended intervention supported participants in evaluating their progress. Specifically, the conversations with the coach were responsible for this. Overall, the participants evaluated the blended intervention to be useful. Some felt that their health improved, but others did not have this feeling. Nevertheless, almost all participants indicated that they wanted to continue their exercise routine with support of the tablet.


The Value of the Blended Approach

The objectives of this study were to assess the usability of the tablet and how it supported older adults in performing home-based exercises, in conjunction with a personal coach. A previous usability study showed that first-time users (age ranging from 69 to 99 years) could successfully complete various predefined tasks on the tablet during a 45-minute session in a laboratory [29]. This study extends those findings by showing that the tablet can be not only successfully operated in a standardized setting for a short period of time, but also useful, satisfying, and easy to use within the context of exercising at home during daily life for an extensive period of time. The participants indicated that the tablet allowed them to follow a tailored exercise program that suited them. It also helped them to perform the exercises more often, better, and safely. From the perspective of older adults, it can be concluded that the use of the tablet successfully supported them in their exercise behavior.

The interviews revealed a more detailed view on the underlying processes. The tablet was useful in developing an exercise routine. The tablet supported the participants in action planning and behavior execution by providing them with a tailored schedule that gave structure and video instructions demonstrating the appropriate behavior. Furthermore, ticking off exercises as a simple form of self-monitoring appeared to be motivating. On the other hand, the interviews revealed that the personal coach played an essential role. The interactive and social nature of coaching was especially useful during the self-regulation phases of goal setting and evaluation. The ability to interact with users in this manner is yet to be achieved by a virtual coach or avatar [24,42,43]. In addition, although the tablet allowed users to tailor the exercise program to their own needs, the exercises in the app did not sufficiently match the needs of the participants. The expertise of the coach was crucial for adapting the exercises to accommodate preferences. Finally, the presence of the coach in the form of remote monitoring was motivating for some participants. These findings are in line with other research showing that physical activity interventions incorporating access to a remote expert for advice and social support tend to be effective [34,44,45]. This study indicates that the coach might, in particular, be beneficial during the initial period, when participants familiarize themselves with the intervention and develop a routine.

Improvements

Although the participants were overall positive about the blended intervention, the evaluation also revealed several possibilities to improve the intervention. First, fit older adults should be able to add more challenging exercises to their schedule. Taking into account the preferences of some older adults, adding support for outdoor activities to the tablet would be enriching. For instance, a map with walking trails in the vicinity could stimulate older adults in achieving daily physical activity. Second, the tablet should offer more detailed reports of user progress (eg, graphs that display long-term trends). Some participants requested such a feature. Third, the extent participants relied on a coach varied from person to person. Owing to the protocol of the RCT, coaches contacted the participants with a fixed frequency. When the intervention is implemented in practice, the intensity of counselling should be tuned to the preferences of individuals. Presumably, some older adults will extensively make use of counseling, while others will merely limit it to initial support.

Study Limitations

The aim of the blended intervention was to support older adults in performing home-based exercises. Questionnaires as well as interviews showed that older adults felt that the intervention accomplished this. However, an underlying assumption of the intervention was that regularly performing exercises would support older adults in their daily activities and lead to an active lifestyle and an increase in their vitality. The interviews showed mixed results on this topic, and no support was found for these assumptions from the questionnaires. More challenging exercises or a more comprehensive approach for the vitality of older adults might be needed for such secondary effects; however, the effectiveness of such strategies is also debatable [46-50].

The results of the questionnaires have to be interpreted with caution though. All older adults who participated in the clinical trial were given at the start of the trial a questionnaire about their prior experience with ICT devices. Only 65 of the 224 trial participants completed this baseline questionnaire. Furthermore, the 6-month trial had a 18% drop-out rate. Among the remaining 103 older adults who were part of the group that received a tablet, only 37 filled out the USE questionnaire about the usability of the tablet. The usability results may therefore be biased. Perhaps only participants who had a positive experience with the tablet filled out the usability questionnaire. We do not, however, think this is plausible. First, the baseline questionnaire had a high rate of nonresponses. This fact cannot be explained by a negative experience with tablet use in the blended intervention. The participants were yet to embark on the intervention when filling out the baseline questionnaire. The high nonresponse rate for both the questionnaires might have been caused by the numerous tests that were administered by the researchers as part of the larger clinical trial [32]. The testing procedure, including body measurements, took half a day. This might have led to fatigue, causing participants to skip questionnaires. Second, the positive evaluation based on the questionnaire is in line with the results from the interviews. Although the sample size of the interviews was small, it was not susceptible to selection bias. The interviews were based on random selection of participants. Only one participant declined to be interviewed. Therefore, the sample that was drawn for the interviews can be considered to be representative of the older adults participating in the intervention. The previous usability study among first-time users and the questionnaires and interviews of this study all point in the same general direction of a favorable evaluation.

The extent to which the findings can be generalized to older adults in general is a different issue. The baseline questionnaire showed that prior use of tablets was high among the participants. Studies have shown that among older adults, tablets are easier to operate than smartphones or personal computers owing to the large touchscreen [51-53]. This was one of the reasons to choose a tablet as the delivery device for the blended intervention [36]. The usability of tablets can also explain the increasing popularity of tablets among older adults. In the United States, tablet ownership among adults aged 65 years or older rose from 1% in 2010 to 32% in 2016 [54]. In the Netherlands, a similar trend has taken place, where tablet ownership among those aged 65 to 75 years grew from 28% in 2012 to 60% in 2016 [55]. In this light, the prior use of tablets among the participants of this study is representative of the larger population. Nevertheless, perhaps only older adults with a positive attitude about ICT in general or a tablet in particular signed up to participate in the blended intervention. More research is needed to assess how a wider range of older adults will experience a physical activity intervention that incorporates the use of tablets.

Conclusion

A mixed-methods process evaluation showed that older adults are positive about a blended intervention designed to support them in performing home-based exercises. Participants rated the adoption of a tablet as useful, satisfying, and easy. They indicated that it helped them to perform exercises better, more frequently, and safely. It supported them in various phases of self-regulation. The interactions with a personal coach strengthened this by offering deeper reflection and more fine-grained tailoring during the earlier stages of the intervention. A blended approach appears to be a promising strategy for delivering physical activity interventions in older adults.

Acknowledgments

The authors thank Samir van Rijn and Jordy Schouten for their valuable contributions to this study. This work is part of the research projects MOTO-B (Motivating Technology for Older Adults’ Behavior; funded by the Dutch Research Council, grant number 023.006.013) and VITAMIN (VITal AMsterdam older adults IN the city; funded by the Amsterdam University of Applied Sciences’ program Urban Vitality).

Conflicts of Interest

None declared.

  1. de Vries NM, van Ravensberg CD, Hobbelen JS, Olde Rikkert MG, Staal JB, Nijhuis-van der Sanden MW. Effects of physical exercise therapy on mobility, physical functioning, physical activity and quality of life in community-dwelling older adults with impaired mobility, physical disability and/or multi-morbidity: a meta-analysis. Ageing Res Rev 2012 Jan;11(1):136-149. [CrossRef] [Medline]
  2. Walston J, Hadley E, Ferrucci L, Guralnik J, Newman A, Studenski S, et al. Research agenda for frailty in older adults: toward a better understanding of physiology and etiology: summary from the American Geriatrics Society/National Institute on Aging Research Conference on Frailty in Older Adults. J Am Geriatr Soc 2006 Jun;54(6):991-1001. [CrossRef] [Medline]
  3. Fried LP, Tangen CM, Walston J, Newman AB, Hirsch C, Gottdiener J, Cardiovascular Health Study Collaborative Research Group. Frailty in older adults: evidence for a phenotype. J Gerontol A Biol Sci Med Sci 2001 Mar;56(3):M146-M156. [CrossRef] [Medline]
  4. Tak E, Kuiper R, Chorus A, Hopman-Rock M. Prevention of onset and progression of basic ADL disability by physical activity in community dwelling older adults: A meta-analysis. Ageing Research Reviews 2013 Jan;12(1):329-338. [CrossRef]
  5. Warburton DE, Nicol CW, Bredin SS. Health benefits of physical activity: the evidence. CMAJ 2006 Mar 14;174(6):801-809 [FREE Full text] [CrossRef] [Medline]
  6. Taylor AH, Cable N, Faulkner G, Hillsdon M, Narici M, Van Der Bij AK. Physical activity and older adults: a review of health benefits and the effectiveness of interventions. J Sports Sci 2004 Aug;22(8):703-725. [CrossRef] [Medline]
  7. King AC, Rejeski W, Buchner DM. Physical activity interventions targeting older adultsaaThis paper was a background paper for the Cooper Institute Conference Series Physical Activity Interventions, an ACSM Specialty Conference. American Journal of Preventive Medicine 1998 Nov;15(4):316-333. [CrossRef]
  8. King AC. Interventions to promote physical activity by older adults. J Gerontol A Biol Sci Med Sci 2001 Oct;56 Spec No 2:36-46. [CrossRef] [Medline]
  9. Nelson M, Rejeski W, Blair S, Duncan P, Judge J, King A, American College of Sports Medicine, American Heart Association. Physical activity and public health in older adults: recommendation from the American College of Sports Medicine and the American Heart Association. Circulation 2007 Aug 28;116(9):1094-1105. [CrossRef] [Medline]
  10. Stiggelbout M, Popkema DY, Hopman-Rock M, de Greef M, van Mechelen W. Once a week is not enough: effects of a widely implemented group based exercise programme for older adults; a randomised controlled trial. J Epidemiol Community Health 2004 Mar;58(2):83-88 [FREE Full text] [CrossRef] [Medline]
  11. Chodzko-Zajko WJ, Proctor DN, Fiatarone Singh MA, Minson CT, Nigg CR, Salem GJ, et al. Exercise and Physical Activity for Older Adults. Medicine & Science in Sports & Exercise 2009;41(7):1510-1530. [CrossRef]
  12. van der Bij AK, Laurant M, Wensing M. Effectiveness of physical activity interventions for older adults: a review. Am J Prev Med 2002 Mar;22(2):120-133. [CrossRef] [Medline]
  13. Lee J, Jung D, Byun J, Lee M. Effects of a Combined Exercise Program Using an iPad for Older Adults. Healthc Inform Res 2016 Apr;22(2):65-72 [FREE Full text] [CrossRef] [Medline]
  14. Gschwind Y, Kressig R, Lacroix A, Muehlbauer T, Pfenninger B, Granacher U. A best practice fall prevention exercise program to improve balance, strength / power, and psychosocial health in older adults: study protocol for a randomized controlled trial. BMC Geriatr 2013 Oct 09;13:105 [FREE Full text] [CrossRef] [Medline]
  15. King A, Haskell WL, Taylor CB, Kraemer HC, DeBusk RF. Group- vs home-based exercise training in healthy older men and women. A community-based clinical trial. JAMA 1991 Sep 18;266(11):1535-1542. [Medline]
  16. Gill TM, Baker DI, Gottschalk M, Peduzzi PN, Allore H, Byers A. A Program to Prevent Functional Decline in Physically Frail, Elderly Persons Who Live at Home. N Engl J Med 2002 Oct 03;347(14):1068-1074. [CrossRef]
  17. Mehra S, Dadema T, Kröse BJ, Visser B, Engelbert RH, Van Den Helder J, et al. Attitudes of Older Adults in a Group-Based Exercise Program Toward a Blended Intervention; A Focus-Group Study. Front Psychol 2016;7:1827 [FREE Full text] [CrossRef] [Medline]
  18. Vandelanotte C, Spathonis KM, Eakin EG, Owen N. Website-delivered physical activity interventions a review of the literature. Am J Prev Med 2007 Jul;33(1):54-64. [CrossRef] [Medline]
  19. Norman GJ, Zabinski MF, Adams MA, Rosenberg DE, Yaroch AL, Atienza AA. A review of eHealth interventions for physical activity and dietary behavior change. Am J Prev Med 2007 Oct;33(4):336-345 [FREE Full text] [CrossRef] [Medline]
  20. Krebs P, Prochaska JO, Rossi JS. A meta-analysis of computer-tailored interventions for health behavior change. Prev Med 2010;51(3-4):214-221 [FREE Full text] [CrossRef] [Medline]
  21. Davies CA, Spence JC, Vandelanotte C, Caperchione CM, Mummery WK. Meta-analysis of internet-delivered interventions to increase physical activity levels. Int J Behav Nutr Phys Act 2012 Apr 30;9:52 [FREE Full text] [CrossRef] [Medline]
  22. Schoeppe S, Alley S, Van Lippevelde W, Bray N, Williams S, Duncan M, et al. Efficacy of interventions that use apps to improve diet, physical activity and sedentary behaviour: a systematic review. Int J Behav Nutr Phys Act 2016 Dec 07;13(1):127 [FREE Full text] [CrossRef] [Medline]
  23. Vandelanotte C, Müller AM, Short CE, Hingle M, Nathan N, Williams SL, et al. Past, Present, and Future of eHealth and mHealth Research to Improve Physical Activity and Dietary Behaviors. J Nutr Educ Behav 2016 Mar;48(3):219-228.e1. [CrossRef] [Medline]
  24. Dasgupta D, Chaudhry B, Koh E, Chawla NV. A Survey of Tablet Applications for Promoting Successful Aging in Older Adults. IEEE Access 2016;4:9005-9017. [CrossRef]
  25. Muellmann S, Forberger S, Möllers T, Bröring E, Zeeb H, Pischke C. Effectiveness of eHealth interventions for the promotion of physical activity in older adults: A systematic review. Prev Med 2018 Mar;108:93-110. [CrossRef] [Medline]
  26. Ryan RM, Deci EL. Self-determination theory and the facilitation of intrinsic motivation, social development, and well-being. American Psychologist 2000;55(1):68-78. [CrossRef]
  27. Deci EL, Ryan RM. The "What" and "Why" of Goal Pursuits: Human Needs and the Self-Determination of Behavior. Psychological Inquiry 2000 Oct;11(4):227-268. [CrossRef]
  28. Craig P, Dieppe P, Macintyre S, Michie S, Nazareth I, Petticrew M, Medical Research Council Guidance. Developing and evaluating complex interventions: the new Medical Research Council guidance. BMJ 2008 Sep 29;337:a1655 [FREE Full text] [CrossRef] [Medline]
  29. Mehra S, Visser B, Cila N, van den Helder J, Engelbert RH, Weijs PJ, et al. Supporting Older Adults in Exercising With a Tablet: A Usability Study. JMIR Hum Factors 2019 Mar 01;6(1):e11598 [FREE Full text] [CrossRef] [Medline]
  30. McCurdie T, Taneva S, Casselman M, Yeung M, McDaniel C, Ho W, et al. mHealth consumer apps: the case for user-centered design. Biomed Instrum Technol 2012;Suppl:49-56. [CrossRef] [Medline]
  31. Zapata B, Fernández-Alemán JL, Idri A, Toval A. Empirical studies on usability of mHealth apps: a systematic literature review. J Med Syst 2015 Mar;39(2):1. [CrossRef] [Medline]
  32. van den Helder J, van Dronkelaar C, Tieland M, Mehra S, Dadema T, Visser B, et al. A digitally supported home-based exercise training program and dietary protein intervention for community dwelling older adults: protocol of the cluster randomised controlled VITAMIN trial. BMC Geriatr 2018 Aug 14;18(1):183 [FREE Full text] [CrossRef] [Medline]
  33. Michie S, Abraham C, Whittington C, McAteer J, Gupta S. Effective techniques in healthy eating and physical activity interventions: a meta-regression. Health Psychol 2009 Nov;28(6):690-701. [CrossRef] [Medline]
  34. Webb T, Joseph J, Yardley L, Michie S. Using the internet to promote health behavior change: a systematic review and meta-analysis of the impact of theoretical basis, use of behavior change techniques, and mode of delivery on efficacy. J Med Internet Res 2010 Mar 17;12(1):e4 [FREE Full text] [CrossRef] [Medline]
  35. Carver C, Scheier M. Control theory: A useful conceptual framework for personality–social, clinical, and health psychology. Psychological Bulletin 1982;92(1):111-135. [CrossRef]
  36. Mehra S, Visser B, Dadema T, van den Helder J, Engelbert RH, Weijs PJ, et al. Translating Behavior Change Principles Into a Blended Exercise Intervention for Older Adults: Design Study. JMIR Res Protoc 2018 May 02;7(5):e117 [FREE Full text] [CrossRef] [Medline]
  37. Shorten A, Smith J. Mixed methods research: expanding the evidence base. Evid Based Nurs 2017 Jul;20(3):74-75. [CrossRef] [Medline]
  38. Lund A. Measuring usability with the USE questionnaire. Usability Interface 2001;8(2):3-6.
  39. Hsieh H, Shannon SE. Three approaches to qualitative content analysis. Qual Health Res 2005 Nov;15(9):1277-1288. [CrossRef] [Medline]
  40. Assarroudi A, Heshmati Nabavi F, Armat MR, Ebadi A, Vaismoradi M. Directed qualitative content analysis: the description and elaboration of its underpinning methods and data analysis process. Journal of Research in Nursing 2018 Jan 10;23(1):42-55. [CrossRef]
  41. Kirkwood K. Review: Directed qualitative content analysis: the description and elaboration of its underpinning methods and data analysis process. Journal of Research in Nursing 2018 Jan 10;23(1):56-57. [CrossRef]
  42. Khaghani-Far I, Nikitina S, Baez M, Taran EA, Casati F. Fitness Applications for Home-Based Training. IEEE Pervasive Comput 2016 Oct;15(4):56-65. [CrossRef]
  43. Kwok Chi-Wai R, Hui Sai-Chuen S, Mak So-Ning T, Wu Ka-Shun P, Lee Wing-Kuen K, Wong Choi-Ki C. Can mobile virtual fitness apps replace human fitness trainer? 2011 Presented at: The 5th International Conference on New Trends in Information Science and Service Science; October 24-26, 2011; Macao, China   URL: https://ieeexplore.ieee.org/abstract/document/6093392/
  44. Greaves CJ, Sheppard KE, Abraham C, Hardeman W, Roden M, Evans PH, IMAGE Study Group. Systematic review of reviews of intervention components associated with increased effectiveness in dietary and physical activity interventions. BMC Public Health 2011 Mar 18;11:119 [FREE Full text] [CrossRef] [Medline]
  45. Geraedts H, Zijlstra A, Bulstra SK, Stevens M, Zijlstra W. Effects of remote feedback in home-based physical activity interventions for older adults: a systematic review. Patient Educ Couns 2013 Apr;91(1):14-24. [CrossRef] [Medline]
  46. Steib S, Schoene D, Pfeifer K. Dose-Response Relationship of Resistance Training in Older Adults. Medicine & Science in Sports & Exercise 2010;42(5):902-914 [FREE Full text] [CrossRef]
  47. Peterson M, Rhea M, Sen A, Gordon P. Resistance exercise for muscular strength in older adults: a meta-analysis. Ageing Res Rev 2010 Jul;9(3):226-237 [FREE Full text] [CrossRef] [Medline]
  48. Spirduso W, Cronin DL. Exercise dose-response effects on quality of life and independent living in older adults. Med Sci Sports Exerc 2001 Jun;33(6 Suppl):S598-608; discussion S609. [CrossRef] [Medline]
  49. Taaffe D, Duret C, Wheeler S, Marcus R. Once-weekly resistance exercise improves muscle strength and neuromuscular performance in older adults. J Am Geriatr Soc 1999 Oct;47(10):1208-1214. [CrossRef] [Medline]
  50. Denison HJ, Cooper C, Sayer AA, Robinson SM. Prevention and optimal management of sarcopenia: a review of combined exercise and nutrition interventions to improve muscle outcomes in older people. Clin Interv Aging 2015;10:859-869 [FREE Full text] [CrossRef] [Medline]
  51. Murata A, Iwase H. Usability of touch-panel interfaces for older adults. Hum Factors 2005;47(4):767-776. [CrossRef] [Medline]
  52. Findlater L, Froehlich J, Fattal K, Wobbrock J, Dastyar T. Age-related differences in performance with touchscreens compared to traditional mouse input. 2013 Presented at: CHI '13: CHI Conference on Human Factors in Computing Systems; April 2013; Paris, France   URL: https://dl.acm.org/doi/10.1145/2470654.2470703 [CrossRef]
  53. Kobayashi M, Hiyama A, Miura T, Asakawa C, Hirose M, Ifukube T. Elderly User Evaluation of Mobile Touchscreen Interactions. 2011 Presented at: 13th IFIP TC 13 International Conference on Human-Computer Interaction, INTERACT 2011; September 5-9, 2011; Lisbon, Portugal p. 83-99   URL: https://link.springer.com/chapter/10.1007%2F978-3-642-23774-4_9 [CrossRef]
  54. Anderson M, Perrin A. Tech Adoption Climbs Among Older Adults. Pew Research Center. 2017.   URL: https://www.pewinternet.org/2017/05/17/technology-use-among-seniors/ [accessed 2020-06-29]
  55. 75-plussers sterkst groeiende groep internetters. CBS. 2016.   URL: https://www.cbs.nl/nl-nl/nieuws/2016/52/75-plussers-sterkst-groeiende-groep-internetters [accessed 2020-06-29]


MBvO: Meer Bewegen voor Ouderen; More Exercise for Seniors, a Dutch community-based physical activity program for adults aged 55 and above
mHealth: mobile health
MOTO-B: Motivating Technology for Older Adults’ Behavior
MRC: Medical Research Council
RCT: randomized controlled trial
USE: Usefulness, Satisfaction, and Ease of use
VITAMIN: VITal AMsterdam older adults IN the city


Edited by G Eysenbach; submitted 24.09.19; peer-reviewed by K Ng, M Macaraig; comments to author 06.01.20; revised version received 11.02.20; accepted 14.05.20; published 23.07.20

Copyright

©Sumit Mehra, Jantine van den Helder, Bart Visser, Raoul H H Engelbert, Peter J M Weijs, Ben J A Kröse. Originally published in the Journal of Medical Internet Research (http://www.jmir.org), 23.07.2020.

This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on http://www.jmir.org/, as well as this copyright and license information must be included.