Comparison of Use and Appreciation of a Print-Delivered Versus CD-ROM-Delivered, Computer-Tailored Intervention Targeting Saturated Fat Intake: Randomized Controlled Trial

Introduction

Computer-Tailored Health Education

Computer-tailored health education delivers individualized information matched to an individual’s characteristics [1,2] and is a promising health education technique, particularly for (print-delivered) nutrition education [3]. The Internet is increasingly being used for the delivery of computer-tailored interventions. There are many features that make the Internet an attractive medium of delivery, such as the instant and continuous availability, the possibilities for interactivity, and the possibility to provide immediate feedback [4,5]. Another potential advantage is that larger numbers of people can be reached for lower cost, as compared with print-delivered interventions [4,6,7].

There also may be disadvantages of providing computer-tailored interventions over the Internet: it may be more difficult to read or process information from a computer screen [8,9], it may require more effort to receive the computer-tailored feedback (ie, starting the computer and the program), and people may be less likely to save and re-read interactive-delivered feedback [8]. Furthermore, it has been suggested that specific groups, such as people of lower socioeconomic status, women, and older people, will not be reached with interventions over the Internet because they may have more difficulty with and less interest in using interactive media [10-14].

On the other hand, some previous studies have shown that persons from lower socioeconomic groups have more interest in computer-tailored feedback compared to generic information [15-17]. In addition, the possibility of incorporating multiple mediums on the Internet to convey the information could reinforce comprehension for less-educated individuals [18]. Even though it has been suggested that there may be differences in use between print- and interactive-delivered computer-tailored interventions, the evidence to demonstrate this is still limited. The aim of the present study is to examine differences in use and appreciation of an identical-content, print-delivered versus interactive-delivered, computer-tailored intervention.

Knowledge about differences in use and appreciation could help in choosing the appropriate delivery mode for a particular target audience.

Information Processing and Delivery Mode

Use and appreciation of an intervention are important factors to study since they are prerequisites for active information processing [19,20]. Active information processing is necessary for finally achieving changes in determinants and behavior [20]. Information processing starts with attention to the message [19], which can be operationalized as reading the information. The channel through which the information is provided is one of the factors that may determine attention to the message [19]. Attention to the message may be more easily achieved when the information is provided in a readily readable format or when it is provided via a medium that the receiver likes or knows how to use [13,21].

Active information processing not only involves attention to the message, but also thoughtful consideration of the information content. Reading, saving, and discussing the information with others may be indicators of active information processing. Furthermore, information is more likely to be attended to and actively processed when it is perceived as interesting, personally relevant, and individualized [22-26]. In a study by Oenema and colleagues, perceived personal relevance and individualization were identified as mediators of the effect of a computer-tailored intervention [26].

Even though, based on theory, indicators of use and perception of personal relevance are important for achieving intervention effects, these factors may be different for print and interactive deliveries: the medium may determine attention and access to the message [19], as well as the ability and willingness to actively process the information [13,27].

Only two previous studies have compared use of print- and Internet-delivered interventions with identical content [28,29]. Both studies reported higher recall and use of the print materials compared to the materials delivered through the Internet. In the current study we will evaluate a broader set of indicators for use and appreciation and perceptions of personal relevance between a print-delivered and an interactive-delivered, computer-tailored, nutrition education intervention with identical content aimed at reducing saturated fat intake. These interventions were found to be equally effective in reducing saturated fat intake in the short term, but only the effects of the print-delivered tailored feedback were maintained in the longer term [30].

The current study specifically examines whether there are differences in use (information read, saved, discussed with others) and appreciation (perceived personal relevance, perceived individualization, trustworthiness, user-friendliness) between print computer-tailored advice and interactive computer-tailored advice. These differences were examined for a mixed population and for gender, age, and education subgroups. A CD-ROM was used to deliver the interactive, Web-based intervention, enabling people who did not have Internet access to use the program.

‎View this figure

Methods

Design and Recruitment

This study is part of a larger randomized controlled trial with five study arms. The current study uses data from two of the study arms for secondary data analysis: computer-tailored dietary saturated fat reduction feedback delivered on CD-ROM (n = 151) or delivered in print (n = 141). Approval for the research project was obtained from the Medical Ethics Committee of Erasmus University Medical Center, Rotterdam, The Netherlands. All participants gave written informed consent after receiving written information about the study. Volunteers for the larger intervention trial were recruited from among employees of nine large companies and inhabitants of two neighborhoods in the Rotterdam area (2003-2004). A total of 798 adults volunteered to participate, none of whom were on a prescribed diet or under treatment for hypercholesterolemia. Participants completed a baseline paper-and-pencil screening questionnaire and were subsequently randomized by computer to one of the two intervention conditions (Figure 1).

Computer-Tailored Interventions

The tailored feedback in the current study incorporated feedback on personal saturated fat intake, social-comparison information, motivational feedback, practical product feedback addressing the most important sources of fat in the person’s diet, information on low-fat alternatives, and self-efficacy-enhancing feedback for difficult situations as derived from an individual assessment. The content of the computer-tailored program (screening questionnaire and feedback) was identical for the two intervention conditions, only the delivery mode was different, as described below. Details of the computer-tailored feedback are described elsewhere [30].

CD-ROM Condition

In the CD-ROM condition, the computer-tailored feedback was programmed as a series of Web pages (questionnaire, feedback messages), then stored on a CD-ROM. The program started with a home page explaining the nature and goal of the program and how it should be used. Immediately after completion of the screening questionnaire, the individualized computer-tailored information appeared on screen (Figure 2). Low-fat recipes for appetizers, main courses, and desserts could be searched from a recipe page. It was possible to print and save the feedback, but the program did not automatically do this. Respondents were asked to use the program on a computer with Internet Explorer 5.0 or higher and to use it in the same week they received the CD-ROM.

‎View this figure

Print Condition

The tailored information in the print condition was generated from the results of a baseline paper-and-pencil questionnaire. The questionnaires were scanned and imported into a computer-tailoring program that generated individualized computer-tailored printed feedback letters of 1.5-4 pages (Figure 3). Depending on their preferences, respondents received recipe suggestions for low-fat appetizers, main courses, or desserts. The feedback letters were sent to the home address of the respondent within 2 weeks of the time the study team received the completed questionnaire.

‎View this figure

Measurements

Gender, age, and education level were assessed in the baseline questionnaire. A categorical variable was created from age (≤ 34 years, 35-49 years, 50-65 years) [13]. Highest level of completed formal education was measured using one question in which seven education categories were distinguished (from elementary school to university degree) [31]. The categories were then collapsed into a three-level education variable (lower = lower secondary education or less; medium = upper secondary or post-secondary non-tertiary education; higher = college or university training).

At 1 month post-intervention, the outcome measures (use and appreciation items) were assessed. The questions were introduced by explaining that nutrition advice referred to either the advice delivered by a printed letter or by CD-ROM. Use was assessed with the following yes/no items: “I have read the complete nutrition advice”; “I saved the nutrition advice”; and “I discussed the nutrition advice with others.” Appreciation was assessed using a 5-point scale (from −2 = strongly disagree to +2 = strongly agree): “I perceived the nutrition advice as trustworthy”; “The nutrition advice addressed my personal dietary habits”; “The nutrition advice was of personal relevance for me”; and “The nutrition advice was user-friendly.” Appreciation questions were adapted from the process questionnaire as proposed by Brug and colleagues [23] and have been successfully used in previous studies [25,26].

Statistical Analysis

Equality of the study groups at baseline was examined with chi-square tests (gender, education) and an independent-samples t test (age). Differences in use and appreciation outcomes between the intervention conditions were analyzed with chi-square tests (feedback read, saved, and discussed) and independent-samples t tests (trustworthy, perceived individualization, personal relevance, and user-friendliness). Respondents with missing values were excluded from the analyses. The “discussed” variable and the appreciation items were analyzed only for those respondents who confirmed they had read all the information. Finally, in order to compare the size of the difference in appreciation items between the print and the CD-ROM group, we calculated the effect sizes as the standardized differences in group means by dividing the difference between the conditions by the pooled standard deviation. Effect sizes were categorized as small (0-0.32), moderate (0.33-0.55), or large (> 0.55) as defined by Lipsey [32]. The analyses were performed for the total group, and, based on the literature [13], we decided a priori to conduct stratified analyses in specific subgroups based on gender, age, and education category. All analyses were conducted in SPSS version 11 (SPSS Inc, Chicago, IL, USA).

Results

Population Characteristics

Among the respondents (n = 292), 46% were male, the mean age was 43.9 years (SD 10.3), 22% fell in the lower education level, 34.4% in the medium education level, and 43.6% in the higher education level. There were no significant differences in gender, age, or education level between the two conditions.

Use of the Computer-Tailored Information

As shown in Table 1, the print-delivered feedback was read more often than the CD-ROM-delivered feedback according to self-reports among the total population (P = .001) and among women (P = .003). This was also the case for participants in the 50-65 year age group (P = .01; Table 2) and for participants in lower and higher education levels (P = .04 for both groups; Table 3).

The print-delivered feedback was reported to be saved more often than the CD-ROM-delivered feedback among the total population (P < .001), men (P = .02), women (P < .001), the ≤ 34 year and 35-49 year age groups (P = .001 for both groups), and medium- and higher-educated respondents (P = .001 for both groups).

Less than 50% of those who reported to have read the tailored information discussed it with others.

Appreciation of the Computer-Tailored Information

Trustworthiness, perceived individualization, and user-friendliness were not significantly different between the print condition and the CD-ROM condition. However, the CD-ROM condition was rated as more user-friendly by men (P = .10) and respondents ≤ 34 years (P = .10), with a moderate, though not statistically significant, effect size.

Results showed a statistically significant higher perceived personal relevance for the print condition compared to the CD-ROM condition among the total population (P = .04), women (P = .04), and the 35-49 year age group (P = .03), with effect sizes that can be categorized as small (among total population) to moderate (among women and 35-49 year age group). In addition, the print condition was rated as more personally relevant by the ≤ 34 year age group (P = .18) and the less educated respondents (P = .19), with moderate, though not statistically significant, effect sizes.

Discussion

Principal Results

The results of this study indicate that there are differences in the use and appreciation of a print-delivered versus CD-ROM-delivered, computer-tailored intervention. The differences were mainly in favor of the print-delivered intervention. The print feedback was read and saved more often than the CD-ROM feedback (some specific subgroups excepted), and the print feedback was perceived as more personally relevant in the total study group and in some of the subgroups, with small to moderate effect sizes.

Surprisingly, the print-delivered feedback was rated as more personally relevant. Personal relevance is considered to be a core characteristic and a potential working mechanism of computer-tailored interventions [16,17], and, in the present study, both interventions had the same level of personalization and individualization. Apparently, it is not only the feedback itself that is related to the perception of personal relevance, but also the delivery mode through which the information is distributed. Perhaps the immediate feedback on screen after completion of the questionnaire (in the CD-ROM condition) versus the time lag between returning the questionnaire to the researchers and receiving feedback (in the print condition) influences this perception. The receipt of a personalized mailed letter might also enhance relevance. Another explanation may be that participants had expected more personal relevance from a computer program in which they had to complete questions first.

Comparison With Prior Work

Our study is unique in evaluating a broader set of indicators for use, appreciation, and perception of personal relevance between a print-delivered and an interactive-delivered, computer-tailored intervention with identical content.

The finding that the print-delivered feedback is read and saved more often than the CD-ROM-delivered feedback is in line with expectations and findings from previous studies [8,9,28,29].

Information sent through print media may be more easily available and accessible and easier to read and save [8,9]. Our results not only indicate that the subgroups suggested in the literature (women, less educated respondents, and older respondents) use the CD-ROM less than print, but also that this is the case for men and higher-educated and younger respondents. However, we do not know why participants in the CD-ROM group did not read the information. Having to use a computer and start a program may have been a barrier in terms of the time, effort, or planning that would be needed to use the program and generate the feedback. For another segment of the participants, lack of motivation or skills to use interactive media may have been a reason [13,21]. This could have been the case for women, older persons, and less-educated persons.

Vandelanotte et al found that people over 40 years compared to those younger than 40 years preferred an intervention delivered in print over an interactively delivered intervention [25]. However, it has also been found that even though people had indicated they preferred to receive an intervention over the Internet, they nevertheless did not access this intervention [29].

The findings of this study add to the evidence regarding differences in use of interactive and print-delivered interventions with identical content [28,29] and provide important new insights in appreciation and perceived relevance of the information. Findings from this and previous studies suggest that interactively delivered interventions as used to date may be less successful in attracting attention and may be less suited to facilitate active information processing compared to print-delivered computer-tailored information. Efforts are needed to increase use, appreciation, and active information processing.

Limitations

The present study provides descriptive data. Further studies should explore if personal relevance and reading level mediate differential effects between print-delivered and interactive-delivered tailored feedback. Additionally, less-educated people and those older than 65 years were underrepresented or not included in this study. Although the intervention could be provided over the Internet, in this study it was delivered on a CD-ROM.

In this study we conducted a lot of tests without correction for multiple testing, which may increase the risk of false positives in the outcomes of the analyses. However, due to subgroup analyses, the number of participants was rather small in some analyses, which may have caused lack of power to detect significant differences, even when there was a moderate effect size. Reducing the P value to correct for multiple testing would increase the risk of false negatives. Therefore, we reported the uncorrected P values and the effect sizes of our different outcome measures. We evaluated the significance of differences using a significance level of P < .05. Effects can also be evaluated using a more conservative significance level of P < .01 to approach correction for multiple testing. In addition, the moderate effect sizes may provide an indication of differences that might become statistically significant when analyzed in larger groups.

Further, this study compared two delivery modes on aspects of use and appreciation that are relevant for both modes (ie, in both cases, for information processing, the information should be read, saved, and perceived as personally relevant). However, using this approach, we may have missed important aspects for use and probably appreciation of the information or the program that are more sensitive to specific characteristics of interactive media. Future process evaluation studies could use more extensive and specific instruments.

Conclusions

Interactive computer-tailored feedback appears to be read and saved less than print-delivered feedback and perceived as less personally relevant, especially among certain subgroups. These differences in use and appreciation of the computer-tailored intervention delivered through print or interactive delivery modes can be taken into account when selecting a delivery mode for a specific subgroup in order to optimize exposure. Future studies should explore methods to improve exposure to and use of interactively delivered computer-tailored information.