This paper is in the following e-collection/theme issue:

E-Health / Health Services Research and New Models of Care (450) Consumer & Patient Education and Shared-Decision Making (636) Email Communication, Web-Based Communication, Secure Messaging (147)

Published on in Vol 11, No 3 (2009): Jul-Sep

Nationwide Implementation of Hello World: A Dutch Email-Based Health Promotion Program for Pregnant Women

Nationwide Implementation of Hello World: A Dutch Email-Based Health Promotion Program for Pregnant Women

Nationwide Implementation of Hello World: A Dutch Email-Based Health Promotion Program for Pregnant Women

Authors of this article:

Mariska Bot ;   Ivon EJ Milder ;   Wanda JE Bemelmans
Article Authors Cited by (13) Tweetations Metrics

    Original Paper

    National Institute for Public Health and the Environment, Bilthoven, the Netherlands

    Corresponding Author:

    Ivon EJ Milder, PhD

    Centre for Prevention andHealth Services Research (PZO)

    National Institute for Public Health and the Environment

    PO Box 1, 3720 BA Bilthoven

    The Netherlands

    Phone: +31 30 2742871

    Fax:+31 30 2744407

    Email: ivon.milder@rivm.nl


    Background: In November 2006, an email-based health promotion program for pregnant women was implemented nationally in the Netherlands. The program consisted of emails containing quizzes with pregnancy-related questions tailored to the number of weeks of pregnancy. Emails were sent out once every 4 weeks, up to a maximum of nine emails.

    Objectives: The aims of the study were (1) to assess the recruitment of participants and their representativeness of the Dutch population and (2) to study differences in recruitment, program use, and program appreciation among women with different levels of education.

    Methods: Data from 13,946 pregnant women who enrolled during the first year of the program were included. Upon registration, participants were asked how they found out about the program and subsequently received an email questionnaire to assess demographic, lifestyle, and Internet characteristics. Program use was tracked, and participants were classified into five user groups (inactive to very active). Program appreciation (low, intermediate, and high) was assessed twice with an email questionnaire that was sent after the woman had received her third and sixth quiz email. Information about pregnant women and their characteristics was obtained from Dutch registries to assess representativeness of the study population.

    Results: About 8% of the pregnant women in the Netherlands enrolled in the program. Immigrants were underrepresented, and women with a low level of education seemed to be slightly underrepresented. Most women knew about the program from a promotional email sent by the organization (32%), followed by the Internet (22%) and midwives (16%). Women with little education were more often inactive users of the program than were highly educated women (15% vs 11%, P < .001), whereas highly educated women were more often very active users compared with women with little education (25% vs 20%, P< .001). However, women with less education were more likely than women with more education to have a high appreciation of the program after receiving three quiz emails (52% vs 44%, P = .001).

    Conclusions: In this real-life setting, pregnant women can be reached through an email-based health promotion program. Selective engagement by education level remains a challenge.

    J Med Internet Res 2009;11(3):e24

    doi:10.2196/jmir.1183

    Keywords

    Health promotion; Internet; pregnancy; email 


    Pregnancy is a time when women are more conscious of health issues than during any other period in their life [1]. This may be a time when behavior can be positively changed, to have a long-term effect on the health of the mother, child, and family [2]. Nowadays, most women seek information about their pregnancy on the Internet [3-6], particularly for first-time pregnancies [4]. However, online medical information varies in quality and is often incomplete [7].

    In 2006, the Dutch Ministry of Health initiated Hello World, an innovative email-based program for pregnant women in which reliable information about a healthy pregnancy is brought together into one health promotion program. The program was tested in a pilot study in Amsterdam [8,9] and was then improved and implemented nationwide in the Netherlands. The aim of the program was to provide comprehensive health information for pregnant women. Although knowledge on its own is criticized as being insufficient for behavior change, knowledge is a prerequisite for behavior change [10].

    To the best of our knowledge, Hello World is the first eHealth program aimed at pregnant women that was implemented nationally. We are aware of only one previous study of an eHealth program for pregnant women conducted locally in Taiwan [11], which was aimed at promoting breastfeeding.

    To be effective as a health promotion program, it is essential to reach the target group. Thus, efficacious recruitment strategies are needed. Several studies have investigated which recruitment strategies for Internet-based eHealth promotion programs result in high participation, but results were mixed [12-18]. In addition to enrollment, engagement is an important condition for efficacy since exposure to the health information is necessary. Unfortunately, the high attrition rate of Internet-based health promotion interventions is still an issue [19,20]. Both enrollment and engagement in health communication programs are often selective, favoring participation of relatively highly educated persons with a healthy lifestyle [19-21]. Indeed, the pilot study of Hello World showed that highly educated women not only enrolled in the program more often, but also used the program more intensively and longer than less-educated women [8].

    The present study analyzes data of participants who enrolled during the first year of the nationwide-implemented program. The main purpose of the study was to describe the participants, their representativeness of all pregnant women in the Netherlands, and how they were recruited in a real-life setting. Our second aim was to compare differences in recruitment channels, program use, and program appreciation among women with varying levels of education.


    Intervention

    The program started on November 13, 2006, and is still available online. The present study analyzes data of pregnant women who enrolled in the first year. The program consisted of emails containing quizzes with pregnancy-related questions that were tailored to the number of weeks of pregnancy. Emails were sent once every 4 weeks. The first quiz email was sent at 8 weeks of pregnancy and the last one at 40 weeks. Women could enroll in the program at no cost anytime during their pregnancy and only received the quizzes that were applicable to their stage of pregnancy. Each quiz consisted of one question on each of the following six topics: nutrition, smoking, physical activity, safety, lifestyle/care, and pregnancy. Women could complete the quiz after receiving an email that contained one of the six questions as an example and a hyperlink to the entire quiz. Each question had two answer possibilities. Selecting an answer was followed by an automatic message on the website informing the women whether their answer was correct, an explanation of the correct answer, and, in most cases, a practical tip and a hyperlink to a related website providing additional or more detailed information. Several national health promotion institutes and the national platform of midwives were responsible for the content of the topic relevant to their expertise. Furthermore, women could ask online experts pregnancy-related questions.

    The program was specifically developed to reach women with basic literacy skills, including the use of short text blocks and plain language. Figure 1 shows an example of a quiz question. For an overview of all quiz questions, translated into English, see the Multimedia Appendix.

    ‎
    Figure 1. Screenshot of the quiz for week 24
    View this figure

    Study Participants

    Pregnant women signed up for participation in Hello World on the website. Those who subscribed between the start of the program and November 13, 2007, were included in the study (n = 14,154). For the women who registered more than once, the most active account or the most recent inactive account was included; all other double accounts were excluded (n = 127). Additionally, data of nonpregnant persons and test users (n = 19) or those with an unlikely number of weeks of pregnancy (less then 0 or more than 40 weeks; n = 62) were excluded. Data of 13,946 participants were used for the analyses. Women who mentioned miscarriage as the reason for unsubscribing (n = 260) were included for assessment of enrollment, representativeness, and recruitment, but they were excluded from the analysis of program use and appreciation. The study was carried out in accordance with Dutch privacy legislation. Informed consent was obtained for all participants via the user conditions of the website that participants had to agree to when registering for Hello World. It was explained to the participants that answering the research questionnaires was voluntary and not a prerequisite for (further) use of the website.

    Recruitment

    Several recruitment strategies were used to promote the program. From January 2007 onward, 50,000 Hello World leaflets were included in pregnancy present boxes, which could be requested by pregnant women on another pregnancy-related website. In addition, between January and November 2007, a promotional email was sent by the organization who implemented the intervention to almost 76,000 women who had requested a pregnancy present box. Furthermore, banners were placed on several websites, and advertisements for Hello World appeared when performing pregnancy-related searches in Google. As well, a total of 45,000 Hello World flyers were distributed in the majority of Dutch midwifery practices. In addition, recruitment took place through traditional mass media as advertisements in magazines and through an information stand at a national pregnancy fair.

    Measures

    Demographic, Lifestyle, and Internet Characteristics

    Upon enrollment, the women were asked to enter their first name, date of birth, email address, expected date of delivery, and how they found out about the website. In this paper, the last variable will be referred to as the “recruitment channel,” and it was categorized into the following eight types: midwife, email, Internet, pregnancy present box, pregnancy fair, peers, media (radio, television, magazines, newspapers), and other/unknown. Subsequent to enrollment, women received a baseline questionnaire by email to assess demographic, lifestyle, and Internet characteristics. Age was calculated from the date of birth. Ages < 15 and > 45 years were regarded as errors and were therefore not included in the age description. The number of weeks of pregnancy (0-14 weeks, 15-27 weeks, and 28-40 weeks) was calculated from the date of enrollment and the expected delivery date, assuming a pregnancy duration of 40 weeks.

    The education level of the women was assessed as the highest level completed and was categorized as low (lower secondary education or less), intermediate (higher secondary education), or high (college or university) [22]. Women were regarded as immigrants when at least one of their parents was born outside the Netherlands [22]. If the woman herself was also born outside the Netherlands, she was considered a first-generation immigrant. Furthermore, immigrant women were divided into immigrants from Western counties and non-Western countries based on their parents’ country of birth. Information on parity, job participation, overweight before pregnancy, smoking status, and alcohol consumption was also obtained with the questionnaire.

    Sufficient fruit and vegetable intake was based on meeting the Dutch guidelines for minimum intake levels of fruit and vegetables (ie, two pieces of fruit or one piece of fruit and one glass of fruit juice per day, and 150-200 g of vegetables per day) [23]. Sufficient physical activity was defined as being moderately active for at least 30 minutes on five or more days per week, according to the Dutch recommendations for physical activity [24]. No folic acid intake was defined as not currently using or not having used folic acid tablets. The questionnaire also included questions about Internet availability at home, time spent online per week (< 1 hour, 1-2 hours, and > 2 hours), and the use of the Internet for obtaining information about pregnancy, health, and/or parenting.

    Program Use

    Program use was registered continuously and included the quiz emails sent to the participant and the quiz questions accessed by the participant. The quiz emails contained a personal identification code to track the use of the quiz questions. All user data up to the end of August 2008 were included, thereby covering a whole pregnancy period after the last moment of registration in this study (November 13, 2007) to ensure that every woman could have received all quiz emails. If at least one of the quiz questions was opened by the participant, that woman was defined as a “user” of the quiz for that specific week. To describe program use, only the women who enrolled before or during week 28 of their pregnancy were included since they could have received a substantial number of quiz emails.

    Program users were classified into five categories: (1) inactive (did not use any of the received quizzes), (2) ceased (did not use the last two received quizzes or unsubscribed themselves from the program after using one or more quizzes), (3) moderately active (used at least two of the last quizzes, but less than 2/3 of all quizzes), (4) active (used at least two of the last quizzes, and at least 2/3 of all quizzes), and (5) very active (used all quizzes). The quiz email for week 40 was not taken into account since we expected that not all pregnant women would be able to open quiz emails around the time of delivery. Indeed, the data showed that this quiz was completed less often than other quizzes.

    Program Appreciation

    Appreciation of the program was assessed by means of an online self-administered questionnaire that was sent in the week after the participants received their third quiz email and their sixth quiz email. As women could enroll themselves anytime throughout their pregnancy, timing of the questionnaire varied among participants. The same questionnaire was used for both evaluations and included eight positively formulated statements about the program that could be rated on a five-point Likert scale (“totally agree” to “totally disagree”). Examples of the statements include “the information on Hello World is reliable” and “the information on Hello World is recent.” Based on the number of statements for which the response was “agree” or “totally agree,” program appreciation was categorized into low (agreed with 0-4 statements), intermediate (agreed with 5-6 statements), or high appreciation (agreed with 7-8 statements).

    Data Analyses

    Data analyses were performed in 2008. Response rates of the questionnaire were based on the number of questionnaires sent to the participants and the number of questionnaires completed by the participants. The demographic characteristics of the pregnant women participating in the email-based health promotion program were described and compared with existing data of pregnant women in the Netherlands [22]. Because younger women may not have completed their education, age-stratified education levels were compared. Demographic, lifestyle, and Internet characteristics; recruitment channel; program use; and program appreciation were compared among participants with different levels of education. For program use and education level, additional analyses were conducted after stratification for parity.

    For all analyses, differences between education levels were tested with chi-square tests for categorical variables and analysis of variance for continuous variables.

    Because education level was associated with several characteristics and lifestyle factors, the associations between education level and program use and program appreciation, after adjustment for these characteristics, were tested using ordinal logistic regression. The final multivariate models were constructed by including all variables that were significantly associated with the independent variable (program use or appreciation) in the bivariate models (including education level and one other characteristic) or the multivariate model (including all characteristics). Statistical significance was set at P < .05. All data analyses were carried out using SAS for Windows, version 9.1 (SAS Institute, Cary, NC, USA).


    Representativeness of the Participants

    Based on the number of enrolled women in the program (n = 13,946) and the number of living newborns in the Netherlands in 2007 (n = 18,1336), we estimated that approximately 8% of all pregnant women in the Netherlands enrolled in the Hello World program (Table 1). Most participants (9210/12,802, 72%) in our study were aged 25-35 years. Although there were fewer low-educated women in the program than in the Netherlands for the 15-25 and 35-45 year age groups, the percentage of low-educated women among the 25-35 year age group was comparable to that of the Netherlands. In our study, the percentage of immigrants (1583/8833, 18%) was smaller than the overall proportion found in the Netherlands (24%). The majority of participants (5568/8833, 63%) were pregnant with their first child, which was higher than the percentage of first-born babies in the Netherlands.

    Table 1. Characteristics of the participants of Hello World
    CharacteristicHello WorldThe Netherlandsa
    Number of pregnant women13,94618,1336b
    Mean ± SDMean
    Age of those pregnant with their first child (years)c28.3 ± 4.429.4d,e
    Age at enrollment (years)c29 ± 4.531.1d,f
    No. (%)%
    Response rate for baseline questionnaireg8833/13,942 (63)–
    Pregnant with first child5568 (63)45h
    Age group
       15-25 years2368 (18)10d
       25-35 years9210 (72)64d
       35-45 years1224 (10)26d
    Education level
       15-25 yearsLow594 (43)50i
    Intermediate660 (47)40i
    High142 (10)10i
       25-35 yearsLow1032 (17)17i
    Intermediate2366 (40)46i
    High2544 (43)37i
       35-45 yearsLow154 (19)25i
    Intermediate260 (33)47i
    High386 (48)28i
    Employment
       Full-time job (≥ 32 hours/week)4120 (47)NAj
       Part-time job (< 32 hours/week3058 (35)NAj
       No job1619 (18)24k
    Immigrant1583 (18)24k
       First generation635 (7)14k
       Non-Western753 (9)14k

    aData from Statistics Netherlands [22].

    bNumber of living newborns in the Netherlands in 2007.

    cOnly those aged ≥ 15 and ≤ 45 years were included. For Hello World participants, age at enrollment included 12,802 women and age of those pregnant of their first child included 5252 women.

    dOnly pregnant women.

    e Mean age of those pregnant with their first child in 2007.

    fMean age of women at the time of delivery in 2007.

    gProportion based on the number of returned questionnaires and the number of questionnaires sent to the women.

    iIncluding pregnant and nonpregnant women.

    j Not available.

    kIncluding pregnant and nonpregnant women aged 15-45 years.

    Recruitment Channel

    As shown in Table 2, the most reported recruitment channel was email (32%), followed by the Internet (22%) and midwives (16%). This order was observed for all education levels. However, relatively more women with lower education mentioned email as the recruitment channel (38%) than did highly educated women (24%; χ2= 154.5, P < .001); the reverse was observed for midwives as the recruitment channel (14% vs 20% for low and high education, respectively; χ2 = 38.1, P < .001).

    Table 2. Recruitment channel by education level
    Recruitment ChannelTotala
    (n = 13,946)    		Low
    (n = 1940)    		Intermediate
    (n = 3548)    		High
    (n = 3317)
    No.%No.%No.%No.%
    Email4399327443812803680424
    Internet (surfing, Google, other websites)302322384207672277923
    Midwife221416279145601667420
    Pregnancy present box11168164828583039
    Peers10417135722962207
    Media (radio, television, magazine, newspaper)653576414641976
    Pregnancy fair585435210031153
    Other/unknown9157123618152257

    a The low, intermediate, and high education levels do not add to the total group because not all women completed the baseline questionnaire with the question about education.

    Characteristics by Education Level

    Table 3 presents the characteristics of the pregnant women by education level. More highly educated women (2257/3312, 68%) were pregnant with their first child than were women with a low level of education (1115/1937, 58%; χ2 = 65.7, P < .001). Low-education women more often smoked during pregnancy, less often had sufficient fruit and vegetable intake, and less often used folic acid than high-education women. Almost all women had access to the Internet at home and used it for obtaining pregnancy-related information.

    Table 3. Demographic, lifestyle, and Internet characteristics by education levela
    LowIntermediateHighχ2bPc
    No.%bNo.%bNo.%b
    Age (years)178027.5(5.2)d328628.8 (4.3)d307230.7 (3.5)d351.0e< .001
    Pregnancy
       Pregnant with first child1115/1937582179/3544612257/33126865.7< .001
       Number of weeks of    pregnancy at enrollment194018.4 (9.2)d354818.0 (9.3)d331717.4 (9.1)d8.1e< .001
       1st trimester795/1940411510/3548431481/33174515.2.004
       2nd trimester783/1940401394/3548391326/331740
       3rd trimester362/194019644/354818510/331715
    Lifestyle characteristics
       Overweight before
       pregnancy
       (BMI ≥ 25 kg/m2) f    		752/1913391297/349537845/328026137.8< .001
       Smoking906.1< .001
          Smoker465/193824329/3543957/33172
          Cessation because of       pregnancy443/193823666/354319399/331712
          Nonsmoker1030/1938532548/3543722861/331786
       Alcohol use during    pregnancy41/1934287/35382142/3308426.9< .001
       Sufficient vegetable intakeg253/122521518/226323674/21063269.2< .001
       Sufficient fruit intakeg482/1266381037/2337441133/21595271.0< .001
       Sufficient physical activityh553/132542885/239337819/22393710.8.005
       No folic acid used304/193216287/35378141/33084210.4< .001
    Internet characteristics
       Internet at home1847/1930963428/3544973259/33099838.6< .001
       Internet use36.4< .001
          < 1 hour/week222/193311370/354010261/33118
          1-2 hours/week610/1933321217/3540341030/331131
          > 2 hours/week1101/1933571953/3540552020/331161
       Use of Internet for    information about    pregnancy1654/1932863176/3542902987/33109029.5< .001

    a Due to missing values, the totals in each column vary. Italics represents significant results.

    b Unless otherwise noted.

    c The chi-square test was used for categorical variables, and analysis of variance was used for continuous variables.

    d Mean (SD).

    e F-value.

    f Body mass index (BMI) was calculated as the self-reported weight before pregnancy (kg) and height (m2).

    g Meeting the current Dutch guidelines for sufficient fruit and vegetable intake. Sufficient fruit intake: at least two pieces of fruit per day or one piece supplemented by fruit juice. Sufficient vegetable intake: at least 150-200 g of vegetables per day.

    h At least 30 minutes of being moderately active on five or more days per week.

    Program Use

    For the analyses of program use, we included only the women who enrolled in week 28 of pregnancy or earlier (11,415/13,686; 83%). On average, the participants received a mean of 5.6 ± 1.8 quiz emails and opened 2.8 ± 2.3 of them to complete at least one of the six questions. Women completed, on average, 3.8 ± 1.6 of the six available questions for each opened quiz.

    Figure 2 shows the distribution of program users for all women who registered in week 28 of pregnancy or earlier. Program users were classified into five categories: (1) inactive (did not use any of the received quizzes), (2) ceased (did not use the last two received quizzes or unsubscribed themselves from the program after using one or more quizzes), (3) moderately active (used at least two of the last quizzes, but less than 2/3 of all quizzes), (4) active (used at least two of the last quizzes, and at least 2/3 of all quizzes), and (5) very active (used all quizzes). The quiz email of week 40 was not taken into account, and miscarriages were excluded. In Figure 2, the numbers of women with low, intermediate, and high education do not add to the total group because not all women completed the baseline questionnaire with the question about education level.

    About 18% (2075/11,415) of the women never opened a quiz email, 27% (n = 5166) ceased participating, and 16% (n = 1849) opened all quiz emails received. Inactivity was observed more among the women with low education (15%, 242/1595) than among the women with high education (8%, 220/2786; χ2 = 56.7, P < .001). Similarly, ceased participation was more common among low-education women (31%, 497/1595) than among high-education women (26%, 712/2786; χ2 = 20.5, P < .001).

    Very active users were more likely to be women with a high level of education (25%, 710/2786) than with a low level of education (14%, 229/1595; χ2 = 93.7, P < .001). When repeating these analyses stratified for those pregnant for the first time and those not, comparable results for education level were found (results not shown).

    Because education level was associated with program use as well as with several lifestyle factors (see Table 3), we tested the independent association of education level and program use using multivariate ordinal regression. In the multivariate model, higher education, being older, being pregnant with the first child, number of weeks of pregnancy, being a nonsmoker, and not being overweight were independently associated with program use, whereas alcohol use and folic acid use were not.

    ‎
    Figure 2. Type of program user by education level
    View this figure

    Program Appreciation

    The first appreciation questionnaire was completed by 3763/12,201 women who received it (response rate 31%); the second appreciation questionnaire was completed by 1926/8666 women who received it (response rate 22%). Half (n = 1840) of the 3763 women who answered the first questionnaire had a high appreciation of the program, more than one quarter (n = 1091) showed an intermediate appreciation, and less than one quarter (n = 832) had a low appreciation. Low-education women were more likely to show a high appreciation (52%, 307/593) of the program than high-education women (44% 539/1219; χ2 = 17.9, P = .001) in the first appreciation questionnaire. A similar pattern was seen for the second appreciation questionnaire (data not shown).

    Because education level was associated with program appreciation as well as with several lifestyle factors (see Table 3), we tested the independent association of education level and program appreciation using multivariate ordinal regression. In the multivariate model, being younger, being pregnant with the first child, and not using alcohol during pregnancy were independently associated with higher program appreciation, while education level and overweight were not.


    Our study describes the enrollment and engagement rates in a national email-based health education program aimed at pregnant women in a real-life setting. We estimate that about 8% of all pregnant women in the Netherlands enrolled in the Hello World program. Women with less education seemed to be slightly underrepresented, and immigrants seemed to be underrepresented compared to the Dutch female population aged 15-45 years. In particular, women who were pregnant with their first child enrolled in the program. Most women cited email as their recruitment channel, followed by the Internet and midwives. In agreement with results of the pilot study [8], program use differed between women with low and high levels of education. Low-education women were more satisfied with the program than high-education women.

    To our knowledge, Hello World is the first national online health education program aimed at pregnant women. The program incorporates several elements that have shown to be effective in online health education programs. These elements include tailored messages, which are known to be appreciated by pregnant women [3]. In addition, emails were sent every 4 weeks to inform the women about the availability of new quizzes, since previous studies showed that email reminders have a positive effect on the number of website revisits and were suggested as a strategy to retain participants [16,25]. Furthermore, a combination of online as well as offline recruitment strategies were used so that women who used the Internet less often could also find out about the program.

    In the Netherlands, the majority of pregnant women visit midwives as the first line of care during pregnancy [26]. One of the tasks of midwives is to provide information about a healthy pregnancy. Thus, this is a natural setting for health promotion and interventions. A few studies have evaluated the effectiveness of interventions (eg, breastfeeding and smoking cessation) but with mixed results [27,28]. To the best of our knowledge, none of these interventions have been implemented nationally.

    Strengths and Limitations

    Strengths of our study were its large sample size and real-life setting. In addition, program use was registered objectively and was not self-reported.

    Some limitations need to be stressed. The response rate for the questionnaires dropped from 63% for the baseline questionnaire to 22% for the second appreciation questionnaire. Additional analyses showed that lower response rates on the questionnaires were related to low education level, younger age, and nonactive program use. Further, participation rates could not be calculated for the different recruitment strategies. In addition, it is likely that not all preterm births and miscarriages were reported. Since delivery and miscarriage will probably result in cessation of program use, this may have led to an underestimation of program use in pregnant women.

    We estimated that 8% of all pregnant women in the Netherlands enrolled in the Hello World program. Our estimation has a few drawbacks. First, it is based on the number of living newborns in the Netherlands in 2007, thereby not taking miscarriages into account. However, as most miscarriages take place early in pregnancy and the women enrolled at 18 weeks of pregnancy on average, the number of miscarriages probably was small. Second, we cannot exclude that some women registered twice using different email addresses. In addition, nonpregnant persons or Dutch-speaking women living abroad may also register for the program. This may have led to an overestimation of the enrollment rate in our study. Third, our enrollment rate was based on all pregnant women, including those who were not exposed to the intervention. This must be kept in mind when comparing our enrollment rate with other studies. For example, the pilot study showed an enrollment rate of 17% [8], but this rate was based on the number of pregnant women who were invited to participate by midwives. Since only a fraction of all pregnant women probably knew about the program in our study, our enrollment rate appears reasonable.

    We had to rely on existing data for describing the representativeness of the participants. In the pilot study, selective enrollment was observed, favoring enrollment of higher-educated women [8]. In contrast, in this study, the percentage of women with a low level of education was comparable to that in the Dutch female population aged 25-35 years. Almost three quarters of the women enrolled in Hello World belong to this age group. However, women with less education have more children than higher-educated women in the Netherlands [29] and may therefore be slightly underrepresented. Pregnant women with a low level of education need more attention since previous studies have shown that these women more often smoked during pregnancy [30], less often breastfed their children up to 6 months after delivery [31], and less often were aware of the benefits of folic acid and used folic acid less often during pregnancy [32,33]. Our study confirmed less favorable health behaviors in lower-educated women compared to higher-educated women, except for alcohol consumption and physical activity. The large number of women pregnant with their first child is desirable since they have the highest need for pregnancy-related information [3].

    In our study, more participants were recruited by online strategies than by offline strategies. Similar results were found by Feil et al [14] and Thüring et al [13]. Further, in our study, lower-educated women were more often recruited by email than were highly educated women, whereas the reverse was observed for recruitment by midwives. It is possible that these differences can be partly explained by differences in exposure.

    Eysenbach [34] has discussed the importance of studying attrition in Internet-based interventions. High dropout rates in Internet interventions are common, and selective dropout is frequently observed [20,34]. In our study, one sixth of the participants never opened a quiz email, and more than a quarter stopped participating. We found a higher level of program use among highly educated pregnant women compared to lower-educated pregnant women. This is similar to the pilot study [8] but is in contrast to Verheijden et al [20], who found no differences between education level for the usage of an online health promotion program in a subsample of the general Dutch population. Although the level of engagement was lower among low-education women, these women appreciated the program more than highly educated women. It is possible that the program was too easy and concise for highly educated women and that they therefore appreciated the program less.

    Future Work

    We have measured both enrollment and engagement, which are important prerequisites for exposure to health messages in the program. However, the effect of these messages on health outcomes is unknown [3] and should be investigated in randomized controlled trials. More research is needed on the differences of processing health information among persons with varying levels of education. Effective methods for increasing enrollment and engagement need to be further studied.

    Conclusions

    In conclusion, this study showed that about 8% of the pregnant women in the Netherlands could be reached through an Internet-based health promotion program. Lower-educated women seemed to be slightly underrepresented. Lower-educated women were less actively engaged than highly educated women but appreciated the program more. Most women were recruited by online recruitment strategies rather than traditional channels. Reducing selective attrition remains a challenge in Web-delivered health promotion programs.

    Acknowledgments

    This study was funded by The Dutch Ministry of Health, Welfare and Sports. The authors would like to thank Martin de Jong from OOiP for his assistance in collecting the program usage data and Maarten Schipper for his statistical advice. Also thanks to Moniek van Zutphen and Salome Scholtens for their comments on earlier versions.

    Conflicts of Interest

    None declared.

    ‎

    Multimedia Appendix

    Overview of quiz questions

    PDF file (Adobe PDF), 21 KB
    1. Anderson AS. Symposium on 'nutritional adaptation to pregnancy and lactation'. Pregnancy as a time for dietary change? Proc Nutr Soc 2001 Nov;60(4):497-504. [Medline] [CrossRef]
    2. Verbeke W, De Bourdeaudhuij I. Dietary behaviour of pregnant versus non-pregnant women. Appetite 2007 Jan;48(1):78-86. [Medline] [CrossRef]
    3. Bernhardt JM, Felter EM. Online pediatric information seeking among mothers of young children: results from a qualitative study using focus groups. J Med Internet Res 2004 Mar 1;6(1):e7 [FREE Full text] [Medline] [CrossRef]
    4. Szwajcer EM, Hiddink GJ, Koelen MA, van Woerkum CM. Nutrition-related information-seeking behaviours before and throughout the course of pregnancy: consequences for nutrition communication. Eur J Clin Nutr 2005 Aug;59 Suppl 1:S57-S65. [Medline] [CrossRef]
    5. Larsson M. A descriptive study of the use of the Internet by women seeking pregnancy-related information. Midwifery 2009 Feb;25(1):14-20. [Medline] [CrossRef]
    6. Shaw E, Howard M, Chan D, Waters H, Kaczorowski J, Price D, et al. Access to web-based personalized antenatal health records for pregnant women: a randomized controlled trial. J Obstet Gynaecol Can 2008;30:38-43. [Medline]
    7. ; Rand Health (Prepared for the California HealthCare Foundation). Proceed with Caution: A Report on the Quality of Health Information on the Internet. Complete Study. Oakland, CA: California HealthCare Foundation; 2001.   URL: http://www.chcf.org/documents/consumer/ProceedWithCautionCompleteStudy.pdf [WebCite Cache]
    8. van Zutphen M, Milder IE, Bemelmans WJ. Usage of an online healthy lifestyle program by pregnant women attending midwifery practices in Amsterdam. Prev Med 2008 Jun;46(6):552-557. [Medline] [CrossRef]
    9. van Zutphen M, Milder IE, Bemelmans WJ. Integrating an eHealth program for pregnant women in midwifery care: a feasibility study among midwives and program users. J Med Internet Res 2009;11(1):e7 [FREE Full text] [Medline] [CrossRef]
    10. Green L, Kreuter MW. Health Promotion Planning: An Educational and Environmental Approach. 2nd edition. Mountain View, CA: Mayfield; 1991.
    11. Huang MZ, Kuo SC, Avery MD, Chen W, Lin KC, Gau ML. Evaluating effects of a prenatal web-based breastfeeding education programme in Taiwan. J Clin Nurs 2007 Aug;16(8):1571-1579. [Medline] [CrossRef]
    12. Martin-Diener E, Thüring N. Response to a single media announcement for an internet based hepa-intervention. Presented at: Hepa-symposium; September 1-2, 2002; Helsinki, Finland   URL: http://www.physicalactivityandhealth.ch/hepa.ch/gf/active-online/publications/02_helsinki_poster.pdf [WebCite Cache]
    13. Thüring N, Martin-Diener E, Martin B. Effectiveness of an interactive Internet program promoting physical activity: the feasibility of an Internet-based, randomized study design. Presented at: ECSS; July 9-12, 2003; Salzburg, Germany   URL: http://www.physicalactivityandhealth.ch/hepa.ch/gf/active-online/publications/03_ECSS_poster.pdf [WebCite Cache]
    14. Feil EG, Noell J, Lichtenstein E, Boles SM, McKay HG. Evaluation of an Internet-based smoking cessation program: lessons learned from a pilot study. Nicotine Tob Res 2003 Apr;5(2):189-194. [Medline] [CrossRef]
    15. Koo M, Skinner H. Challenges of Internet Recruitment: A Case Study with Disappointing Results. J Med Internet Res 2005;7(1):e6 [FREE Full text] [Medline] [CrossRef]
    16. Spittaels H, De Bourdeaudhuij I. Implementation of an online tailored physical activity intervention for adults in Belgium. Health Promot Int 2006 Dec;21(4):311-319 [FREE Full text] [Medline] [CrossRef]
    17. Gordon JS, Akers L, Severson HH, Danaher BG, Boles SM. Successful participant recruitment strategies for an online smokeless tobacco cessation program. Nicotine Tob Res 2006 Dec;8 Suppl 1(1):S35-S41. [Medline] [CrossRef]
    18. Franklin PD, Rosenbaum PF, Carey MP, Roizen MF. Using sequential e-mail messages to promote health behaviors: evidence of feasibility and reach in a worksite sample. J Med Internet Res 2006;8(1):e3 [FREE Full text] [Medline] [CrossRef]
    19. Glasgow RE, Nelson CC, Kearney KA, Reid R, Ritzwoller DP, Strecher VJ, et al. Reach, engagement, and retention in an Internet-based weight loss program in a multi-site randomized controlled trial. J Med Internet Res 2007;9(2):e11 [FREE Full text] [Medline] [CrossRef]
    20. Verheijden MW, Jans MP, Hildebrandt VH, Hopman-Rock M. Rates and determinants of repeated participation in a web-based behavior change program for healthy body weight and healthy lifestyle. J Med Internet Res 2007;9(1):e1 [FREE Full text] [Medline] [CrossRef]
    21. Thoolen B, de Ridder D, Bensing J, Gorter K, Rutten G. Who participates in diabetes self-management interventions?: Issues of recruitment and retainment. Diabetes Educ 2007;33(3):465-474. [Medline] [CrossRef]
    22. Statistics Netherlands. Voorburg/Heerlen.   URL: http://www.cbs.nl/ [WebCite Cache]
    23. ; Health Council of the Netherlands. Richtlijnen goede voeding 2006 [Guidelines on healthy nutrition 2006]. Den Haag, the Netherlands: Health Council of the Netherlands; 2006.   URL: http://www.gr.nl/pdf.php?ID=1479&p=1 [WebCite Cache]
    24. Kemper HGC, Ooijendijk WTM, Stiggelbout M. Consensus over de Nederlandse Norm voor Gezond Bewegen [Consensus about the Dutch recommendation for physical activity to promote health]. Tijdschr Soc Gezondheidsz 2000;78:180-183.
    25. Leslie E, Marshall AL, Owen N, Bauman A. Engagement and retention of participants in a physical activity website. Prev Med 2005 Jan;40(1):54-59. [Medline] [CrossRef]
    26. Althuizen E, van Poppel MN, Seidell JC, van der Wijden C, van Mechelen W. Design of the New Life(style) study: a randomised controlled trial to optimise maternal weight development during pregnancy. [ISRCTN85313483]. BMC Public Health 2006;6(1):168 [FREE Full text] [Medline] [CrossRef]
    27. Kools EJ, Thijs C, Kester AD, van den Brandt PA, de Vries H. A breast-feeding promotion and support program a randomized trial in The Netherlands. Prev Med 2005 Jan;40(1):60-70. [Medline] [CrossRef]
    28. de Vries H, Bakker M, Mullen PD, van Breukelen G. The effects of smoking cessation counseling by midwives on Dutch pregnant women and their partners. Patient Educ Couns 2006 Oct;63(1-2):177-187. [Medline] [CrossRef]
    29. van Agtmaal-Wobma E, van Huis M. De relatie tussen vruchtbaarheid en opleidingsniveau van de vrouw [The relationship between fertility and educational level of the woman]. CBS Bevolkingstrends. 2008.   URL: http://www.cbs.nl/NR/rdonlyres/891A0CBE-B05B-48C2-B1CE-7C273CE69152/0/2008k2b15p32art.pdf [WebCite Cache]
    30. Lu Y, Tong S, Oldenburg B. Determinants of smoking and cessation during and after pregnancy. Health Promot Int 2001 Dec;16(4):355-365 [FREE Full text] [Medline] [CrossRef]
    31. Flacking R, Nyqvist KH, Ewald U. Effects of socioeconomic status on breastfeeding duration in mothers of preterm and term infants. Eur J Public Health 2007 Dec;17(6):579-584 [FREE Full text] [Medline] [CrossRef]
    32. de Walle HE, Cornel MC, de Jong-van den Berg LT. Three years after the dutch folic acid campaign: growing socioeconomic differences. Prev Med 2002 Jul;35(1):65-69. [Medline] [CrossRef]
    33. Timmermans S, Jaddoe VW, Mackenbach JP, Hofman A, Steegers-Theunissen RP, Steegers EA. Determinants of folic acid use in early pregnancy in a multi-ethnic urban population in The Netherlands: The Generation R study. Prev Med 2008 Jul 2. [Medline] [CrossRef]
    34. Eysenbach G. The law of attrition. J Med Internet Res 2005;7(1):e11 [FREE Full text] [Medline] [CrossRef]

    Edited by G Eysenbach; submitted 11.12.08; peer-reviewed by H Spittaels, P Franklin; comments to author 05.02.09; revised version received 25.03.09; accepted 28.04.09; published 30.07.09

    Copyright

    © Mariska Bot, Ivon EJ Milder, Wanda JE Bemelmans. Originally published in the Journal of Medical Internet Research (http://www.jmir.org), 30.07.2009.  

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on http://www.jmir.org/, as well as this copyright and license information must be included.