Determinants of Follow-Up Participation in the Internet-Based European Influenza Surveillance Platform Influenzanet

Introduction

The Internet is an increasingly used tool in epidemiological data collection, especially for recruitment and follow-up of large cohorts. Successful examples of this approach include the Millennium Cohort Study [1], the Nurses and Midwives e-Cohort Study [2], the Internet-based Pregnancy Planning Study (“SnartGravid”) [3], the participatory nutritional study Nutrinet [4], and the newborn cohort NINFEA [5]. Some studies have systematically examined the advantages of the Internet-based approach [6,7], mostly in terms of the reduction of costs and time required for the data collection. Moreover, an unknown proportion of individuals with symptoms do not seek health care, and this proportion may vary with age, sex, or other social groups. Health care-seeking behavior also varies between countries and may change over the course of an epidemic. There is currently no method for systematically assessing health care usage. The use of the Internet-based cohorts can help to overcome this issue. Here we focus on Internet-based community surveillance of influenza-like-illness (ILI) as a means of gathering epidemiological data from the general population in a participatory fashion. In particular, we will study how the characteristics of individuals who register for the surveillance system are related to their involvement over the course of a surveillance season.

Influenza-like illness in Europe is monitored by means of nationwide networks of sentinel General Practitioners (GPs) detecting only medically attended ILI cases. Internet-based community surveillance of influenza can help to determine the disease burden [8], time trends and seasonality, and to characterize care-seeking and treatment behavior [9] and patterns of absenteeism [10]. Internet-based systems can thus enhance traditional GP-based surveillance and support the interpretation of recorded data, both for pandemic and seasonal influenza [8,9].

Collection of data related to influenza-like symptoms using an Internet platform is ongoing in several European countries: since 2003 in the Netherlands and Belgium [11], since 2005 in Portugal [12], 2008 in Italy, and 2009 in the United Kingdom [8,9]. Starting during the influenza season of 2011-2012, for the first time a network of Internet-based surveillance systems, called Influenzanet [13], has been active in seven European countries (the Netherlands, Belgium, Portugal, Italy, the United Kingdom, Sweden, and France), each using the same platform with the aim of gathering data across different countries in a standardized way, to monitor ILI in the community in real-time, track vaccine effectiveness [10,14], and to estimate risk factors for ILI.

In the seven countries, epidemiological data are collected with the participation of a self-selected cohort of volunteers followed over the influenza season. The success of the data collection strongly depends on the regular participation of the volunteers. Here, we investigate the determinants of participation in follow-up of volunteers enrolled in the Influenzanet platforms during the influenza season of 2011-2012.

Methods

Any resident of a country where Influenzanet is implemented can be involved in the influenza data collection by registering through the national Web page [15-20]. In each country, identical questionnaires are implemented with questions about respiratory symptoms, access and utilization of care and self-medication, uptake of vaccines, attitudes to influenza vaccines, and absenteeism. For the sake of clarity in the following, the term “users” will indicate all the individuals who have registered with the platform and possess a username and a password, regardless of their subsequent activity during the influenza season.

Upon registration, users are invited to complete a background questionnaire containing various sociodemographic, medical, geographic, and behavioral questions. In particular, the background questionnaire covers age, gender, household size and composition, location of home and workplace, education level, occupation, vaccination status for the previous and present influenza season, the presence of a chronic disease, possible pregnancy, and other issues (see the complete list of questions in Multimedia Appendix 1). Users are reminded weekly, via an email newsletter, to report their health status through a brief symptoms questionnaire, whether or not they experienced any symptoms since the last time they visited the platform. Users who report the presence of symptoms are asked some follow-up questions about the symptoms’ onset date, about their health care-seeking behavior, medications taken for that particular episode of illness, and time off work/school. The weekly newsletter contains also a summary of the latest influenza facts and news to maintain users’ interest in the questionnaire. Users can also create accounts on behalf of other members of their family/household, thus enabling, for instance, parents to record data for their children.

To study the determinants of participation in follow-up, we analyzed the behavior of users over the course of an influenza season, focusing on their propensity to return to the platform and provide information about their health status. Information collected in the background questionnaire allows us to study how the sociodemographic characteristics of participants are related to participation in follow-up. The study sample here consisted of all the Influenzanet volunteers in the seven European countries who contributed at least one symptoms questionnaire during the 2011-2012 influenza season and who inserted their own data. Since users can also create accounts on behalf of other people of their family/household, we discarded users whose information was reported to have been provided by someone else (eg, a husband whose questionnaires are filled in by his wife). Likewise, we did not consider subjects less than 15 or more than 70 years old, on the assumption that a different participant may have managed their account. In fact, more than 400 children younger than 15 years old and more than 200 individuals older than 70 years have their own account (ie, their own username and password to access the platform). This is a legacy from previous seasons when some of the platforms had the requirement that each individual have his/her own account even if it was managed by someone else. Therefore, we did impose the additional constraint on the volunteer’s age in an attempt to ensure, as far as possible, that we were considering volunteers who manage their own accounts.

From the study sample, we considered as “enrolled participants”, those participants eligible to be included in the analysis presented here, those who completed their first symptoms questionnaire at least 60 days before the end of the monitoring season, and completed at least one additional symptoms questionnaire within 15 days of the first symptoms questionnaire. From enrolled participants, we considered as “participants in follow–up” or “respondent participants” (either terms will be used in the following), those individuals who filled in at least two symptoms questionnaires during the time window of 30 to 60 days after their first symptoms questionnaire. Otherwise, the enrolled participants were considered to have a lower participation in the follow-up (see Figure 1).

In order to properly follow the unfolding of the seasonal epidemic and collect data that can be compared with the sentinel-based surveillance (which aggregates data on a weekly basis), users were asked to fill in a symptoms questionnaire each week. However, although completing the symptoms questionnaire only took a couple of minutes each week, there were numerous missing reports. Nevertheless, many individuals who missed a week did not drop out of the study; instead, they updated their health status more infrequently but they continued to provide useful information. On the other hand, some individuals registered on the website just to explore the website and its functionalities and never updated their health status; these individuals are not considered to be enrolled in the study. The definitions used for enrolled participants and participants involved in the follow-up, though by necessity somewhat arbitrary, were chosen to capture behavior that would generate a flow of useful information throughout the season.

By means of a multilevel analysis, we evaluated the association between participation in follow-up during the season and sociodemographic and behavioral characteristics collected in the background questionnaire. A multilevel analysis is generally used when the set of values of a categorical predictor variable are seen not as the complete set but rather as a random sample of all values, in order to allow inferences over a wider population than is possible with regression or other general linear model methods. In this case, we considered the follow-up participation as a dichotomous outcome, the sociodemographic and behavioral characteristics as independent variables, and the country variability as a random effect. We used as independent variables: gender, age, education level, household composition, smoking, presence of a chronic condition, and vaccination status. For each variable, we used the levels shown in Textbox 1.

In the multilevel analysis, each variable was adjusted against all the others as potential confounders for the outcome. Since some subject records for the various independent variables were missing, we used a complete-subject analysis to deal with such missing records; thus, the multilevel regression was performed only on those enrolled individuals who provided information for all the considered variables. The education level was asked only to participants above 15 years old, and therefore those with 15 years old are excluded from the multivariate analysis. The reference age group was chosen to be the one with more participants in the total population (51-60 years old) in order to reduce the estimates of confidence intervals. Given the relatively small number of clusters (ie, countries), we verified that a logistic regression where the countries are considered as dummy variables led to results comparable with those obtained with the multilevel regression in terms of strength of association (ie, odds ratios) and significance (P value). Data were analyzed using Stata software, version 11.0.

In the United Kingdom, the Flusurvey study was approved by the London School of Hygiene and Tropical Medicine Ethics Committee (Application number 5530). In Sweden, the Influensakoll study was approved by the Stockholm Regional Ethical Review Board (Dnr. 2011/387-31/4). In France, the Grippenet study has been approved by the Comité consultatif sur le traitement de l’information en matière de recherche (CCTIRS, Advisory committee on information processing for research, authorization 11.565), and by the Commission Nationale de l’Informatique et des Libertés (CNIL, French Data Protection Authority, authorization DR-2012-024).

In all the participating countries, the study was conducted in agreement with national regulations on privacy and data collection and treatment. Informed consent was obtained from individuals who participated in the study described in this article that the information collected through their data may be used for scientific purposes and published.

‎View this figure

Results

Overall, 31,236 individuals registered and completed at least one symptoms questionnaire during the influenza season of 2011-2012, of whom 28,644 were aged between 15 and 70 years old, thereby comprising the sample in this study. Among these, there was a total of 26,662 enrolled participants, according to the definition above. The sociodemographic characteristics of enrolled participants are shown in Figure 2 (gender, age, education level, household composition, smoking, presence of a chronic condition, and vaccination status).

For each country, the numbers of enrolled participants and follow-up respondents are shown in Table 1. After the complete-subject exclusion of individuals with missing records, the final sample on which the multilevel regression was performed was 22,968 enrolled individuals who provided information for all the variables (86.15% of all enrolled participants, 22,968/26,662).

The proportion of respondent participants varies between 43% and 79% across the national platforms. The Dutch cohort represents almost half of the entire Influenzanet cohort (46.97%, 12,524/26,662), while the sample sizes of the others studies range between 1152 (Portugal) and 3834 (Belgium) individuals.

For comparison, we report in Table 2 the information regarding Internet access in each country (ie, the fraction of Internet users with respect to the general population).

A P value of <.001 associated with the likelihood-ratio test allows us to reject the null hypothesis that the between-cluster (ie, between country) variance is 0, thus confirming that a multilevel analysis is required. The results of the multilevel analysis are shown in Table 3.

The multilevel results show that men and women do not differ significantly in terms of follow- up participation. Holding a university degree, non-smoking behavior, having received an influenza vaccination, and increased age are associated with a higher participation in follow-up. Presence of a chronic health condition and living with children are associated with lower participation in follow-up.

We performed a separate analysis for each country by calculating both the crude and adjusted odds ratio for being a follow-up participant using the same variables that were used for the random effects multilevel analysis. Results are shown in Figure 3.

The adjusted results in Figure 3 (and Table 4 in Multimedia Appendix 2) indicate that for all the “n” countries where a significant association was obtained, participation at follow-up was positively associated with being: non-smoker (n=7 countries), older than 60 years (n=5), vaccinated against seasonal influenza (n=4), not having a chronic condition (n=3), having a university degree (vs secondary/high school, n=3; or vs having no formal education, n=2), and being female in the United Kingdom, while being male in France.

To assess the suitability of our definitions of enrollment and participation in follow-up, and to test the possible sensitivity of the results to the details of the definitions, we tested a slightly stricter definition for enrollment and follow-up participation, requiring one additional symptoms questionnaire for “enrollment”, and shifting the time window for “follow-up participation” to 45 to 75 days (instead of 30 to 60 days) after the first symptoms questionnaire. Similar conclusions were obtained for the determinants of follow-up participation when using the stricter definition for enrollment and follow-up participation (results not shown).

‎View this figure

‎View this figure

Discussion

Principal Findings

The first year of Influenzanet data collection took place in seven European countries and saw the participation of tens of thousands of individuals among the general population. Given the opportunistic enrollment of self-selected volunteers in the Influenzanet study, it is important to investigate how sociodemographic and behavioral characteristics may be associated with follow-up participation in the Influenzanet cohort.

The study described in this paper shows that, overall, the most important determinants of participation are related to education and lifestyle: smoking (odds ratio [OR] 0.64, 95% CI 0.59-0.70), lower education level (OR ranging from 0.70 to 0.80 depending on the educational level compared with people holding a university degree), and younger age (OR ranging from 0.30 to 0.70 with an increasing trend in participation with older age) are associated with a lower rate of follow-up participation. People living with children participate in follow-up less than people living alone or in a household consisting only of adults (OR 0.66, 95% CI 0.65-0.74); people who have not been vaccinated against seasonal influenza tend to have a lower participation in follow-up with an associated (OR 0.77, 95% CI 0.72-0.84). We speculate that even though individuals living with children are at greater risk of being infected with ILI and so might be expected to be more motivated to report their health status, the demands of parental care mean that voluntary participation in follow-up could be affected by lack of time. The fact that individuals who chose to be vaccinated are more likely to be follow-up respondents could be because individuals who get the vaccine might also be individuals more concerned about their personal health and thus more likely to be involved in follow-up throughout the influenza season. Finally, males and females do not have significantly different follow-up participation behavior (OR 1.01, 95% CI 0.95-1.08).

Despite the cross-country variation, the main findings are similar in the different national cohorts, and indeed the results are found to be valid also when performing a single-country analysis. Differences between countries do not seem to play a crucial role in determining the factors associated with involvement in follow-up. The results of the multilevel analysis performed on the Influenzanet cohort as a whole indicates, as expected, that the results regarding smoking, education, and age are similar to what can be found in the literature for traditional non−Internet-based epidemiological studies [21-23] (ie, people who smoke, who are younger, and who have a lower educational level are more likely to have a lower participation in follow-up). This suggests that the self-selection of volunteers through an Internet-based system does not introduce different motivations or determinants for follow-up participation in a study with respect to traditional non−Internet-based epidemiological studies.

The overall percentage of follow-up responders for the different countries varies between 43% and 79%. The platforms running longer (the Netherlands, Belgium, and Portugal) tend to have higher proportions of follow-up responders, suggesting that the participation behavior of Influenzanet users may change over the years as they are more likely to become regular respondents the longer they are involved in the project. It is also worth mentioning that longer-standing systems may well be better able to keep people engaged, due to lessons learned about what works and what does not. Moreover, participants who continue to participate over several years are also more motivated to participate than those who drop out. In our sample, we did not distinguish between users who registered during the 2011-12 season and users from previous seasons but future work could investigate whether this explains the differences between countries. These differences could be also due to different levels of Internet penetration. The large differences in the proportion of Internet users among the general population, as shown in Table 2, can be an index of different cultural attitudes in the various countries leading to differing attitudes to participation. Further analysis might also consider the level of engagement, defining the outcome as the proportion of symptoms questionnaires completed out of the maximum possible number of questionnaires that could have been completed since registration, instead of the dichotomous definition of follow-up participation explored in the present analysis. Future work could also investigate whether the determinants associated with participation over several seasons are the same as the determinants identified in the present study.

Conclusions

Previous studies compared the self-selected sample of Influenzanet users in a single country with the general population [8,11] and it was found that individuals recruited by the platforms are neither demographically nor geographically representative [8]. In this work, we focused on the cohort of enrolled participants from the seven countries during the 2011-12 season as a whole but we did not attempt to make comparisons with the general population. Rather, this is one of the first attempts to describe the determinants of follow-up participation in an Internet-based multi-country cohort study assessing the impact of demographic and behavioral characteristics on follow-up participation.

This study has thus provided information that will help investigators improve the planning of studies for future Internet-based surveillance and to guide enrollment and retention strategies aimed not only at enlarging the samples with motivated participants but also to enhance control over potential biases introduced by differences in follow-up behavior among participants. Our findings can additionally be used to inform the design of engagement campaigns strategically targeted at less self-motivated people to promote their participation and thereby further enhance these surveillance systems by minimizing the selection bias.