Original Paper
Abstract
Background: Web-based alcohol interventions are a promising way to reduce alcohol consumption because of their anonymity and the possibility of reaching a high numbers of individuals including heavy drinkers. However, Web-based interventions are often characterized by high rates of attrition. To date, very few studies have investigated whether individuals with higher alcohol consumption show higher attrition rates in Web-based alcohol interventions as compared with individuals with lower alcohol consumption.
Objectives: The aim of this study was to examine the attrition rate and predictors of attrition in a Web-based intervention study on alcohol consumption.
Methods: The analysis of the predictors of attrition rate was performed on data collected in a Web-based randomized control trial. Data collection took place at the University of Konstanz, Germany. A total of 898 people, which consisted of 46.8% males (420/898) and 53.2% females (478/898) with a mean age of 23.57 years (SD 5.19), initially volunteered to participate in a Web-based intervention study to reduce alcohol consumption. Out of the sample, 86.9% (781/898) were students. Participants were classified as non-completers (439/898, 48.9%) if they did not complete the Web-based intervention. Potential predictors of attrition were self-reported: alcohol consumption in the last seven days, per week, from Monday to Thursday, on weekends, excessive drinking behavior measured with the Alcohol Use Disorder Identification Test (AUDIT), and drinking motives measured by the Drinking Motive Questionnaire (DMQ-R SF).
Results: Significant differences between completers and non-completers emerged regarding alcohol consumption in the last seven days (B=−.02, P=.05, 95% CI [0.97-1.00]), on weekends (B=−.05, P=.003, 95% CI [0.92-0.98]), the AUDIT (B=−.06, P=.007, 95% CI [0.90-0.98], and the status as a student (B=.72, P=.001, 95% CI [1.35-3.11]). Most importantly, non-completers had a significantly higher alcohol consumption compared with completers.
Conclusions: Hazardous alcohol consumption appears to be a key factor of the dropout rate in a Web-based alcohol intervention study. Thus, it is important to develop strategies to keep participants who are at high risk in Web-based interventions.
doi:10.2196/jmir.6780
Keywords
Introduction
Background
According to the World Health Organization, hazardous alcohol consumption is one of the world’s leading health risks [
]. A common definition of hazardous drinking is the consumption of at least 4 (for girls or women) or 5 (for boys or men) standard glasses of alcohol (eg, 0.3 liter beer, 0.2 liter wine, or 0.04 liter spirits) on a single occasion [ ]. Hazardous alcohol consumption is most common among young people [ ]. For example, in Germany, young people aged 18 to 29 (1790/7649, 23.40%) are most likely to engage in hazardous drinking compared with other age groups [ ]. Long-term consequences of hazardous consumption include increased risk of developing diseases such as breast cancer, coronary heart disease, and liver cirrhosis [ ]. Short-term consequences of hazardous consumption include poor educational attainment and involvement in other health risk behaviors such as riding with a driver who had been drinking, using illicit drugs, and unplanned and unsafe sexual behavior [ , ]. Against the background of such health consequences, the question of why young people consume alcoholic beverages arises. According to the Motivational Model of Alcohol Use [ ] 2 dimensions are relevant to classify the motivation to drink alcohol: the valence (positive or negative) and the source (internal or external) of the outcomes individuals expect to achieve from drinking alcohol. On the basis of these 2 dimensions, 4 classes of drinking motives are generated: social motives (eg, drinking to enjoy social gatherings), enhancement motives (eg, drinking to have fun), coping motives (eg, drinking to handle worries or personal problems), and conformity motives (eg, drinking to be part of the group). Among hazardous drinkers, social motives seem to be more important relative to the other motives [ ].Due to the high health risks of alcohol consumption and the high consumption among young individuals, alcohol intervention programs in young people are of key importance. Due to the increased use of the Internet by adolescents and young adults, digital media may be an effective strategy for reaching out to young people [
, ]. Furthermore, online delivery offers a cost-effective and an easy way to deliver alcohol intervention to a large number of people [ ]. Web-based interventions can be as effective as traditional face-to-face interventions at reducing alcohol consumption [ , ] with the advantages of higher availability, greater convenience, and greater anonymity [ , ] when compared with the more traditional modes of delivery.A serious concern with Web-based delivery of interventions is the potentially high rates of attrition. According to Postel, de Haan, ter Huurne, van der Palen, Becker, and Jong [
] attrition rates of Web-based alcohol interventions can be up to 92% whereas face-to-face interventions show premature termination rates of around 50% [ ].Many different reasons for attrition in Web-based intervention studies have been previously reported. Technical reasons include visual appeal, the complexity of the visual presentation, or the number of questions [
]. Other reasons include low material incentives [ , ], asking for personal information [ ], non-familiarity with the Internet [ , - ], or low interest and motivation to take part [ ]. A further aspect comprises the access to guidance support (eg, via messages) instead of a self-help Web-based intervention. As shown, attrition rates are higher in Web-based intervention studies without guidance from a professional compared with Web-based studies with a counselor [ , ]. Regarding socio-demographic characteristics, evidences exist that men are more likely to be non-completers than women (eg, [ , ]) and that attrition rates are lower among participants with a lower or middle educational level compared with highly educated participants [ ].A key factor that may cause attrition is engaging in the behaviour that is the focus of the intervention [
, ]. For example, Bewick, Trusler, Mulhern, Barkham, and Hill [ ] reported that among participants in their online alcohol intervention, those who completed the study reported lower alcohol consumption at baseline compared with participants who did not complete the study. Similar patterns were found in other studies (eg, [ , ]). These results support our proposition that heavier drinkers are less likely to remain in alcohol interventions [ ].Attrition threatens the internal and external validity of any intervention [
]. A key consequence of a high attrition rate among individuals at high risk is that they are unlikely to benefit from the intervention. A further key consequence of retaining people at lower risk is that intervention results, and interpretation thereof, are likely to be highly biased [ ].The Study
Few studies to date have provided detailed analyses of attrition rates and possible reasons [
, ], and to the best of our knowledge, there are only a few studies investigating systematic attrition in Web-based alcohol interventions (eg, [ , ]) despite a high need [ ]. In line with previous research [ - ] we expect that non-completers will report consuming more alcohol than completers. Relatedly, as it has been shown that hazardous drinkers report drinking for social motives more than other motives, we also expect that non-completers will be more likely to report drinking for social motives versus completers. Finally, in previous alcohol intervention studies [ , ], men were more likely to dropout than women. The current study tests the following hypotheses (H):- Non-completers will have a higher level of alcohol consumption compared with completers.
- Non-completers will report higher social motives compared with completers.
- Non-completers will be more likely to be men.
Methods
Participants
Participants were recruited in Germany via the University of Konstanz student email list, flyers, posters on campus notice boards, and via social media networks (eg, Facebook). The study was advertised as a study about individual alcohol consumption habits to recruit participants who consume alcoholic beverages. The study took place during an exam free period of the semester (May and June 2012). Overall, N=1343 people clicked on the link to the online questionnaire (see
). Of those, n=209 had to be excluded because they reported that they had not consumed any alcohol in the last 12 months. In addition, n=236 were excluded as they completed less than 5% (3/53) of the questionnaire. Although one could argue that this is also a form of attrition, it was not possible to include these participants in the analyses due to too many missing values to analyze the differences between completers and non-completers. Thus, the baseline sample consisted of n=898 participants out of which 46.8% (420/898) were male and 53.2% (478/898) were female with a mean age of 23.57 years (SD 5.19). Out of the total sample, 86.9% (781/989) were students whereas the others were employees or freelancers, PhD students, school children, or interns. Women and men reported high alcohol consumption rates per week (women: mean=5.74, SD 5.01; men: mean=12.33, SD 10.93) and high alcohol consumption rates within the last seven days (women: mean=7.92, SD 7.81; men: mean=16.28, SD 15.28); this indicated hazardous alcohol consumption according to the German national drinking guidelines [ ].As an incentive to encourage participation, 10 Amazon gift cards worth 20 Euros were raffled among participants who completed all three points of measurement. Students received no credits for taking part in the study. All individuals participated voluntarily, gave informed consent, and were treated in accordance with the ethical standards of the Declaration of Helsinki [
]. This implied that the confidentiality and privacy of all participants was assured all the time. Only the main investigator had access to personal information like the e-mail address. Personal data were stored separately from data files to ensure a strictly anonymous data analysis. Furthermore, it was not possible for the participants to fill in the questionnaire twice. However, participants were able to interrupt filling out the questionnaire and return at a later time point to complete the questionnaire. All participants who did not answer the questionnaires got a reminder by email after two days.Design
This study was designed as a Web-based self-affirmation alcohol intervention study [
] to test possible moderators and mediators that may underlie the effects of self-affirmation on health behavior. The study design is only described briefly because the present analyses focus on the systematic dropout of participants from the intervention, rather than the intervention itself (for further information see [ ]). The study consisted of 3 measurement points. The first (baseline) point of measurement took place in May and June 2012. Only participants who consumed alcoholic beverages were included in the study. After one week, participants were invited by email to take part in the study (T1) and randomly assigned to the experimental or the control group of the self-affirmation intervention (adopted from [ , ]). Participants in the experimental condition had to choose one of their most important values from a list of several values (eg, reliability) and to write down why this value is important to them. In the control condition, participants were instructed to write about their least important value from the listed values and why it might be important to another person. After this intervention task, all participants had to read health messages about alcohol consumption. This information included a description of short-term and long-term health risks of heavy alcohol consumption (eg, cancer), a definition of heavy drinking, and the recommended intake of alcoholic beverages. Afterwards, participants had to fill in several measures. The final follow-up (T2) took place one week later. Again, participants were invited by email to take part in the study.Measures
The following instruments were included in the online questionnaire at the baseline measurement one week prior to the intervention.
Alcohol Consumption (adapted from [
]). Alcohol consumption was assessed with 4 items. Before answering the items, participants were provided with a brief definition and examples of standard glasses of different alcoholic beverages in line with the German drinking guidelines [ ]. An example is: “One German standard drink equals 10g to 12g of pure alcohol, which equates to a small beer (250 ml), or a small glass of wine (100 ml).” The items concerning alcohol-consumption were ‘How many standard drinks do you consume per week?’ (per week), ‘Referring to the last 7 days, how many standard drinks did you consume?’ (last seven days), ‘How many standard drinks do you consume from Monday to Thursday?’ (Monday to Thursday), and ‘How many standard drinks do you consume from Friday to Sunday?’ (on weekends).The Alcohol Use Disorders Identification Test (AUDIT, [
]) measures excessive drinking behavior. The 10-item questionnaire screens for harmful alcohol use. An item example is, ‘How often do you have six or more drinks on one occasion?’ A sum score of eight or above refers to hazardous alcohol consumption, a score between 16 and 19 refers to harmful alcohol consumption, and a score higher than 20 indicates a possible alcohol dependence. Cronbach alpha of the scale was equal to .83.The Drinking Motive Questionnaire Revised Short Form (DMQ-R SF, [
]) measures 4 different motives to drink alcohol. The social (Cronbach alpha =.84), enhancement (Cronbach alpha=.76), coping (Cronbach alpha=.86), and conformity (Cronbach alpha=.79) motive dimensions were assessed with three items each. The 5-point Likert-scale ranges from 1 = (almost) never to 5 = (almost) always. The stem for each item was ‘I have drunk alcohol in the past 12 months’ followed by different item options, for example, ‘...in order to be liked’. Cronbach alpha for the overall scale was equal to .83.Data Analysis
All analyses were run using SPSS version 20 (IBM, Somers, NY, USA) to test the hypotheses. In a first step, t tests and Chi-square tests (threshold for statistical significance P<.05) were conducted to reveal group differences concerning alcohol consumption, excessive drinking behavior (AUDIT), drinking motives (DMQ-R SF), and socio-demographics like gender, age, and student status. After the detection of differences between completers and non-completers, the relationship between dropout classification and possible predictors was tested with logistic regressions in a second step. Logistic regression analyses were performed with completion of the Web-based self-affirmation intervention as the dependent variable. Predictor variables showing a significant association with dropout (based on correlations) were entered into the model, whereas non-significant variables were removed. In addition, it was decided to include only one variable regarding alcohol consumption in the model to avoid multicollinearity as the variables correlated to a high degree. Thus, 4 models were calculated. The goodness of fit of the models was evaluated by the Hosmer-Lemeshow test, which needs to be non-significant.
Results
Overall, the baseline sample consisted of n=898 participants. Of these, 293 participants did not participate at T1 (early dropouts). A further n=146 participants who began completing the online questionnaire at T1 dropped out (ie, completed less than 5% data of the questionnaire) before being allocated to one of the experimental conditions (late dropouts; see
).Overall, no significant differences were found between the early and late dropouts regarding most of the measures. The only two significant differences were found regarding the AUDIT score and the amount of alcohol consumption on weekends. Early dropouts reported significantly higher AUDIT scores compared with the late dropouts (mean=9.60 vs mean=8.47; t317.76=2.19, P=.03, d=0.21, 95% CI [0.12-2.13]) as well as higher alcohol consumption on weekends (mean=8.37 vs mean=6.90; t335.46=2.16, P=.03, d=0.21, 95% CI [0.13-2.82]). On the basis of these few differences and the fact that the results of the logistic regression revealed an almost identical pattern of results when running the analyses separately for early and late dropouts, it was decided not to further distinguish between both groups in the following analyses. Overall, the dropout rate from baseline to the randomized allocation to the intervention at T1 was 48.9% (439/898). At T2, a further n=28 dropped out. However, those non-completers did not differ significantly from the completers regarding all measures, except for the sub-dimension coping motives of the DMQ-R SF (mean=2.08 vs mean=1.59; t457=−3.44, P=.001, d=0.67, 95% CI [−0.77 to −0.21]).
and present the descriptive statistics for completers (n=459) and non-completers (n=439). Significant differences between completers and non-completers were found regarding alcohol consumption, AUDIT score, coping, enhancement and social drinking motives, gender, and student status. Non-completers showed a significantly higher alcohol consumption per week, from Monday to Thursday, on weekends and in the last seven days. In addition, non-completers reported significantly higher AUDIT scores and higher mean values regarding social, enhancement, and coping motives for drinking alcohol compared with completers. Furthermore, women and students were more likely to be completers compared with men and non-students. No significant differences between completers and non-completers were found for age, or the conformity motive.
Sample characteristics | Attrition | |||||||||
Completers N=459 | Non-completers N=439 | All | All | |||||||
Mean | SD | Mean | SD | T | P | 95% CI | Cohen d | |||
Alcohol consumption (standard drinks) | ||||||||||
per week (range 0-70) | 7.20 | 6.85 | 10.60 | 10.50 | −5.71 | <.001 | −4.56 to −2.23 | .39 | ||
Monday to Thursday (range 0-40) | 2.60 | 3.58 | 3.96 | 5.37 | −4.45 | <.001 | −1.96 to −0.76 | .30 | ||
Weekends (range 0-45) | 5.18 | 4.76 | 7.88 | 7.15 | −6.63 | <.001 | −3.50 to −1.90 | .45 | ||
last seven days (range 0-95) | 9.65 | 9.54 | 14.17 | 14.83 | −5.41 | <.001 | −6.16 to −2.88 | .36 | ||
AUDITa (range 0-27) | 7.19 | 4.20 | 9.22 | 5.27 | −6.35 | <.001 | −2.65 to −1.40 | .43 | ||
Drinking motives (range 1-5) | ||||||||||
social motives | 3.15 | .92 | 3.30 | .98 | −2.33 | .02 | −0.27 to −0.02 | .13 | ||
enhancement motives | 2.88 | .92 | 3.08 | .98 | −3.22 | .001 | −0.32 to −0.08 | .21 | ||
coping motives | 1.62 | .74 | 1.78 | .85 | −2.98 | .003 | −0.26 to −0.05 | .20 | ||
conformity motives | 1.33 | .57 | 1.35 | .61 | −.55 | .58 | −0.10 to 0.06 | - | ||
Age (range 16-67) | 23.51 | 5.17 | 23.63 | 5.22 | −.33 | .74 | −0.80 to 0.57 | - |
aAUDIT: Alcohol Use Disorders Identification Test.
Sample characteristics | Attrition | ||||||
Completers N=459 | Non-completers N=439 | ||||||
N | % | N | % | χ2 | P | ||
Female | 269 | 58.6 | 208 | 47.6 | 10.90 | .001 | |
Student | 416 | 90.6 | 360 | 82.0 | 12.61 | <.001 |
Completers | ||||||||||||
Non-Completers | 1a | 2b | 3c | 4d | 5e | 6f | 7g | 8h | 9i | 10j | 11k | 12l |
1a | - | .82 <.001 | .86 <.001 | .74 <.001 | .71 <.001 | .23 <.001 | .28 <.001 | .21 <.001 | .08 .071 | −.03 .57 | .34 <.001 | .02 .75 |
2b | .83 <.001 | - | .57 <.001 | .59 <.001 | .57 <.001 | .13 .004 | .19 <.001 | .21 <.001 | .06 .19 | .00 .99 | .26 <.001 | .04 .37 |
3c | .87 <.001 | .63 <.001 | - | .71 <.001 | .68 <.001 | .24 <.001 | .28 <.001 | .16 .001 | .04 .35 | −.06 .24 | .29 <.001 | −.01 .91 |
4d | .80 <.001 | .66 <.001 | .73 <.001 | - | .61 <.001 | .26 <.001 | .26 <.001 | .16 <.001 | .05 .31 | −.03 .51 | .29 <.001 | .01 .82 |
5e | .61 <.001 | .47 <.001 | .61 <.001 | .56 <.001 | - | .43 <.001 | .39 <.001 | .36 <.001 | .09 .06 | −.12 .009 | .33 <.001 | .04 .35 |
6f | .25 <.001 | .18 <.001 | .29 <.001 | .21 <.001 | .48 <.001 | - | .57 <.001 | .16 .001 | .25 <.001 | −.25 <.001 | .18 <.001 | .13 .006 |
7g | .31 <.001 | .24 <.001 | .36 <.001 | .26 <.001 | .47 <.001 | .63 <.001 | - | .23 <.001 | .21 <.001 | −.11 .02 | .12 .01 | .07 .16 |
8h | .14 .004 | .11 .02 | .17 <.001 | .14 .003 | .41 <.001 | .27 <.001 | .31 <.001 | - | .13 .006 | −.01 .94 | −.07 .13 | −.03 .49 |
9i | .03 52 | .02 .70 | .03 .50 | .02 .70 | .26 <.001 | .36 <.001 | .28 <.001 | .20 <.001 | - | −.09 .07 | .07 .17 | .07 .12 |
10j | .02 .65 | .05 .28 | −.02 .69 | .01 .83 | −.09 .06 | −.29 <.001 | −.11 .02 | .01 .84 | −.02 .69 | - | −.05 .34 | −.51 <.001 |
11k | .38 <.001 | .25 <.001 | .32 <.001 | .35 <.001 | .34 <.001 | .13 .008 | .08 .10 | −.06 .20 | .08 .09 | .03 .58 | - | −.05 .30 |
12l | −.02 .74 | .05 .26 | −.06 .19 | −.01 .97 | .02 .69 | .16 .001 | .03 .56 | −.04 .44 | .01 .78 | −.46 <.001 | −.10 .04 | - |
aAlcohol consumption per week.
bAlcohol consumption Monday-Tuesday.
cAlcohol consumption weekends.
dAlcohol consumption last seven days.
eAlcohol Use Disorders Identification Test (AUDIT).
fSocial drinking motives.
gEnhancement drinking motives.
hCoping drinking motives.
iConformity drinking motives.
jAge.
kGender; 1=male, 0=female.
lStudent; 1=student, 0=non-student.
In
the intercorrelations separated by completers and non-completers are presented. As evident, the intercorrelations among the great majority of the study variables are similar across completers and non-completers. Overall, completion of the study was significantly negatively related with all 4 alcohol consumption measures (r=−.15 to −.22, P<.001), the AUDIT score (r =−.21, P<.001), all drinking motives except for conformity drinking motives (r =−.08 to r =−.11, P=.001 to .02), gender (r =−.11, P=.001), and status as a student (r =−.12, P<.001).Four multivariate logistic regression analyses were performed to predict the completion of Web-based alcohol intervention using the variables outlined above. Results across the 4 analyses revealed that alcohol consumption on weekends and in the last seven days, the AUDIT score, and being a student predicted completion of the study (see
). The higher the alcohol consumption on weekends and in the last seven days as well as the AUDIT score, the more likely an individual was to be a non-completer. Students were more likely to complete the study than non-students. All other variables included in the model did not significantly predict study completion. Overall, the regression models showed sufficient goodness of fit.Scale | B | SE | P | Odds ratio | 95% CI for odds ratio | |||
Constant Model 1 | .30 | .33 | .36 | 1.35 | ||||
Alcohol consumption (standard drinks) | ||||||||
per week | −.02 | .01 | .08 | .98 | 0.96-1.00 | |||
AUDITb | −.06 | .02 | .02 | .95 | 0.90-0.99 | |||
Drinking motives | ||||||||
social motives | .03 | .10 | .75 | 1.03 | 0.85-1.25 | |||
enhancement motives | −.06 | .09 | .55 | .95 | 0.79-1.14 | |||
coping motives | −.07 | .10 | .46 | .93 | 0.77-1.13 | |||
Genderc | −.11 | .15 | .48 | .90 | 0.66-1.21 | |||
Studentd | .72 | .21 | .001 | 2.04 | 1.35-3.11 | |||
R2=.06 (Cox & Snell), .08 (Nagelkerke). Model Model χ28=5.05, P=.75. Correct classification 60.7%. | ||||||||
Constant Model 2 | .28 | .33 | .38 | 1.33 | ||||
Alcohol consumption (standard drinks) | ||||||||
Monday to Thursday | −.03 | .02 | .18 | .97 | 0.94-1.01 | |||
AUDITb | −.07 | .02 | .002 | .94 | 0.90-0.98 | |||
Drinking motives | ||||||||
social motives | .04 | .10 | .69 | 1.04 | 0.86-1.26 | |||
enhancement motives | −.07 | .09 | .49 | .94 | 0.78-1.13 | |||
coping motives | −.06 | .10 | .52 | .94 | 0.78-1.14 | |||
Genderc | −.14 | .15 | .36 | .87 | 0.65-1.17 | |||
Studentd | .73 | .21 | .001 | 2.08 | 1.34-3.15 | |||
R2=.06 (Cox & Snell), .08 (Nagelkerke). Model χ28=4.36, P=.82. Correct classification 51.3%. | ||||||||
Constant Model 3 | .33 | .33 | .31 | 1.39 | ||||
Alcohol consumption (standard drinks) | ||||||||
Weekends | −.05 | .02 | .003 | .95 | 0.92-0.98 | |||
AUDITb | −.04 | .02 | .08 | .96 | 0.92-1.0 | |||
Drinking motives | ||||||||
social motives | .03 | .10 | .75 | 1.03 | 0.85-1.25 | |||
enhancement motives | −.04 | .10 | .67 | .96 | 0.80-1.16 | |||
coping motives | −.08 | .10 | .38 | .92 | 0.76-1.11 | |||
Genderc | −.11 | .15 | .46 | .89 | 0.66-1.21 | |||
Studentd | .68 | .22 | .002 | 1.97 | 1.29-2.99 | |||
R2=.07 (Cox & Snell), .09 (Nagelkerke). Model χ28=8.69, P=.37. Correct classification 61.0%. | ||||||||
Constant Model 4 | .30 | .33 | .36 | 1.35 | ||||
Alcohol consumption (standard drinks) | ||||||||
last seven days | −.02 | .01 | .05 | .99 | 0.97-1.00 | |||
AUDITb | −.06 | .02 | .007 | .94 | 0.90-0.98 | |||
Drinking motives | ||||||||
social motives | .04 | .10 | .68 | 1.04 | 0.86-1.26 | |||
enhancement motives | −.06 | .09 | .52 | .94 | 0.78-1.13 | |||
coping motives | −.07 | .10 | .47 | .93 | 0.77-1.13 | |||
Genderc | −.11 | .15 | .46 | .89 | 0.66-1.21 | |||
Studentd | .72 | .21 | .001 | 2.05 | 1.35-3.11 | |||
R2=.06 (Cox & Snell), .08 (Nagelkerke). Model χ28=4.65, P=.80. Correct classification 60.3%. |
aCompletion: 0=non-completers, 1=completers.
bAUDIT: Alcohol Use Disorders Identification Test.
cGender: 1=male, 0=female.
dStudent: 1=student, 0=non-student.
Discussion
Principal Findings
This study found that individuals who reported higher alcohol consumption on weekends and in the last seven days were less likely to complete a Web-based alcohol intervention over and above other predictors, providing support for Hypothesis 1. In addition, higher likelihood of problematic alcohol consumption as indicated by higher AUDIT scores positively predicted the dropout rate over and above other predictors. In line with our Hypotheses 2 and 3, non-completers reported higher levels of social drinking motives compared with completers, and men were more likely to dropout compared with women. However, social drinking motives and gender did not predict completion of the study over and above other predictors, so Hypotheses 2 and 3 have to be rejected. However, we found that students were more likely to complete a Web-based alcohol intervention than non-students.
As assumed in Hypothesis 1, non-completers showed higher levels of alcohol consumption compared with completers. There are several explanations for the higher attrition rate among individuals with higher alcohol consumption and higher AUDIT scores. Participants with higher alcohol consumption and AUDIT scores may have responded with defensive reactivity [
] when confronted with the definition of a standard drink and further information about acceptable and excessive alcohol consumption, which could have led to dissatisfaction with the study in general or the intervention in particular and consequently to a dropout (see also [ ]). Another explanation for early termination of the study could be the experience of cognitive dissonance [ ] in individuals with higher alcohol consumption and AUDIT scores when learning about the German drinking guidelines and evaluating their drinking against these guidelines. Early termination of study participation could have been one way to resolve their cognitive dissonance. In line with this, participants might also have terminated the intervention as they might have recognized that a reduction of their level of alcohol consumption is not realistic. However, all these explanations remain speculative and can account only in some parts for the finding of a higher attrition rate among individuals with a high alcohol consumption. Therefore and because only very few studies exist that examined reasons for dropout [ ], future research should examine in more detail why individuals at risk (especially regarding alcohol consumption) have higher attrition rates.However, some differences emerged regarding the different measures of alcohol consumption included in this study. Despite significant mean differences between completers and non-completers concerning alcohol consumption per week as well as the alcohol consumption from Monday to Thursday, these two alcohol measures did not significantly contribute to the prediction of the dropout rate in the regression analyses in comparison to other predictors. This provides an important information on the characteristics of a group that might be especially hard to reach: this study’s results indicate that it might be especially important to address interventions in young adults engaging in excessive weekend drinking [
]. These results also emphasize the importance of assessing more than a single indicator of alcohol consumption as was done in this study. This is of high importance especially for heavy alcohol drinkers or alcohol abusers. Several explanations have been offered why those individuals tend to underreport their alcohol consumption. Other than forgetting, the way how alcohol consumption was measured might also lead to biased self-reports [ ]. To resolve such problems with self-reports, Sobell and Sobell [ ] recommend including a minimum set of essential items, such as, usual quantity of drinking. In addition, future studies might also want to complement self-reported alcohol consumption with objective measures such as blood alcohol concentration, the enzymes gamma glutamyl transpeptidase (gamma-GTP), glutamic-oxaloacetic transaminase (GOT), or glutamic-pyruvic transaminase (GPT) [ , ]. However, objective measurements are not suitable for all alcohol-related studies like Web-based surveys or interventions like in this study. The reason is that an objective measurement of alcohol consumption requires a face-to-face contact with participants. In addition, there are also shortcomings of objective measurements. For example, the measurement of gamma-GTP does not guarantee to be a sole indicator of excessive alcohol consumption as an increased serum gamma-GTP activity is also associated with overweight [ ]. The same problem of the causal relationship applies to the assessment of the GOT and GPT levels. These objective measures provide information about the severity of the liver disease, which might be a consequence of excessive alcohol consumption [ ].Contrary to Hypothesis 2 drinking motives were not significant predictors of study completion in contrast to other predictors like alcohol consumption as revealed by logistic regression analyses. However, significant mean differences between completers and non-completers emerged regarding drinking motives. As expected, non-completers reported higher social drinking motives compared with completers. In addition, coping and enhancement drinking motives were higher among non-completers [
, ], whereas there was no difference regarding conformity motives. As non-completers in this study are characterised as individuals with high alcohol consumption, this result is in line with research showing that conformity motives are generally not related to alcohol consumption (eg, [ ]). Concerning Hypothesis 3, it was found that more men than women dropped out in the current study. This is in line with the result that men reported higher alcohol consumption compared with women as also found in other studies [ , ]. However, as gender did not emerge as a significant predictor in the logistic regression analysis, it appears that alcohol consumption is a more important factor for attrition than gender.An additional predictor of completing the study was student status. Students were more likely to complete the study as compared with non-students. This result is in contrast to previous research, which did not find a difference regarding the level of education and attrition in Web-based studies [
, ]. However, previous studies also reported that individuals with higher education and higher socioeconomic status are more likely to take part in psychological surveys and interventions (eg, [ , ]). Thus, further research is recommended to focus on the socioeconomic status and the level of education as a predictor of completion of a Web-based intervention; as alcohol-related harms are more likely in individuals with lower educational attainment and or lower socioeconomic status this is a key issue to resolve. Furthermore, it might also be the case that students are more familiar with the participation in Web-based studies. The reason for that might be that numerous studies, lecture evaluations, or surveys via Internet take place at the University of Konstanz. This might enhance the probability that students have lower attrition rates in contrast to non-students. In addition, it might also be the case, that students are more willing to spend time filling out further questionnaires compared with non-students as non-students might be less flexible due to a more stringent working schedule. Furthermore, it might be possible that amazon vouchers that were raffled among participants were more attractive for students due to a tight budget compared with non-students.Limitations
This study is not without limitations. First, all the information was derived from self-reports, which might cause a bias due to social desirability and memory effects like forgetting [
, ]. Therefore, future research is recommended to use objective measurements (eg, breathalyzer for estimating blood alcohol concentration, see discussion above) although self-reported alcohol consumption has been shown to be reliable and valid [ , ]. However, the validity and reliability depends upon the accurate measure of alcohol consumption. Therefore, standardized alcohol consumption measures should be used. In this study one of the 4 alcohol measures (AUDIT) was a standardized one. Nonetheless, the other measures included in this study followed Sobell and Sobell`s recommendations how to best measure alcohol consumption [ ].A second limitation of the study is that the sample consisted mainly of students (781/898, 86.4%). As outlined above, a greater heterogeneity in socioeconomic status would be desirable to learn more about the characteristics of people at most risk for hazardous alcohol consumption. However, as alcohol consumption in students is a problem per se [
, , , ], this study is nonetheless able to make a significant contribution to the identification of risk factors for attrition of alcohol-intervention studies.Conclusions
Reducing attrition is essential for any intervention. Usually, interventions are designed to reach people who are at the most risk. Unfortunately, as shown by this study, individuals with higher alcohol consumption were more likely to dropout before or at the beginning of the intervention. Thus, it is important to develop and test different strategies to keep participants who are at high risk in Web-based interventions. Only after taking this into account can the effectiveness of Web-based interventions for individuals at high risk be evaluated correctly.
Acknowledgments
We would like to thank all students who worked on this project for their assistance in recruiting participants.
Conflicts of Interest
None declared.
References
- WHO. Global status report on alcohol and health. Geneva, Switzerland: WHO Press; 2014.
- Stolle M, Sack P, Thomasius R. Binge drinking in childhood and adolescence: epidemiology, consequences, and interventions. Dtsch Arztebl Int 2009 May;106(19):323-328 [FREE Full text] [CrossRef] [Medline]
- Hapke U, V der Lippe E, Gaertner B. [Alcohol consumption, at-risk and heavy episodic drinking with consideration of injuries and alcohol-specific medical advice: results of the German Health Interview and Examination Survey for Adults (DEGS1)]. Bundesgesundheitsblatt Gesundheitsforschung Gesundheitsschutz 2013 May;56(5-6):809-813. [CrossRef] [Medline]
- Miller JW, Naimi TS, Brewer RD, Jones SE. Binge drinking and associated health risk behaviors among high school students. Pediatrics 2007 Jan;119(1):76-85 [FREE Full text] [CrossRef] [Medline]
- Townshend JM, Kambouropoulos N, Griffin A, Hunt FJ, Milani RM. Binge drinking, reflection impulsivity, and unplanned sexual behavior: impaired decision-making in young social drinkers. Alcohol Clin Exp Res 2014 Apr;38(4):1143-1150. [CrossRef] [Medline]
- Cox W, Klinger E. A motivational model of alcohol use: determinants of use and change. In: Cox WM, Klinger E, editors. Handbook of motivational counseling: Concepts, approaches, and assessment. Chichester, UK: John Wiley & Sons; 2004:121-138.
- Van Damme J, Maes L, Clays E, Rosiers JF, Van Hal G, Hublet A. Social motives for drinking in students should not be neglected in efforts to decrease problematic drinking. Health Educ Res 2013 Mar 13;28(4):640-660. [CrossRef]
- Eysenbach G, CONSORT-EHEALTH Group. CONSORT-EHEALTH: improving and standardizing evaluation reports of web-based and mobile health interventions. J Med Internet Res 2011;13(4):e126 [FREE Full text] [CrossRef] [Medline]
- Norman CD, Yip AL. eHealth promotion and social innovation with youth: using social and visual media to engage diverse communities. Stud Health Technol Inform 2012;172:54-70. [Medline]
- White A, Kavanagh D, Stallman H, Klein B, Kay-Lambkin F, Proudfoot J, et al. Online alcohol interventions: a systematic review. J Med Internet Res 2010;12(5):e62 [FREE Full text] [CrossRef] [Medline]
- Barak A, Hen L, Boniel-Nissim M, Shapira N. A comprehensive review and a meta-analysis of the effectiveness of internet-based psychotherapeutic interventions. J Technol Hum Serv 2008 Jul 03;26(2-4):109-160. [CrossRef]
- Webb TL, Joseph J, Yardley L, Michie S. Using the internet to promote health behavior change: a systematic review and meta-analysis of the impact of theoretical basis, use of behavior change techniques, and mode of delivery on efficacy. J Med Internet Res 2010;12(1):e4 [FREE Full text] [CrossRef] [Medline]
- Murray E, Khadjesari Z, Linke S, Hunter R, Freemantle N. Health on the web: randomised trial of work-based online screening and brief intervention for hazardous and harmful drinking. BMC Public Health 2013;13:505 [FREE Full text] [CrossRef] [Medline]
- Tensil M, Jonas B, Strüber E. Two fully automated web-based interventions for risky alcohol use: randomized controlled trial. J Med Internet Res 2013;15(6):e110 [FREE Full text] [CrossRef] [Medline]
- Postel MG, de Haan HA, ter Huurne ED, van der Palen J, Becker ES, de Jong CA. Attrition in web-based treatment for problem drinkers. J Med Internet Res 2011;13(4):e117 [FREE Full text] [CrossRef] [Medline]
- de Weert-van Oene G, Burger H, Grobbee D, Schrijvers A. Identification of patients at high risk of noncompliance in substance dependence treatment. Eur Addict Res 2007 Mar 16;13(2):74-80. [CrossRef]
- Brouwer W, Oenema A, Crutzen R, de Nooijer J, de Vries N, Brug J. What makes people decide to visit and use an internet‐delivered behavior‐change intervention? Health Educ 2009 Oct 16;109(6):460-473. [CrossRef]
- Göritz A. Incentives in web studies: Methodological issues and a review. Int J Internet Sci 2006;1:58-70.
- Jander A, Crutzen R, Mercken L, De Vries H. Web-based interventions to decrease alcohol use in adolescents: a Delphi study about increasing effectiveness and reducing drop-out. BMC Public Health 2015 Apr 9;15(1):340. [CrossRef]
- O'Neil KM, Penrod SD, Bornstein BH. Web-based research: methodological variables' effects on dropout and sample characteristics. Behav Res Methods Instrum Comput 2003 May;35(2):217-226. [Medline]
- Al-Asadi AM, Klein B, Meyer D. Pretreatment attrition and formal withdrawal during treatment and their predictors: an exploratory study of the anxiety online data. J Med Internet Res 2014;16(6):e152 [FREE Full text] [CrossRef] [Medline]
- Galesic M. Dropouts on the Web. Effects of interest and burden experienced during an online survey. J Off Stat 2006;22:313-328.
- Wantland DJ, Portillo CJ, Holzemer WL, Slaughter R, McGhee EM. The effectiveness of web-based vs. non-Web-based interventions: a meta-analysis of behavioral change outcomes. J Med Internet Res 2004 Nov 10;6(4):e40 [FREE Full text] [CrossRef] [Medline]
- Coa K, Patrick H. Baseline motivation type as a predictor of dropout in a healthy eating text messaging program. JMIR Mhealth Uhealth 2016 Sep 29;4(3):e114 [FREE Full text] [CrossRef] [Medline]
- Sundström C, Gajecki M, Johansson M, Blankers M, Sinadinovic K, Stenlund-Gens E, et al. Guided and unguided internet-based treatment for problematic alcohol use - a randomized controlled pilot trial. PLoS One 2016 Jul;11(7):e0157817 [FREE Full text] [CrossRef] [Medline]
- Richards D, Richardson T. Computer-based psychological treatments for depression: a systematic review and meta-analysis. Clin Psychol Rev 2012 Jun;32(4):329-342. [CrossRef] [Medline]
- Bewick BM, West R, Gill J, O'May F, Mulhern B, Barkham M, et al. Providing web-based feedback and social norms information to reduce student alcohol intake: a multisite investigation. J Med Internet Res 2010 Dec 19;12(5):e59 [FREE Full text] [CrossRef] [Medline]
- Reinwand DA, Crutzen R, Elfeddali I, Schneider F, Schulz DN, Smit ES, et al. Impact of educational level on study attrition and evaluation of web-based computer-tailored interventions: results from seven randomized controlled trials. J Med Internet Res 2015 Oct 07;17(10):e228 [FREE Full text] [CrossRef] [Medline]
- Edwards AG, Rollnick S. Outcome studies of brief alcohol intervention in general practice: the problem of lost subjects. Addiction 1997 Dec;92(12):1699-1704. [Medline]
- Geraghty AW, Kirby S, Essery R, Little P, Bronstein A, Turner D, et al. Internet-based vestibular rehabilitation for adults aged 50 years and over: a protocol for a randomised controlled trial. BMJ Open 2014 Jul 22;4(7):e005871 [FREE Full text] [CrossRef] [Medline]
- Bewick BM, Trusler K, Mulhern B, Barkham M, Hill AJ. The feasibility and effectiveness of a web-based personalised feedback and social norms alcohol intervention in UK university students: a randomised control trial. Addict Behav 2008 Sep;33(9):1192-1198. [CrossRef] [Medline]
- Bewick BM, West RM, Barkham M, Mulhern B, Marlow R, Traviss G, et al. The effectiveness of a Web-based personalized feedback and social norms alcohol intervention on United Kingdom university students: randomized controlled trial. J Med Internet Res 2013 Jul 24;15(7):e137 [FREE Full text] [CrossRef] [Medline]
- Bingham CR, Barretto AI, Walton MA, Bryant CM, Shope JT, Raghunathan TE. Efficacy of a web-based, tailored, alcohol prevention/intervention program for college students: initial findings. J Am Coll Health 2010;58(4):349-356. [CrossRef] [Medline]
- Shadish W, Cook T, Campbell D. Experimental and quasi-experimental designs for generalized causal inference. Boston, MA: Houghton-Mifflin; 2002.
- Molenberghs G, Kenward M. Missing data in clinical studies. Chichester: Wiley; 2007.
- Crutzen R, Viechtbauer W, Spigt M, Kotz D. Differential attrition in health behaviour change trials: a systematic review and meta-analysis. Psychol Health 2015 Jan;30(1):122-134. [CrossRef] [Medline]
- Hochheimer CJ, Sabo RT, Krist AH, Day T, Cyrus J, Woolf SH. Methods for evaluating respondent attrition in web-based surveys. J Med Internet Res 2016 Nov 22;18(11):e301 [FREE Full text] [CrossRef] [Medline]
- Schulz DN, Candel MJ, Kremers SP, Reinwand DA, Jander A, de VH. Effects of a Web-based tailored intervention to reduce alcohol consumption in adults: randomized controlled trial. J Med Internet Res 2013;15(9):e206 [FREE Full text] [CrossRef] [Medline]
- Eysenbach G. The law of attrition. J Med Internet Res 2005;7(1):e11 [FREE Full text] [CrossRef] [Medline]
- World MO. Declaration of Helsinki (1964). BMJ 1996;7070:1448-1449.
- Harris PR, Napper L. Self-affirmation and the biased processing of threatening health-risk information. Pers Soc Psychol Bull 2005 Sep;31(9):1250-1263. [CrossRef] [Medline]
- Radtke T, Scholz U. Beliefs are not behavior: the distinction between compensatory health beliefs and compensatory health behavior. Zeitschrift für Gesundheitspsychologie 2016 Jul;24(3):119-129. [CrossRef]
- van Koningsbruggen GM, Harris PR, Smits AJ, Schu z B, Scholz U, Cooke R. Self-affirmation before exposure to health communications promotes intentions and health behavior change by increasing anticipated regret. Communic Res 2014 Oct 28;43(8):1027-1044. [CrossRef]
- IARD. 2016. National drinking guidelines URL: http://www.iard.org/wp-content/uploads/2016/04/Policy-Review-National-Drinking-Guidelines.pdf [accessed 2016-09-06] [WebCite Cache]
- Babor TF, Higgins-Biddle JC, Saunders JB, Monteiro MG. AUDIT: The alcohol use disorders identification test. Guidelines for use in primary care. Switzerland: World Health Organization; 2001.
- Kuntsche E, Kuntsche S. Development and validation of the drinking motive questionnaire revised short form (DMQ-R SF). J Clin Child Adolesc Psychol 2009 Nov;38(6):899-908. [CrossRef] [Medline]
- Festinger L. A Theory of Cognitive Dissonance. California: Stanford University Press; 1957.
- Postel MG, de Haan HA, ter Huurne ED, Becker ES, de Jong CA. Effectiveness of a web-based intervention for problem drinkers and reasons for dropout: randomized controlled trial. J Med Internet Res 2010 Jan;12(4):e68 [FREE Full text] [CrossRef] [Medline]
- Kuntsche E, Gmel G. Alcohol consumption in late adolescence and early adulthood--where is the problem? Swiss Med Wkly 2013 Jul 25;143:w13826. [CrossRef] [Medline]
- Sobell L, Sobell M. Alcohol consumption measures. In: Allen JP, Wilson VB, editors. Assessing alcohol problems a guide for clinicians and researchers. Bethesda, MD: National Institute on Alcohol Abuse and Alcoholism; 2003:75-101.
- Yokoyama H. [Gamma glutamyl transpeptidase (gammaGTP) in the era of metabolic syndrome]. Nihon Arukoru Yakubutsu Igakkai Zasshi 2007 Jun;42(3):110-124. [Medline]
- Cohen JA, Kaplan MM. The SGOT/SGPT ratio--an indicator of alcoholic liver disease. Dig Dis Sci 1979 Nov;24(11):835-838. [Medline]
- Atwell K, Abraham C, Duka T. A parsimonious, integrative model of key psychological correlates of UK university students' alcohol consumption. Alcohol Alcohol 2011;46(3):253-260 [FREE Full text] [CrossRef] [Medline]
- Németh Z, Urbán R, Kuntsche E, San Pedro EM, Roales NJ, Farkas J, et al. Drinking motives among Spanish and Hungarian young adults: a cross-national study. Alcohol Alcohol 2011;46(3):261-269 [FREE Full text] [CrossRef] [Medline]
- Riper H, Kramer J, Conijn B, Smit F, Schippers G, Cuijpers P. Translating effective web-based self-help for problem drinking into the real world. Alcohol Clin Exp Res 2009 Aug;33(8):1401-1408. [CrossRef] [Medline]
- Gosling SD, Vazire S, Srivastava S, John OP. Should we trust web-based studies? a comparative analysis of six preconceptions about internet questionnaires. Am Psychol 2004 Mar;59(2):93-104. [CrossRef] [Medline]
- Kraut R, Olson J, Banaji M, Bruckman A, Cohen J, Couper M. Psychological research online: report of Board of Scientific Affairs' Advisory Group on the Conduct of Research on the Internet. Am Psychol 2004;59(2):105-117. [CrossRef] [Medline]
- Davis CG, Thake J, Vilhena N. Social desirability biases in self-reported alcohol consumption and harms. Addict Behav 2010 Apr;35(4):302-311. [CrossRef] [Medline]
- Del Boca FK, Darkes J. The validity of self-reports of alcohol consumption: state of the science and challenges for research. Addiction 2003 Dec;98(Suppl 2):1-12. [Medline]
- Mitka M. College binge drinking still on the rise. JAMA 2009 Aug 26;302(8):836-837. [CrossRef] [Medline]
Abbreviations
AUDIT: Alcohol Use Disorder Identification Test |
DMQ-R SF: Drinking Motive Questionnaire Revised Short Form |
T1: Time point 1, one week after baseline |
T2: Follow-up, one week after T1 |
Edited by G Eysenbach; submitted 13.12.16; peer-reviewed by K Donoghue, J Apolinário-Hagen; comments to author 21.01.17; revised version received 14.03.17; accepted 28.03.17; published 28.06.17
Copyright©Theda Radtke, Mathias Ostergaard, Richard Cooke, Urte Scholz. Originally published in the Journal of Medical Internet Research (http://www.jmir.org), 28.06.2017.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on http://www.jmir.org/, as well as this copyright and license information must be included.