Original Paper
Abstract
Background: Individuals who gamble online may be at risk of gambling excessively, but internet gambling also provides a unique opportunity to monitor gambling behavior in real environments which may allow intervention for those who encounter difficulties.
Objective: The objective of this study was to model the early gambling trajectories of individuals who play online lottery.
Methods: Anonymized gambling‐related records of the initial 6 months of 1152 clients of the French national lottery who created their internet gambling accounts between September 2015 and February 2016 were analyzed using a two-step approach that combined growth mixture modeling and latent class analysis. The analysis was based upon behavior indicators of gambling activity (money wagered and number of gambling days) and indicators of gambling problems (breadth of involvement and chasing). Profiles were described based upon the probabilities of following the trajectories that were identified for the four indicators, and upon several covariates (age, gender, deposits, type of play, net losses, voluntary self-exclusion, and Playscan classification—a responsible gambling tool that provides each player with a risk assessment: green for low risk, orange for medium risk and red for high risk). Net losses, voluntary self-exclusion, and Playscan classification were used as external verification of problem gambling.
Results: We identified 5 distinct profiles of online lottery gambling. Classes 1 (56.8%), 2 (14.8%) and 3 (13.9%) were characterized by low to medium gambling activity and low values for markers of problem gambling. They displayed low net losses, did not use the voluntary self-exclusion measure, and were classified predominantly with green Playscan tags (range 90%-98%). Class 4 (9.7%) was characterized by medium to high gambling activity, played a higher breadth of game types (range 1-6), and had zero to few chasing episodes. They had high net losses but were classified with green (66%) or orange (25%) Playscan tags and did not use the voluntary self-exclusion measure. Class 5 (4.8%) was characterized by medium to very high gambling activity, played a higher breadth of game types (range 1-17), and had a high number of chasing episodes (range 0-5). They experienced the highest net losses, the highest proportion of orange (32%) and red (39%) tags within the Playscan classification system and represented the only class in which voluntary self-exclusion was present.
Conclusions: Classes 1, 2, 3 may be considered to represent recreational gambling. Class 4 had higher gambling activity and higher breadth of involvement and may be representative of players at risk for future gambling problems. Class 5 stood out in terms of much higher gambling activity and breadth of involvement, and the presence of chasing behavior. Individuals in classes 4 and 5 may benefit from early preventive measures.
doi:10.2196/17675
Keywords
Introduction
The prevalence of past-year gambling problems varies from 0.1% to 5.8% worldwide [
]. In France, it was estimated at 2.7% of the general population between 15 and 75 years old [ ]. This prevalence reached 22.4% among the population of individuals who gambled online in 2017 [ ], compared to 17.0% in 2012 [ ]. Internet gambling has intrinsic features that may facilitate excessive gambling, such as high accessibility, anonymity, high frequency of gambling outcomes, and digital payment modes [ - ]. Individuals who gamble online have a higher risk and a higher severity of gambling problems [ - ].Online gambling also provides a unique opportunity to monitor gambling behavior in real environments [
]. The larger part of gambling research has been performed using questionnaire-reported subjective data, but self-reported data has been widely criticized (even beyond the framework of gambling) because it lacks both accuracy and validity and is prone to numerous biases [ - ]. It has been emphasized that too little research has been conducted in a real gambling environment with individuals who gamble [ , ]. Thus, a stream of gambling-related research has been undertaken using of gambling tracking data (naturalistic data) [ ]. Large research programs [ - ] have been initiated including research [ ] that focuses on rarely studied online lottery gambling tracking data (lottery draws, daily lotteries, and scratch cards). Indeed, such gambling is traditionally considered the least associated with gambling problems, but is the most prevalent form of gambling, leading to an overall sum of low-level harms that could be as important as the harm associated with more problematic but less prevalent forms of gambling [ ].Gambling tracking data allow researchers to easily access activity such as money wagered, number of gambling days, deposits, wins, and losses. Such indicators are informative, but do not, on their own, identify the potential for future gambling problems (since individuals who engage heavily in gambling are not necessarily those who develop gambling problems). Consequently, the combination of activity-based indicators with indicators that are related to core features of addiction may better capture individuals at risk for gambling problems. One potential indicator of addiction is chasing behavior which is defined as the continuation or intensification of gambling after a sequence of losses with the objective to recover previous losses [
]. This behavior is almost omnipresent in individuals with gambling problems and has been identified as the most significant step in the development of pathological gambling [ - ]. It is considered a key indicator of problem gambling behavior, especially in research that uses gambling tracking data [ , ]. The identification of chasing episodes may be performed in either a between- (over a long timescale spanning multiple sessions) or within-session (bet-by-bet behavior) dimension [ ]; however, the latter appears to be better at capturing chasing behavior [ ]. Researchers often use the modification of betting behavior depending on previous betting outcomes as a proxy to identify chasing episodes, as it is a behavior that is not directly observable [ ]. In recent work [ , ], we proposed to approximate within-session chasing behavior by focusing on recurrent deposits within a short period of time or deposits that occurred immediately after a bet. When a deposit is made in these conditions, it likely means that the person has recently lost money; the deposit indicates the unplanned continuation of gambling in an attempt to recover losses. Another potential indicator of problem gambling is the breadth of involvement, which is generally defined as the number of different games played by an individual [ ] and is considered a form of variability in gambling [ ]. It has been found to be higher for those who gamble online compared to those who gamble offline [ , , ] and could be a mediator in the relationship between online gambling and gambling problems [ ].Rather than using cross-sectional data, a longitudinal approach may be more relevant to identify individuals at risk for gambling problems. Gambling activity (frequency and intensity) and gambling variability (daily variability and trajectory, ie, the increasing or decreasing pattern of wagers) have been used to monitor gambling patterns in live-action sports betting by individuals during the first month after their gambling account is created and to determine the association of patterns with the development of later gambling problems [
]. The results indicated that individuals with high-activity and high-variability gambling were more likely to close their account due to gambling-related problems. Moreover, in previous work [ ], we found that risky monthly behaviors were associated with larger deviations from the usual gambling activity in online lotteries. Finally, in a recent review, trajectory information has been reported as a possible method with good predictive performance in identifying problem gambling behavior through online gambling tracking data analysis [ ].In this study, the early gambling trajectories of online lottery gambling during the first month after the creation of an account is modeled. The objective was to identify distinct profiles of individuals who gamble online which can be distinguished by their early trajectories and to characterize their patterns in relation to their potential for gambling problems. This work is part of the first stage of EDEIN (Etude de Dépistage des comportements Excessifs de jeu sur Internet; Screening for Excessive Gambling Behaviors on the Internet) [
] (ClinicalTrials.gov NCT02415296; http://clinicaltrials.gov/ct2/show/NCT02415296).Methods
Participants
An anonymized data set was used; this data set had also been used in a previous analysis [
]. The data were comprised of gambling‐related records from a random sample of 10,000 clients of the French national lottery and included the age, gender, and Playscan classification—a responsible gambling tool that provides a low, medium, or high risk assessment—of each client. This operator is the only one in France that is permitted to offer online lotteries and scratch games, and thus, represents 100% of the market for online lotteries and scratch games in France [ ]. The Playscan classification is a risk assessment based on an individual’s 5 previous weeks of gambling activity: green corresponds to a low risk of problem gambling, orange corresponds to a medium risk, and red corresponds to a high risk [ ]. It uses a combination of quantitative (wagers, deposits, gambling session duration, etc) and qualitative (gambling in risky periods, etc) gambling behavior data to estimate risk of problem gambling. The initial dataset (n=10,000) included individuals who gambled at least once between September 2015 and August 2016. In this study, we were interested in early behaviors only; therefore, we restricted inclusion to individuals who created their account between September 2015 and February 2016 (n=1152). As a consequence, it was possible to observe gambling activity during the six months following account creation. We chose a period of six months in order to observe early gambling behaviors without focusing solely on the first few weeks, which are not necessarily representative of future gambling activity.Data Reduction
To observe changes in early gambling trajectories, each variable was computed based on a 15-day unit of time, starting with t=t0 on the day of account creation, resulting in 12 equidistant time points (t=t0, t1, t2,…, t11) over the 6-month period for each newly registered individual.
To conduct the trajectory analysis, 4 measures were selected from the original data set and calculated for each 15-day unit of time: amount wagered (the sum of all the bets made), number of gambling days (the total number of days with at least one gambling session), the number of chasing episodes (the number of times that money was deposited into the gambling account was used as a proxy of chasing behavior and applicable only if criteria were met—deposits either 3 or more times within a 12-hour period or less than 1 hour after a bet) [
, ], and involvement (the number of different games played). The amount wagered and number of gambling days were used as indicators of gambling activity, while the number of chasing episodes and involvement were used as indicators of at-risk gambling behaviors.In addition, we used the following covariates to characterize the profiles that were identified: gender, age, cumulative deposits over the 6-month period, largest single-day deposit during the 6-month period, percentage of bets on instant lotteries (scratch cards and instant draws) over the 6-month period, cumulative net loss over the 6-month period (calculated by subtracting winnings and promotional e-credits from wagers), voluntary self-exclusion during the 6-month period (a categorical variable defined as either yes, if there was at least one episode of self-exclusion, or no, if there were zero episodes of self-exclusion during the 6-month period), and the individual’s highest Playscan classification during the 6-month period. Net loss, voluntary self-exclusion, and Playscan classification were chosen to serve as external verification of problem gambling [
]. All amounts were recorded in euros and have been converted to US dollars (a currency exchange rate of €1=US $1.084 was applicable at the time of publication).Statistical Analysis
We used a two-step approach to establish typologies that group individuals who evolve differently over time (individuals with similar trajectories identified for the 4 indicators) using data from the initial six months of their online gambling subscription.
The first step of the analysis consisted of identifying trajectories for each of the 4 gambling indicators. To model the evolution of each indicator (measured at 12 discrete time points for each individual, in a highly heterogeneous population [
]), we used growth mixture models [ , ]. Models were selected based on statistical criteria and upon interpretation of the classes. For each indicator, we tested multiple models to determine the best number of trajectories (from 1 to 8). For each number of trajectories, we computed several models, starting with the most complex (linear, quadratic, and cubic time-dependent terms, an intercept term, and random effects on both intercept and slopes), which was then simplified, if necessary, based on statistical criteria (convergence and stability of the model, Bayesian information criterion, significance of the parameters). For each model, we randomly generated 400 sets of initial values, for which 10 iterations of the expectation-maximization algorithm were performed. For the 50 best solutions, the entire expectation-maximization algorithm was performed. A model was considered to be stable if the best log-likelihood was replicated (ie, if at least two solutions had the same final best log-likelihood). The selected trajectory models were compared with one another to determine the best model for each indicator. The outcomes of the growth mixture models were membership probabilities (the probability that an individual belonged to each modeled trajectory).The second step was to perform classification by grouping individuals with similar indicator trajectories. A latent class analysis was performed using the trajectory membership probabilities as the observed variable. This strategy allowed us to define latent classes with distinct characteristics of gambling activity and at-risk behavior. Model selection was based on a trade‐off between the Bayesian information criterion, the classification error rate (which reflects the precision of the classification), the interpretability of the classes, and the replicability of the model. The classes were described by the trajectory membership probabilities of each indicator and by the covariates.
Such a two-step analysis strategy has been previously used in studies [
, ] in various health areas, including behavioral addictions. Growth mixture models were estimated using Mplus software (version 8.1; Muthen and Muthen) [ ]. Latent class analysis was conducted using Latent Gold software (Statistical Innovations Inc) [ ].Ethics
This study was approved by the research ethics committee (Groupe Nantais d'Ethique dans le Domaine de la Santé) on March 25, 2015. Because of the retrospective and noninterventional design of this study, consent of the individuals whose data were used was deemed unnecessary.
Results
Characteristics
The characteristics of the sample, which was composed of 1152 individuals who had newly registered for an online gambling account, are described in
. The sample was mainly composed of men (male: 740/1152, 64.2%; female: 412/1152, 35.8%) and the sample had a mean of 39.83 (SD 12.65) years of age. shows that the indicators of gambling activity varied highly both between individuals (between-subject SD) and over the 6-month period for a given individual (within-subject SD).Characteristics | Individuals (N=1152) n (%) | Meana | SD | SD, between-subjectb | SD, within-subjectc | Minimum | Maximum | ||
Age, years | — | 39.83 | 12.65 | N/Ad | N/A | 19 | 81 | ||
Gender | |||||||||
Male | 740 (64.2) | — | — | — | — | — | — | ||
Female | 412 (35.8) | — | — | — | — | — | — | ||
Gambling activity | |||||||||
Money wagered, €e | — | 16.98 | 68.83 | 52.82 | 44.15 | 0.00 | 1918.00 | ||
Gambling days, n | — | 1.27 | 2 | 1.48 | 1.36 | 0 | 15 | ||
Chasing, n | — | 0.10 | 0.85 | 0.55 | 0.65 | 0 | 26 | ||
Involvement, n | — | 1.15 | 2.23 | 1.5 | 1.66 | 0 | 31 | ||
Deposits, € | — | 10.46 | 35.29 | 25.98 | 23.89 | 0.00 | 835.00 | ||
Largest single-day deposit, € | — | 7.32 | 17.69 | 10.44 | 14.29 | 0.00 | 500.00 | ||
Losses, € | — | 4.43 | 417.85 | 120.8 | 400 | –48748.40 | 712.40 | ||
Instant lotteries, % | — | 11 | 28 | 19 | 21 | 0 | 100 | ||
Voluntary self-exclusion | 6 (0.5) | N/A | N/A | N/A | N/A | N/A | N/A | ||
Playscan | |||||||||
Green | 1032 (89.6) | N/A | N/A | N/A | N/A | N/A | N/A | ||
Orange | 83 (7.2) | N/A | N/A | N/A | N/A | N/A | N/A | ||
Red | 36 (3.1) | N/A | N/A | N/A | N/A | N/A | N/A |
aFor quantitative variables, data were averaged at a monthly level over the 6-month period. This was intended to be more representative and meaningful than the 15-day unit of time used for trajectory analyses.
bbetween SD: represents the fluctuations of monthly gambling activity between the individuals (between-subject standard deviation).
cwithin SD: represents the fluctuations of monthly gambling activity within the 6-month period for a given individual (within-subject standard deviation).
dN/A: not applicable.
eAt the time of publication, a currency exchange rate of €1=US $1.084 was applicable.
Growth Mixture Models
Seven trajectories were obtained for amount wagered and are shown in
. Trajectories 1 (13.0%), 3 (12.3%), and 6 (14.6%) exhibited a downward trend, initially showing a medium (trajectory 6) to high (trajectories 1 and 3) amount of money during initial weeks which gradually diminished to near zero amounts at the end of the 6-month period. Trajectories 2 (7.1%), 4 (26.4%), 5 (23.4%), and 7 (3.2%) were stable over the 6-month period. Trajectory 5 was characterized by low wagers—under €2 (US $2.17) per two weeks, trajectory 4 by medium wagers—€4-€12 (US $4.34-$13.01) per two weeks, trajectory 2 by high wagers—approximately €18 (US $19.51) per two weeks, and trajectory 7 by very high wagers—mainly €60-€100 (US $65.04-$108.40) per two weeks.Three trajectories were obtained for the number of gambling days (
). Trajectory 1 (9.8%) was an inverted parabolic, increasing from 2.38 to 4.58 gambling days per two weeks, reaching a maximum at 120 days, and decreasing to reach 3.29 days at the end of the 6-month period. Trajectory 2 (9.8%) decreased rapidly from an initially high number of gambling days (6.8) which rapidly decreased to 0.98 days. Trajectory 3 represented the majority of individuals (83.4%) and had a relatively stable and low trajectory, with the number of gambling days fluctuating between 0.42 and 1.67.Four trajectories were obtained for the involvement indicator (
). Trajectory 1 represented a very low proportion of individuals (1.3%), initially showing a very high diversity of games played (16.38 per two weeks) that rapidly decreased, and then stabilized to reach between 1.29-1.84 games after 120 days. Trajectory 2 represented the majority of individuals (89.9%) and was stable and low with approximately 1 (range 0.43-1.49) game played throughout the 6-month period. Trajectory 3 (5.8%) was also relatively stable, but with a higher number of games played, varying between 1.91 and 5.21. Finally, trajectory 4 (3.0%) exhibited a reverse parabolic shape, decreasing from 5.52 to 2.61 games played during the first 60 days, followed by a more pronounced rise after 90 days to reach 6.37 games at the end of the 6-month period.Three trajectories were identified for chasing (
). Trajectories 1 and 2 were similar and represented the majority of individuals (trajectory 1: 33.9%; trajectory 2: 64.2%). They were characterized by the absence (trajectory 2: 0 episodes) or a very low number (trajectory 1: 0.06-0.31 episodes) of chasing episodes during the 6-month period. Trajectory 3 (1.9%) was an inverse parabolic and had a very high initial number (5.05 episodes per two weeks) which decreased to 2.39 episodes at 90 days and increased to 3.49 episodes at the end of the 6-month period.Latent Class Analysis
Fit indices of the models (1 to 8 classes) are given in
. Bayesian information criteria decreased from the 1-class to the 8-class solution; however, the 7- and 8-class models were not stable. Because the 6-class solution did not yield a significant change in interpretation compared to that of the 5-class solution, the simplest model (ie, the 5-class model) was chosen.Model type | Log-likelihood | Bayesian information criterion | Number of parameters | Classification errors |
1-Class | –955 | 2150 | 34 | 0 |
2-Class | 30077 | –59667 | 69 | 0.0004 |
3-Class | 38004 | –75274 | 104 | 0.0006 |
4-Class | 39901 | –78823 | 139 | 0.0011 |
5-Class | 43508 | –85790 | 174 | 0.0016 |
6-Class | 45205 | –88937 | 209 | 0.0018 |
7-Classa | 47402 | –93085 | 244 | 0.0033 |
8-Classa | 47837 | –93707 | 279 | 0.0026 |
aFinal log-likelihood not replicated.
shows the distribution of the trajectories obtained for the gambling indicators and covariates for each class.
Class 1 (56.8%) was characterized by low gambling activity and low values for indicators of addiction; most individuals had the lowest trajectory of involvement and either a trajectory with no (p=.89) or few (p=.11) chasing episodes. Demographics of this class were similar to those of the overall sample (male: 64.8%; female: 35.2%; mean age: 39.06 years). Individuals from this class predominantly played deferred lotteries (79% of lotteries). They had low cumulative losses (€37.22) and deposits (€48.15) over the 6-month period. Almost all individuals (97.9%) were within the green Playscan classification.
Class 2 (14.8%) was characterized by medium to high and stable level of money wagered. For the number of gambling days, individuals in class 2 had either a low and stable trajectory (p=.61) or a medium and parabolic trajectory (p=.34). Moreover, they had similar indicators of addiction as those in class 1, but with a higher probability (proportion) for the trajectory that represented few chasing episodes (p=.59 compared to p=.11). The mean age of 43.41 years was higher than that of the overall sample and the proportion of women was lower than that in the overall sample (26.5%). These individuals were the only ones who had negative losses (ie, won €161.13), despite higher cumulative deposits (€154.97) than class 1. They predominantly played deferred lotteries (88% of lotteries) and were mainly (90.0%) within the green Playscan classification.
Model outcomes | Class 1 | Class 2 | Class 3 | Class 4 | Class 5 | ||
Probabilistic class size, in % | 56.8 | 14.8 | 13.9 | 9.7 | 4.8 | ||
Probabilities,p | |||||||
Amount wagered | |||||||
Trajectory 1 | .17a | <.001 | .24a | <.001 | .002 | ||
Trajectory 2 | <.001 | .37a | <.001 | .001 | .33a | ||
Trajectory 3 | .06 | .02 | .35a | .28a | .24a | ||
Trajectory 4 | .20a | .57a | .08 | .52a | .13a | ||
Trajectory 5 | .33a | .03 | .28a | .02 | <.001 | ||
Trajectory 6 | .24a | <.001 | .05 | <.001 | <.001 | ||
Trajectory 7 | <.001 | .003 | <.001 | .18a | .30a | ||
Gambling days | |||||||
Trajectory 1 | .003 | .34a | .004 | .23a | .47a | ||
Trajectory 2 | .001 | .05 | .16a | .25a | .31a | ||
Trajectory 3 | .997a | .61a | .84a | .52a | .22a | ||
Chasing | |||||||
Trajectory 1 | .11a | .59a | .71a | .67a | .48a | ||
Trajectory 2 | .89a | .41a | .29a | .33a | .13a | ||
Trajectory 3 | <.001 | <.001 | <.001 | <.001 | .39a | ||
Involvement | |||||||
Trajectory 1 | <.001 | <.001 | <.001 | <.001 | .27a | ||
Trajectory 2 | .999a | .998a | .994a | .39a | .15a | ||
Trajectory 3 | .001 | .002 | .005 | .41a | .35a | ||
Trajectory 4 | <.001 | .001 | .001 | .19a | .23a | ||
Covariates | |||||||
Ageb, years | 39.06 | 43.41 | 38.21 | 4.33 | 41.68 | ||
Gender, %c | |||||||
Male | 64.8 | 73.5 | 62.1 | 54.9 | 52.0 | ||
Female | 35.2 | 26.5 | 37.9 | 45.1 | 48.0 | ||
Voluntary self-exclusion, %c | 0 | 0 | 0 | 0 | 10.8 | ||
Cumulative lossesd, €e | 37.22 | –161.13 | 80.85 | 189.65 | 541.64 | ||
Cumulative depositsd, €e | 48.15 | 154.97 | 102.91 | 232.99 | 797.05 | ||
Largest single day deposit, €e | 23.27 | 31.02 | 31.19 | 39.16 | 74.91 | ||
Instant lotteries, %c | 21 | 12 | 39 | 65 | 78 | ||
Playscan, %c | |||||||
Missing | 0.5 | 0 | 0.6 | 0 | 0 | ||
Green | 97.9 | 90.0 | 9.6 | 66.4 | 28.7 | ||
Orange | 1.5 | 8.8 | 18.1 | 24.6 | 31.8 | ||
Red | 0.2 | 1.2 | 0.6 | 9.0 | 39.5 |
aThese probabilities are the main trajectories represented within each class (p>.10).
bValues represent the mean for each class.
cProbability of belonging to each class. The percentages indicated refer to this probabilistic approach but do not represent a proportion of individuals.
dCumulative over the 6-month period.
eAt the time of publication, a currency exchange rate of €1=US $1.084 was applicable.
Class 3 (13.9%) was characterized by generally decreasing trends in gambling activity (amount wagered and the number of gambling days). Moreover, these individuals had similar indicators of addiction to those in class 2, but with a higher probability (proportion) for the trajectory that represented few chasing episodes (p=.71 compared to p=.59). Demographics of this class were similar to those of the overall sample (male: 62.1%; female: 37.9%; mean age: 38.21 years). These individuals displayed moderate cumulative losses (€80.85) and deposits (€102.91) over the 6-month period. They predominantly played deferred lotteries (61% of lotteries), but to a lesser extent than those in classes 1 and 2, and were mainly (90.6%) within the green Playscan classification.
Class 4 (9.7%) was characterized by medium to very high wagers, with the moderate and stable trajectory most represented (p=.52). For number of gambling days, individuals were distributed across the three trajectories with predominance in the low stable trajectory (p=.52). In contrast to classes 1, 2, and 3, this class was characterized by a combination of three trajectories for involvement with the majority in low and medium stable trajectories (p=.39 and p=.41, respectively). Moreover, individuals from class 4 had a similar pattern of chasing episodes as those from class 3. As a consequence, the pattern of class 4 was characterized by a diversification of games played but not by an increase in chasing episodes which remained relatively rare. The mean age of 40.33 years was similar to that of the overall sample and the proportion of women was higher than that in the overall sample (45.1%). These individuals displayed high cumulative losses (€189.65) and deposits (€232.99) over the 6-month period. In contrast to the first three classes, they predominantly played instant lotteries (65% of lotteries). The majority of individuals from this class were within the green Playscan classification (66.4%), but a significant proportion were within the orange (24.6%), and to a lesser extent, red (9.0%) classifications.
Class 5 (4.9%) was characterized by medium to high wagers, with the stable and high (p=.33) and the stable and very high (p=.30) trajectories most represented. Individuals from class 5 were also distributed in the three trajectories for the number of gambling days, but with a relative predominance of the high and parabolic trajectory (p=.47). Thus, individuals from this class had high or very high levels of gambling activity which remained high throughout the 6-month period. They were also characterized by a higher levels of involvement (all 4 trajectories) and were the only ones for which the highest-level trajectory of chasing was represented (p=.39). As a consequence, this class was characterized by both a diversification of games played and a large increase in chasing episodes. The mean age of 41.68 years was similar to that of the overall sample and the proportion of women was higher than that in the overall sample (48%). These individuals had very high cumulative losses (€541.64) and deposits (€797.05) over the 6-month period which were approximately 15 times more than the individuals in class 1 experienced and 3 times more than the individuals in class 4 experienced. They were also characterized by very high largest single-day deposits (€74.91) compared to those of the other classes. They predominantly played instant lotteries (78% of lotteries) and were mainly within orange (31.8%) and red (39.5%) Playscan classifications. Finally, this was the only class for which voluntary self-exclusions were present (10.8%).
Discussion
Principal Findings
The aim of this study was to investigate the early gambling trajectories of individuals over the initial 6 months of their subscription to the French online lottery website. We identified 5 distinct profiles of online lottery gambling, and we characterized each pattern in relation to indicators of gambling activity and gambling addiction.
The first three classes represented the majority of individuals (85.5%) and were characterized by low to medium gambling activity and low levels of problem gambling indicators. According to our assumptions, such individuals do not seem to encounter difficulty with their gambling practices and their gambling may be considered recreational. This was supported by findings of low losses (and sometimes wins), no voluntary self-exclusion, and low-risk Playscan classification (green tags).
In parallel, we identified 2 profiles that should be considered for early intervention or harm minimization. Class 4 represented approximately 10% of the sample and was characterized by medium to high gambling activity, a diversification of games played, and zero to few chasing episodes. The higher breadth of involvement may reflect more variable gambling activity and has previously been associated with account closure and classification of the individual as high risk by responsible gambling indicators [
]. Engagement in multiple online gambling activities has been identified as a potential predictor of high-risk gambling or the emergence of gambling problems [ ]. Consequently, we can suggest that individuals in Class 4 may be at risk for future gambling problems but may not yet be gambling excessively. This assumption is supported by the fact that these individuals displayed high losses but were predominantly considered low and medium risk (green and orange, respectively) and did not use the voluntary self-exclusion measure. They played predominantly instant lotteries (65%), which have been found to be more associated with gambling problems than deferred lotteries are, due to high event frequency [ , , ].Class 5 was the smallest (4.8%) and was characterized by medium to very high gambling activity, a higher diversification of games played, and a high number of chasing episodes. Higher breadth of involvement and chasing behavior have been consistently associated with problem gambling [
]. Chasing, in particular, is considered a key indicator of problem gambling [ , ] and has been found to be the best discriminator between social and problem gambling among women [ ]. Because class 5 was the only class with nonzero chasing trajectories, there is strong reason to believe that such gambling may be problematic. This is supported by the fact that these individuals experienced higher net losses and had the highest proportion among their class (71.3%) who were considered medium and high risk (orange and red tags). Moreover, they played forms of lottery that are more associated with gambling problems (ie, instant lotteries). More importantly, this class was the only class in which voluntary self-exclusion was present in a proportion (10.8%) that was higher than that observed in general online gambling (1%) [ ], but close to that found in at-risk individuals who gamble online (11%) [ ]. Voluntary self-exclusion is a harm-minimization strategy for individuals who experience gambling problems. In the case of online gambling, it consists of voluntarily banishing oneself from gambling websites for a predefined period [ ]. Voluntary self-exclusion is considered a valid proxy indicator to externally verify which individuals have gambling problems [ ], and thus, reinforced our deduction that individuals in class 5 may have gambling problems.The whole sample was characterized by a higher proportion of women (35.8%) than that found in other studies using gambling tracking data from online gambling: 5.5% [
], 8% [ ], and 10% [ ]. Given that games of chance, such as lotteries, are more appealing to women than skill-based games are [ ], this higher proportion was expected. This finding is also consistent with a French survey on the prevalence of online gambling [ ] which found that 38.8% of the individuals involved in online lotteries were women; however, it was surprising that we found a higher proportion of women in the two classes exhibiting at-risk profiles. This was unexpected because it has generally been shown that men gamble more than women [ , ] and that at-risk individuals are predominantly men [ , ]. This unexpectedly higher proportion of women in at-risk classes was previously described in the same data set in a study that did not restrict inclusion to newly registered individuals [ ]. It is worth noting that this tendency was maintained in early trajectories, making women a particularly vulnerable population for problem gambling when they initially open online accounts. As reported in Perrot et al [ ], women with gambling problems may prefer to gamble online because they experience less stigma [ ] and because they may be more socially anxious [ ]. Moreover, boredom has been found to be both a motivating factor for gambling and a factor associated with continued problem gambling among women [ , ]. One can hypothesize that, beyond social anxiety and stigma, women with gambling problems may tend to choose online gambling to avoid boredom because it is accessible 24/7 and may represent a way to stay occupied to avoid negative emotional states.Limitations and Strengths
This study has several limitations. First, because we were not able to directly measure gambling problems, we were constrained to use proxies (net losses, Playscan status, and voluntary self-exclusion); however, these proxies have previously been used for external verification of gambling problems in gambling studies that use tracking data [
]. Otherwise, gambling problems have generally been measured using self-report questionnaires, such as in LaPlante et al [ ], but self-reporting has limited representativeness given its low percentage of respondents [ ]. Second, we only investigated a sample of individuals who play online lotteries. It would be interesting to replicate this work in other types of online gambling and will be the subject of future investigations; the results herein constitute only one part of the EDEIN research program and future EDEIN studies will address this limitation. Third, the choice of indicators for the trajectory analysis is questionable since other indicators exist; however, these choices had the advantage of combining information on gambling activity and on the potential for gambling problems. Fourth, the data set included only gambling activity related to online lotteries within a limited period. As a consequence, it is possible that some individuals in this study were also engaged in other types of gambling that were not captured by this study (other online or offline gambling activities) or that some individuals previously had an account on the same website which would bias the notion of describing “early” trajectories.Despite these limitations, we must emphasize the strengths of this study. First, the naturalistic nature of gambling tracking data has high value for gambling research [
]. Second, we used a valid and robust method to explore trajectories whose utility has previously been demonstrated [ , ]. Trajectories as indicators for problem gambling have previously been defined using the slope of a linear regression that modeled wager size according to the sequence of active betting days during the initial month [ ]. Such an approach may strongly reduce the information available because only positive or negative linear trends during the first month are observed and the following months, more complex trajectories, and other indicators of gambling are neglected. In our study, we used growth mixture modeling to model trajectories, which allowed us to capture the complexity of the evolution of gambling practice over time. Moreover, we performed this trajectory analysis on 4 indicators rather than only on wagers, which gave us access to the monetary variations over time as well as variations in gambling frequency, breadth of involvement, and chasing. Finally, the 6-month period allowed access to more in-depth trajectory information. Indeed, as shown in to , the variations of gambling activity during the first month did not necessarily reflect activity during the subsequent months. Third, Deng et al [ ] emphasized that data aggregation often cannot capture chasing behavior, which requires fine-grained data. In our study, a chasing proxy was computed (based on the temporality between deposits and bets on a within-session basis) before data were aggregated. Because the chasing indicator best contributed to the identification of the problematic class, this definition may be useful for identifying individuals who are potentially at risk for gambling problems.Conclusion and Perspectives
We demonstrated the importance of using longitudinal trajectory models rather than cross-sectional analysis to identify groups of individuals who are potentially at risk for gambling problems. High breadth of involvement and high and sustained chasing, combined with the use of trajectory models, may be used early on to identify individuals who are at risk of experiencing gambling problems. More specifically, the probabilities of individuals belonging to the 5 classes identified can serve to implement personalized preventive actions. Indeed, the effectiveness of self-regulation strategies from responsible gambling programs, such as the setting of gambling limits for oneself or voluntary self-exclusion, may be limited by the fact that they completely rely on individuals changing their own behavior. As argued by Haefeli et al [
], it is of high importance to detect excessive gambling as early as possible before individuals reach the late stages of gambling problems and experience too much damage to be receptive to preventive interventions. The ability to rapidly identify individuals who are at risk for future gambling problems may allow the implementation of targeted, personalized minimal interventions. Such interventions could rely on valuing help-seeking, or on informing at-risk individuals about existing tools to prevent excessive gambling and possible gambling-related damage. This is the ultimate goal of the EDEIN project [ ] of which this study was a first step.Acknowledgments
This research project has received funding from the Primary Prevention Call for Proposals that was issued by the French Institute for Public Health Research and the French National Cancer Institute in 2013 and funded by the French National Health Insurance Fund for Employees, the French Directorate General of Health, the Arc Foundation for Cancer Research, the French National Cancer Institute , the French National Institute for Prevention and Education in Health, the French National Institute of Health and Medical Research, the French Inter‐Departmental Agency for the Fight against Drugs and Addictive Behaviors, and the French Social Security Scheme for Liberal Professionals.
We would like to thank Française des Jeux for giving us access to the gambling data and Playscan for allowing access to the risk assessment data.
This research was conducted on the initiative of and coordinated by the Department of Addiction and Psychiatry of the University Hospital of Nantes which sponsored this study. Neither the data providers (Française des Jeux and Playscan) nor the funders (French Institute for Public Health Research and its partners) had any influence on this work; they did not review or approve the manuscript. No constraints on publication were imposed.
Conflicts of Interest
GCB, ET, AS, YD, and MGB declare that the University Hospital of Nantes received funding from the gambling industry (Française des Jeux and Pari Mutuel Urbain) in the form of philanthropic sponsorship (donations that do not assign purpose of use). Scientific independence with respect to these gambling organizations is guaranteed, and the funding did not have any influence on this work. No conflicts of interest exist for BP.
References
- Calado F, Griffiths MD. Problem gambling worldwide: an update and systematic review of empirical research (2000-2015). J Behav Addict 2016 Dec;5(4):592-613. [CrossRef] [Medline]
- Costes JM, Eroukmanoff V, Richard JB, Tovar ML. Les jeux d'argent et de hasard en France en 2014. Les notes de l'Observatoire Des Jeux; n°6. Paris, France: Observatoire des Jeux; 2015 Apr 15. URL: https://www.economie.gouv.fr/files/note_6.pdf [accessed 2020-01-03]
- Costes JM, Eroukmanoff V. Les pratiques de jeux d'argent sur Internet en France en 2017. Les notes de l'Observatoire des jeux; n°9. Paris, France: Observatoire des Jeux; 2018 Jul. URL: https://www.economie.gouv.fr/files/files/directions_services/observatoire-des-jeux/Note_ODJ_9.pdf [accessed 2020-01-03]
- Tovar ML, Costes JM, Eroukmanoff V. Les jeux d'argent et de hasard sur Internet en France en 2012. Tendances; n°85. Saint-Denis-La-Plaine, France: Observatoire français des drogues et des toxicomanies (OFDT); 2013 Jun. URL: https://www.ofdt.fr/BDD/publications/docs/eftxmtt6.pdf [accessed 2020-01-03]
- Gainsbury SM. Online gambling addiction: the relationship between internet gambling and disordered gambling. Curr Addict Rep 2015;2(2):185-193 [FREE Full text] [CrossRef] [Medline]
- Griffiths M. Internet gambling: issues, concerns, and recommendations. Cyberpsychol Behav 2003 Dec;6(6):557-568. [CrossRef] [Medline]
- McCormack A, Griffiths MD. A scoping study of the structural and situational characteristics of Internet gambling. International Journal of Cyber Behavior, Psychology and Learning 2013;3(1):29-49. [CrossRef]
- Effertz T, Bischof A, Rumpf HJ, Meyer C, John U. The effect of online gambling on gambling problems and resulting economic health costs in Germany. Eur J Health Econ 2018 Sep;19(7):967-978. [CrossRef] [Medline]
- Griffiths M, Wardle H, Orford J, Sproston K, Erens B. Internet gambling, health, smoking and alcohol use: findings from the 2007 british gambling prevalence survey. Int J Ment Health Addiction 2009 Sep 15;9(1):1-11. [CrossRef]
- Kairouz S, Paradis C, Nadeau L. Are online gamblers more at risk than offline gamblers? Cyberpsychol Behav Soc Netw 2012 Mar;15(3):175-180. [CrossRef] [Medline]
- Papineau E, Lacroix G, Sévigny S, Biron JF, Corneau-Tremblay N, Lemétayer F. Assessing the differential impacts of online, mixed, and offline gambling. International Gambling Studies 2017 Oct 03;18(1):69-91. [CrossRef]
- Wood RT, Williams RJ. Internet Gambling: Prevalence, Patterns, Problems, and Policy Options. Guelph, Ontario: Final Report prepared for the Ontario Problem Gambling Research Centre; 2009 Jan 05. URL: https://opus.uleth.ca/bitstream/handle/10133/693/2009-InternetPPPP-OPGRC.pdf [accessed 2020-01-03]
- Gainsbury S. Player account-based gambling: potentials for behaviour-based research methodologies. International Gambling Studies 2011 Aug;11(2):153-171. [CrossRef]
- Braverman J, Tom MA, Shaffer HJ. Accuracy of self-reported versus actual online gambling wins and losses. Psychol Assess 2014 Sep;26(3):865-877. [CrossRef] [Medline]
- Baumeister RF, Vohs KD, Funder DC. Psychology as the science of self-reports and finger movements: whatever happened to actual behavior? Perspect Psychol Sci 2007 Dec;2(4):396-403. [CrossRef] [Medline]
- Garber MC, Nau DP, Erickson SR, Aikens JE, Lawrence JB. The concordance of self-report with other measures of medication adherence: a summary of the literature. Med Care 2004 Jul;42(7):649-652. [Medline]
- Rundle‐Thiele S. Bridging the gap between claimed and actual behaviour: the role of observational research. Qualitative Mrkt Res 2009 Jun 12;12(3):295-306. [CrossRef]
- Editorial. Science has a gambling problem. Nature 2018 Jan 25;553(7689):379. [CrossRef] [Medline]
- Ladouceur R, Shaffer P, Blaszczynski A, Shaffer HJ. Responsible gambling: a synthesis of the empirical evidence. Addiction Research & Theory 2016 Dec 14;25(3):225-235. [CrossRef]
- Deng X, Lesch T, Clark L. Applying data science to behavioral analysis of online gambling. Curr Addict Rep 2019 Jul 15;6(3):159-164. [CrossRef]
- Adami N, Benini S, Boschetti A, Canini L, Maione F, Temporin M. Markers of unsustainable gambling for early detection of at-risk online gamblers. International Gambling Studies 2013 Aug;13(2):188-204. [CrossRef]
- Braverman J, LaPlante DA, Nelson SE, Shaffer HJ. Using cross-game behavioral markers for early identification of high-risk internet gamblers. Psychol Addict Behav 2013 Sep;27(3):868-877. [CrossRef] [Medline]
- Braverman J, Shaffer HJ. How do gamblers start gambling: identifying behavioural markers for high-risk internet gambling. Eur J Public Health 2012 Apr;22(2):273-278 [FREE Full text] [CrossRef] [Medline]
- Broda A, LaPlante DA, Nelson SE, LaBrie RA, Bosworth LB, Shaffer HJ. Virtual harm reduction efforts for Internet gambling: effects of deposit limits on actual Internet sports gambling behavior. Harm Reduct J 2008 Aug 06;5(27):1-9 [FREE Full text] [CrossRef] [Medline]
- Gray HM, LaPlante DA, Shaffer HJ. Behavioral characteristics of internet gamblers who trigger corporate responsible gambling interventions. Psychol Addict Behav 2012 Sep;26(3):527-535. [CrossRef] [Medline]
- Labrie RA, Kaplan SA, Laplante DA, Nelson SE, Shaffer HJ. Inside the virtual casino: a prospective longitudinal study of actual Internet casino gambling. Eur J Public Health 2008 Aug;18(4):410-416. [CrossRef] [Medline]
- LaBrie RA, LaPlante DA, Nelson SE, Schumann A, Shaffer HJ. Assessing the playing field: a prospective longitudinal study of internet sports gambling behavior. J Gambl Stud 2007 Sep;23(3):347-362. [CrossRef] [Medline]
- LaBrie R, Shaffer HJ. Identifying behavioral markers of disordered Internet sports gambling. Addiction Research & Theory 2010 Sep 07;19(1):56-65. [CrossRef]
- LaPlante DA, Kleschinsky JH, LaBrie RA, Nelson SE, Shaffer HJ. Sitting at the virtual poker table: a prospective epidemiological study of actual Internet poker gambling behavior. Computers in Human Behavior 2009 May;25(3):711-717. [CrossRef]
- LaPlante DA, Nelson SE, Gray HM. Breadth and depth involvement: understanding internet gambling involvement and its relationship to gambling problems. Psychol Addict Behav 2014 Jun;28(2):396-403. [CrossRef] [Medline]
- LaPlante DA, Schumann A, LaBrie RA, Shaffer HJ. Population trends in internet sports gambling. Comput Human Behav 2008 Sep;24(5):2399-2414. [CrossRef]
- Nelson SE, LaPlante DA, Peller AJ, Schumann A, LaBrie RA, Shaffer HJ. Real limits in the virtual world: self-limiting behavior of Internet gamblers. J Gambl Stud 2008 Dec;24(4):463-477. [CrossRef] [Medline]
- Philander KS. Identifying high-risk online gamblers: a comparison of data mining procedures. Int Gambl Stud 2013 Oct 23;14(1):53-63. [CrossRef]
- Dragicevic S, Tsogas G, Kudic A. Analysis of casino online gambling data in relation to behavioural risk markers for high-risk gambling and player protection. Int Gambl Stud 2011 Nov 17;11(3):377-391. [CrossRef]
- Luquiens A, Tanguy ML, Benyamina A, Lagadec M, Aubin HJ, Reynaud M. Tracking online poker problem gamblers with player account-based gambling data only. Int J Methods Psychiatr Res 2016 Dec;25(4):333-342. [CrossRef] [Medline]
- Perrot B, Hardouin JB, Grall-Bronnec M, Challet-Bouju G. Typology of online lotteries and scratch games gamblers' behaviours: a multilevel latent class cluster analysis applied to player account-based gambling data. Int J Methods Psychiatr Res 2018 Dec;27(4):e1746. [CrossRef] [Medline]
- Costes JM, Kairouz S, Monson E, Eroukmanoff V. Where lies the harm in lottery gambling? a portrait of gambling practices and associated problems. J Gambl Stud 2018 Dec;34(4):1293-1311. [CrossRef] [Medline]
- Breen RB, Zuckerman M. `Chasing' in gambling behavior: personality and cognitive determinants. Personality and Individual Differences 1999 Dec;27(6):1097-1111. [CrossRef]
- Lesieur HR. The compulsive gambler's spiral of options and involvement. Psychiatry 1979 Feb;42(1):79-87. [CrossRef] [Medline]
- Toce-Gerstein M, Gerstein DR, Volberg RA. A hierarchy of gambling disorders in the community. Addiction 2003 Dec;98(12):1661-1672. [CrossRef] [Medline]
- Ciccarelli M, Cosenza M, D'Olimpio F, Griffiths MD, Nigro G. An experimental investigation of the role of delay discounting and craving in gambling chasing behavior. Addictive Behaviors 2019 Jun;93:250-256. [CrossRef]
- Perrot B, Hardouin JB, Costes JM, Caillon J, Grall-Bronnec M, Challet-Bouju G. Study protocol for a transversal study to develop a screening model for excessive gambling behaviours on a representative sample of users of French authorised gambling websites. BMJ Open 2017 May 17;7(5):e014600 [FREE Full text] [CrossRef] [Medline]
- LaPlante DA, Nelson SE, LaBrie RA, Shaffer HJ. Disordered gambling, type of gambling and gambling involvement in the British Gambling Prevalence Survey 2007. Eur J Public Health 2011 Aug;21(4):532-537 [FREE Full text] [CrossRef] [Medline]
- Baggio S, Dupuis M, Berchtold A, Spilka S, Simon O, Studer J. Is gambling involvement a confounding variable for the relationship between internet gambling and gambling problem severity? Comput Human Behav 2017 Jun;71:148-152. [CrossRef]
- Forsström D, Jansson-Fröjmark M, Hesser H, Carlbring P. Experiences of Playscan: interviews with users of a responsible gambling tool. Internet Interv 2017 Jun;8:53-62 [FREE Full text] [CrossRef] [Medline]
- Blaszczynski A, Nower L. A pathways model of problem and pathological gambling. Addiction 2002 May;97(5):487-499. [Medline]
- Muthén B, Shedden K. Finite mixture modeling with mixture outcomes using the EM algorithm. Biometrics 1999 Jun;55(2):463-469. [CrossRef] [Medline]
- Verbeke G, Lesaffre E. A linear mixed-effects model with heterogeneity in the random-effects population. Journal of the American Statistical Association 1996 Mar;91(433):217-221. [CrossRef]
- Brédart A, Merdy O, Sigal-Zafrani B, Fiszer C, Dolbeault S, Hardouin JB. Identifying trajectory clusters in breast cancer survivors' supportive care needs, psychosocial difficulties, and resources from the completion of primary treatment to 8 months later. Support Care Cancer 2016 Jan;24(1):357-366. [CrossRef] [Medline]
- Montourcy M, Hardouin JB, Caillon J, Leboucher J, Rousselet M, Grall-Bronnec M, et al. Typology of patients with behavioral addictions or eating disorders during a one-year period of care: exploring similarities of trajectory using growth mixture modeling coupled with latent class analysis. PLoS One 2018;13(11):e0207398. [CrossRef] [Medline]
- Muthén LK, Muthén BO. Mplus user‘s guide. Mplus. URL: https://www.statmodel.com/download/usersguide/MplusUserGuideVer_8.pdf [accessed 2020-02-29]
- Vermunt JK, Magidson J. Technical guide for Latent GOLD 5.1: basic, advanced, andsyntax. Statistical Innovations. URL: https://www.statisticalinnovations.com/wp-content/uploads/LGtecnical.pdf [accessed 2020-02-29]
- Challet-Bouju G, Hardouin JB, Renard N, Legauffre C, Valleur M, Magalon D, et al. A gamblers clustering based on their favorite gambling activity. J Gambl Stud 2015 Dec;31(4):1767-1788. [CrossRef] [Medline]
- Temcheff CE, Paskus TS, Potenza MN, Derevensky JL. Which diagnostic criteria are most useful in discriminating between social gamblers and individuals with gambling problems? an examination of DSM-IV and DSM-5 criteria. J Gambl Stud 2016 Feb 5;32(3):957-968. [CrossRef]
- Percy C, França M, Dragičević S, d’Avila Garcez A. Predicting online gambling self-exclusion: an analysis of the performance of supervised machine learning models. Int Gambl Stud 2016 Apr 10;16(2):193-210. [CrossRef]
- Motka F, Grüne B, Sleczka P, Braun B, Örnberg JC, Kraus L. Who uses self-exclusion to regulate problem gambling? A systematic literature review. Journal of Behavioral Addictions 2018 Dec;7(4):903-916. [CrossRef]
- Caillon J, Grall-Bronnec M, Perrot B, Leboucher J, Donnio Y, Romo L, et al. Effectiveness of at-risk gamblers' temporary self-exclusion from internet gambling sites. J Gambl Stud 2019 Jun;35(2):601-615. [CrossRef] [Medline]
- McCormack A, Shorter GW, Griffiths MD. An empirical study of gender differences in online gambling. J Gambl Stud 2014 Mar;30(1):71-88. [CrossRef] [Medline]
- Auer M, Hopfgartner N, Griffiths MD. An empirical study of the effect of voluntary limit-setting on gamblers’ loyalty using behavioural tracking data. Int J Ment Health Addiction 2019 Apr 26:1-12. [CrossRef]
- Hing N, Cherney L, Gainsbury SM, Lubman DI, Wood RT, Blaszczynski A. Maintaining and losing control during internet gambling: a qualitative study of gamblers' experiences. New Media & Society 2014 Jan 27;17(7):1075-1095 [FREE Full text] [CrossRef]
- Williams RJ, Volberg RA, Stevens RMG. The population prevalence of problem gambling: methodological influences, standardized rates, jurisdictional differences, and worldwide trends.: Report prepared for the Ontario Problem Gambling Research Centre & the Ontario Ministry of Health and Long Term Care; 2012 May 08. URL: https://pdfs.semanticscholar.org/e657/fb4399befa9a5cb68337d08b5675d04306bd.pdf?_ga=2.252403977.1281152942.1590565077-607814672.1580121986 [accessed 2020-01-03]
- Corney R, Davis J. The attractions and risks of Internet gambling for women: a qualitative study. Journal of Gambling Issues 2010 Jul 01(24):121-139. [CrossRef]
- Bruneau M, Guillou-Landreat M, Challet-Bouju G, Leboucher J, Sauvaget A, Caillon J, et al. Gambling problems in women: French specificities. In: Bowden-Jones H, Prever F, editors. Gambling Disorders In Women: An International Female Perspective On Treatment And Research. Abingdon (GB): Routledge; Jun 2017.
- Haefeli J, Lischer S, Schwarz J. Early detection items and responsible gambling features for online gambling. Int Gambl Stud 2011 Aug 17;11(3):273-288. [CrossRef]
Abbreviations
EDEIN: Etude de Dépistage des comportements Excessifs de jeu sur Internet (Screening for Excessive Gambling Behaviors on the Internet) |
Edited by G Eysenbach; submitted 03.01.20; peer-reviewed by M Bellringer, D Hodgins; comments to author 13.02.20; revised version received 26.02.20; accepted 29.02.20; published 12.08.20
Copyright©Gaëlle Challet-Bouju, Jean-Benoit Hardouin, Elsa Thiabaud, Anaïs Saillard, Yann Donnio, Marie Grall-Bronnec, Bastien Perrot. Originally published in the Journal of Medical Internet Research (http://www.jmir.org), 12.08.2020.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on http://www.jmir.org/, as well as this copyright and license information must be included.