A Mobile Phone App Featuring Cue Exposure Therapy As Aftercare for Alcohol Use Disorders: An Investigator-Blinded Randomized Controlled Trial

Background Cue exposure therapy (CET) is a psychological approach developed to prepare individuals with alcohol use disorder (AUD) for confronting alcohol and associated stimuli in real life. CET has shown promise when treating AUD in group sessions, but it is unknown whether progressing from group sessions to using a mobile phone app is an effective delivery pathway. Objective The objectives of this study were to investigate (1) whether CET as aftercare would increase the effectiveness of primary treatment with cognitive behavior therapy, and (2) whether CET delivered through a mobile phone app would be similarly effective to CET via group sessions. Methods A total of 164 individuals with AUD were randomized to one of three groups: CET as group aftercare (CET group), CET as fully automated mobile phone app aftercare (CET app), or aftercare as usual. Study outcomes were assessed face-to-face at preaftercare, postaftercare, and again at 6 months after aftercare treatment. Generalized mixed models were used to compare the trajectories of the groups over time on drinking, cravings, and use of urge-specific coping skills (USCS). Results In all, 153 of 164 individuals (93%) completed assessments both at posttreatment and 6-month follow-up assessments. No differences in the trajectories of predicted means were found between the experimental groups (CET group and app) compared with aftercare as usual on drinking and craving outcomes over time. Both CET group (predicted mean difference 5.99, SE 2.59, z=2.31, P=.02) and the CET app (predicted mean difference 4.90, SE 2.26, z=2.31, P=.02) showed increased use of USCS compared to aftercare as usual at posttreatment, but this effect was reduced at the 6-month follow-up. No differences were detected between the two experimental CET groups on any outcomes. Conclusions CET with USCS delivered as aftercare either via group sessions or a mobile phone app did not increase the effectiveness of primary treatment. This suggests that CET with USCS may not be an effective psychological approach for the aftercare of individuals treated for AUD. Trial Registration ClinicalTrials.gov NCT02298751; https://clinicaltrials.gov/ct2/show/NCT02298751


1b-i) Key features/functionalities/components of the intervention and comparator in the METHODS section of the ABSTRACT
Mention key features/functionalities/components of the intervention and comparator in the abstract. If possible, also mention theories and principles used for designing the site. Keep in mind the needs of systematic reviewers and indexers by including important synonyms. (Note: Only report in the abstract what the main paper is reporting. If this information is missing from the main body of text, consider adding it) 1 2 3 4 5 subitem not at all important essential Does your paper address subitem 1b-i? * Copy and paste relevant sections from the manuscript abstract (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study Yes, for example, like this: "Cue exposure therapy (CET) is a psychological approach developed to prepare individuals with alcohol use disorder (AUD) for confronting alcohol and associated stimuli in real life." "The objectives of this study were to investigate1) whether CET as aftercare would increase the effectiveness of primary treatment with cognitive behavior therapy, and 2) whether CET delivered through a mobile phone app would be similarly effective to CET via group sessions."

1b-ii) Level of human involvement in the METHODS section of the ABSTRACT
Clarify the level of human involvement in the abstract, e.g., use phrases like "fully automated" vs. "therapist/nurse/care provider/physician-assisted" (mention number and expertise of providers involved, if any). (Note: Only report in the abstract what the main paper is reporting. If this information is missing from the main body of text, consider adding it) 1 2 3 4 5 subitem not at all important essential

Does your paper address subitem 1b-ii?
Copy and paste relevant sections from the manuscript abstract (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study 1b-iii) Open vs. closed, web-based (self-assessment) vs. face-to-face assessments in the METHODS section of the ABSTRACT Mention how participants were recruited (online vs. offline), e.g., from an open access website or from a clinic or a closed online user group (closed usergroup trial), and clarify if this was a purely web-based trial, or there were face-to-face components (as part of the intervention or for assessment). Clearly say if outcomes were self-assessed through questionnaires (as common in web-based trials). Note: In traditional offline trials, an open trial (open-label trial) is a type of clinical trial in which both the researchers and participants know which treatment is being administered. To avoid confusion, use "blinded" or "unblinded" to indicated the level of blinding https://docs.google.com/spreadsheet/viewform?formkey=dGlKd2Z2Q1lNSGQ0THl1azM5MS1aWWc6MA Page 6 of 45 instead of "open", as "open" in web-based trials usually refers to "open access" (i.e. participants can self-enrol). (Note: Only report in the abstract what the main paper is reporting. If this information is missing from the main body of text, consider adding it) 1 2 3 4 5 subitem not at all important essential Does your paper address subitem 1b-iii? Copy and paste relevant sections from the manuscript abstract (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study 1b-iv) RESULTS section in abstract must contain use data Report number of participants enrolled/assessed in each group, the use/uptake of the intervention (e.g., attrition/adherence metrics, use over time, number of logins etc.), in addition to primary/secondary outcomes. (Note: Only report in the abstract what the main paper is reporting. If this information is missing from the main body of text, consider adding it) 1 2 3 4 5 subitem not at all important essential Does your paper address subitem 1b-iv? Copy and paste relevant sections from the manuscript abstract (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study

1b-v) CONCLUSIONS/DISCUSSION in abstract for negative trials
Conclusions/Discussions in abstract for negative trials: Discuss the primary outcome -if the trial is negative (primary outcome not changed), and the intervention was not used, discuss whether negative results are attributable to lack of uptake and discuss reasons. (Note: Only report in the abstract what the main paper is reporting. If this information is missing from the main body of text, consider adding it) 1 2 3 4 5 subitem not at all important essential

Does your paper address subitem 1b-v?
Copy and paste relevant sections from the manuscript abstract (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study

INTRODUCTION 2a) In INTRODUCTION: Scientific background and explanation of rationale 2a-i) Problem and the type of system/solution
Describe the problem and the type of system/solution that is object of the study: intended as stand-alone intervention vs. incorporated in broader health care program? Intended for a particular patient population? Goals of the intervention, e.g., being more cost-effective to other interventions, replace or complement other solutions? (Note: Details about the intervention are provided in "Methods" under 5) 1 2 3 4 5 subitem not at all important essential Does your paper address subitem 2a-i? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study Yes, for example, like this: "In Western societies, individuals with an alcohol use disorder (AUD) are constantly exposed to alcohol and associated cues in their everyday life. Even when successfully treated with evidence-based psychological approaches, such as cognitive behavioral therapy, this pervasive exposure can induce cue-controlled cravings and lead to relapses, with devastating personal, familial, and socioeconomic consequences and increased burden on national health care resources." "Cue exposure therapy (CET) is a behavioristic, psychological approach to treating AUD that aims to reduce cue-induced cravings by repeatedly exposing individuals with AUD to relevant alcohol cues and hindering their habitual drinking response [1][2][3][4][5]. AUD individuals can thus reduce their cue reactivity and be better prepared to navigate in society." "When offering evidence-based primary and add-on aftercare AUD treatments, such as CET with USCS, the duration of the treatment is often shortened and may even be performed in group settings rather than individual sessions [10]. Due to the heavy burden on health care resources, this in itself may be an advantage of implementing evidence-based treatment strategies. Moreover, we may be experiencing another paradigm change in treatment delivery pathways, progressing from individual and group sessions to eHealth interventions through mobile devices [16][17][18][19][20], which could also lower the costs of treatment.

2b) In INTRODUCTION: Specific objectives or hypotheses
Does your paper address CONSORT subitem 2b? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study Yes, like this: "The objectives of this study are two-fold: (1) to investigate whether CET with USCS (based on a published treatment manual) delivered as aftercare would increase the effectiveness of cognitive behavioral therapy compared with aftercare as usual and (2) to investigate whether CET with USCS delivered through a mobile phone app would be noninferior to CET with USCS via group sessions. In light of available evidence, it was hypothesized that the experimental CET aftercare groups would achieve superior outcomes (such as alcohol consumption, urges or cravings, and coping skills) compared with active controls treated with aftercare as usual. It was an explorative research question whether a CET mobile phone app was noninferior to the group therapy."

3a) Description of trial design (such as parallel, factorial) including allocation ratio
Does your paper address CONSORT subitem 3a? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study Yes, like this: "The CET aftercare study was conducted as a single-site, investigator-blinded, parallel randomized controlled trial (RCT)…" The allocation ratio was 1:1:1 and is not stated explicitly in the ms.

3b) Important changes to methods after trial commencement (such as eligibility criteria), with reasons
Does your paper address CONSORT subitem 3b? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study Although it may be a minor change, it is worth mentioning that we included patients between 18 and 80 years, although we aimed to include patients between 18 and 60 years in the beginning of the trial. This modification was performed due to unexpected challenges recruiting the 300 patients.

3b-i) Bug fixes, Downtimes, Content Changes
Bug fixes, Downtimes, Content Changes: ehealth systems are often dynamic systems. A description of changes to methods therefore also includes important changes made on the intervention or comparator during the trial (e.g., major bug fixes or changes in the functionality or content) (5-iii) and other "unexpected events" that may have influenced study design such as staff Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study Yes, like this: "To be eligible for inclusion in the study, individuals had to provide informed written consent, be aged between 18 and 80 years, and have completed primary treatment. Individuals who did not speak Danish, had an acute psychotic disorder, severe cognitive impairment, or terminal somatic illness were not eligible to participate."

4a-i) Computer / Internet literacy
Computer / Internet literacy is often an implicit "de facto" eligibility criterion -this should be explicitly clarified.
1 2 3 4 5 subitem not at all important essential Does your paper address subitem 4a-i? Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study 4a-ii) Open vs. closed, web-based vs. face-to-face assessments: Open vs. closed, web-based vs. face-to-face assessments: Mention how participants were recruited (online vs. offline), e.g., from an open access website or from a clinic, and clarify if this was a purely web-based trial, or there were face-to-face components (as part of the intervention or for assessment), i.e., to what degree got the study team to know the participant. In online-only trials, clarify if participants were quasi-anonymous and whether having multiple identities was possible or whether technical or logistical measures (e.g., cookies, email confirmation, phone calls) were used to detect/prevent these. Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study Yes, for example, as follows: "The CET aftercare study was conducted …..in an outpatient alcohol treatment clinic in Funen, Denmark." "Study participants were recruited…shortly before concluding the standard 3-month primary treatment at the outpatient clinic, the individuals were briefly informed about the aftercare project." "Willing individuals then received additional oral and written project information from the research assistant. After informed consent was obtained, the preaftercare interview was carried out,…" "Study outcomes were assessed face-to-face at preaftercare, postaftercare, and again at 6 months after aftercare treatment"

4a-iii) Information giving during recruitment
Information given during recruitment. Specify how participants were briefed for recruitment and in the informed consent procedures (e.g., publish the informed consent documentation as appendix, see also item X26), as this information may have an effect on user self-selection, user expectation and may also bias results.
1 2 3 4 5 subitem not at all important essential Does your paper address subitem 4a-iii? Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study 4b) Settings and locations where the data were collected Does your paper address CONSORT subitem 4b? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study Yes, like this: individual or group sessions and usually consists of eight sessions. The treatment course is planned together with the individual, and the therapy typically incorporates psychoeducation, functional analysis of drinking situations, development of coping strategies (eg, waiting out until the urges pass, thinking about the negative consequences of drinking, thinking about positive consequences of sobriety, and intake of alternative food and beverage), problem solving, and homework between sessions. The psychological treatments are delivered by therapists who are nurses and social workers educated within the treatment range. Supervision is frequent, and psychiatrists regularly monitor the treatment course" 4b-i) Report if outcomes were (self-)assessed through online questionnaires Clearly report if outcomes were (self-)assessed through online questionnaires (as common in web-based trials) or otherwise.
1 2 3 4 5 subitem not at all important essential Does your paper address subitem 4b-i? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study Yes, all outcome measures were delivered in face-to-face-interviews.

4b-ii) Report how institutional affiliations are displayed
Report how institutional affiliations are displayed to potential participants [on ehealth media], as affiliations with prestigious hospitals or universities may affect volunteer rates, use, and reactions with regards to an intervention.(Not a required itemdescribe only if this may bias results) 1 2 3 4 5 subitem not at all important essential

Does your paper address subitem 4b-ii?
Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study https://docs.google.com/spreadsheet/viewform?formkey=dGlKd2Z2Q1lNSGQ0THl1azM5MS1aWWc6MA Page 13 of 45

5-i) Mention names, credential, affiliations of the developers, sponsors, and owners
Mention names, credential, affiliations of the developers, sponsors, and owners [6] (if authors/evaluators are owners or developer of the software, this needs to be declared in a "Conflict of interest" section or mentioned elsewhere in the manuscript).
1 2 3 4 5 subitem not at all important essential Does your paper address subitem 5-i? Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study

5-ii) Describe the history/development process
Describe the history/development process of the application and previous formative evaluations (e.g., focus groups, usability testing), as these will have an impact on adoption/use rates and help with interpreting results.

Does your paper address subitem 5-ii?
Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study

5-iii) Revisions and updating
Revisions and updating. Clearly mention the date and/or version number of the application/intervention (and comparator, if applicable) evaluated, or describe whether the intervention underwent major changes during the evaluation process, or whether the development and/or content was "frozen" during the trial. Describe dynamic components such as news feeds or changing content which may have an impact on the replicability of the intervention (for unexpected events see item 3b). Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study

5-iv) Quality assurance methods
Provide information on quality assurance methods to ensure accuracy and quality of information provided [1], if applicable.
1 2 3 4 5 subitem not at all important essential Does your paper address subitem 5-iv? Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study

5-v) Ensure replicability by publishing the source code, and/or providing screenshots/screen-capture video, and/or providing flowcharts of the algorithms used
Ensure replicability by publishing the source code, and/or providing screenshots/screen-capture video, and/or providing flowcharts of the algorithms used. Replicability (i.e., other researchers should in principle be able to replicate the study) is a hallmark of scientific reporting.

Does your paper address subitem 5-v?
Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study

5-vi) Digital preservation
Digital preservation: Provide the URL of the application, but as the intervention is likely to change or disappear over the course of the years; also make sure the intervention is archived (Internet Archive, webcitation.org, and/or publishing the source code or screenshots/videos alongside the article). As pages behind login screens cannot be archived, consider creating demo pages which are accessible without login. this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study

5-vii) Access
Access: Describe how participants accessed the application, in what setting/context, if they had to pay (or were paid) or not, whether they had to be a member of specific group. If known, describe how participants obtained "access to the platform and Internet" [1]. To ensure access for editors/reviewers/readers, consider to provide a "backdoor" login account or demo mode for reviewers/readers to explore the application (also important for archiving purposes, see vi).
1 2 3 4 5 subitem not at all important essential Does your paper address subitem 5-vii? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study No, this is not explicitly stated in the ms.. The patients either downloaded the app for free on their own mobile phone or borrowed a phone from the project in the case they did not have one. subitem not at all important essential Does your paper address subitem 5-viii? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study Yes, as follows: "Based on the same treatment manual as the group CET approach, the CET aftercare intervention was transformed into a fully automated mobile phone app (see Figure 1). The app was individually adaptive in terms of the featured coping strategies and the alcohol exposure material. Exposure to alcohol was simulated by watching one of eight alcohol videos on the mobile phone (eg, beer, red or white wine, mixed alcoholic drinks, hard liquor), which allowed individuals to select their preferred beverage as the exposure material. The alcohol exposure videos imitated sessions with a therapist, and the alcohol presented in the videos became increasingly appetitive during the exposure session to induce cue-controlled cravings. The app contained a direct phone number to a CET therapist in case of uncontrollable cravings, and the app was only accessible during the opening hours of the alcohol outpatient clinic (Monday to Friday from 9 AM to 6 PM) so that the patient could meet the therapist and get help to control the cravings."

5-viii) Mode of delivery, features/functionalities/components of the intervention and comparator, and the theoretical framework
We also refer to the following method paper for more detailed information: Mellentin, A. I., Stenager, E., Nielsen, B., Nielsen, A. S., & Yu, F. (2017). A smarter pathway for delivering cue exposure therapy? The design and development of a smartphone app targeting alcohol use disorder. JMIR mHealth and uHealth, 5(1), e5.

5-ix) Describe use parameters
Describe use parameters (e.g., intended "doses" and optimal timing for use). Clarify what instructions or recommendations were given to the user, e.g., regarding timing, frequency, heaviness of use, if any, or was the intervention used ad libitum.

Does your paper address subitem 5-ix?
Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study

5-x) Clarify the level of human involvement
Clarify the level of human involvement (care providers or health professionals, also technical assistance) in the e-intervention or as co-intervention (detail number and expertise of professionals involved, if any, as well as "type of assistance offered, the timing and frequency of the support, how it is initiated, and the medium by which the assistance is delivered". It may be necessary to distinguish between the level of human involvement required for the trial, and the level of human involvement required for a routine application outside of a RCT setting (discuss under item 21generalizability). subitem not at all important essential

Does your paper address subitem 5-x?
Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study

5-xi) Report any prompts/reminders used
Report any prompts/reminders used: Clarify if there were prompts (letters, emails, phone calls, SMS) to use the application, what triggered them, frequency etc. It may be necessary to distinguish between the level of prompts/reminders required for the trial, and the level of prompts/reminders for a routine application outside of a RCT setting (discuss under item 21generalizability).
1 2 3 4 5 subitem not at all important essential Does your paper address subitem 5-xi? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study

5-xii) Describe any co-interventions (incl. training/support)
Describe any co-interventions (incl. training/support): Clearly state any interventions that are provided in addition to the targeted eHealth intervention, as ehealth intervention may not be designed as stand-alone intervention. This includes training sessions and support [1]. It may be necessary to distinguish between the level of training required for the trial, and the level of training for a routine application outside of a RCT setting (discuss under item 21generalizability.
1 2 3 4 5 subitem not at all important essential Does your paper address subitem 5-xii? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study Yes, for example, like this: "The objectives of this study were to investigate1) whether CET as aftercare would increase the effectiveness of primary treatment with cognitive behavior therapy, and 2) whether CET delivered through a smartphone app would be similarly effective to CET via group sessions." 6a) Completely defined pre-specified primary and secondary outcome Copy and paste relevant sections from manuscript text 6b) Any changes to trial outcomes after the trial commenced, with reasons Does your paper address CONSORT subitem 6b? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study No, we did not change outcomes.

7a) How sample size was determined
NPT: When applicable, details of whether and how the clustering by care provides or centers was addressed

7a-i) Describe whether and how expected attrition was taken into account when calculating the sample size
Describe whether and how expected attrition was taken into account when calculating the sample size.

Does your paper address subitem 7a-i?
Copy and paste relevant sections from manuscript title (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study

7b) When applicable, explanation of any interim analyses and stopping guidelines
Does your paper address CONSORT subitem 7b? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for https://docs.google.com/spreadsheet/viewform?formkey=dGlKd2Z2Q1lNSGQ0THl1azM5MS1aWWc6MA Page 20 of 45 your study No, this is not described in the ms., but after including 30 patients a statistician (not part of the research team) analyzed the primary outcomes to make sure that the participants in the app group did not have remarkable more relapses than the other groups.

8a) Method used to generate the random allocation sequence
NPT: When applicable, how care providers were allocated to each trial group Does your paper address CONSORT subitem 8a? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study Only, like this: "To ensure adequate allocation concealment, the random allocation sequence was generated by a statistician so that the research team was not involved in generating the sequence. " But the randomization occurred by means of a computerised random number generator.

8b) Type of randomisation; details of any restriction (such as blocking and block size)
Does your paper address CONSORT subitem 8b? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study Yes, like this: "Randomization occurred using computerized urn randomization….. In contrast to simple or block randomization, urn randomization is dynamic, and the probability of treatment assignment changes depending on the degree of treatment imbalance throughout the trial. Increased probability of randomization to the groups with the least number of participants increases systematically. This ensures allocation balance throughout the study and random allocation of covariates."

9) Mechanism used to implement the random allocation sequence (such as sequentially numbered containers), describing any steps taken to conceal the sequence until interventions were assigned
Does your paper address CONSORT subitem 9? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study No, but the research assistants conducted the pre-aftercare assessment questionnaires on a PC https://docs.google.com/spreadsheet/viewform?formkey=dGlKd2Z2Q1lNSGQ0THl1azM5MS1aWWc6MA Page 21 of 45 though a web-based research database (REDCap) where the project data were stored. After completing each patient assessment they entered a randomization section and pushed a randomization bottom, whereby the randomization group was revealed for that specific patient. Hence, the allocation sequence was concealed for the research team as well as research assistants until the patients were randomized.

10) Who generated the random allocation sequence, who enrolled participants, and who assigned participants to interventions
Does your paper address CONSORT subitem 10? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study Yes, like this: "…the random allocation sequence was generated by a statistician so that the research team was not involved in generating the sequence" "Willing individuals then received additional oral and written project information from the research assistant. After informed consent was obtained, the preaftercare interview was carried out, and individuals fulfilling the eligibility criteria were randomized to one of the three aftercare treatment groups described subsequently" In sum, the statistician generated the random alloction sequence and the research assistants enrolled and assigned the patients to the groups.

11a) If done, who was blinded after assignment to interventions (for example, participants, care providers, those assessing outcomes) and how
NPT: Whether or not administering co-interventions were blinded to group assignment 11a-i) Specify who was blinded, and who wasn't Specify who was blinded, and who wasn't. Usually, in web-based trials it is not possible to blind the participants [1, 3] (this should be clearly acknowledged), but it may be possible to blind outcome assessors, those doing data analysis or those administering co-interventions (if any).
Does your paper address subitem 11a-i? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study Yes, the researchers who developed the study and assessing the outcomes, like this: "… investigator-blinded…" 11a-ii) Discuss e.g., whether participants knew which intervention was the "intervention of interest" and which one was the "comparator" Informed consent procedures (4a-ii) can create biases and certain expectations -discuss e.g., whether participants knew which intervention was the "intervention of interest" and which one was the "comparator".

Does your paper address subitem 11a-ii?
Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study

11b) If relevant, description of the similarity of interventions
(this item is usually not relevant for ehealth trials as it refers to similarity of a placebo or sham intervention to a active medication/intervention) Does your paper address CONSORT subitem 11b? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study 12a) Statistical methods used to compare groups for primary and secondary outcomes NPT: When applicable, details of whether and how the clustering by care providers or centers was addressed Does your paper address CONSORT subitem 12a? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for https://docs.google.com/spreadsheet/viewform?formkey=dGlKd2Z2Q1lNSGQ0THl1azM5MS1aWWc6MA Page 23 of 45 your study Yes, as follows: "Generalized linear mixed models were used to examine the trajectories of the primary and secondary outcomes by group allocation over time. Specifically, we wanted to examine how alcohol consumption, cravings, and USCS were influenced by the variable time point (preaftercare, postaftercare, and 6-month follow-up) and the interaction between time point and group (CET group, CET app, and aftercare as usual)." "Fixed effects consisted of time point and group×time point interaction. Because patients were randomized into three groups, this interaction tests for the existence of a treatment effect over time. All models included a subject-specific random intercept and allowed for a subject-specific random slope over time... If there was an overall significant interaction effect between group and any one time point, we examined whether the change over time differed between the groups and the time point using contrasts"

12a-i) Imputation techniques to deal with attrition / missing values
Imputation techniques to deal with attrition / missing values: Not all participants will use the intervention/comparator as intended and attrition is typically high in ehealth trials. Specify how participants who did not use the application or dropped out from the trial were treated in the statistical analysis (a complete case analysis is strongly discouraged, and simple imputation techniques such as LOCF may also be problematic [4]).
1 2 3 4 5 subitem not at all important essential Does your paper address subitem 12a-i? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study.
Yes, as follows: "Assuming the dropout mechanism is missing at random, these models deal efficiently with missing values due to dropout using the maximum likelihood estimator (missing were 7%, n=11 in both the first and second follow-ups). Therefore, with the mixed-effects model approach, all available data were used."

12b) Methods for additional analyses, such as subgroup analyses and adjusted analyses
Does your paper address CONSORT subitem 12b? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study No, the aim of this ms. is to provide the main results. Further, due to the fact that we did not achieve the 300 patients we strived for based on the power calculation, it may be difficult to conduct meaningful sub-group analysis.

X26) REB/IRB Approval and Ethical Considerations [recommended as subheading under "Methods"] (not a CONSORT item)
X26-i) Comment on ethics committee approval 1 2 3 4 5 subitem not at all important essential

Does your paper address subitem X26-i?
Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study

x26-ii) Outline informed consent procedures
Outline informed consent procedures e.g., if consent was obtained offline or online (how? Checkbox, etc.?), and what information was provided (see 4a-ii). See [6] for some items to be included in informed consent documents.

Does your paper address subitem X26-ii?
Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study

X26-iii) Safety and security procedures
Safety and security procedures, incl. privacy considerations, and any steps taken to reduce the likelihood or detection of harm (e.g., education and training, availability of a hotline) 1 2 3 4 5 subitem not at all important essential

Does your paper address subitem X26-iii?
Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for

RESULTS
13a) For each group, the numbers of participants who were randomly assigned, received intended treatment, and were analysed for the primary outcome NPT: The number of care providers or centers performing the intervention in each group and the number of patients treated by each care provider in each center Does your paper address CONSORT subitem 13a? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study Yes, in tables and the CONSORT flow diagram.

13b) For each group, losses and exclusions after randomisation, together with reasons
Does your paper address CONSORT subitem 13b? (NOTE: Preferably, this is shown in a CONSORT flow diagram) * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study Yes, in the CONSORT flow diagram.

13b-i) Attrition diagram
Strongly recommended: An attrition diagram (e.g., proportion of participants still logging in or using the intervention/comparator in each group plotted over time, similar to a survival curve) or other figures or tables demonstrating usage/dose/engagement. item is not applicable/relevant for your study

14a) Dates defining the periods of recruitment and follow-up
Does your paper address CONSORT subitem 14a? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study Yes, for example, like this: "Study participants were recruited from June 1, 2015, to June 1, 2017." "Study outcomes were assessed face-to-face at pre-aftercare, post-aftercare and again at 6month upon aftercare treatment."

14a-i) Indicate if critical "secular events" fell into the study period
Indicate if critical "secular events" fell into the study period, e.g., significant changes in Internet resources available or "changes in computer hardware or Internet delivery resources" 1 2 3 4 5 subitem not at all important essential Does your paper address subitem 14a-i? Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study 14b) Why the trial ended or was stopped (early) Does your paper address CONSORT subitem 14b? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study The trial was ended as planned. The power calculation led us to aim for 300 participants, which could not be achieved due to surprisingly few patients entering primary treatment during the recruitment period and many patients declining to participate in the aftercare study. Unfortunately, it was not possible to extend the recruitment period.

15) A table showing baseline demographic and clinical characteristics for each group
NPT: When applicable, a description of care providers (case volume, qualification, expertise, etc.) and centers (volume) in each group Does your paper address CONSORT subitem 15? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study Yes, can be seen in Table 1.: Sample characteristics before aftercare treatment with cue exposure treatment (CET) or aftercare as usual (N=164).

15-i) Report demographics associated with digital divide issues
In ehealth trials it is particularly important to report demographics associated with digital divide issues, such as age, education, gender, social-economic status, computer/Internet/ehealth literacy of the participants, if known.
1 2 3 4 5 subitem not at all important essential Does your paper address subitem 15-i? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study No, because it was not the aim of this ms. reporting the main results to conduct descriptive subgroup analysis.

16-i) Report multiple "denominators" and provide definitions
Report multiple "denominators" and provide definitions: Report N's (and effect sizes) "across a range of study participation [and use] thresholds" [1], e.g., N exposed, N consented, N used more than x times, N used more than y weeks, N participants "used" the intervention/comparator at specific pre-defined time points of interest (in absolute and relative numbers per group). Always clearly define "use" of the intervention.

16-ii) Primary analysis should be intent-to-treat
Primary analysis should be intent-to-treat, secondary analyses could include comparing only "users", with the appropriate caveats that this is no longer a randomized sample (see 18-i).
1 2 3 4 5 subitem not at all important essential Does your paper address subitem 16-ii? Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study Yes, like this: "Two analyses were performed for each outcome measure: (1) intention-to-treat analysis (ie, irrespective of whether individuals had completed the interventions or were reinterviewed).." 17a) For each primary and secondary outcome, results for each group, and the estimated effect size and its precision (such as 95% confidence interval) Does your paper address CONSORT subitem 17a? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study Yes, please see Table 2 and 3.

17a-i) Presentation of process outcomes such as metrics of use and intensity of use
In addition to primary/secondary (clinical) outcomes, the presentation of process outcomes such as metrics of use and intensity of use (dose, exposure) and their operational definitions is critical. This does not only refer to metrics of attrition (13-b) (often a binary variable), but also to more continuous exposure metrics such as "average session length". These must be accompanied by a technical description how a metric like a "session" is defined (e.g., timeout after idle time) [1] (report under item 6a).
1 2 3 4 5 subitem not at all important essential Does your paper address subitem 17a-i? Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study 17b) For binary outcomes, presentation of both absolute and relative effect sizes is recommended Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study We have reported predicted mean changes over time and predicted mean differences between groups over time using GLM models.

18) Results of any other analyses performed, including subgroup analyses and adjusted analyses, distinguishing pre-specified from exploratory
Does your paper address CONSORT subitem 18? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study No, it was not the aim of this manuscript to report at sub-group levelplease see answers above.

18-i) Subgroup analysis of comparing only users
A subgroup analysis of comparing only users is not uncommon in ehealth trials, but if done, it must be stressed that this is a self-selected sample and no longer an unbiased sample from a randomized trial (see 16-iii).
1 2 3 4 5 subitem not at all important essential Does your paper address subitem 18-i? Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study

19) All important harms or unintended effects in each group
(for specific guidance see CONSORT for harms) Does your paper address CONSORT subitem 19? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study No, there were no unintended effects at the 6-month follow-up and we did therefore not report any.

19-i) Include privacy breaches, technical problems
Include privacy breaches, technical problems. This does not only include physical "harm" to participants, but also incidents such as perceived or real privacy breaches [1], technical problems, and other unexpected/unintended incidents. "Unintended effects" also includes unintended positive effects [2].

Does your paper address subitem 19-i?
Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study

19-ii) Include qualitative feedback from participants or observations from staff/researchers
Include qualitative feedback from participants or observations from staff/researchers, if available, on strengths and shortcomings of the application, especially if they point to unintended/unexpected effects or uses. This includes (if available) reasons for why people did or did not use the application as intended by the developers.

Does your paper address subitem 19-ii?
Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study

22) Interpretation consistent with results, balancing benefits and harms, and considering other relevant evidence
NPT: In addition, take into account the choice of the comparator, lack of or partial blinding, and unequal expertise of care providers or centers in each group

22-i) Restate study questions and summarize the answers suggested by the data, starting with primary outcomes and process outcomes (use)
Restate study questions and summarize the answers suggested by the data, starting with primary outcomes and process outcomes (use).
1 2 3 4 5 subitem not at all important essential Does your paper address subitem 22-i? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study Yes, as follows: "The objectives of this study were to investigate whether CET based on a treatment manual and combined with USCS delivered as alcohol treatment aftercare would increase the effectiveness of cognitive behavioral therapy, and whether delivery by means of a mobile phone app would demonstrate similar effectiveness as group sessions. Contrary to our a priori hypothesis, we did not find support for superior effectiveness of CET compared with aftercare as usual on alcohol consumption and urge-related outcomes over time. The experimental CET groups used USCS more than the controls at posttreatment, but this effect was reduced at 6-month follow-up. We found no differences in outcomes between the experimental groups receiving CET through group sessions or a mobile phone app." subitem not at all important essential

Does your paper address subitem 22-ii?
Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study

20-i) Typical limitations in ehealth trials
Typical limitations in ehealth trials: Participants in ehealth trials are rarely blinded. Ehealth trials often look at a multiplicity of outcomes, increasing risk for a Type I error. Discuss biases due to non-use of the intervention/usability issues, biases through informed consent procedures, unexpected events.
1 2 3 4 5 subitem not at all important essential Does your paper address subitem 20-i? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study Yes, for example, like this: "Although the RCT is the largest conducted to date, it may still lack power to detect potential effects and hence commit type II errors, particularly in view of the well-treated sample. Indeed, the power calculation led us to aim for 300 participants, which could not be achieved due to surprisingly few patients entering primary treatment during the recruitment period and many patients declining to participate in the aftercare study. Second, it was challenging to get the individuals with AUD to use the app, and technical issues meant that the software failed to send regular text messages to remind patients to use the app. These limitations could be easily overcome in the future. Finally, no objective measures of alcohol consumption and cravings were applied to validate self-reported outcomes." https://docs.google.com/spreadsheet/viewform?formkey=dGlKd2Z2Q1lNSGQ0THl1azM5MS1aWWc6MA Page 34 of 45

21) Generalisability (external validity, applicability) of the trial findings
NPT: External validity of the trial findings according to the intervention, comparators, patients, and care providers or centers involved in the trial

21-i) Generalizability to other populations
Generalizability to other populations: In particular, discuss generalizability to a general Internet population, outside of a RCT setting, and general patient population, including applicability of the study results for other organizations 1 2 3 4 5 subitem not at all important essential Does your paper address subitem 21-i? Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study

21-ii) Discuss if there were elements in the RCT that would be different in a routine application setting
Discuss if there were elements in the RCT that would be different in a routine application setting (e.g., prompts/reminders, more human involvement, training sessions or other co-interventions) and what impact the omission of these elements could have on use, adoption, or outcomes if the intervention is applied outside of a RCT setting.
1 2 3 4 5 subitem not at all important essential Does your paper address subitem 21-ii? Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study

23) Registration number and name of trial registry
Does your paper address CONSORT subitem 23? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study Yes, like this: "The trial was registered in ClinicalTrials.gov (ID: NCT02298751) on November 6, 2014."

24) Where the full trial protocol can be accessed, if available
Does your paper address CONSORT subitem 24? * Cite a Multimedia Appendix, other reference, or copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study Yes, like this: "The study methods are presented in more detail elsewhere [33,34]

25) Sources of funding and other support (such as supply of drugs), role of funders
Does your paper address CONSORT subitem 25? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like https://docs.google.com/spreadsheet/viewform?formkey=dGlKd2Z2Q1lNSGQ0THl1azM5MS1aWWc6MA Page 36 of 45 this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study Yes, as follows: "The study was funded by unconditional grants from the Lundbeck Foundation, Tryg Foundation, and the Region of Southern Denmark."

X27-i) State the relation of the study team towards the system being evaluated
In addition to the usual declaration of interests (financial or otherwise), also state the relation of the study team towards the system being evaluated, i.e., state if the authors/evaluators are distinct from or identical with the developers/sponsors of the intervention.
1 2 3 4 5 subitem not at all important essential Does your paper address subitem X27-i? Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study

About the CONSORT EHEALTH checklist
As a result of using this checklist, did you make changes in your manuscript? * X yes, major changes yes, minor changes no What were the most important changes you made as a result of using this checklist?
How much time did you spend on going through the checklist INCLUDING making changes in your manuscript *

hours
As a result of using this checklist, do you think your manuscript has improved? * X yes