Mobile Ecological Momentary Assessment and Intervention and Health Behavior Change Among Adults in Rakai, Uganda: Pilot Randomized Controlled Trial

Background An extraordinary increase in mobile phone ownership has revolutionized the opportunities to use mobile health approaches in lower- and middle-income countries (LMICs). Ecological momentary assessment and intervention (EMAI) uses mobile technology to gather data and deliver timely, personalized behavior change interventions in an individual’s natural setting. To our knowledge, there have been no previous trials of EMAI in sub-Saharan Africa. Objective To advance the evidence base for mobile health (mHealth) interventions in LMICs, we conduct a pilot randomized trial to assess the feasibility of EMAI and establish estimates of the potential effect of EMAI on a range of health-related behaviors in Rakai, Uganda. Methods This prospective, parallel-group, randomized pilot trial compared health behaviors between adult participants submitting ecological momentary assessment (EMA) data and receiving behaviorally responsive interventional health messaging (EMAI) with those submitting EMA data alone. Using a fully automated mobile phone app, participants submitted daily reports on 5 different health behaviors (fruit consumption, vegetable consumption, alcohol intake, cigarette smoking, and condomless sex with a non–long-term partner) during a 30-day period before randomization (P1). Participants were then block randomized to the control arm, continuing EMA reporting through exit, or the intervention arm, EMA reporting and behavioral health messaging receipt. Participants exited after 90 days of follow-up, divided into study periods 2 (P2: randomization + 29 days) and 3 (P3: 30 days postrandomization to exit). We used descriptive statistics to assess the feasibility of EMAI through the completeness of data and differences in reported behaviors between periods and study arms. Results The study included 48 participants (24 per arm; 23/48, 48% women; median age 31 years). EMA data collection was feasible, with 85.5% (3777/4418) of the combined days reporting behavioral data. There was a decrease in the mean proportion of days when alcohol was consumed in both arms over time (control: P1, 9.6% of days to P2, 4.3% of days; intervention: P1, 7.2% of days to P3, 2.4% of days). Decreases in sex with a non–long-term partner without a condom were also reported in both arms (P1 to P3 control: 1.9% of days to 1% of days; intervention: 6.6% of days to 1.3% of days). An increase in vegetable consumption was found in the intervention (vegetable: 65.6% of days to 76.6% of days) but not in the control arm. Between arms, there was a significant difference in the change in reported vegetable consumption between P1 and P3 (control: 8% decrease in the mean proportion of days vegetables consumed; intervention: 11.1% increase; P=.01). Conclusions Preliminary estimates suggest that EMAI may be a promising strategy for promoting behavior change across a range of behaviors. Larger trials examining the effectiveness of EMAI in LMICs are warranted. Trial Registration ClinicalTrials.gov NCT04375423; https://www.clinicaltrials.gov/ct2/show/NCT04375423

Is this a full powered effectiveness trial or a pilot/feasibility trial? * Manuscript tracking number * If this is a JMIR submission, please provide the manuscript tracking number under "other" (The ms tracking number can be found in the submission acknowledgement email, or when you login as author in JMIR. If the paper is already published in JMIR, then the ms tracking number is the four-digit number at the end of the DOI, to be found at the bottom of each published article in JMIR) TITLE AND ABSTRACT 1a) TITLE: Identification as a randomized trial in the title

1a-i) Identify the mode of delivery in the title
Identify the mode of delivery. Preferably use "web-based" and/or "mobile" and/or "electronic game" in the title. Avoid ambiguous terms like "online", "virtual", "interactive". Use "Internet-based" only if Intervention includes non-web-based Internet components (e.g. email), use "computer-based" or "electronic" only if offline products are used. Use "virtual" only in the context of "virtual reality" (3-D worlds). Use "online" only in the context of "online support groups". Complement or substitute product names with broader terms for the class of products (such as "mobile" or "smart phone" instead of "iphone"), especially if the application runs on different platforms.
Does your paper address subitem 1a-i? * Copy and paste relevant sections from manuscript title (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study "Mobile Ecological Momentary Assessment and Intervention" 1a-ii) Non-web-based components or important co-interventions in title Mention non-web-based components or important co-interventions in title, if any (e.g., "with telephone support").
Does your paper address subitem 1a-ii?
Copy and paste relevant sections from manuscript title (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study Your answer 1a-iii) Primary condition or target group in the title Mention primary condition or target group in the title, if any (e.g., "for children with Type I Diabetes") Example: A Web-based and Mobile Intervention with Telephone Support for Children with Type I Diabetes: Randomized Controlled Trial Does your paper address subitem 1a-iii? * Copy and paste relevant sections from manuscript title (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study "among Adults in Rakai, Uganda" https://docs.google.com/forms/d/e/1FAIpQLSfZBSUp1bwOc_OimqcS64RdfIAFvmrTSkZQL2-3O8O9hrL5Sw/viewform?hl=en_US&formkey=dGlKd2… 10/57 1b) ABSTRACT: Structured summary of trial design, methods, results, and conclusions NPT extension: Description of experimental treatment, comparator, care providers, centers, and blinding status.
subitem not at all important Does your paper address subitem 1b-i? * Copy and paste relevant sections from the manuscript abstract (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study "This prospective, parallel group, randomized pilot trial compared health behaviors between adult participants submitting EMA data and receiving behaviorallyresponsive interventional health messaging (EMAI) to those submitting EMA data, alone."

1b-ii) Level of human involvement in the METHODS section of the ABSTRACT
Clarify the level of human involvement in the abstract, e.g., use phrases like "fully automated" vs. "therapist/nurse/care provider/physician-assisted" (mention number and expertise of providers involved, if any). (Note: Only report in the abstract what the main paper is reporting. If this information is missing from the main body of text, consider adding it) https://docs.google.com/forms/d/e/1FAIpQLSfZBSUp1bwOc_OimqcS64RdfIAFvmrTSkZQL2-3O8O9hrL5Sw/viewform?hl=en_US&formkey=dGlKd2… 11/57 subitem not at all important 1 2 3 4 5 essential Does your paper address subitem 1b-ii?
Copy and paste relevant sections from the manuscript abstract (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study "Using a fully-automated mobile phone application" 1b-iii) Open vs. closed, web-based (self-assessment) vs. face-to-face assessments in the METHODS section of the ABSTRACT Mention how participants were recruited (online vs. offline), e.g., from an open access website or from a clinic or a closed online user group (closed usergroup trial), and clarify if this was a purely web-based trial, or there were face-to-face components (as part of the intervention or for assessment). Clearly say if outcomes were self-assessed through questionnaires (as common in web-based trials subitem not at all important 1 2 3 4 5 essential Does your paper address subitem 2a-i? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study "To date, behavior change strategies in lower-and middle-income countries (LMICs) have failed to fully leverage the potential of mobile technology to promote optimal health outcomes. While this may be partially due to historically limited technology access in these settings, an extraordinary increase in mobile technology ownership and use, facilitated by advances in lower-cost smartphones, has revolutionized opportunities to employ mHealth approaches in LMICs1. Ecological Momentary Assessment and Intervention (EMAI) uses mobile technology to gather individual-level behavioral data and deliver timely, personalized behavior change interventions in an individual's natural setting2.
These strengths could promote a range of health objectives. Compared to traditional, in-person assessments and interventions, EMAI may offer more userdriven, cost effective, and ecologically and temporally relevant strategies2,3. Rapid and repeated individual-level behavioral measurement and feedback may be particularly effective in supporting changes to semi-conscious behaviors or habits that are di cult to accurately recall and bene t from interruptions in routine to alter4,5. Remote data collection and intervention strategies may be critical for hardto-reach populations, and, due to infection-related concerns such as COVID-19, may help to ll the more widespread need for remote or contactless intervention options." 2a-ii) Scientific background, rationale: What is known about the (type of) system Does your paper address CONSORT subitem 2b? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study "We hypothesized that participants submitting ecological momentary assessment (EMA) reports and receiving intervention messaging (EMAI) would have improved self-reported health behaviors compared to those submitting EMA reports only." 3a) Description of trial design (such as parallel, factorial) including allocation ratio 3b) Important changes to methods after trial commencement (such as eligibility criteria), with reasons subitem not at all important 1 2 3 4 5 essential Does your paper address CONSORT subitem 3a? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study "The study was a prospective, parallel group, randomized pilot trial in Rakai, Uganda." Does your paper address CONSORT subitem 3b? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study There were not any changes after trial commencement.

3b-i) Bug fixes, Downtimes, Content Changes
Bug fixes, Downtimes, Content Changes: ehealth systems are often dynamic systems. A description of changes to methods therefore also includes important changes made on the intervention or comparator during the trial (e.g., major bug fixes or changes in the functionality or content) (5-iii) and other "unexpected events" that may have influenced study design such as staff changes, system failures/downtimes, etc. [2].

4a) Eligibility criteria for participants
subitem not at all important 1 2 3 4 5 essential Does your paper address subitem 3b-i?
Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study

Your answer
Does your paper address CONSORT subitem 4a? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study "The study sampled adult participants (18-49 years) from the Rakai Community Cohort Study (RCCS), an open, population-based cohort running since 1994." "Participants were eligible if they were current RCCS participants with a telephone number listed from the last survey and had at least a secondary level education."

4a-i) Computer / Internet literacy
Computer / Internet literacy is often an implicit "de facto" eligibility criterion -this should be explicitly clarified. Does your paper address subitem 4a-i?
Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study Your answer 4a-ii) Open vs. closed, web-based vs. face-to-face assessments: Open vs. closed, web-based vs. face-to-face assessments: Mention how participants were recruited (online vs. offline), e.g., from an open access website or from a clinic, and clarify if this was a purely webbased trial, or there were face-to-face components (as part of the intervention or for assessment), i.e., to what degree got the study team to know the participant. In online-only trials, clarify if participants were quasi-anonymous and whether having multiple identities was possible or whether technical or logistical measures (e.g., cookies, email confirmation, phone calls) were used to detect/prevent these.
Does your paper address subitem 4a-ii? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study "Lists of potential participants who met the eligibility criteria according to RCCS survey data were generated from the RCCS database. Participants were purposively recruited over the telephone. Study staff members sought variation in participant age, sex, and occupation, aiming to include a minimum of 20% traders and 20% farmers in the sample." subitem not at all important 1 2 3 4 5 essential 4b) Settings and locations where the data were collected 4a-iii) Information giving during recruitment Information given during recruitment. Specify how participants were briefed for recruitment and in the informed consent procedures (e.g., publish the informed consent documentation as appendix, see also item X26), as this information may have an effect on user self-selection, user expectation and may also bias results.
Does your paper address subitem 4a-iii?
Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study

Your answer
Does your paper address CONSORT subitem 4b? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study subitem not at all important 1 2 3 4 5 essential 4b-i) Report if outcomes were (self-)assessed through online questionnaires Clearly report if outcomes were (self-)assessed through online questionnaires (as common in web-based trials) or otherwise.
Does your paper address subitem 4b-i? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study "At the rst study visit, participants were issued a password-protected smartphone programmed with the EMAI study application (emocha Health Inc., Baltimore, MD), a phone charger, and a portable power bank. Participants were trained on the use of the smartphone and fully-automated study application (app) and completed a paper-based enrollment questionnaire collecting participant demographic and behavioral data, recalling the 30 days prior to enrollment.
The app collected EMA data on ve behaviors of interest: fruit consumption, vegetable consumption, alcohol intake, cigarette smoking, and sex with a nonmarital or non-long-term partner without a condom. EMA behavioral data were submitted by the participant through the app: 1) in response to a text message prompt twice per day, once at a random time and once at a xed time asking about each of the behaviors since the last prompt-based report, 2) in response to a text message prompt sent each week, recalling behaviors throughout the week, and 3) through a participant-generated report sent within approximately one hour of engaging in any of the study behaviors of interest (an 'event-contingent' report)." Does your paper address subitem 4b-ii?
Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study The Rakai Health Sciences Program logo was displayed in app icon

5-i) Mention names, credential, affiliations of the developers, sponsors, and owners
Mention names, credential, affiliations of the developers, sponsors, and owners [6] (if authors/evaluators are owners or developer of the software, this needs to be declared in a "Conflict of interest" section or mentioned elsewhere in the manuscript). Does your paper address subitem 5-i?
Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study Your answer

5-ii) Describe the history/development process
Describe the history/development process of the application and previous formative evaluations (e.g., focus groups, usability testing), as these will have an impact on adoption/use rates and help with interpreting results.

Does your paper address subitem 5-ii?
Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study Your answer

5-iii) Revisions and updating
Revisions and updating. Clearly mention the date and/or version number of the application/intervention (and comparator, if applicable) evaluated, or describe whether the intervention underwent major changes during the evaluation process, or whether the development and/or content was "frozen" during the trial. Describe dynamic components such as news feeds or changing content which may have an impact on the replicability of the intervention (for unexpected events see item 3b). Does your paper address subitem 5-iii?
Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study Your answer

5-iv) Quality assurance methods
Provide information on quality assurance methods to ensure accuracy and quality of information provided [1], if applicable.
Does your paper address subitem 5-iv?
Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study Your answer 5-v) Ensure replicability by publishing the source code, and/or providing screenshots/screen-capture video, and/or providing flowcharts of the algorithms used Ensure replicability by publishing the source code, and/or providing screenshots/screen-capture video, and/or providing flowcharts of the algorithms used. Replicability (i.e., other researchers should in principle be able to replicate the study) is a hallmark of scientific reporting. Does your paper address subitem 5-v?
Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study Your answer

5-vi) Digital preservation
Digital preservation: Provide the URL of the application, but as the intervention is likely to change or disappear over the course of the years; also make sure the intervention is archived (Internet Archive, webcitation.org, and/or publishing the source code or screenshots/videos alongside the article). As pages behind login screens cannot be archived, consider creating demo pages which are accessible without login.
Does your paper address subitem 5-vi?
Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study Your answer

5-vii) Access
Access: Describe how participants accessed the application, in what setting/context, if they had to pay (or were paid) or not, whether they had to be a member of specific group. If known, describe how participants obtained "access to the platform and Internet" [1]. To ensure access for editors/reviewers/readers, consider to provide a "backdoor" login account or demo mode for reviewers/readers to explore the application (also important for archiving purposes, see vi). Does your paper address subitem 5-vii? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study "At the rst study visit, participants were issued a password-protected smartphone programmed with the EMAI study application (emocha Health Inc., Baltimore, MD), a phone charger, and a portable power bank. Participants were trained on the use of the smartphone and fully-automated study application (app)" "Participants were given funds equivalent 525MBs of data monthly throughout the study". The app was study-speci c, so we do not have a login account for reviewers/readers. subitem not at all important 1 2 3 4 5 essential Does your paper address subitem 5-viii? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study "The app collected EMA data on ve behaviors of interest: fruit consumption, vegetable consumption, alcohol intake, cigarette smoking, and sex with a nonmarital or non-long-term partner without a condom. EMA behavioral data were submitted by the participant through the app: 1) in response to a text message prompt twice per day, once at a random time and once at a xed time asking about each of the behaviors since the last prompt-based report, 2) in response to a text message prompt sent each week, recalling behaviors throughout the week, and 3) through a participant-generated report sent within approximately one hour of engaging in any of the study behaviors of interest (an 'event-contingent' report).

5-viii) Mode of delivery, features/functionalities/components of the intervention and comparator, and the theoretical framework
For the rst 30 days of the study, all participants sent EMA data, after which they were randomized to control or intervention conditions. Participants in the control arm continued to submit EMA data throughout the remainder of the study period.
From randomization to study exit, intervention arm participants, in addition to continuing EMA data submissions, received health-related messages responsive to the behavioral data submitted. The messages, developed using formative research to ensure appropriateness and relevance, provided positive reinforcement for reported healthy behaviors (e.g. Living alcohol-free today is a step to a healthier future! Alcohol contributes to heart disease and liver cancer.) and encouragement to change in response to reported risk behaviors (e.g. Alcohol abuse increases your risk of heart disease. Protect your heart, and stick to water or juice tomorrow.). Participants exited after study day 90."

5-ix) Describe use parameters
Describe use parameters (e.g., intended "doses" and optimal timing for use). Clarify what instructions or recommendations were given to the user, e.g., regarding timing, frequency, heaviness of use, if any, or was the intervention used ad libitum. Does your paper address subitem 5-ix?
Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study Figure 1 demonstrates use parameters.

5-x) Clarify the level of human involvement
Clarify the level of human involvement (care providers or health professionals, also technical assistance) in the e-intervention or as co-intervention (detail number and expertise of professionals involved, if any, as well as "type of assistance offered, the timing and frequency of the support, how it is initiated, and the medium by which the assistance is delivered". It may be necessary to distinguish between the level of human involvement required for the trial, and the level of human involvement required for a routine application outside of a RCT setting (discuss under item 21 -generalizability).
Does your paper address subitem 5-x?
Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study Your answer

5-xi) Report any prompts/reminders used
Report any prompts/reminders used: Clarify if there were prompts (letters, emails, phone calls, SMS) to use the application, what triggered them, frequency etc. It may be necessary to distinguish between the level of prompts/reminders required for the trial, and the level of prompts/reminders for a routine application outside of a RCT setting (discuss under item 21 -generalizability). Does your paper address subitem 5-xi? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study "EMA behavioral data were submitted by the participant through the app: 1) in response to a text message prompt twice per day, once at a random time and once at a xed time asking about each of the behaviors since the last prompt-based report, 2) in response to a text message prompt sent each week, recalling behaviors throughout the week"

5-xii) Describe any co-interventions (incl. training/support)
Describe any co-interventions (incl. training/support): Clearly state any interventions that are provided in addition to the targeted eHealth intervention, as ehealth intervention may not be designed as stand-alone intervention. This includes training sessions and support [1]. It may be necessary to distinguish between the level of training required for the trial, and the level of training for a routine application outside of a RCT setting (discuss under item 21 -generalizability. https://docs.google.com/forms/d/e/1FAIpQLSfZBSUp1bwOc_OimqcS64RdfIAFvmrTSkZQL2-3O8O9hrL5Sw/viewform?hl=en_US&formkey=dGlKd2… 29/57 6a) Completely defined pre-specified primary and secondary outcome measures, including how and when they were assessed Does your paper address subitem 5-xii? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study "Participants were given funds equivalent 525MBs of data monthly throughout the study and an incentive totaling 100,000 UGX (~30USD) in three increments at 30, 60 and 90 days for responding to ≥50% of data collection prompts." "Interested participants attended an in-person visit at the study o ce, enrolling upon completion of voluntary, written informed consent at the rst in-person study visit.
At the rst study visit, participants were issued a password-protected smartphone programmed with the EMAI study application (emocha Health Inc., Baltimore, MD), a phone charger, and a portable power bank. Participants were trained on the use of the smartphone and fully-automated study application (app) " Figure 1 shows training timing and procedures.
Does your paper address CONSORT subitem 6a? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study "The primary study outcome of interest is the preliminary estimate of effect of intervention messaging on each of the behaviors monitored by the study. As a pilot study, the secondary aim was to assess the feasibility of the data collection and intervention approach. To do so, we examine the comparability of the study arms by indicators of data collection success. All outcomes were assessed after study closure." "Participants were assigned a 'yes' or 'no' for each behavior for each day of study follow-up. A participant was counted as engaging in a behavior if the participant reported having practiced the behavior on at least one of the twice-daily prompt response forms or any event-contingent form submitted on that day. Does your paper address subitem 6a-i?

Copy and paste relevant sections from manuscript text
Your answer 6a-ii) Describe whether and how "use" (including intensity of use/dosage) was defined/measured/monitored Describe whether and how "use" (including intensity of use/dosage) was defined/measured/monitored (logins, logfile analysis, etc.). Use/adoption metrics are important process outcomes that should be reported in any ehealth trial.
Does your paper address subitem 6a-ii? subitem not at all important 1 2 3 4 5 essential 6b) Any changes to trial outcomes after the trial commenced, with reasons 7a) How sample size was determined NPT: When applicable, details of whether and how the clustering by care provides or centers was addressed 6a-iii) Describe whether, how, and when qualitative feedback from participants was obtained Describe whether, how, and when qualitative feedback from participants was obtained (e.g., through emails, feedback forms, interviews, focus groups).

Does your paper address subitem 6a-iii?
Copy and paste relevant sections from manuscript text

Your answer
Does your paper address CONSORT subitem 6b? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study There were not any changes to the trial outcomes after the trial commenced. Does your paper address subitem 7a-i?
Copy and paste relevant sections from manuscript title (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study

Your answer
Does your paper address CONSORT subitem 7b? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study There were no interim analyses or stopping guidelines.
8b) Type of randomisation; details of any restriction (such as blocking and block size) 9) Mechanism used to implement the random allocation sequence (such as sequentially numbered containers), describing any steps taken to conceal the sequence until interventions were assigned Does your paper address CONSORT subitem 8a? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study "Participants were assigned to the control or intervention study arm using block randomization with randomly varying block sizes of 4, 6, and 8 through blockr and R package by Greg Snow." Does your paper address CONSORT subitem 8b? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study "Participants were assigned to the control or intervention study arm using block randomization with randomly varying block sizes of 4, 6, and 8 through blockr and R package by Greg Snow." 10) Who generated the random allocation sequence, who enrolled participants, and who assigned participants to interventions 11a) If done, who was blinded after assignment to interventions (for example, participants, care providers, those assessing outcomes) and how NPT: Whether or not administering co-interventions were blinded to group assignment Does your paper address CONSORT subitem 9? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study "Study arm assignments were enclosed within opaque, consecutively numbered envelopes. At the Day-30 visit, the Study Coordinator allocated the randomization assignment enclosed in the next consecutive envelope to each participant, activating the appropriate EMAI smartphone module." Does your paper address CONSORT subitem 10? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study "Study arm assignments were enclosed within opaque, consecutively numbered envelopes. At the Day-30 visit, the Study Coordinator allocated the randomization assignment enclosed in the next consecutive envelope to each participant, activating the appropriate EMAI smartphone module." subitem not at all important 1 2 3 4 5 essential subitem not at all important 1 2 3 4 5 essential 11a-i) Specify who was blinded, and who wasn't Specify who was blinded, and who wasn't. Usually, in web-based trials it is not possible to blind the participants [1, 3] (this should be clearly acknowledged), but it may be possible to blind outcome assessors, those doing data analysis or those administering co-interventions (if any).
Does your paper address subitem 11a-i? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study "Assignments were not masked to study participants or staff." 11a-ii) Discuss e.g., whether participants knew which intervention was the "intervention of interest" and which one was the "comparator" Informed consent procedures (4a-ii) can create biases and certain expectations -discuss e.g., whether participants knew which intervention was the "intervention of interest" and which one was the "comparator".

Does your paper address subitem 11a-ii?
Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study Your answer https://docs.google.com/forms/d/e/1FAIpQLSfZBSUp1bwOc_OimqcS64RdfIAFvmrTSkZQL2-3O8O9hrL5Sw/viewform?hl=en_US&formkey=dGlKd2… 36/57 11b) If relevant, description of the similarity of interventions (this item is usually not relevant for ehealth trials as it refers to similarity of a placebo or sham intervention to a active medication/intervention) 12a) Statistical methods used to compare groups for primary and secondary outcomes NPT: When applicable, details of whether and how the clustering by care providers or centers was addressed Does your paper address CONSORT subitem 11b? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study This is not relevant for our trial.
Does your paper address CONSORT subitem 12a? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study "We used paired t-tests with 2-sided P values to identify differences in the mean proportion of days when participants reported each behavior between P1 and P2, P2 and P3, and P1 and P3 within each study arm. We present visual plots of the proportion of days when behaviors are reported for each participant by study arm and study period. To compare change between study arms, we calculated the mean difference in the proportion of days each participant reported each behavior between periods by subtracting the later period's mean proportion of days when the behavior was practiced from the earlier period's mean. We then took the overall mean difference across all participants for each study arm and calculated the difference of the differences, subtracting the control arm from the intervention arm.
We used two sample t-tests with 2-sided P values to assess if the mean differences between each time period were the same in the two study arms." 12a-i) Imputation techniques to deal with attrition / missing values Imputation techniques to deal with attrition / missing values: Not all participants will use the intervention/comparator as intended and attrition is typically high in ehealth trials. Specify how participants who did not use the application or dropped out from the trial were treated in the statistical analysis (a complete case analysis is strongly discouraged, and simple imputation techniques such as LOCF may also be problematic [4]).

Does your paper address subitem 12a-i? *
Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study The study dropped the one participant who did not complete the study postrandomization and excluded days with missing data.
Does your paper address CONSORT subitem 12b? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study As a pilot trial, we did not have additional analyses.

x26-ii) Outline informed consent procedures
Outline informed consent procedures e.g., if consent was obtained offline or online (how? Checkbox, etc.?), and what information was provided (see 4a-ii). See [6] for some items to be included in informed consent documents.

Does your paper address subitem X26-ii?
Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study Your answer

RESULTS
13a) For each group, the numbers of participants who were randomly assigned, received intended treatment, and were analysed for the primary outcome NPT: The number of care providers or centers performing the intervention in each group and the number of patients treated by each care provider in each center

X26-iii) Safety and security procedures
Safety and security procedures, incl. privacy considerations, and any steps taken to reduce the likelihood or detection of harm (e.g., education and training, availability of a hotline) Does your paper address subitem X26-iii?
Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study

Your answer
Does your paper address CONSORT subitem 13a? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study "Between 10th June 2016 -1st March 2017, 71 participants were screened for enrollment, of whom 58 enrolled. Eight initial participants were excluded due to an early failure of the study application. Two dropped out at 15 days and 79-days postenrollment, respectively. The complete analysis dataset included 48 participants.

13b-i) Attrition diagram
Strongly recommended: An attrition diagram (e.g., proportion of participants still logging in or using the intervention/comparator in each group plotted over time, similar to a survival curve) or other figures or tables demonstrating usage/dose/engagement.

Does your paper address subitem 13b-i?
Copy and paste relevant sections from the manuscript or cite the figure number if applicable (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study Your answer 7/20/2020 CONSORT-EHEALTH (V 1.6.1) - 14b) Why the trial ended or was stopped (early) Does your paper address CONSORT subitem 14a? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study "Between 10th June 2016 -1st March 2017, 71 participants were screened for enrollment, of whom 58 enrolled." "Participants exited after study day 90." 14a-i) Indicate if critical "secular events" fell into the study period Indicate if critical "secular events" fell into the study period, e.g., significant changes in Internet resources available or "changes in computer hardware or Internet delivery resources" Does your paper address subitem 14a-i?
Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study

Your answer
Does your paper address CONSORT subitem 14b? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study The trial was not ended or stopped early. analysis and whether the analysis was by original assigned groups Does your paper address CONSORT subitem 15? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study Table 1 shows this information.

15-i) Report demographics associated with digital divide issues
In ehealth trials it is particularly important to report demographics associated with digital divide issues, such as age, education, gender, social-economic status, computer/Internet/ehealth literacy of the participants, if known.
Does your paper address subitem 15-i? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study 16-i) Report multiple "denominators" and provide definitions Report multiple "denominators" and provide definitions: Report N's (and effect sizes) "across a range of study participation [and use] thresholds" [1], e.g., N exposed, N consented, N used more than x times, N used more than y weeks, N participants "used" the intervention/comparator at specific pre-defined time points of interest (in absolute and relative numbers per group). Always clearly define "use" of the intervention.
Does your paper address subitem 16-i? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study Participants were analyzed as randomized, with 24 participants in each group. This is shown in tables 1 -4 "All 24 participants in both the control and intervention arms report eating fruits and vegetables on at least one day during each of the three study periods, except for one participant who did not report eating vegetables on any day during study period two...."

16-ii) Primary analysis should be intent-to-treat
Primary analysis should be intent-to-treat, secondary analyses could include comparing only "users", with the appropriate caveats that this is no longer a randomized sample (see 18-i).
17a) For each primary and secondary outcome, results for each group, and the estimated effect size and its precision (such as 95% confidence interval) Does your paper address subitem 16-ii?
Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study

Your answer
Does your paper address CONSORT subitem 17a? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study Tables 2, 3 and 4 show this. Additionally: "There was a signi cant decrease in the mean proportion of days when alcohol was consumed in both the control and intervention arms. In the control arm, the decrease was observed between Periods 1 and 2 (9.6% of days to 4.3% of days, P=.03), while it was observed between Periods 1 and 3 in the intervention arm (7.2% of days to 2.4% of days, P=.01). (Table 3) Similarly, both arms show a signi cant decrease in the mean proportion of days when participants reported having sex with a non-marital or non-long-term partner without a condom between periods 1 and 3 (control: 1.9% of days to 1.0% of days, P=.02, intervention: 6.6% of days to 1.3% of days P=.03) and, for the intervention arm only, between periods 1 and 2 (6.6% of days to 2.1% of days P=.04). (  Figure 3)" "The comparison of study arms showed a signi cant difference in the change in reported vegetable consumption between Periods 1 and 3 (control: 8.0% decrease in the mean proportion of days vegetables were consumed, intervention: 11.1% increase in the mean proportion of days vegetables were consumed, P=.01) and Periods 2 and 3 (control: 5.7% decrease in the mean proportion of days vegetables were consumed, intervention: 8.6% increase in the mean proportion of days vegetables were consumed, P=.002). There were no other signi cant differences in the change in behavior over time between the intervention and control groups.
( 17a-i) Presentation of process outcomes such as metrics of use and intensity of use In addition to primary/secondary (clinical) outcomes, the presentation of process outcomes such as metrics of use and intensity of use (dose, exposure) and their operational definitions is critical. This does not only refer to metrics of attrition (13-b) (often a binary variable), but also to more continuous exposure metrics such as "average session length". These must be accompanied by a technical description how a metric like a "session" is defined (e.g., timeout after idle time) [1] (report under item 6a).

Does your paper address subitem 17a-i?
Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study

Your answer
Does your paper address CONSORT subitem 17b? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study Does your paper address CONSORT subitem 18? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study We did not conduct additional sub-group analyses.

18-i) Subgroup analysis of comparing only users
A subgroup analysis of comparing only users is not uncommon in ehealth trials, but if done, it must be stressed that this is a self-selected sample and no longer an unbiased sample from a randomized trial (see 16-iii).
Does your paper address subitem 18-i?
Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study

Your answer
Does your paper address CONSORT subitem 19? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study We did not encounter harms or unintended effects in either group.

20-i) Typical limitations in ehealth trials
Typical limitations in ehealth trials: Participants in ehealth trials are rarely blinded. Ehealth trials often look at a multiplicity of outcomes, increasing risk for a Type I error. Discuss biases due to non-use of the intervention/usability issues, biases through informed consent procedures, unexpected events.

21) Generalisability (external validity, applicability) of the trial findings
NPT: External validity of the trial findings according to the intervention, comparators, patients, and care providers or centers involved in the trial Does your paper address subitem 20-i? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study "The ndings of this pilot trial were not designed to be generalizable beyond the study's target population or 90-day follow-up period. However, as preliminary estimates they offer insight into the potential of EMAI and warrant further exploration. Behaviors were self-reported. It is not possible to differentiate actual changes in behavior from changes in reported behaviors in uenced by social desirability bias, potentially reinforced by intervention messages, or other facts. However, while of different magnitude, changes were observed in both control and intervention arms of the trial. Further, for sensitive behaviors such as condom use, self-report is the best available standard, with questions asking about recent experiences considered to be more valid and reliable than longer recall periods25.
The study enrolled current RCCS participants who are accustomed to participation in trials. They may respond differently to interventions than research-naïve participants. Given the pilot nature of the study, explanations for reported behavior changes other than the effect of the intervention messaging cannot be ruled out. Particularly given block randomization and the study limit of ten simultaneous

21-i) Generalizability to other populations
Generalizability to other populations: In particular, discuss generalizability to a general Internet population, outside of a RCT setting, and general patient population, including applicability of the study results for other organizations Does your paper address subitem 21-i?
Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study Your answer 21-ii) Discuss if there were elements in the RCT that would be different in a routine application setting Discuss if there were elements in the RCT that would be different in a routine application setting (e.g., prompts/reminders, more human involvement, training sessions or other co-interventions) and what impact the omission of these elements could have on use, adoption, or outcomes if the intervention is applied outside of a RCT setting.
Does your paper address subitem 21-ii?
Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study Your answer Does your paper address CONSORT subitem 24? * Cite a Multimedia Appendix, other reference, or copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study The trial protocol is available in the ClinicalTrials.gov record.

X27) Conflicts of Interest (not a CONSORT item)
subitem not at all important 1 2 3 4 5 essential About the CONSORT EHEALTH checklist Does your paper address CONSORT subitem 25? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study "The study was funded by the Johns Hopkins Center for Global Health."

X27-i) State the relation of the study team towards the system being evaluated
In addition to the usual declaration of interests (financial or otherwise), also state the relation of the study team towards the system being evaluated, i.e., state if the authors/evaluators are distinct from or identical with the developers/sponsors of the intervention.
Does your paper address subitem X27-i?
Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study Your answer yes, major changes yes, minor changes no yes no Other: As a result of using this checklist, did you make changes in your manuscript? * What were the most important changes you made as a result of using this checklist?

Your answer
How much time did you spend on going through the checklist INCLUDING making changes in your manuscript *

Approximately 8 hours
As a result of using this checklist, do you think your manuscript has improved? *