This paper is in the following e-collection/theme issue:

Web-based and Mobile Health Interventions (3297) HIV/AIDS/STI Prevention and Care (873) Homelessness (31) Homeless Youth (15) Risky Sexual Behavior (145)

Published on in Vol 23, No 7 (2021): July

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/26704, first published .
Efficacy of a Just-in-Time Adaptive Intervention to Promote HIV Risk Reduction Behaviors Among Young Adults Experiencing Homelessness: Pilot Randomized Controlled Trial

Efficacy of a Just-in-Time Adaptive Intervention to Promote HIV Risk Reduction Behaviors Among Young Adults Experiencing Homelessness: Pilot Randomized Controlled Trial

Efficacy of a Just-in-Time Adaptive Intervention to Promote HIV Risk Reduction Behaviors Among Young Adults Experiencing Homelessness: Pilot Randomized Controlled Trial

Authors of this article:

Diane Santa Maria1 Author Orcid Image ;   Nikhil Padhye1 Author Orcid Image ;   Michael Businelle2 Author Orcid Image ;   Yijiong Yang1 Author Orcid Image ;   Jennifer Jones1 Author Orcid Image ;   Alexis Sims1 Author Orcid Image ;   Marguerita Lightfoot3 Author Orcid Image
Article Authors Cited by (11) Tweetations (5) Metrics

    Original Paper

    1Cizik School of Nursing, University of Texas Health Science Center at Houston, Houston, TX, United States

    2TSET Health Promotion Research Center, University of Oklahoma Health Sciences Center, Oklahoma City, OK, United States

    3Center for AIDS Prevention Studies and UCSF Prevention Research Center, University of California San Francisco, San Francisco, CA, United States

    Corresponding Author:

    Diane Santa Maria, DrPH, MSN, BSN

    Cizik School of Nursing

    University of Texas Health Science Center at Houston

    6901 Bertner Ave

    Houston, TX, 77030

    United States

    Phone: 1 713 500 2190

    Email: diane.m.santamaria@uth.tmc.edu


    Background: People experiencing homelessness have higher rates of HIV than those who are stably housed. Mental health needs, substance use problems, and issues unique to homelessness such as lack of shelter and transiency need to be considered with regard to HIV prevention. To date, HIV prevention interventions for young adults experiencing homelessness have not specifically addressed modifiable real-time factors such as stress, sexual or drug use urge, or substance use, or been delivered at the time of heightened risk. Real-time, personalized HIV prevention messages may reduce HIV risk behaviors.

    Objective: This pilot study tested the initial efficacy of an innovative, smartphone-based, just-in-time adaptive intervention that assessed predictors of HIV risk behaviors in real time and automatically provided behavioral feedback and goal attainment information.

    Methods: A randomized attention control design was used among young adults experiencing homelessness, aged 18-25 years, recruited from shelters and drop-in centers in May 2019. Participants were randomized to either a control or an intervention group. The intervention (called MY-RID [Motivating Youth to Reduce Infection and Disconnection]) consisted of brief messages delivered via smartphone over 6 weeks in response to preidentified predictors that were assessed using ecological momentary assessments. Bayesian hierarchical regression models were used to assess intervention effects on sexual activity, drug use, alcohol use, and their corresponding urges.

    Results: Participants (N=97) were predominantly youth (mean age 21.2, SD 2.1 years) who identified as heterosexual (n=51, 52%), male (n=56, 57%), and African American (n=56, 57%). Reports of sexual activity, drug use, alcohol use, stress, and all urges (ie, sexual, drug, alcohol) reduced over time in both groups. Daily drug use reduced by a factor of 13.8 times over 6 weeks in the intervention group relative to the control group (Multimedia Appendix 4). Lower urges for sex were found in the intervention group relative to the control group over the duration of the study. Finally, there was a statistically significant reduction in reports of feeling stressed the day before between the intervention and control conditions (P=.03).

    Conclusions: Findings indicate promising intervention effects on drug use, stress, and urges for sex in a hard-to-reach, high-risk population. The MY-RID intervention should be further tested in a larger randomized controlled trial to further investigate its efficacy and impact on sexual risk behaviors.

    Trial Registration: ClinicalTrials.gov NCT03911024; https://clinicaltrials.gov/ct2/show/NCT03911024

    J Med Internet Res 2021;23(7):e26704

    doi:10.2196/26704

    Keywords

    youth; homelessness; HIV; prevention; just-in-time adaptive interventions; mHealth; ecological momentary assessments; drug use; stress; intervention; smartphone; mobile phone; drug; efficacy; pilot; feasibility; predictor; risk; behavior 


    Background

    Young adult homelessness continues to be a major public health problem with 1 in 10 young adults aged 18 to 25 years experiencing homelessness over the course of a year [1] and an estimated 1.7 to 2.5 million youth under 25 years experiencing homelessness each year in the United States [2]. Securing food and shelter while experiencing the hardships and dangers of living on the streets creates enormous challenges to maintaining one’s health and well-being [3]. The mortality rate for youth experiencing homelessness (YEH) is 5 to 10 times higher than peers in the general population [4], and many YEH have chronic mental and physical conditions, engage in substance use, and have unmet health and mental health care needs [3,5,6]. One persistent health concern is HIV. Unstable housing is a significant barrier to accessing and engaging in HIV care, maintaining viral suppression, and reducing HIV transmission [7]. The implications of mental health needs, substance use problems, and issues unique to YEH such as the lack of stable sheltering options need to be considered with regard to HIV prevention. This is particularly salient as people experiencing homelessness have higher rates of HIV than those who are stably housed [8]. While HIV prevalence data for YEH are sparse, one study found a self-reported HIV diagnoses rate of 4% [9].

    HIV Risk Among Youth

    HIV risk among all youth is correlated with sexual orientation [10], childhood abuse [11,12], and histories of foster/juvenile justice involvement [13-16]. Further, modifiable factors have been found to predict HIV risk in nonhomeless youth populations. Stress, sexual urge, and substance use negatively impact sexual decision-making and increase HIV risk [17-19]. HIV risk behaviors such as condomless sex and substance use are also correlated with factors such as stress [20,21] and depression [22]. Stress has also been correlated with inconsistent condom use; number of sexual partners; and substance use in young females [23-27], African American adolescent females [28], urban Black heterosexual men [29], and young men who have sex with men (MSM) [30-32]. Finally, a history of traumatic stress and current substance use are associated with more frequent sexual urges among MSM [33].

    Young adults engage in HIV risk behaviors [17-19]. Engagement in risk behaviors may be heightened by low motivation for HIV prevention related to time spent on the streets [18] and exacerbated by high levels of trauma experienced prior to and while homeless [34,35]. In a systematic review of sexual behaviors among YEH, most studies did not examine how situational variables affect sexual risk [34] despite the mounting evidence of the significant correlations between elevated stress, sexual urge, and substance use with HIV risk behaviors in female youth [26,27,36,37] and YEH [38,39]. For example, experiencing sexual urges has been found to influence YEH’s decision to engage in condomless sex [40]. Substance use is also associated with condomless sex and sexual victimization among homeless and urban youth [35,41,42]. Finally, in one study using ecological momentary assessments (EMAs), the odds of having sex on a given day were found to be highest on days when YEH experienced sexual urge and used drugs, and the odds of substance use were highest on the days when youth experienced high stress and drug urge [43].

    HIV Prevention Among YEH

    To date, HIV prevention interventions for YEH have not specifically addressed modifiable real-time factors such as stress, sexual urge, or substance use, or been delivered at the time of heightened risk. Using real-time, personalized HIV prevention messages may provide more timely information and produce more motivation for behavioral change than those seen in prior interventions. Importantly, when programs are tailored and relevant, YEH are interested in health promotion programs, can be recruited and retained in interventions and research studies [44,45], and demonstrate improved outcomes despite challenges with sustaining intervention engagement. In a group-based study with YEH, there were positive intervention effects on alcohol use, motivation, and condom self-efficacy even though 52% of participants did not attend all intervention sessions [46].

    One method to reach and engage YEH in interventions is to utilize mobile technology. Interventions that provide personal motivational messages in response to real-time thoughts, feelings, sexual urges, and substance use may be more effective than interventions that are homogeneous and primarily informational in nature [47,48]. Interventions that can be delivered via smartphones at the time of heightened HIV risk may place tailored health messages more proximally to critical behavioral decision points, thereby increasing access to and relevance of prevention interventions [49].

    Assessing Real-Time HIV Risk

    EMA is currently the gold standard and most accurate way to measure real-time factors in natural settings [50,51], with high compliance rates (78%) found among youth across 42 studies [52]. EMA assesses within-person variance to risk exposures (eg, where, when, and with whom sexual risk is likely to occur throughout a day) by capturing repeated measures to assess changes in behaviors, cognition, environmental factors, and symptoms. Therefore, EMA has the potential for use as a driver of interventions that tailors messages to one’s current risk level. Affect and behavioral monitoring associated with EMA may also increase self-awareness of HIV risk by capturing behavioral patterns and assessing predictors of risk, including sexual urge, stress, and substance use [53]. In smoking studies, EMA alone has lowered urges and stress [54]. By increasing one’s awareness of risk, EMA can detect risk before the behavior occurs. EMA data that are collected at or near the moment when HIV risk behaviors occur can reduce recall biases that are associated with other measures. For example, one study found that 54% of youth reported condom use during their last sexual encounter at baseline, yet 76% of sex acts were condomless when assessed in real time using EMA [46]. Recall data have higher potential for bias, neglect intraindividual variability, and do not capture risk and protective factors as they occur in the real world. Consistently high EMA completion rates have also been found among youth, including substance use (80%) [55], substance use recovery (87%) [56], smoking (88%) [57], sexual behaviors (80%) [58], and drinking (89%) [59]. Little is known about EMA compliance rates among YEH, although one study found that 89% of participants provided EMA data during the study with a 62% compliance rate [60].

    Delivering Interventions in Response to Real-Time Risk

    Just-in-time adaptive interventions (JITAIs), such as EMA-driven messages, may be an effective delivery strategy for information and motivational messages to be delivered at the time of heightened risk detection prior to engaging in a risk behavior and in response to a reported risk behavior antecedent. JITAIs can target the proximal, modifiable mediators that indicate the emergence of a vulnerable state (eg, high sexual urge, substance use, or spikes in stress). For example, messages can be delivered in response to elevated sexual urge and/or after a recent sexual assault [43,60-62]. JITAIs can be effectively delivered for a variety of health behaviors and psychological symptoms management [63], and real-time messaging has improved risk behaviors, including long-term smoking cessation [64], binge drinking among young adults with hazardous alcohol use [65], and sexual risk behaviors and sexually transmitted infection (STI) testing among youth [66]. JITAIs have been found to significantly reduce anxiety and stress [67-69], alcohol use [70], and depressive symptoms [71], and increase pre-exposure prophylaxis (PrEP) uptake among MSM [72]. EMA-informed JITAIs build off of the willingness to disclose personal information electronically through EMAs [73], overcome geographic and organizational barriers to reaching the underserved [74], require few agency resources, are easily accessible to youth, address personalized prevention care, and are particularly attractive to young people especially when these interventions are developed with the target audience to enhance sustainable use [75].

    Optimizing the interactivity that smartphones provide, it is possible to combine tested mobile health (mHealth) strategies (eg, text messaging) [76] with other proven technology-based strategies such as tailored education [77,78] and motivational messaging [79,80] to deliver scalable, cost-efficient HIV prevention interventions. These strategies have had positive outcomes for smoking cessation in youth [81] and among homeless adults [82,83], treatment adherence among youth living with HIV [78], and HIV prevention in African American youth [84,85]. Such real-time interventions may address the challenges of reaching YEH related to transiency and heterogeneity [86] by targeting real-time factors such as sexual urge, substance use, and stress at the time of heightened HIV risk [34]. JITAIs can deliver personalized HIV prevention messages that vary in content and dose depending on an individual’s current sexual urges, substance use, and spikes in stress [87], providing the right type and dose at the optimal time [88]. To our knowledge, no JITAIs have been developed for YEH that use EMA and deliver personalized, time-varied HIV prevention messages. This study advances work done in this field by evaluating the preliminary efficacy of an EMA-driven, personalized HIV prevention intervention that is sensitive to variability in risk among a sample of YEH.

    Purpose of This Study

    No interventions to date have been carried out to intervene at the individual level to increase HIV risk perception and behavioral self-monitoring for the prevention of drug use and sexual risk behaviors among YEH. Therefore, in this study we leveraged the use of mobile technology to test the initial efficacy of a beta-tested mobile, just-in-time, adaptive HIV prevention messaging intervention called MY-RID (Motivating Youth to Reduce Infection and Disconnection; pronounced “My Ride”) among YEH on sexual behaviors and substance use. MY-RID is an innovative, theory-based (Information, Motivation, and Behavioral Skills [IMB] model [89]) JITAI, delivered via a smartphone app, that targets real-time predictors of HIV risk behaviors at the time of high risk, responds to patterns of risk behaviors to motivate participants to engage in prevention services, and provides behavioral feedback and goal attainment information in real time [88].


    Study Design

    The study used a 1:1 randomized attention control design to pilot test the initial efficacy of MY-RID. All study protocols were approved by the Institutional Review Board for the Protection of Human Subjects prior to recruitment. Interested youth were screened, consented, and then completed a baseline survey (Multimedia Appendix 1) about demographic characteristics that was administered on an iPad. Participants were then randomized to either the control or the intervention group, and every participant received an Android smartphone with unlimited data. The phone was preloaded with the MY-RID app, which uses the INSIGHT mHealth platform [90]. The MY-RID app prompted and delivered once daily EMAs and targeted messages (ie, intervention messages or control condition messages) in response to EMA data for 6 weeks. All participants were oriented to the EMA procedures and indicated the time they typically woke up and went to bed each day to assure EMA and messages did not disturb their sleep.

    Recruitment

    YEH aged 18-25 years were recruited from a shelter and drop-in center serving YEH over the course of 1 week in May 2019 from the Houston, TX, region using group presentations and flyers. Youth were eligible if they were between 18 and 25 years and were experiencing homelessness. Experiencing homelessness was defined as: (1) living on the streets or in a place not meant for human habitation, a shelter, hotel/motel, or any place they cannot stay for more than 30 days or (2) currently receiving homelessness services. In order to assure participants could complete the EMA surveys and understand the tailored intervention messages independently, participants were required to be able to speak and read English (determined by the Rapid Estimate of Adult Literacy in Medicine-Short Form [REALM]) at a 7th-grade level or higher [91].

    Ecological Momentary Assessments

    Participants were prompted 3 times a day to complete EMAs during the first 2 weeks of the study, two daily EMAs for the next 2 weeks, and one daily EMA for the final 2 weeks. These EMAs took about 1 to 2 minutes to complete. Example EMA items included: “I am feeling a strong urge to: (have sex, do drugs, drink alcohol),” “Select all of the drugs you used in the last 2 hours,” “Did you have sex yesterday?” EMAs were prompted on the phone 30 minutes after the participants indicated wake time and took approximately 1 to 5 minutes to complete. All participants were able to receive up to $120 based on their EMA response rate (>90%=$40, 75%-89%=$35, 50%-74%=$30, 25%-49%=$20, and >24%=$15) over the 6-week period. A compensation monitor was programmed in the app to show the participants their response and compensation.

    Intervention Messages

    Using the IMB model to assure the messaging reflected on the cognitive, behavioral, and environmental factors of HIV [89], over 360 messages were developed and beta tested with YEH that addressed the real-time predictors of HIV risk, including urge to use drugs, sexual urge, stress, and drug use. First, the research team developed the theory-driven messages. Next, messages were presented to YEH, who offered ways they would “say to this to a friend” to increase the linguistic relevance of the messages. Finally, messages were beta tested with YEH until there was agreement that the message was likely to impact thoughts and behaviors. Example messages included: “Avoiding drugs can help reduce mental health issues.” and “It’s easy to catch an STD. Be careful and always use a condom.” Consistent with the IMB model, messages included information and knowledge about the behavior in question (eg, substance use, sexual risk behavior), the individual’s motivation to perform the behavior, and the behavioral skills necessary to perform the behavior [92].

    Intervention Arm

    During the baseline visit, youth randomized to the intervention arm were asked to set an HIV prevention behavior goal after a study team member reviewed basic HIV prevention strategies. Goal options included increasing condom use, decreasing the number of sexual partners, using PrEP daily, getting tested for HIV, reducing drug and alcohol use, not having sex while using drugs or drinking alcohol, and avoiding injection drug use. Data entered by the participant during the daily EMAs populated a graphic goal interface that depicted the current level of goal attainment based on EMA data. This interface was accessible on the phone at any time by the participant. After the completion of each EMA, participants in the intervention group received tailored messages that addressed the participant’s goals: (1) safer sexual behaviors, (2) alcohol or drug use, (3) PrEP interest, and (4) HIV testing. Messages were selected using an algorithm that prompted messages based on current risk factors that targeted reduction in alcohol and drug use, promoted condom use, and provided urge management strategies (Multimedia Appendix 2). Generalized linear mixed models revealed several predictors of engagement in sexual activity that could increase HIV risk, including constant characteristics (race, sexual orientation), diagnosed conditions (psychosis, posttraumatic stress disorder), and time-varying predictors (urge for sex, drug use) [43]. Predictors of drug use were all time varying: urge for drug use, urge for alcohol use, urge to steal, viewing pornography, alcohol use, and experience of discrimination [60].

    Attention Control Arm

    Participants in the attention control condition were asked to set a behavioral goal related to general health behaviors. Goal options included getting 7 or more hours of sleep, eating 5 or more servings of fruits or vegetables, not using tobacco products, and exercising for at least 60 minutes a day. The control group answered the same EMA items as the intervention group; however, after the completion of each EMA, the control group received different messages related to healthy nutrition, physical activity, sleep hygiene, and prevention of tobacco use. These messages were not tailored to the EMA but sent in a random order.

    Measures

    The baseline and 6-week follow-up survey assessed the demographics that have been associated with sexual risk among YEH such as gender identity, age, education, sexual orientation, and adverse childhood experiences [93,94]. Baseline measures also assessed HIV/STI testing, stress [95], depression [96], and psychological distress [97], all of which have been validated previously in YEH studies. EMA measures assessed real-time HIV risk behaviors, including stress, sexual behaviors, sexual urge, and substance use. The EMA items utilized Likert scales and were developed from prior EMA studies [50,98] and tested in studies within the YEH population [43,60].

    Statistical Analyses

    Participant retention was evaluated to inform future JITAI studies with YEH. Kaplan-Meier survival functions were calculated using the survival package [99] in the R programming language (R Core Team) [100] to obtain the median participation time in the control and intervention groups, based on the total time spent completing activities in the app. Participant EMA completion rates were also examined over the 6-week study duration.

    Baseline data consisting of participants’ demographics and health status measures were compared between the control and intervention groups using Pearson chi-square tests. In instances of low cell counts, the Fisher exact test was calculated using SPSS Statistics 26 (IBM Corp). Outcomes were analyzed first on the basis of cumulative counts before using longitudinal models. The counts provided the number of participants who engaged in sexual activity, or substance use, or reported urges, or reported being stressed at least once over the 6-week study period. The differences in proportions between the control and intervention groups were assessed with Pearson chi-square tests or the Fisher exact test. 

    Longitudinal analysis was carried out with Bayesian hierarchical logistic regression models that assessed the intervention effects on engaging in sex, drug use, alcohol use, and their corresponding urges. The intervention effect was modeled with fixed effects that included the interaction of intervention group and time. Random intercept and slope allowed the intervention effect to vary among participants. Stress experienced at the time of response and stress experienced by participants on the previous day were analyzed in a similar manner. Information about the prior distributions and more details about the analysis are provided in Multimedia Appendix 3. The solution was implemented with the RStan package [101] via code written and executed in the RStudio environment (RStudio, PBC) [102].

    Sensitivity analysis was conducted to check the robustness of statistically significant intervention effects that resulted from the hierarchical regression models. The models were expected to provide robust intervention effects if data were missing at random. We considered the possibility of nonignorable missing mechanisms and used a tipping-point approach for the sensitivity analysis [103]. Multimedia Appendix 3 presents more information about the missingness mechanisms and sensitivity analysis.


    A total of 100 participants were enrolled, of which 3 were excluded due to lack of EMA data. Data were analyzed for the remaining 97 participants aged 18-25 years (mean 21.2, SD 2.1 years), of whom 48 (49.5%) were randomly assigned to the intervention group and 49 (50.5%) were randomly assigned to the control group. Over half of participants identified as heterosexual (n=51, 52%), male (n=56, 57%), and African American (n=56, 57%). There was noteworthy diversity in gender identity, sexual orientation, and racial identity (Table 1). Additionally, 40% (n=39) of participants had been involved with the juvenile justice system. Over 35% (n=37) of the participants rated their overall health status as excellent or very good, and 52% (n=51) of participants had been tested for HIV within the past 3 months. There were no statistically significant differences between the groups in terms of race or ethnicity, gender identity, HIV risk behaviors, or any of the other variables that were collected at baseline.

    Kaplan-Meier survival curves showed that participants engaged with the app for 34.5 days (median), or about 5 of 6 possible weeks (95% CI 28.5-39.5). The length of participation was based on the range from the first to last time of responses received from each participant, and the median value was identical in the control and intervention groups. Another metric of participation was the participant response rate, which decreased over time, resulting in a median of 19 days (IQR 25) of useful data per participant. That corresponds to 46.3% of the maximum potential for responses, or 56.7% of the response potential during the median participation time. The median times for responding to EMAs were 160 seconds (IQR 98) for the daily EMA and 87 seconds (IQR 46) for the random assessments.

    Frequencies of participant reported behaviors, urges (ie, sex, drug, alcohol), and stress during the EMA daily diaries (Table 2) revealed that there was a statistically significant (P=.03) difference in reports of feeling stressed the day before with a lower proportion of participants in the intervention group reporting feeling stressed the day before compared with control group participants (n=20, 41.7% vs n=31, 63.3%) across the 6 weeks of EMA implementation. Although not statistically significant, the intervention group displayed fewer transactional sex behaviors relative to the control group (n=5, 10.4% vs n=9, 18.4%). HIV risk behaviors were similar across gender identities, but current stress was higher among transgender/genderqueer participants compared to cisgender males and females (Table 3).

    Table 1. Baseline characteristics by group.
    VariableEMAa participants (N=97)P valueb

    		Intervention group (n=48), n (%)Control group (n=49), n (%)
    Age

    		.62

    		18-21 years28 (58.3)31 (63.3)

    		22-25 years20 (41.7)18 (36.7)
    Gender

    		.39

    		Male25 (52.1)31 (63.3)

    		Female20 (41.7)14 (28.6)
    Transgender/genderqueer/other/missing3 (6.3)4 (8.2)
    Sexual orientation

    		.12

    		Gay1 (2.1)7 (14.3)

    		Lesbian4 (8.3)2 (4.1)

    		Straight (ie, not gay)29 (60.4)22 (44.9)

    		Bisexual9 (18.8)14 (28.6)

    		Asexual/pansexual/other5 (10.4)4 (8.2)
    Race or ethnicity

    		.06

    		White or Caucasian0 (0)3 (6.1)

    		Black or African American31 (64.6)25 (51.0)

    		Hispanic or Latino7 (14.6)2 (4.1)

    		American Indian/Asian or Pacific Islander/other5 (10.4)9 (18.4)

    		Multiracial5 (10.4)10 (20.4)
    Involved with the juvenile justice system19 (39.6)20 (40.8).90
    Age of first homelessness
    		.07

    		Minor (<18 years)27 (56.3)18 (36.7)

    		Adult (≥18 years)21 (43.8)30 (61.2)

    		Missing0 (0)1 (2.0)
    Mental health

    		.68

    		Excellent13 (27.1)13 (26.5)

    		Very good6 (12.5)5 (10.2)

    		Good10 (20.8)16 (32.7)

    		Fair13 (27.1)9 (18.4)

    		Poor6 (12.5)5 (10.2)

    		Missing0 (0)1 (2.0)
    Emotional problems in the last 7 days
    		.30

    		Never4 (8.3)2 (4.1)

    		Rarely7 (14.6)7 (14.3)

    		Sometimes19 (39.6)16 (32.7)

    		Often7 (14.6)16 (32.7)

    		Always11 (22.9)8 (16.3)
    Last HIV test

    		.88

    		Within the past 3 months24 (50.0)27 (55.1)

    		More than 3 months16 (33.3)15 (30.6)

    		Never been tested for HIV8 (16.7)7 (14.3)

    aEMA: ecological momentary assessment.

    bCalculated using the Pearson chi-square test or the Fisher exact test for differences of proportion between the intervention and control groups.

    Table 2. Frequency of participants who reported specific HIV risk factors by treatment group.
    VariableEMAa participantsbP valuec

    		Intervention group, n (%)Control group, n (%)
    Had sex yesterday33 (68.8)29 (59.2).33
    Used drugs yesterday25 (52.1)24 (49.0).76
    Sex behaviors with drug use18 (37.5)15 (30.6).47
    Condomless sex8 (16.7)14 (28.6).16
    Urge to have sex36 (75.0)34 (69.4).54
    Urge to use drug25 (52.1)30 (61.2).36
    Traded sex yesterday5 (10.4)9 (18.4).27
    Felt stressed yesterday20 (41.7)31 (63.3).03
    Feel stressed now30 (62.5)36 (73.5).25

    aEMA: ecological momentary assessment.

    bNumber of participants who engaged in the behavior at least once.

    cChi-square test was fit to test the significance of differences between the intervention and control groups. Significance level at P<.05.

    Table 3. Frequency of participants who reported specific HIV risk factors by gender identity.
    VariableEMAa participantsbP valuec

    		Cis-male (n=56), n (%)Cis-female (n=34), n (%)Transgender, gender queer, or other (n=7), n (%)
    Had sex yesterday36 (64.3)22 (64.7)4 (57.1).93
    Used drugs yesterday27 (48.2)18 (52.9)4 (57.1).85
    Sex with drug use20 (35.7)10 (29.4)3 (42.9).73
    Condomless sex12 (21.4)9 (26.5)1 (14.3).74
    Urge to have sex39 (69.6)26 (76.5)5 (71.4).78
    Urge to use drug28 (50.0)21 (61.8)6 (85.7).15
    Traded sex yesterday9 (16.1)4 (11.8)1 (14.3).85
    Felt stressed yesterday24 (42.9)22 (64.7)5 (71.4).08
    Feel stressed now32 (57.1)28 (82.4)6 (85.7).03

    aEMA: ecological momentary assessment.

    bNumber of participants who engaged in the behavior at least once.

    cChi-square test was fit to test the significance of differences between the intervention and control groups. Significance level at P<.05.

    Having sex, drug use, and alcohol use reduced over the 6-week EMA period in both groups (Figure 1 and Table 4). An intervention effect was observed for drug use. The odds ratio (OR) for the interaction of the intervention and time measured on the log scale (OR 0.62, 95% CI 0.39-0.97) implied that the odds of drug use reduced by a factor of 13.8 over 6 weeks, or by a factor of 8.5 over 3 weeks (mid-way point), in the intervention group relative to the control group. There was no intervention effect for having sex or alcohol use.

    ‎
    Figure 1. Daily totals of participants who reported using drugs over the 6-week study period, shown separately for the control and intervention groups of the study.
    View this figure
    Table 4. Parameter estimates of fixed and random effects arising from Bayesian hierarchical logistic regression models for sexual intercourse, drug use, and alcohol use.
    VariableCoefficient, mean (SD)Odds ratio (95% CI)ESSab
    Outcome: sexual intercourse



    		Intercept–0.863 (0.41)0.422 (0.181-0.923)10001.00

    		Days (log)–0.601 (0.127)0.548 (0.420-0.687)5631.00

    		Intervention–0.098 (0.554)0.907 (0.299-2.740)13661.00

    		Intervention × days (log)0.04 (0.158)1.041 (0.769-1.423)13211.00

    		Random intercept: σ1.758 (0.285)—c17081.00

    		Random slope: σ0.361 (0.098)—4381.00
    Outcome: drug use



    		Intercept–1.669 (0.663)0.188 (0.047-0.614)8721.00

    		Days (log)–0.597 (0.17)0.550 (0.379-0.743)7371.00

    		Intervention0.779 (0.861)2.179 (0.415-12.231)8601.00

    		Intervention × days (log)–0.486 (0.233)0.615 (0.386-0.971)15481.00

    		Random intercept: σ3.212 (0.502)—11801.00

    		Random slope: σ0.519 (0.138)—4781.00
    Outcome: alcohol use



    		Intercept–2.185 (0.541)0.112 (0.037-0.303)6731.01

    		Days (log)–0.564 (0.181)0.569 (0.392-0.795)6721.01

    		Intervention0.115 (0.652)1.122 (0.312-4.035)15331.00

    		Intervention × days (log)–0.139 (0.23)0.870 (0.545-1.344)16031.00

    		Random intercept: σ1.858 (0.418)—6511.00

    		Random slope: σ0.542 (0.14)—5571.01

    aESS: effective sample size; after accounting for autocorrelated samples.

    bPotential scale reduction statistic; <1.1 indicates convergence of Markov chains.

    cNot applicable.

    Urges for sex, drugs, or alcohol reduced over the study period in both groups (Table 5). Lower odds of the urge for sex were found in the intervention group (OR 0.16, 95% CI 0.04-0.63), and this was a time-independent effect that indicated suppressed sexual urge in the intervention group over the duration of the study. There was no intervention effect for drug or alcohol urge. Stress experienced now and the day before was also reduced over time in both groups (Table 6), with no intervention effect.

    Table 5. Parameter estimates of fixed and random effects arising from Bayesian hierarchical logistic regression models for urges: urge for sex, urge for drug use, and urge for alcohol.
    VariableCoefficient, mean (SD)Odds ratio (95% CI)ESSab
    Outcome: urge for sex



    		Intercept1.115 (0.495)3.050 (1.157-8.004)17571.00

    		Days (log)–0.807 (0.145)0.446 (0.333-0.586)14901.00

    		Intervention–1.845 (0.709)0.158 (0.038-0.626)23671.00

    		Intervention × days (log)0.352 (0.206)1.422 (0.947-2.143)21411.00

    		Random intercept: σ2.157 (0.358)—c22291.00

    		Random slope: σ0.535 (0.105)—13791.00
    Outcome: urge for drugs



    		Intercept–0.846 (0.582)0.429 (0.130-1.296)14271.00

    		Days (log)–0.537 (0.171)0.584 (0.410-0.799)15121.00

    		Intervention0.291 (0.809)1.338 (0.274-6.430)19201.00

    		Intervention × days (log)–0.354 (0.250)0.702 (0.428-1.148)24991.00

    		Random intercept: σ2.469 (0.445)—12831.00

    		Random slope: σ0.611 (0.137)—10651.00
    Outcome: urge for alcohol



    		Intercept–1.318 (0.709)0.268 (0.057-0.944)14751.00

    		Days (log)–0.767 (0.207)0.464 (0.297-0.679)12721.00

    		Intervention0.634 (0.930)1.885 (0.313-12.884)25001.00

    		Intervention × days (log)–0.305 (0.294)0.737 (0.406-1.279)28921.00

    		Random intercept: σ2.663 (0.544)—14941.00

    		Random slope: σ0.616 (0.171)—7721.01

    aESS: effective sample size; after accounting for autocorrelated samples.

    bPotential scale reduction statistic; <1.1 indicates convergence of Markov chains.

    cNot applicable.

    Table 6. Parameter estimates of fixed and random effects arising from Bayesian hierarchical logistic regression models for stress experienced now and stress experienced the day before.
    VariablesCoefficient, mean (SD)Odds ratio (95% CI)ESSab
    Outcome: stressed now



    		Intercept1.861 (0.674)6.430 (1.779-25.229)20311.00

    		Days (log)–0.762 (0.199)0.467 (0.310-0.681)19041.00

    		Intervention1.448 (1.015)4.255 (0.584-32.169)20441.00

    		Intervention × days (log)–0.107 (0.304)0.899 (0.495-1.642)21911.00

    		Random intercept: σ3.373 (0.570)—c16231.00

    		Random slope: σ0.902 (0.158)—17661.00
    Outcome: stressed yesterday



    		Intercept–0.216 (0.418)0.806 (0.347-1.831)15911.00

    		Days (log)–0.339 (0.149)0.712 (0.526-0.942)14451.00

    		Intervention–0.027 (0.597)0.973 (0.300-3.238)20301.00

    		Intervention × days (log)0.012 (0.213)1.012 (0.670-1.540)19841.00

    		Random intercept: σ1.826 (0.417)—8991.01

    		Random slope: σ0.623 (0.129)—10501.01

    aESS: effective sample size; after accounting for autocorrelated samples.

    bPotential scale reduction statistic; <1.1 indicates convergence of Markov chains.

    cNot applicable.

    The number of participants with any PrEP use during the study was 17%—9 (18%) in the control group and 8 (16%) in the intervention group (χ21=0.07, P=.79). HIV tests were completed by 11 (22%) and 13 (26%) participants in the control and intervention groups, respectively (χ21=0.22, P=.64). Intervention goals were selected by participants at the baseline visit. Overall, participants chose from goals, including increasing condom use (n=13), reducing drug and alcohol use (n=9), reducing the number of sex partners (n=9), increasing HIV testing (n=7), using PrEP for HIV prevention (n=6), reducing injection drug use (n=4), and reducing sex while under the influence of drugs or alcohol (n=2).

    Sensitivity analysis with the tipping-point approach showed that the intervention effect for drug use was fairly robust on both dimensions of the nonignorable missing mechanisms (Figure 2). The intervention effect was significant even if there was an average of two unreported drug use events among participants who never reported drug use. Similarly, the intervention effect could withstand a doubling of the probability of drug use on nonresponse days among drug users. The intervention effect could also withstand a combination of one unreported drug use event among nonusers and doubling of the probability on the other dimension. The intervention effect tipped over into nonsignificance (at the 95% confidence level) if there were two unreported drug use events simultaneously with a doubling of the probability of drug use in the second mechanism.

    ‎
    Figure 2. Tipping-point display of the sensitivity analysis for drug use that is based on two nonignorable missingness mechanisms. Each 2.5-unit increment in the translation levels represents roughly one unreported drug use event per nonuser during the study period. The multipliers are inflation factors of the probability of drug use on nonresponse days among those with a record of drug usage. The numbers in each cell display the odds ratio (OR) of the intervention effect, that is, the interaction of group and time. The cells with a thick navy border have P<.05. The OR and P values represent a summary of results from the multiple imputation.
    View this figure

    Principal Findings

    This pilot randomized controlled trial of a theoretically based intervention adds to the growing body of literature on the feasibility and potential efficacy of JITAIs to address the modifiable risk factors that are correlated with HIV risk. The findings suggest promising preliminary effects of MY-RID among YEH compared with an attention control group. This intervention was effective at reducing (1) the odds of substance use, (2) the urge for sex, and (3) stress among YEH. This is the first evidence that JITAIs can reduce drug use among a high substance-using population of YEH. Given the association between substance use, as well as sexual risk behaviors (eg, condomless sex) and sexual victimization, among homeless and urban youth [35,38,39,41,42], MY-RID may be a promising approach to HIV prevention in a hard-to-reach population. These findings add to the mounting evidence of the malleability of the risk factors that impact HIV risk in real time, including stress, sexual urge, and substance use [26,27,36-39].

    While this study was not powered to detect small effects or examine the impact of the intervention on condom use, the data suggest that experiencing sexual urges can negatively influence the use of condoms [40]. In addition, only 13 (27%) participants chose increasing condom use as their behavioral goal, which may also account for the lack of impact of the intervention on condomless sex. As well, while we did not examine the intervention effect on engaging in sex while using substances, the substance use literature reports that sex is highest on substance-using days [43] and that substance use is also associated with sexual risk behaviors (eg, condomless sex) and sexual victimization among youth [35,41,42].

    Findings from this study further suggest that MY-RID may reduce mental health symptoms such as stress and urge, which are antecedents to HIV risks. JITAIs have been found to improve psychological symptoms [63], anxiety and stress [67-69], and depressive symptoms [71]. The evidence linking stress to sexual risk behaviors is growing [104]. Delivering coping messages when symptoms (eg, drug or alcohol use urges) are reported may improve stress management and reduce HIV risk behaviors such as substance use and risky sexual activity. Intervention effects were also found for reducing urges for sex among YEH. While reductions in sexual activity and alcohol did not reach significance, they decreased throughout the intervention period in both groups. This may indicate the need to conduct an adequately powered randomized trial to determine if these reductions in risk are significant and sustained over time.

    While EMA completion rates were low among this sample of YEH (ie, EMAs were completed on 46.3% of all possible days), the average length of participation was 5 out of a total of 6 possible weeks and suggests that youth received over half of all possible intervention messages. Since intervention messages were only delivered after EMAs were completed, the average participant received messages on less than half of the study days. However, even with this low EMA completion rate and corresponding lower than expected intervention dose (less than 50%), the results indicate that the intervention demonstrated a significant impact on several key outcomes. It is important to consider that while EMA completion rates are much higher for youth EMA studies in general (78%, range 54.6%-96.2%) [52], in an EMA study with YEH, the completion rate was 62% [43]. This is the first study using EMA-responsive JITAI with YEH and, therefore, comparative data are lacking.

    In a group-based study with YEH, there was a positive intervention effect on alcohol use, motivation, and condom self-efficacy with less than the prescribed intervention dose (48% completion) [46]. This suggests that a lower than planned dose may still lead to change. While comprehensive, high-dose HIV prevention interventions are effective, they also require high participant burden [105], are expensive to support, and are rarely disseminated widely. Further, while there is little evidence of the effectiveness of all interventions for YEH [106], cognitive-behavioral interventions show marginally positive results [86]. Given the difficulty in engaging YEH in HIV prevention interventions in current health care and social service delivery models, mobile, tailored JITAIs may enhance dissemination in hard-to-reach populations such as YEH. Further, since HIV risk behaviors rarely take place during engagements in care and tend to happen within one’s day, JITAIs allow for interventions to be delivered more proximally at times of heightened risk. Given the intervention effect found with a lower than planned level of intervention engagement, there is a need to determine the minimal effective intervention dose to reduce participant burden.

    Limitations

    There are several limitations and challenges to consider when interpreting the findings of this study. First, EMA is an emerging method, and, therefore, there is no robust body of science on EMA measurement psychometrics. However, while no validated EMA scale exists for urge, a systematic review of 91 studies using EMA found the vast majority used a 1-item measure [107]. Further psychometric studies are needed on EMA measures. Second, this was a small pilot study with a convenience sample that only allowed for a preliminary examination of the intervention effects without the power to detect small effect sizes. Third, the control condition received generic motivational messages, which may have positively impacted stress management strategies, thereby diluting any effects that may be attributable to the intervention. Fourth, there may have also been reactivity to EMAs [52] similar to a Hawthorne Effect—HIV health risk behaviors went down over time in both groups, potentially because participants were thinking about their health more due to the EMAs and the generic health messages. Social desirability cannot be eliminated as a possibility that may have affected participant reports. Finally, 16 phones were reported lost or stolen during the study, one was broken, and one was returned after being found in the possession of a different participant. Despite these limitations, the strengths of the study include the diverse gender identity, sexual orientation, and race/ethnicity of the sample.

    Conclusion

    In conclusion, the findings from this study suggest a positive effect of a highly scalable mobile intervention that increases access to a HIV prevention intervention for a hard-to-reach population. MY-RID incorporates several of the core elements indicative of apps that have the potential to change behavior, including knowledge and information, goals and planning, feedback and monitoring, and actions [108]. This intervention builds on proven mHealth strategies [76], tailored education [77,78], and motivational messaging [79,80], delivered at the time of heightened need. Prevention interventions tailored for YEH continue to be rare and yet have led to improvements in sexual health outcomes [86,106,109-111]. Therefore, more research is needed to build on YEH’s willingness to participate in intervention research studies [44,45], improvement intervention engagement, and continue to explore the mounting evidence on efficacy. For example, studies are needed to assess whether the survey length and frequency affect engagement rates. However, it is crucial to involve YEH in the development of interventions as studies suggest improved outcomes when programs are tailored and relevant [49].

    Acknowledgments

    Programming and technological support for the Insight app was provided through the mHealth shared resource of the Stephenson Cancer Center via an NCI Cancer Center Support Grant (grant P30CA225520). Data analysis and manuscript preparation were additionally supported by the Oklahoma Tobacco Settlement Endowment Trust (grant R21-02). The contents of the manuscript are solely the responsibility of the authors and do not necessarily represent the official views of the sponsoring organizations.

    Conflicts of Interest

    MB is the primary inventor of the Insight mHealth platform, which was used to create the data collection and intervention components of the smartphone app used in this study. He receives royalties related to the use of Insight.

    ‎
    Multimedia Appendix 1

    The MY-RID EMA survey.

    DOCX File , 23 KB
    ‎
    Multimedia Appendix 2

    Messaging algorithm.

    DOCX File , 18 KB
    ‎
    Multimedia Appendix 3

    Bayesian stats and sensitivity analysis.

    DOCX File , 22 KB
    ‎
    Multimedia Appendix 4

    Frequencies and proportions of risky behaviors.

    DOCX File , 16 KB
    ‎
    Multimedia Appendix 5

    CONSORT-eHEALTH (V 1.6.1) checklist.

    PDF File (Adobe PDF File), 1114 KB

    References

    1. Morton MH, Dworsky A, Matjasko JL, Curry SR, Schlueter D, Chávez R, et al. Prevalence and Correlates of Youth Homelessness in the United States. J Adolesc Health 2018 Jan;62(1):14-21 [FREE Full text] [CrossRef] [Medline]
    2. Bassuk EL, DeCandia CJ, Beach CA, Berman F. America's youngest outcasts 2014: State report card on child homelessness. National Center for Family Homelessness. Waltham, MA: American Institute for Research; 2014 Nov.   URL: https:/​/www.​air.org/​sites/​default/​files/​downloads/​report/​Americas-Youngest-Outcasts-Child-Homelessness-Nov2014.​pdf [accessed 2014-12-15]
    3. Edidin JP, Ganim Z, Hunter SJ, Karnik NS. The Mental and Physical Health of Homeless Youth: A Literature Review. Child Psychiatry Hum Dev 2011 Nov 26;43(3):354-375. [CrossRef]
    4. Baggett TP, Hwang SW, O'Connell JJ, Porneala BC, Stringfellow EJ, Orav EJ, et al. Mortality among homeless adults in Boston: shifts in causes of death over a 15-year period. JAMA Intern Med 2013 Mar 11;173(3):189-195 [FREE Full text] [CrossRef] [Medline]
    5. Kulik D, Gaetz S, Crowe C, Ford-Jones E. Homeless youth's overwhelming health burden: A review of the literature. Paediatr Child Health 2011 Jun;16(6):e43-e47 [FREE Full text] [CrossRef] [Medline]
    6. Hwang SW, Ueng JJM, Chiu S, Kiss A, Tolomiczenko G, Cowan L, et al. Universal Health Insurance and Health Care Access for Homeless Persons. Am J Public Health 2010 Aug;100(8):1454-1461. [CrossRef]
    7. Aidala A, Cross JE, Stall R, Harre D, Sumartojo E. Housing status and HIV risk behaviors: implications for prevention and policy. AIDS Behav 2005 Sep 9;9(3):251-265. [CrossRef] [Medline]
    8. Beijer U, Wolf A, Fazel S. Prevalence of tuberculosis, hepatitis C virus, and HIV in homeless people: a systematic review and meta-analysis. The Lancet Infectious Diseases 2012 Nov;12(11):859-870. [CrossRef]
    9. Santa Maria D, Flash CA, Narendorf S, Barman-Adhikari A, Petering R, Hsu H, et al. Knowledge and Attitudes About Pre-Exposure Prophylaxis Among Young Adults Experiencing Homelessness in Seven U.S. Cities. J Adolesc Health 2019 May;64(5):574-580. [CrossRef] [Medline]
    10. Noell JW, Ochs LM. Relationship of sexual orientation to substance use, suicidal ideation, suicide attempts, and other factors in a population of homeless adolescents. Journal of Adolescent Health 2001 Jul;29(1):31-36. [CrossRef]
    11. Melander LA, Tyler KA. The effect of early maltreatment, victimization, and partner violence on HIV risk behavior among homeless young adults. J Adolesc Health 2010 Dec;47(6):575-581. [CrossRef] [Medline]
    12. Tyler KA, Hoyt DR, Whitbeck LB. The Effects of Early Sexual Abuse on Later Sexual Victimization Among Female Homeless and Runaway Adolescents. J Interpers Violence 2016 Jul 02;15(3):235-250. [CrossRef]
    13. Thompson RG, Hasin DS. Cigarette, marijuana, and alcohol use and prior drug treatment among newly homeless young adults in New York City: Relationship to a history of foster care. Drug Alcohol Depend 2011 Aug 01;117(1):66-69 [FREE Full text] [CrossRef] [Medline]
    14. Fowler PJ, Toro PA, Miles BW. Pathways to and From Homelessness and Associated Psychosocial Outcomes Among Adolescents Leaving the Foster Care System. Am J Public Health 2009 Aug;99(8):1453-1458. [CrossRef]
    15. Combs KM, Begun S, Rinehart DJ, Taussig H. Pregnancy and Childbearing Among Young Adults Who Experienced Foster Care. Child Maltreat 2018 May 15;23(2):166-174 [FREE Full text] [CrossRef] [Medline]
    16. Zlotnick C. What research tells us about the intersecting streams of homelessness and foster care. Am J Orthopsychiatry 2009 Jul;79(3):319-325. [CrossRef] [Medline]
    17. Khawcharoenporn T, Kendrick S, Smith K. HIV risk perception and preexposure prophylaxis interest among a heterosexual population visiting a sexually transmitted infection clinic. AIDS Patient Care STDS 2012 Apr;26(4):222-233. [CrossRef] [Medline]
    18. Collins J, Slesnick N. Factors Associated with Motivation to Change HIV Risk and Substance Use Behaviors among Homeless Youth. J Soc Work Pract Addict 2011 Jul 01;11(2):163-180 [FREE Full text] [CrossRef] [Medline]
    19. Steinberg L. Risk Taking in Adolescence. Curr Dir Psychol Sci 2016 Jun 23;16(2):55-59. [CrossRef]
    20. Hill TD, Ross CE, Angel RJ. Neighborhood disorder, psychophysiological distress, and health. J Health Soc Behav 2005 Jun;46(2):170-186. [CrossRef] [Medline]
    21. Cutrona CE, Wallace G, Wesner KA. Neighborhood Characteristics and Depression: An Examination of Stress Processes. Curr Dir Psychol Sci 2006 Aug;15(4):188-192 [FREE Full text] [CrossRef] [Medline]
    22. Diez Roux AV, Mair C. Neighborhoods and health. Ann N Y Acad Sci 2010 Mar;1186(1):125-145. [CrossRef] [Medline]
    23. Solorio MR, Rosenthal D, Milburn NG, Weiss RE, Batterham PJ, Gandara M, et al. Predictors of sexual risk behaviors among newly homeless youth: a longitudinal study. J Adolesc Health 2008 Apr;42(4):401-409 [FREE Full text] [CrossRef] [Medline]
    24. Wong Y, Piliavin I. Stressors, resources, and distress among homeless persons:. Social Science & Medicine 2001 Apr;52(7):1029-1042. [CrossRef]
    25. Sinha R. Chronic stress, drug use, and vulnerability to addiction. Ann N Y Acad Sci 2008 Oct;1141(1):105-130 [FREE Full text] [CrossRef] [Medline]
    26. Hall KS, Moreau C, Trussell J, Barber J. Role of young women's depression and stress symptoms in their weekly use and nonuse of contraceptive methods. J Adolesc Health 2013 Aug;53(2):241-248 [FREE Full text] [CrossRef] [Medline]
    27. Hall K, Kusunoki Y, Gatny H, Barber J. Stress symptoms and frequency of sexual intercourse among young women. J Sex Med 2014 Aug;11(8):1982-1990 [FREE Full text] [CrossRef] [Medline]
    28. Hulland E, Brown JL, Swartzendruber AL, Sales JM, Rose ES, DiClemente RJ. The association between stress, coping, and sexual risk behaviors over 24 months among African-American female adolescents. Psychol Health Med 2015;20(4):443-456 [FREE Full text] [CrossRef] [Medline]
    29. Bowleg L, Fitz CC, Burkholder GJ, Massie JS, Wahome R, Teti M, et al. Racial discrimination and posttraumatic stress symptoms as pathways to sexual HIV risk behaviors among urban Black heterosexual men. AIDS Care 2014;26(8):1050-1057 [FREE Full text] [CrossRef] [Medline]
    30. Parsons J, Lelutiu-Weinberger C, Botsko M, Golub SA. Predictors of day-level sexual risk for young gay and bisexual men. AIDS Behav 2013 May;17(4):1465-1477 [FREE Full text] [CrossRef] [Medline]
    31. Wong CF, Kipke MD, Weiss G, McDavitt B. The impact of recent stressful experiences on HIV-risk related behaviors. J Adolesc 2010 Jun;33(3):463-475 [FREE Full text] [CrossRef] [Medline]
    32. Voisin DR, Hotton AL, Schneider JA, UConnect Study Team. The relationship between life stressors and drug and sexual behaviors among a population-based sample of young Black men who have sex with men in Chicago. AIDS Care 2017 May;29(5):545-551 [FREE Full text] [CrossRef] [Medline]
    33. Jerome RC, Woods WJ, Moskowitz JT, Carrico AW. The Psychological Context of Sexual Compulsivity Among Men Who Have Sex with Men. AIDS Behav 2016 Feb;20(2):273-280 [FREE Full text] [CrossRef] [Medline]
    34. Heerde J, Scholes-Balog KE, Hemphill SA. Associations between youth homelessness, sexual offenses, sexual victimization, and sexual risk behaviors: a systematic literature review. Arch Sex Behav 2015 Jan;44(1):181-212. [CrossRef] [Medline]
    35. Heerde JA, Hemphill SA. Sexual Risk Behaviors, Sexual Offenses, and Sexual Victimization Among Homeless Youth: A Systematic Review of Associations With Substance Use. Trauma Violence Abuse 2016 Dec 23;17(5):468-489. [CrossRef] [Medline]
    36. Hall K, Kusunoki Y, Gatny H, Barber J. Social discrimination, stress, and risk of unintended pregnancy among young women. J Adolesc Health 2015 Mar;56(3):330-337 [FREE Full text] [CrossRef] [Medline]
    37. Hall K, Kusunoki Y, Gatny H, Barber J. The risk of unintended pregnancy among young women with mental health symptoms. Soc Sci Med 2014 Jan;100:62-71 [FREE Full text] [CrossRef] [Medline]
    38. Carmona J, Slesnick N, Guo X, Letcher A. Reducing High Risk Behaviors among Street Living Youth: Outcomes of an Integrated Prevention Intervention. Child Youth Serv Rev 2014 Aug 01;43:118-123 [FREE Full text] [CrossRef] [Medline]
    39. Castro AL, Gustafson EL, Ford AE, Edidin JP, Smith DL, Hunter SJ, et al. Psychiatric disorders, high-risk behaviors, and chronicity of episodes among predominantly African American homeless Chicago youth. J Health Care Poor Underserved 2014 Aug;25(3):1201-1216 [FREE Full text] [CrossRef] [Medline]
    40. Kennedy D, Brown RA, Morrison P, Vie L, Ryan GW, Tucker JS. Risk evaluations and condom use decisions of homeless youth: a multi-level qualitative investigation. BMC Public Health 2015 Jan 31;15(1):62 [FREE Full text] [CrossRef] [Medline]
    41. Elkington K, Bauermeister JA, Zimmerman MA. Psychological distress, substance use, and HIV/STI risk behaviors among youth. J Youth Adolesc 2010 May;39(5):514-527 [FREE Full text] [CrossRef] [Medline]
    42. Tucker J, Ryan GW, Golinelli D, Ewing B, Wenzel SL, Kennedy DP, et al. Substance use and other risk factors for unprotected sex: results from an event-based study of homeless youth. AIDS Behav 2012 Aug;16(6):1699-1707 [FREE Full text] [CrossRef] [Medline]
    43. Santa Maria D, Padhye N, Yang Y, Gallardo K, Businelle M. Predicting Sexual Behaviors Among Homeless Young Adults: Ecological Momentary Assessment Study. JMIR Public Health Surveill 2018 Apr 10;4(2):e39. [CrossRef]
    44. Gwadz M, Rotheram-Borus MJ. Tracking high-risk adolescents longitudinally. AIDS Educ Prev 1992;Suppl:69-82. [Medline]
    45. Leonard N, Lester P, Rotheram-Borus MJ, Mattes K, Gwadz M, Ferns B. Successful recruitment and retention of participants in longitudinal behavioral research. AIDS Educ Prev 2003 Jun;15(3):269-281. [CrossRef] [Medline]
    46. Tucker JS, D'Amico EJ, Ewing BA, Miles JNV, Pedersen ER. A group-based motivational interviewing brief intervention to reduce substance use and sexual risk behavior among homeless young adults. J Subst Abuse Treat 2017 May;76:20-27 [FREE Full text] [CrossRef] [Medline]
    47. Bartholomew LK, Mullen PD. Five roles for using theory and evidence in the design and testing of behavior change interventions. J Public Health Dent 2011;71 Suppl 1:S20-S33. [CrossRef] [Medline]
    48. Bartholomew Eldredge LK, Markham CM, Ruiter RAC, Fernández ME, Kok G, Parcel GS. Planning Health Promotion Programs: An Intervention Mapping Approach. Hoboken, NJ: John Wiley & Sons, Inc; 2016.
    49. Bender K, Begun S, DePrince A, Haffejee B, Brown S, Hathaway J, et al. Mindfulness Intervention with Homeless Youth. Journal of the Society for Social Work and Research 2015 Dec;6(4):491-513. [CrossRef]
    50. Stone A. The Science of Real-Time Data Capture: Self-Reports in Health Research. Oxford, UK: Oxford University Press; 2007.
    51. Stone A, Shiffman S. Capturing momentary, self-report data: a proposal for reporting guidelines. Ann Behav Med 2002;24(3):236-243. [CrossRef] [Medline]
    52. Wen C, Schneider S, Stone AA, Spruijt-Metz D. Compliance With Mobile Ecological Momentary Assessment Protocols in Children and Adolescents: A Systematic Review and Meta-Analysis. J Med Internet Res 2017 Apr 26;19(4):e132 [FREE Full text] [CrossRef] [Medline]
    53. Gaelick L, Kanfer FH, Goldstein AP. Self-management methods. In: Helping People Change: A Textbook of Methods. Oxford, UK: Pergamon Press; 1991:305-360.
    54. McCarthy D, Minami H, Yeh VM, Bold KW. An experimental investigation of reactivity to ecological momentary assessment frequency among adults trying to quit smoking. Addiction 2015 Oct;110(10):1549-1560 [FREE Full text] [CrossRef] [Medline]
    55. Comulada W, Lightfoot M, Swendeman D, Grella C, Wu N. Compliance to Cell Phone-Based EMA Among Latino Youth in Outpatient Treatment. J Ethn Subst Abuse 2015;14(3):232-250 [FREE Full text] [CrossRef] [Medline]
    56. Dennis M, Scott CK, Funk RR, Nicholson L. A Pilot Study to Examine the Feasibility and Potential Effectiveness of Using Smartphones to Provide Recovery Support for Adolescents. Subst Abus 2015;36(4):486-492 [FREE Full text] [CrossRef] [Medline]
    57. Hoeppner B, Kahler CW, Gwaltney CJ. Relationship between momentary affect states and self-efficacy in adolescent smokers. Health Psychol 2014 Dec;33(12):1507-1517 [FREE Full text] [CrossRef] [Medline]
    58. Shrier L, Feldman HA, Black SK, Walls C, Kendall AD, Lops C, et al. Momentary affective states surrounding sexual intercourse in depressed adolescents and young adults. Arch Sex Behav 2012 Oct;41(5):1161-1171. [CrossRef] [Medline]
    59. Wright C, Dietze PM, Crockett B, Lim MSC. Participatory development of MIDY (Mobile Intervention for Drinking in Young people). BMC Public Health 2016 Mar 24;16(1):184-111 [FREE Full text] [CrossRef] [Medline]
    60. Santa Maria D, Padhye N, Yang Y, Gallardo K, Santos GM, Jung J, et al. Drug use patterns and predictors among homeless youth: Results of an ecological momentary assessment. Am J Drug Alcohol Abuse 2018;44(5):551-560. [CrossRef] [Medline]
    61. Businelle M, Ma P, Kendzor DE, Frank SG, Vidrine DJ, Wetter DW. An Ecological Momentary Intervention for Smoking Cessation: Evaluation of Feasibility and Effectiveness. J Med Internet Res 2016 Dec 12;18(12):e321 [FREE Full text] [CrossRef] [Medline]
    62. Businelle M, Ma P, Kendzor DE, Frank SG, Wetter DW, Vidrine DJ. Using Intensive Longitudinal Data Collected via Mobile Phone to Detect Imminent Lapse in Smokers Undergoing a Scheduled Quit Attempt. J Med Internet Res 2016 Oct 17;18(10):e275 [FREE Full text] [CrossRef] [Medline]
    63. Heron KE, Smyth JM. Ecological momentary interventions: incorporating mobile technology into psychosocial and health behaviour treatments. Br J Health Psychol 2010 Feb;15(Pt 1):1-39. [CrossRef] [Medline]
    64. Whittaker R, McRobbie H, Bullen C, Rodgers A, Gu Y. Mobile phone-based interventions for smoking cessation. Cochrane Database Syst Rev 2016 Apr 10;4(4):CD006611 [FREE Full text] [CrossRef] [Medline]
    65. Suffoletto B, Kristan J, Callaway C, Kim KH, Chung T, Monti PM, et al. A text message alcohol intervention for young adult emergency department patients: a randomized clinical trial. Ann Emerg Med 2014 Dec;64(6):664-72.e4 [FREE Full text] [CrossRef] [Medline]
    66. Jones K, Eathington P, Baldwin K, Sipsma H. The impact of health education transmitted via social media or text messaging on adolescent and young adult risky sexual behavior: a systematic review of the literature. Sex Transm Dis 2014 Jul;41(7):413-419. [CrossRef] [Medline]
    67. Loo Gee B, Griffiths KM, Gulliver A. Effectiveness of mobile technologies delivering Ecological Momentary Interventions for stress and anxiety: a systematic review. J Am Med Inform Assoc 2016 Jan;23(1):221-229 [FREE Full text] [CrossRef] [Medline]
    68. Grassi A, Gaggioli A, Riva G. The green valley: the use of mobile narratives for reducing stress in commuters. Cyberpsychol Behav 2009 Apr;12(2):155-161. [CrossRef] [Medline]
    69. Riva G, Grassi A, Villani D, Gaggioli A, Preziosa A. Managing exam stress using UMTS phones: the advantage of portable audio/video support. In: Medicine Meets Virtual Reality. Milan, Italy: Applied Technology for Neuro-Psychology Lab; 2007:406-408.
    70. Suffoletto B, Callaway C, Kristan J, Kraemer K, Clark DB. Text-message-based drinking assessments and brief interventions for young adults discharged from the emergency department. Alcohol Clin Exp Res 2012 Mar;36(3):552-560. [CrossRef] [Medline]
    71. Kauer SD, Reid SC, Crooke AHD, Khor A, Hearps SJC, Jorm AF, et al. Self-monitoring using mobile phones in the early stages of adolescent depression: randomized controlled trial. J Med Internet Res 2012 Jun 25;14(3):e67 [FREE Full text] [CrossRef] [Medline]
    72. Sullivan P, Driggers R, Stekler JD, Siegler A, Goldenberg T, McDougal SJ, et al. Usability and Acceptability of a Mobile Comprehensive HIV Prevention App for Men Who Have Sex With Men: A Pilot Study. JMIR Mhealth Uhealth 2017 Mar 09;5(3):e26 [FREE Full text] [CrossRef] [Medline]
    73. Serrano K, Yu M, Riley WT, Patel V, Hughes P, Marchesini K, et al. Willingness to Exchange Health Information via Mobile Devices: Findings From a Population-Based Survey. Ann Fam Med 2016;14(1):34-40 [FREE Full text] [CrossRef] [Medline]
    74. Silva B, Rodrigues JPC, de la Torre Díez I, López-Coronado M, Saleem K. Mobile-health: A review of current state in 2015. J Biomed Inform 2015 Aug;56:265-272 [FREE Full text] [CrossRef] [Medline]
    75. Akter S, Ray P. mHealth - an Ultimate Platform to Serve the Unserved. Yearb Med Inform 2018 Mar 07;19(01):94-100. [CrossRef]
    76. McInnes D, Li AE, Hogan TP. Opportunities for engaging low-income, vulnerable populations in health care: a systematic review of homeless persons' access to and use of information technologies. Am J Public Health 2013 Dec;103 Suppl 2(S2):e11-e24. [CrossRef] [Medline]
    77. Shegog R, Bartholomew LK, Parcel GS, Sockrider MM, Mâsse L, Abramson SL. Impact of a computer-assisted education program on factors related to asthma self-management behavior. J Am Med Inform Assoc 2001;8(1):49-61 [FREE Full text] [CrossRef] [Medline]
    78. Shegog R, Markham CM, Leonard AD, Bui TC, Paul ME. "+CLICK": pilot of a web-based training program to enhance ART adherence among HIV-positive youth. AIDS Care 2012;24(3):310-318. [CrossRef] [Medline]
    79. Dermen KH, Thomas SN. Randomized controlled trial of brief interventions to reduce college students' drinking and risky sex. Psychol Addict Behav 2011 Dec;25(4):583-594. [CrossRef] [Medline]
    80. Baer JS, Beadnell B, Garrett SB, Hartzler B, Wells EA, Peterson PL. Adolescent change language within a brief motivational intervention and substance use outcomes. Psychol Addict Behav 2008 Dec;22(4):570-575 [FREE Full text] [CrossRef] [Medline]
    81. Whittaker R, Maddison R, McRobbie H, Bullen C, Denny S, Dorey E, et al. A multimedia mobile phone-based youth smoking cessation intervention: findings from content development and piloting studies. J Med Internet Res 2008 Nov 25;10(5):e49 [FREE Full text] [CrossRef] [Medline]
    82. Businelle M, Kendzor DE, Kesh A, Cuate EL, Poonawalla IB, Reitzel LR, et al. Small financial incentives increase smoking cessation in homeless smokers: a pilot study. Addict Behav 2014 Mar;39(3):717-720. [CrossRef] [Medline]
    83. Businelle MS, Ma P, Kendzor DE, Reitzel LR, Chen M, Lam CY, et al. Predicting quit attempts among homeless smokers seeking cessation treatment: an ecological momentary assessment study. Nicotine Tob Res 2014 Oct 03;16(10):1371-1378 [FREE Full text] [CrossRef] [Medline]
    84. Cornelius JB, Cato M, Lawrence JS, Boyer CB, Lightfoot M. Development and pretesting multimedia HIV-prevention text messages for mobile cell phone delivery. J Assoc Nurses AIDS Care 2011 Sep;22(5):407-413 [FREE Full text] [CrossRef] [Medline]
    85. Cornelius J, St Lawrence JS, Howard JC, Shah D, Poka A, McDonald D, et al. Adolescents' perceptions of a mobile cell phone text messaging-enhanced intervention and development of a mobile cell phone-based HIV prevention intervention. J Spec Pediatr Nurs 2012 Jan;17(1):61-69 [FREE Full text] [CrossRef] [Medline]
    86. Altena AM, Brilleslijper-Kater SN, Wolf JR. Effective interventions for homeless youth: a systematic review. Am J Prev Med 2010 Jun;38(6):637-645. [CrossRef] [Medline]
    87. Spruijt-Metz D, Hekler E, Saranummi N, Intille S, Korhonen I, Nilsen W, et al. Building new computational models to support health behavior change and maintenance: new opportunities in behavioral research. Transl Behav Med 2015 Sep 28;5(3):335-346 [FREE Full text] [CrossRef] [Medline]
    88. Nahum-Shani I, Smith SN, Spring BJ, Collins LM, Witkiewitz K, Tewari A, et al. Just-in-Time Adaptive Interventions (JITAIs) in Mobile Health: Key Components and Design Principles for Ongoing Health Behavior Support. Ann Behav Med 2018 May 18;52(6):446-462 [FREE Full text] [CrossRef] [Medline]
    89. Fisher JD, Fisher WA, Amico KR, Harman JJ. An information-motivation-behavioral skills model of adherence to antiretroviral therapy. Health Psychol 2006 Jul;25(4):462-473. [CrossRef] [Medline]
    90. Mobile Health Technology. Health Promotion Research Center.   URL: https://healthpromotionresearch.org/Mobile-Health-Technology [accessed 2020-12-12]
    91. Murphy PW, Davis TC, Long SW, Jackson RH, Decker BC. Rapid estimate of adult literacy in medicine (REALM): a quick reading test for patients. Journal of Reading 1993:124-130.
    92. Fisher JD, Fisher WA. Changing AIDS-risk behavior. Psychol Bull 1992 May;111(3):455-474. [CrossRef] [Medline]
    93. Felitti VJ, Anda RF, Nordenberg D, Williamson DF, Spitz AM, Edwards V, et al. Relationship of Childhood Abuse and Household Dysfunction to Many of the Leading Causes of Death in Adults. American Journal of Preventive Medicine 1998 May;14(4):245-258. [CrossRef]
    94. Slesnick N, Zhang J, Brakenhoff B. Homeless Youths' Caretakers: The Mediating Role of Childhood Abuse on Street Victimization and Housing Instability. Soc Work 2016 Apr;61(2):147-154. [CrossRef] [Medline]
    95. Cohen S, Kamarck T, Mermelstein R. A Global Measure of Perceived Stress. Journal of Health and Social Behavior 1983 Dec;24(4):385-396. [CrossRef]
    96. Martin A, Rief W, Klaiberg A, Braehler E. Validity of the Brief Patient Health Questionnaire Mood Scale (PHQ-9) in the general population. Gen Hosp Psychiatry 2006;28(1):71-77. [CrossRef] [Medline]
    97. Green J, Gruber MJ, Sampson NA, Zaslavsky AM, Kessler RC. Improving the K6 short scale to predict serious emotional disturbance in adolescents in the USA. Int J Methods Psychiatr Res 2010 Jun;19 Suppl 1(S1):23-35 [FREE Full text] [CrossRef] [Medline]
    98. Shiffman S. Ecological momentary assessment (EMA) in studies of substance use. Psychol Assess 2009 Dec;21(4):486-497 [FREE Full text] [CrossRef] [Medline]
    99. Therneau T. A Package for Survival Analysis in R, version 2. 2015.   URL: https://CRAN.R-project.org/package=survival [accessed 2021-06-30]
    100. R Core Team. R: A language and environment for statistical computing. R Foundation for Statistical Computing. 2020.   URL: https://www.r-project.org/ [accessed 2021-06-30]
    101. RStan: the R interface to Stan. Stan Development Team. 2016.   URL: https://cran.r-project.org/web/packages/rstan/vignettes/rstan.html [accessed 2021-06-30]
    102. The R Team. RStudio: Integrated Development for R. RStudio, PBC. 2012.   URL: http://www.rstudio.com/ [accessed 2021-06-30]
    103. Liublinska V, Rubin DB. Sensitivity analysis for a partially missing binary outcome in a two-arm randomized clinical trial. Stat Med 2014 Oct 30;33(24):4170-4185 [FREE Full text] [CrossRef] [Medline]
    104. Heerde J, Hemphill SA. The role of risk and protective factors in the modification of risk for sexual victimization, sexual risk behaviors, and survival sex among homeless youth: A meta-analysis. J Investig Psych Offender Profil 2016 Nov 24;14(2):150-174. [CrossRef]
    105. Arnold E, Rotheram-Borus MJ. Comparisons of prevention programs for homeless youth. Prev Sci 2009 Mar;10(1):76-86 [FREE Full text] [CrossRef] [Medline]
    106. Naranbhai V, Abdool Karim Q, Meyer-Weitz A. Interventions to modify sexual risk behaviours for preventing HIV in homeless youth. Cochrane Database Syst Rev 2011 Jan 19(1):CD007501 [FREE Full text] [CrossRef] [Medline]
    107. Serre F, Fatseas M, Swendsen J, Auriacombe M. Ecological momentary assessment in the investigation of craving and substance use in daily life: a systematic review. Drug Alcohol Depend 2015 Mar 01;148:1-20. [CrossRef] [Medline]
    108. McKay F, Slykerman S, Dunn M. The App Behavior Change Scale: Creation of a Scale to Assess the Potential of Apps to Promote Behavior Change. JMIR Mhealth Uhealth 2019 Jan 25;7(1):e11130 [FREE Full text] [CrossRef] [Medline]
    109. Rotheram-Borus M, Song J, Gwadz M, Lee M, Van Rossem R, Koopman C. Reductions in HIV risk among runaway youth. Prev Sci 2003 Sep;4(3):173-187. [CrossRef] [Medline]
    110. Slesnick N, Kang MJ. The impact of an integrated treatment on HIV risk behavior among homeless youth: a randomized controlled trial. J Behav Med 2008 Mar;31(1):45-59 [FREE Full text] [CrossRef] [Medline]
    111. Slesnick N, Prestopnik J. Dual and multiple diagnosis among substance using runaway youth. Am J Drug Alcohol Abuse 2005;31(1):179-201 [FREE Full text] [CrossRef] [Medline]

    ‎
    EMA: ecological momentary assessment
    IMB: Information, Motivation, and Behavioral Skills
    JITAI: just-in-time adaptive intervention
    mHealth: mobile health
    MSM: men who have sex with men
    MY-RID: Motivating Youth to Reduce Infection and Disconnection
    OR: odds ratio
    PrEP: pre-exposure prophylaxis
    REALM: Rapid Estimate of Adult Literacy in Medicine-Short Form
    YEH: youth experiencing homelessness

    Edited by G Eysenbach; submitted 22.12.20; peer-reviewed by T Lillie, J Glass, M Step; comments to author 07.01.21; revised version received 26.02.21; accepted 05.05.21; published 06.07.21

    Copyright

    ©Diane Santa Maria, Nikhil Padhye, Michael Businelle, Yijiong Yang, Jennifer Jones, Alexis Sims, Marguerita Lightfoot. Originally published in the Journal of Medical Internet Research (https://www.jmir.org), 06.07.2021.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on https://www.jmir.org/, as well as this copyright and license information must be included.