Published on in Vol 26 (2024)

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/47448, first published .
Willingness to Use Digital Health Screening and Tracking Tools for Public Health in Sexual Minority Populations in a National Probability Sample: Quantitative Intersectional Analysis

Willingness to Use Digital Health Screening and Tracking Tools for Public Health in Sexual Minority Populations in a National Probability Sample: Quantitative Intersectional Analysis

Willingness to Use Digital Health Screening and Tracking Tools for Public Health in Sexual Minority Populations in a National Probability Sample: Quantitative Intersectional Analysis

Authors of this article:

Wilson Vincent1 Author Orcid Image

Original Paper

Department of Psychology and Neuroscience, Temple University, Philadelphia, PA, United States

Corresponding Author:

Wilson Vincent, MPH, PhD

Department of Psychology and Neuroscience, Temple University

Weiss Hall

1701 N 13th St

Philadelphia, PA, 19122

United States

Phone: 1 404 200 0203

Email: wilson.vincent@temple.edu


Background: Little is known about sexual minority adults’ willingness to use digital health tools, such as pandemic-related tools for screening and tracking, outside of HIV prevention and intervention efforts for sexual minority men, specifically. Additionally, given the current cultural climate in the United States, heterosexual and sexual minority adults may differ in their willingness to use digital health tools, and there may be within-group differences among sexual minority adults.

Objective: This study compared sexual minority and heterosexual adults’ willingness to use COVID-19–related digital health tools for public health screening and tracking and tested whether sexual minority adults differed from each other by age group, gender, and race or ethnicity.

Methods: We analyzed data from a cross-sectional, national probability survey (n=2047) implemented from May 30 to June 8, 2020, in the United States during the height of the public health response to the COVID-19 pandemic. Using latent-variable modeling, heterosexual and sexual minority adults were tested for differences in their willingness to use digital health tools for public health screening and tracking. Among sexual minority adults, specifically, associations with age, gender, and race or ethnicity were assessed.

Results: On average, sexual minority adults showed greater willingness to use digital health tools for screening and tracking than heterosexual adults (latent factor mean difference 0.46, 95% CI 0.15-0.77). Among sexual minority adults, there were no differences by age group, gender, or race or ethnicity. However, African American (b=0.41, 95% CI 0.19-0.62), Hispanic or Latino (b=0.36, 95% CI 0.18-0.55), and other racial or ethnic minority (b=0.54, 95% CI 0.31-0.77) heterosexual adults showed greater willingness to use digital health tools for screening and tracking than White heterosexual adults.

Conclusions: In the United States, sexual minority adults were more willing to use digital health tools for screening and tracking than heterosexual adults. Sexual minority adults did not differ from each other by age, gender, or race or ethnicity in terms of their willingness to use these digital health tools, so no sexual orientation-based or intersectional disparities were identified. Furthermore, White heterosexual adults were less willing to use these tools than racial or ethnic minority heterosexual adults. Findings support the use of digital health tools with sexual minority adults, which could be important for other public health-related concerns (eg, the recent example of mpox). Additional studies are needed regarding the decision-making process of White heterosexual adults regarding the use of digital health tools to address public health crises, including pandemics or outbreaks that disproportionately affect minoritized populations.

J Med Internet Res 2024;26:e47448

doi:10.2196/47448

Keywords



Despite the economic, health, and mortality impacts of COVID-19 on the population as a whole, there has been great variability in the public’s willingness to participate in public health efforts to address the pandemic, including wearing masks and getting vaccinated [1,2]. Additionally, the COVID-19 pandemic has had an especially devastating impact on specific groups in the United States, with disproportionate mortality affecting older adults, men, and African American, and Hispanic American individuals [3-5]. Studies have examined the willingness to engage in preventive behaviors of American adults by age, gender, and race or ethnicity to curtail the COVID-19 pandemic, including the use of digital health tools for screening and tracking [6-11]. Although the COVID-19 pandemic has had a significant impact on sexual minority populations (ie, people who identify as gay, lesbian, bisexual, or other nonheterosexual sexual orientation identities) [12-14], less is known about sexual minority populations’ preventive responses to the COVID-19 pandemic. In the current climate of increased medical mistrust, the corresponding unwillingness to follow public health recommendations often occurs along demographic lines [15-17].

Some public health efforts for screening and tracking COVID-19, such as mobile health (mHealth), which includes the use of smartphones and related digital technologies to assess or address health, and other digital health tools (eg, patient portals and web-based patient questionnaires), have previously proven effective, acceptable, and feasible for HIV prevention for sexual minority men [18-21]. Generally, research shows that digital technologies such as mHealth applications improve the feasibility of delivering health care to sexual minority patients [22]. Additionally, studies indicate that tracking mental and physical health-related information through mHealth applications was associated with better mental health status for sexual minority people to a greater extent during the COVID-19 pandemic than before the pandemic [23]. Despite the potential for significant benefits, research has yet to examine sexual minority populations’ willingness to use mHealth tools for COVID-19.

For COVID-19, mobile apps created specifically in response to the COVID-19 pandemic have been the most frequently used type of mHealth tool [24]. Such mHealth tools aid in the screening, monitoring, and treatment of COVID-19 [24]. These mHealth-based approaches have had the advantage of easing the burden of in-person activities on COVID-19 testing and public health infrastructure (eg, avoiding supply chain issues, limiting the possibility of viral exposure) [18,25]. Previous research is mixed on whether there are no demographic differences by age, gender, or race or ethnicity in willingness to use digital health tools for COVID-19 screening and tracking. Although some studies showed no differences [26-28], others found evidence of greater willingness or support among younger adults, women, and racial and ethnic minority people [29-31]. However, these studies did not examine sexual orientation diversity. Heterosexual and sexual minority adults in the United States may differ in their willingness to participate in pandemic-related mHealth approaches, and these differences may vary based on other demographic characteristics such as age, gender, and race or ethnicity.

In addition to potential differences between heterosexual and sexual orientation–diverse populations, there may be notable differences among sexual minority populations. For example, the intersectionality theory asserts that seemingly independent yet intersecting social identities along social hierarchies based on dimensions such as race or ethnicity, gender, and sexual orientation jointly shape human experiences [32-35]. The intersectionality framework suggests that sexual minority people’s multiple intersecting identities must be considered simultaneously (eg, sexual minority people who are also African American), rather than treating each identity as a mutually exclusive category [36,37]. A recent review [38] and commentaries [39,40] have emphasized the urgent need to use intersectionality theory in the conceptualization and methodology of examining digital health disparities.

Although research has yet to explore sexual minority people’s willingness to use mHealth tools for COVID-19 based on their intersecting identities, such as age, gender, or race or ethnicity, the sexual minority health and HIV literatures illustrate how minoritized identities that intersect with sexual orientation–minoritized identities change the social position of individuals in ways that increase their risk of oppression and resulting adverse health outcomes. For example, Black sexual minority men experience both sexual orientation– and race-based stigma, and they experience more race- or ethnicity-based stigma in gay spaces than other groups [41,42]. Also, although both Black and White sexual minority men experience stereotypes about their sexual behaviors, assumptions may be more extreme for Black sexual minority men given the added layer of stereotypes about Black male sexuality [43,44]. The confluence of racism and antigay attitudes contributes to the increased risk of HIV for Black sexual minority men, including through social marginalization within communities of sexual minority men and late detection of HIV by medical and public health establishments, despite these men having no greater frequency or extent of sexual risk behavior to explain elevated HIV risk [42,45,46]. Additionally, Black sexual minority men may not benefit from or see the usefulness of mHealth tools for HIV prevention given that these tools may inadvertently stigmatize them through their “targeted” sexual health messages [47], or the tools may be viewed as a subpar offering in place of clinicians and public health professions “doing their jobs” [48]. Thus, although mHealth apps for HIV prevention have been found to be acceptable and feasible for implementation for sexual minority men in general [18-21], results may vary depending on intersecting racial, ethnic, or other identities.

This study examined the extent to which heterosexual adults and sexual minority adults differed in their willingness to participate in public health digital screening and tracking efforts to address the COVID-19 pandemic in a nationally representative sample of adults living in the United States. Also, for sexual minority participants, the author assessed differences within sexual minority populations in mean levels of willingness for COVID-19–related digital screening and tracking based on age group, gender, and race or ethnicity. Thus, the focus was on whether a sexual orientation–based disparity adversely affected sexual minority adults’ willingness to use digital health tools for screening and tracking and whether there were also intersectional disparities based on age, gender, and racial or ethnic categories.


Overview

This study was conducted and reported in accordance with the “Strengthening the Reporting of Observational Studies in Epidemiology” (STROBE) guidelines [49,50]. Specific study methods are provided in subsequent sections.

Data

The COVID Impact Survey (CIS) is a national probability survey of US households designed to provide estimates for preventative behaviors and the impact of the COVID-19 pandemic; the data are publicly available [51]. The author used data from the last of 3 waves of cross-sectional data collection in the CIS, which occurred from May 30 to June 8, 2020 (n=2047). All 3 waves occurred between April 20 and June 8, 2020. These data were collected using the AmeriSpeak Panel, a probability-based panel distributed by NORC (formerly the National Opinion Research Center) at the University of Chicago.

US households were sampled with a known, nonzero probability of selection based on the NORC National Sample Frame, which was extracted from the US Postal Service Delivery Sequence File. Households were contacted by US mail, email, telephone, and field interviewers. The data are representative of noninstitutionalized adults who reside in the United States when weighted using sampling weights provider by the CIS. The CIS was funded by the Data Foundation. The NORC Institutional Review Board approved the CIS protocol to protect human participants (FWA00000142).

Measures

Willingness for Public Health Digital Screening and Tracking for COVID-19

Participants responded to questions asking about their likelihood of COVID-19–related testing (ie, “Testing you for COVID-19 infection using a Q-tip to swab your cheek or nose” and “Testing you for immunity or resistance to COVID-19 by drawing a small amount of blood”) and digital screening and tracking (eg, “Installing an app on your phone that asks you questions about your own symptoms and provides recommendations about COVID-19” and “Installing an app on your phone that tracks your location and sends push notifications if you might have been exposed to COVID-19”). Response options ranged from (1) “extremely likely” to (5) “not at all likely.” Items were reverse-coded such that higher scores reflected a greater perceived likelihood for screening and tracking. Participants had the option to respond with (88) “Already done this,” and these cases were excluded using listwise deletion.

In a sample that included mostly heterosexual participants from Wave 2 of the CIS (manuscript under review), the measure showed construct validity in its positive correlations with participants having engaged in other protective behaviors to prevent COVID-19 infection (eg, “worn a face mask” and “avoided public or crowded places”). Additionally, participants who engaged in more frequent digital communications with friends and family before the public health response to the COVID-19 pandemic in the United States in March 2020 scored higher in willingness to use pandemic-related mHealth tools than participants who used digital communications with friends and family less frequently. The measure also showed measurement invariance across age groups, genders, and categories of race or ethnicity based on Wave 3. Based on Wave 1 of the CIS, the measure has demonstrated high internal consistency (Cronbach α=.90).

Demographic Characteristics

Participants self-reported their sexual orientation identity (ie, gay, lesbian, or bisexual, straight, something else, and I don’t know). Sexual orientation identity was dichotomized to reflect heterosexual status and nonheterosexual sexual-minority status, respectively. The following additional demographic characteristics were assessed for measurement invariance: age, gender, and race or ethnicity. Additionally, participants reported their current age, which the CIS categorized (ie, 18-24 years, 25-34 years, 45-54 years, 55-64 years, 65-74 years, and ≥75 years) to help anonymize the data set; gender (female coded 1, male coded 0); and self-identified race or ethnicity (eg, Black or African American, Hispanic or Latino, White, multiple other races and ethnicities, such as Asian, Indian, and Native Hawaiian). Transgender and nonbinary identities were not options on the CIS.

Data Analysis Plan

This study tested the extent to which heterosexual and sexual minority adults differed in their willingness to use digital health tools for public health screening and tracking, a latent variable, and whether sexual minority adults’ willingness to use these COVID-19–related digital health tools was associated with age, gender, and race or ethnicity. Measurement invariance (ie, whether the measure means and assesses the same thing across groups) was tested across heterosexual and sexual minority adults.

Descriptive statistics and Cronbach α were computed using Stata (version 16; StataCorp) [52], and coefficient ω and all analyses of associations and latent variables were conducted using Mplus (version 8; Muthén & Muthén) [53]. Weighted least squares estimation with Delta parameterization was used to estimate model parameters [53]. This estimation method uses a diagonal weight matrix with SEs and mean- and variance-adjusted chi-square test statistics that rely on a full weight matrix (ie, ESTIMATOR=WLSMV in Mplus) [53]. It is particularly appropriate for ordinal and nominal data [53]. Model fit was assessed with several fit indices based on any 2 of the following 3 criteria: a root-mean-square standard error of approximation (RMSEA) value of 0.06, a comparative fit index (CFI) value of at least 0.95, and a standardized root-mean-square residual (SRMR) criterion of 0.08 or less [54,55].

The author tested the extent to which the 5-item measure was invariant across the 2 sexual orientation categories. The 3 levels of measurement invariance—configural, metric, and scalar—were tested to determine if the 5-item measure was invariant across sexual-orientation categories. For ordinal variables and weighted least squares estimation methods with Delta parameterization, configural invariance (ie, pattern invariance), the least strict form of invariance, shows that each group has the same indicators loading onto the same factors in the same direction (ie, positive versus negative). To model configural invariance: (1) factor loadings are free to vary across groups, (2) thresholds are free to vary across groups, (3) scale factors are fixed to 1 in all groups, (4) factor means are fixed to 0 for all groups, and (5) factor variances are free to vary across groups [53]. Metric invariance (ie, weak invariance) indicates the invariance of factor loadings across groups, wherein (1) factor loadings are constrained to be equal across groups, (2) the first threshold of each item is constrained to be equal across groups, (3) the second threshold of the item that sets the metric of the factor is constrained to be equal across groups, (4) scale factors are fixed to 1 in 1 group and free to vary in the other groups, (5) factor means a Muthén & Muthénre fixed to 0 in 1 group and free to vary in the other groups, and (6) factor variances remain free to vary across groups [53]. Scalar invariance (ie, strong invariance) indicates equivalence of item intercepts or thresholds, in the case of categorical or ordinal variables, across groups and is the minimum needed to proceed with using a measure to test for differences in latent factor means between groups [56,57]. Scalar invariance is the same as metric invariance, except that thresholds are constrained to be equal across groups [53].

To compare invariance models, the author used a difference in CFI (ΔCFI) equal to or greater than 0.01 to indicate noninvariance [56]. Thus, a lack of worsened model fit with increased constraints indicates measurement invariance. Although scaled chi-square difference tests scaled for the weighted least squares estimator were conducted, this test may detect small discrepancies in ways that are not practically or theoretically meaningful in sample sizes greater than 200 [56-58].

Upon determining measurement invariance, the latent factor mean difference between heterosexual adults and sexual minority adults in the underlying factor of willingness to use digital health tools for public health screening and tracking was tested. Specifically, the latent variable for willingness to use digital health tools was standardized such that its mean was fixed to 0 and SD set to 1. The factor mean remained 0 for the reference group, heterosexual individuals, but the factor mean was freely estimated for the comparison group, sexual minority individuals. Thus, the resulting mean for sexual minority individuals reflected the difference in the mean from the reference group on a standardized metric, or in SD units. To identify correlates of willingness to use digital health tools for public health screening and tracking among sexual minority populations, specifically, willingness to use digital health tools was regressed on sexual minority adults’ age group, gender, and race or ethnicity, respectively.

Within an intersectionality-informed analytic framework, as described by Jackson et al [59], we can use additive measures of interaction to test for joint, referent, or excess intersectional disparities. Using the present analyses as a guiding example, the outcome variable would be recoded such that higher scores reflect a more adverse or disparity-oriented outcome (ie, less willingness to use COVID-19 screening and tracking tools). The predictor, gender (women coded 1), and the moderator, sexual orientation identity (sexual minority identity coded 1), would be coded such that the reference category (coded 0) is the nonminoritized group in this instance (ie, men and heterosexual adults) and the active category (coded 1) is the minoritized group (ie, women and sexual minority adults). Thus, the code of 1 reflects an adverse social position. For gender and sexual orientation, the original equation in the primary analyses before recoding and not including other covariates would be:

Given that the outcome should reflect a negative outcome to identify a disparity, the analyses would be repeated with the outcome variable recoded to reflect an unwillingness to use digital health tools rather than a willingness to use these tools. For gender and sexual orientation, the equation after recoding and not including other covariates would then be:

The joint disparity compares outcomes from the cell or group at the intersection of 2 minoritized identities, in this case, sexual minority women, to the group at the intersection of the 2 corresponding nonminoritized identities, in this instance, heterosexual men. In our example, b1 + b2 + b3 equals the joint disparity in unwillingness to use COVID-19 screening and tracking tools comparing sexual minority women to heterosexual men. Referent disparities are those that affect only 1 minoritized population or identity, in this case, women compared with men among heterosexual adults or heterosexual adults compared with sexual minority adults among men. It describes the disparity based on gender as a proxy for sexism or sexual minority identity as a proxy for heterosexism or homonegativity, but not both. Specifically, b1 equals the referent gender disparity in unwillingness to use COVID-19 digital screening among heterosexual adults, and b2 equals the referent sexual minority disparity among men. Finally, the excess intersectional disparity focuses on the intersection of minoritized identities and describes the extent to which the joint disparity exceeds the 2 individual referent disparities. Suppose it is greater than 0, or statistically significant. In that case, the strength of the association indicates the disparity at the intersection of minoritized gender and sexual orientation, that is, women who are also sexual minority adults, and b3 equals this excess intersectional disparity. A more detailed explanation can be found in Jackson et al [59] and VanderWeele and Tchetgen Tchetgen [60].

Disparities are indicated if the regression coefficients are positive, reflecting direct associations (ie, disadvantages for the minoritized groups) as opposed to inverse associations (ie, advantages for the more minoritized group). An advantage on an outcome for a relatively disadvantaged group that otherwise disproportionately and systematically experiences worse health outcomes and greater health risks would not meet established definitions of a disparity [61,62].

Given the complex nature of these survey data, analyses were adjusted using a sampling weight based on the inverse of the probability of selection in the sample. These analyses also accounted for stratification using pseudostrata based on census tracts. The data producer, NORC, used pseudostrata to preserve confidentiality. Per NORC, they did not include cluster variables because there were negligible cluster effects, and excluding these variables better preserved confidentiality (personal communication; Jennifer Benz, May 14, 2021). Descriptive statistics for the present sample accounted for weighting and stratification to reflect the complex survey design and national representativeness of the sample along key raking variables (ie, age, gender, and race or ethnicity). Latent factor mean differences (ΔM) and regression coefficients (b) are presented with their 95% CIs. Missing data, which were up to 3.7% missing across analyses, were handled using listwise deletion.

Ethical Considerations

Temple University’s institutional review board determined that the present analyses, which used deidentified publicly available data, did not require institutional approval for human participants research (contact the corresponding author for documentation).


Sample Characteristics

Of the total sample of 1928 adults, 161 were sexual minority individuals. Other sample characteristics are listed in Tables 1 and 2. The sample size was reduced from 2047 due to missing data on sexual orientation (6.2%).

Table 1. Descriptive statistics based on raking variables (ie, age, gender, and race or ethnicity) given complex design and weighting and sexual orientation identities represented in the sample (N=1928). Proportions may not sum to 1, and percentages may not sum to 100 due to rounding. Subcategories (eg, sexual orientation subcategories) may not sum to 1928 due to missing data. Sexual orientation was significantly associated with age group; the pattern of results indicates that younger adults were more likely to self-identify as sexual minority individuals than older adults.
VariableTotalEstimated proportionComparison linearized SEP value


nEstimated proportion (%)Linearized SEDesign effectHeterosexualSexual minority

Age (years)<.001

18-293110.2110.0152.480.8820.1180.025

30-445940.2630.0131.620.9160.0850.015

45-594350.2380.0131.740.9450.0550.012

≥605880.2880.0131.6750.9660.0340.008
Gender.19

Male9140.4780.0151.820.9400.0600.009

Female10140.5220.0151.820.9210.0790.012
Race or ethnicity.72

Asian or Asian American620.0560.0082.470.9560.0440.027

Black or African American2270.1240.0101.830.9200.0800.026

Hispanic or Latino3240.1660.0122.010.9190.0810.019

White or European American11270.6230.0151.840.9340.0660.010

Other races and ethnicities1030.0310.0040.8920.9060.0950.029
Sexual orientationa

Homosexual583.0

Bisexual693.6

Heterosexual176791.7

Other: “Something else”251.3

Other: “I don’t know the answer”90.5

aNot available.

Table 2. Descriptive statistics based on sexual orientation and willingness to use mHealth tools for pandemic-related digital screening and tracking (“If these options were available to you, how likely would you be to participate in them?”; N=1928). Proportions may not sum to 1, and percentages may not sum to 100 due to rounding. Subcategories (eg, sexual orientation subcategories) may not sum to 1928 due to missing data. Sexual orientation was significantly associated with willingness to install “an app on your phone that tracks your location and sends push notifications if you might have been exposed to COVID-19”; the pattern of results indicates that sexual minority adults reported being more likely to install such an app than heterosexual adults. Additionally, sexual orientation was also significantly associated with willingness to “use a website to log your symptoms and location and get recommendations about COVID-19”; the pattern of findings indicates that sexual minority adults reported being more likely to use such a website than heterosexual adults.
VariableTotalEstimated proportionComparison linearized SEP value

NEstimated proportion (%)Linearized SEDesign effectHeterosexualSexual minority

Installing an app on your phone that asks you questions about your own symptoms and provides recommendations about COVID-19.06

Extremely likely1460.0750.0081.750.8660.1340.044

Very likely2120.1100.0101.950.8980.1020.028

Moderately likely3730.2030.0132.040.9270.0730.018

Not too likely4040.2190.0131.850.9370.0630.014

Not likely at all7570.3770.0151.730.9500.0500.009

Already done this270.0170.0041.890.8930.1070.062
Installing an app on your phone that tracks your location and sends push notifications if you might have been exposed to COVID-19<.001

Extremely likely1710.0860.0081.690.8260.1740.045

Very likely2320.1300.0111.880.8890.1110.029

Moderately likely3650.2020.0131.950.9470.0530.011

Not too likely3420.1800.0132.170.9580.0420.012

Not likely at all7900.3940.0151.710.9430.0570.010

Already done this150.0070.0021.540.9480.0520.052
Using a website to log your symptoms and location and get recommendations about COVID-19.008

Extremely likely1290.0740.0092.400.8420.1580.048

Very likely2160.1120.0091.720.9060.0950.025

Moderately likely4410.2400.0142.000.9170.0830.016

Not too likely4030.2040.0121.720.9530.0470.014

Not likely at all7100.6310.0121.730.9490.0510.010

Already done this150.0090.0031.811.000.0000.000

Psychometric Properties of Measure of Willingness to Use Digital Health Tools for COVID-19–Related Screening and Tracking

The measure of willingness to use digital health tools for COVID-19–related screening and tracking showed internal consistency and reliability (Cronbach α=.89 and coefficient ω=0.93). Additionally, as shown in Table 3, the measure was invariant by sexual orientation. Configural invariance was indicated by all factor loadings being significant and in the expected direction for each group. The configural model had no global fit statistics, as it was a fully saturated model. Next, the author tested a metric invariance model with factor loadings constrained to be equal across groups, and metric invariance was evident (ΔCFI<0.01; Δχ22=2.30; P=.32). Thus, the metric model had an equivalent model fit with the configural invariance model; the nonsaturated metric model fit the data, per the RMSEA, CFI, and SRMR (Table 3). Finally, the author tested a scalar invariance model, and scalar invariance was shown (ΔCFI<0.01; Δχ28=6.44; P=.60).

Table 3. Measurement invariance by sexual orientation for a measure of pandemic-related psychological distress (N=1928). Sexual orientation categories are heterosexual and sexual minority. The measure showed measurement in variance based on the criterion of ΔCFI<.01 [54] between the configural and the metric model and between the metric and the scalar model.

Fit index

Chi-square (df)P valueRMSEAaCFIbSRMRc
Invariance models

Configural0.00 (0)<.0010.001.000.00

Metric2.30 (2).320.011.00<0.01

Scalar8.51 (10).58<0.011.000.01

aRMSEA: root-mean-square standard error of approximation.

bCFI: comparative fit index.

cSRMR: standardized root-mean-square residual.

Mean Difference by Sexual Orientation on Willingness to Use Digital Health Tools for COVID-19–Related Screening and Tracking

Given scalar invariance, factor means for willingness to use COVID-19–related digital screening and tracking tools differed between heterosexual and sexual minority adults. Specifically, willingness to use digital health tools was nearly half an SD greater for sexual minority adults than for heterosexual adults (ΔM=0.46, 95% CI 0.15-0.77).

Associations Between Demographic Characteristics and Willingness to Use Digital Health Tools for COVID-19–Related Screening and Tracking Among Sexual Minority Adults

Within the population of sexual minority adults, no differences were detected by age group, gender, or race or ethnicity in their willingness to use digital health tools for COVID-19–related screening and tracking. Specifically, as detailed in Table 4, for each increase in age by group, there was no change in willingness to use digital health tools. Also, men and women did not differ in their willingness to use digital health tools. Finally, African American individuals, Hispanic or Latino individuals, and people of other races or ethnicities did not differ from White individuals (the reference group) in their willingness to use digital health tools.

Table 4. The independent associations of age, gender, and race and ethnicity with willingness to use digital health tools for public health screening and tracking (latent variable) in separate structural equation models in a national probability sample of sexual minority people (N=161).
VariableStructural equation models

ba95% CIR2bRMSEAcCFIdSRMRe
Age (years)

Age groupf0.04–0.12 to 0.210.010.170.990.04
Gender

Female (reference: male)–0.14–0.66 to 0.380.010.001.000.02
Race or ethnicity

Race or ethnicity (reference: White or European American)0.010.001.000.03


Black or African American0.03–0.69 to 0.75





Hispanic or Latino0.09–0.45 to 0.64





Other race or ethnicity–0.20–1.02 to 0.62



ab=unstandardized regression coefficient.

bR2=coefficient of determination.

cRMSEA: root-mean-square standard error of approximation.

dCFI: comparative fit index.

eSRMR: standardized root-mean-square residual.

fAge group is an ordinal variable with levels as follows: (1) 18-24 years, (2) 25-34 years, (3) 35-44 years, (4) 45-54 years, (5) 55-64 years, (6) 65-74 years, and (7) ≥75 years.

Additional models were tested for interactions of sexual minority status as a moderator with the other demographic characteristics as respective predictors in their associations with willingness to use digital health tools for screening and tracking. None of the interaction terms reached statistical significance in the models (Table 5). However, with the inclusion of the interaction terms, the main effects of being African American, Hispanic or Latino, and another racial or ethnic identity reached statistical significance. Specifically, among heterosexual adults, being Black or African American was associated with 41% of an SD greater willingness to use digital health screening and tracking tools (b=0.41, CI 0.19-0.62), being Hispanic or Latino was associated with 36% of an SD greater willingness to use these tools (b=0.36, CI 0.18-0.55), and being of another racial or ethnic minority group was associated with 54% of an SD greater willingness to use these tools (b=0.54, CI 0.31-0.77).

Table 5. The independent associations of age, gender, and race or ethnicity and their respective interactions by sexual minority status with willingness to use digital health tools for public health screening and tracking (latent variable) in separate structural equation models in a national probability sample of sexual minority people (N=1928).
VariableStructural equation models


ba95% CIR2bRMSEAcCFIdSRMRe
Age (years)0.020.031.000.01

Age groupf–0.02–0.06 to 0.02




Sexual minority (reference: heterosexual)0.28–0.32 to 0.88




Age group × sexual minority0.06–0.10 to 0.22



Gender0.020.001.000.01

Female (reference: male)0.05–0.08 to 0.19




Sexual minority0.580.25 to 0.91




Female × sexual minority–0.19–0.68 to 0.31



Race or ethnicity

Race or ethnicity (reference: White or European American)0.050.011.000.01


Black or African American0.410.19 to 0.62





Hispanic or Latino0.360.18 to 0.55





Other race or ethnicity0.540.31 to 0.77



Sexual minority0.610.28 to 0.94



Race or ethnicity × sexual minority

Black/African American × sexual minority–0.35–1.05 to 0.35




Hispanic or Latino × sexual minority–0.21–0.77 to 0.35




Other race or ethnicity × sexual minority–0.75–1.57 to 0.07



ab=unstandardized regression coefficient.

bR2=coefficient of determination.

cRMSEA: root-mean-square standard error of approximation.

dCFI: comparative fit index.

eSRMR: standardized root-mean-square residual.

fAge group is an ordinal variable with levels as follows: (1) 18-24 years, (2) 25-34 years, (3) 35-44 years, (4) 45-54 years, (5) 55-64 years, (6) 65-74 years, and (7) ≥75 years.

The models were re-run with the outcome variable recoded to identify referent, excess intersectional, and joint disparities. Given the direction of the significant associations for each racial or ethnic minority group (Black or African American: b=–0.41, CI –0.62 to –0.19; Hispanic or Latino: b=–0.36, CI –0.55 to –0.18; and other racial or ethnic minority group: b=–0.54, CI –0.77 to –0.31), referent racial or ethnic or sexual orientation-based disparities were not detected. Also, no excess intersectional disparity was detected (Black or African American × sexual minority: b=–0.35, CI –0.35 to 1.05; Hispanic or Latino × sexual minority: b=0.21, CI –0.35 to 0.77; and other racial or ethnic minority group × sexual minority: b=–0.75, CI –0.07 to 1.57). Overall, no joint disparity was identified.


Overview

Studies rarely examine the willingness of sexual minority populations to use mHealth and related digital health tools in the context of pandemic-related or non-HIV prevention. However, such mHealth tools have been acceptable and effective when used to fight the HIV epidemic for sexual minority men, specifically [18-21]. This study examined the use of digital health tools for screening and tracking for the COVID-19 pandemic, focusing on a broader, more diverse range of the sexual minority population in the United States. In particular, the study used the conceptual [32,33] and methodological [34,35,39] frameworks of intersectionality theory to determine the presence of disparities between heterosexual and sexual minority adults across various intersections of identity (ie, age, gender, and race or ethnicity) in their willingness to use digital health tools for screening and tracking.

Findings indicated that sexual minority adults were significantly more willing to use digital health tools for screening and tracking than heterosexual adults in the United States. The greater willingness to use digital health tools among sexual minority adults compared with heterosexual adults might be explained partly by the familiarity of many sexual minority individuals with the use of mHealth and other digital health methods for outreach and other public health efforts, particularly sexual minority men in the context of HIV prevention [18-21].

Despite the difference between heterosexual adults and sexual minority adults in this study, there were no within-group demographic differences among sexual minority adults in their willingness to use digital health tools for screening and tracking. These findings from the United States are consistent with findings from a large survey of registered National Health Service users in the United Kingdom, in which there were no differences by age or gender in terms of willingness to participate in contact tracing through a mobile phone app in the adult population as a whole [63]. Interestingly, although sexual minority men are often more likely to be the focus of mHealth interventions for HIV [20,21], they were no more likely than sexual minority women to express a willingness to use digital health tools for screening and tracking in this study.

Based on the established definitions of a disparity [61,62] and the analytic framework of intersectionality theory [32,33,59], this study detected no referent disparity based on sexual orientation and no joint or excess joint disparity at the intersection of sexual orientation identity and other demographic characteristics. A previous study that used the same publicly available data without testing for sexual minority status as a predictor or moderator found no significant associations that would indicate an age-related, gender, or racial or ethnic disparity [28]. In contrast to other studies, which showed mixed findings for race or ethnicity and other demographics as a predictor without considering sexual minority status [26,27,29-31], the significant main effects of race or ethnicity in this study occurred among heterosexual adults in the presence of interactions of race or ethnicity with sexual minority status.

The differences between racial or ethnic minority adults and White adults may be explained, in part, by political ideology affecting attitudes toward the public health establishment during COVID-19. For example, a study found that moderate- and conservative-leaning respondents showed less support for using COVID-19–related digital health tools than liberal-leaning respondents in the same model in which racial and ethnic minorities showed greater support for using COVID-19–related digital health tools than White Americans or non-Hispanic Americans [31]. Additionally, studies indicate that some White Americans may be increasingly voting conservative [64-66]. To the extent that these political ideologies are also tied to public health mistrust, there may be noteworthy consequences. For example, there is evidence of excess deaths for conservative-voting adults compared with less conservative-voting adults in Florida and Ohio during the COVID-19 pandemic [67]. The CIS did not include questions regarding political beliefs. As such, this study did not test whether demographic factors interacted with political ideology, which would have helped to determine whether political ideology mattered within each racial or ethnic category. Additional studies are needed to examine the decision-making process of White heterosexual adults regarding their use of digital health tools for screening and tracking during public health emergencies.

The present psychometric evaluation indicated that the COVID-19–related psychological distress measure was assessing the same construct in heterosexual participants and sexual minority participants. A previous study has already validated the psychometric properties of the present items (eg, construct validity and internal consistency) and demonstrated measurement invariance across age groups, genders, and races and ethnicities [28]. Other studies on willingness to use digital health tools have typically used a single item [63] or several items treated as separate measures [68,69] rather than a single, validated scale. In terms of scales that use any variation on willingness (eg, intentions and perceived usefulness), 1 study used a 15-item measure [70] and another study used 2 measures of 32 items each [71]; these are notably longer than the 3-item measure of this study. Some studies have used items with binary yes-or-no responses [63,68,69], which may not capture sufficient gradation in response if the goal is to understand the degree of willingness.

Strengths and Limitations

This study has multiple strengths. For example, the study used a national probability sample to represent the population of noninstitutionalized adults in the United States. Additionally, the study used innovative methods to conceptualize and quantitatively identify disparities within the framework of intersectionality theory. In addition, the study established measurement invariance between heterosexual and sexual orientation–diverse adults for a measure of willingness to use a digital health screening and tracking tool that was previously validated by age, gender, and race or ethnicity. The measure can be adapted for screening and tracking in response to future public health events.

Additionally, several limitations must be noted. Specifically, the cross-sectional study design precludes definitive causal conclusions. In addition, the author did not attempt to draw conclusions about the temporal associations among the variables. Moreover, the sample was imbalanced with respect to the proportion of sexual minority adults compared with heterosexual adults in the sample; the number of sexual minority adults was much smaller. Limitations also include a lack of questions measuring sexual and gender identity that follow best practice [72], including the lack of transgender-inclusive gender questions and the lack of sexual orientation measures that distinguish different sexual orientation groups beyond sexual minority status by gender (ie, sexual minority men, including gay and bisexual men, and women, including lesbians and bisexual women, which were accounted for in this study). As a result, the analyses were not more nuanced regarding gender and sexual orientation identity.

Implications

This study has several research and applied implications. For instance, additional research can oversample sexual minority adults to provide balanced samples for comparisons between heterosexual and sexual minority adults. Additionally, studies can examine sexual minority individuals’ willingness to use digital health tools for other non-COVID-19–related health issues beyond HIV, including specific mental health diagnoses (eg, depression and substance use) and chronic illnesses (eg, diabetes and hypertension). These studies should consider intersections of identities among sexual minority people, such as underrepresented racial and ethnic minority people among sexual minority populations. Recently, monkey pox has emerged among sexual minority men, in particular [73], and digital health approaches may be useful in such circumstances. Additionally, studies are needed to further examine the decision-making process of White heterosexual adults regarding their use of digital health tools in response to public health emergencies.

Regarding applied implications, public health professionals and clinicians should consider screening sexual minority adults for their willingness to use digital health tools as they continue to use telehealth during COVID-19 and post–COVID-19 times. Such screening is particularly needed for sexual minority adults who contend with intersecting systems of oppression and identities and, thus, have elevated levels of medical mistrust (eg, underrepresented ethnic and sexual minority people) [15,17,74]. Policy changes and other structural interventions are needed to provide access to digital health technologies in cases in which willingness to use these technologies does not appear to be the issue. In this study, racial and ethnic minority heterosexual adults seemed particularly willing to use these technologies.

Conclusions

This study is responsive to recent calls in the literature to address the pronounced dearth of intersectionality theory-informed research investigating disparities related to digital health [38-40]. As we strive to narrow the digital divide, or the disparities in technology and internet access and use [75-77], we must understand disparities in willingness to use digital technologies for health-related purposes even when these tools are available. This study detected no disparities based on sexual minority status or intersections of identity among sexual minority adults along age, gender, or race or ethnicity. As such, for sexual minority populations, including intersections that are at joint or compound risk of experiencing adverse health outcomes, the issue is not willingness to use digital health tools compared to heterosexual adults. Sexual minority populations require culturally responsive digital health approaches to address their needs, as opposed to motivational enhancement or other interventions to increase their willingness during public health events. The willingness of sexual minority adults across intersecting identities to use pandemic-related digital health tools, including mobile health apps, is noteworthy given the potential promise of digital health tools for other public health-related concerns, such as the recently ended mpox outbreak [78,79], which disproportionately affected sexual minority men [80-82], and obesity [83,84] and cardiovascular disease [85,86], which disproportionately affects sexual minority women [87,88]. Additionally, White heterosexual adults demonstrated a disproportionately low willingness to use digital health tools, and this may become an issue in the event that this population is adversely affected by a public health concern that can benefit from digital health technologies.

Acknowledgments

The author would like to thank the NORC (formerly the National Opinion Research Center) at the University of Chicago. The data analyzed are freely available to the public through NORC at the University of Chicago. WV was supported by a National Institute of Mental Health grant (K23-MH111402).

Data Availability

The data sets analyzed during this study are available in the NORC at the University of Chicago repository [51].

Conflicts of Interest

None declared.

  1. Daly M, Robinson E. Willingness to vaccinate against COVID-19 in the U.S.: representative longitudinal evidence from april to october 2020. Am J Prev Med. 2021;60(6):766-773. [FREE Full text] [CrossRef] [Medline]
  2. Iboi E, Richardson A, Ruffin R, Ingram D, Clark J, Hawkins J, et al. Impact of public health education program on the novel coronavirus outbreak in the United States. Front Public Health. 2021;9:630974. [FREE Full text] [CrossRef] [Medline]
  3. Truman BI, Chang MH, Moonesinghe R. Provisional COVID-19 age-adjusted death rates, by race and ethnicity—United States, 2020-2021. MMWR Morb Mortal Wkly Rep. 2022;71(17):601-605. [FREE Full text] [CrossRef] [Medline]
  4. Itzhak N, Shahar T, Moskovich R, Shahar Y. The impact of US county-level factors on COVID-19 morbidity and mortality. J Urban Health. 2022;99(3):562-570. [FREE Full text] [CrossRef] [Medline]
  5. McGowan VJ, Bambra C. COVID-19 mortality and deprivation: pandemic, syndemic, and endemic health inequalities. Lancet Public Health. 2022;7(11):e966-e975. [FREE Full text] [CrossRef] [Medline]
  6. Berg MB, Lin L. Prevalence and predictors of early COVID-19 behavioral intentions in the United States. Transl Behav Med. 2020;10(4):843-849. [FREE Full text] [CrossRef] [Medline]
  7. Bowman L, Kwok KO, Redd R, Yi Y, Ward H, Wei WI, et al. Comparing public perceptions and preventive behaviors during the early phase of the COVID-19 pandemic in Hong Kong and the United Kingdom: cross-sectional survey study. J Med Internet Res. 2021;23(3):e23231. [FREE Full text] [CrossRef] [Medline]
  8. Gerace A, Rigney G, Anderson JR. Predicting attitudes towards easing COVID-19 restrictions in the United States of America: the role of health concerns, demographic, political, and individual difference factors. PLoS One. 2022;17(2):e0263128. [FREE Full text] [CrossRef] [Medline]
  9. Huang Q, Abad N, Bonner KE, Baack B, Petrin R, Hendrich MA, et al. Explaining demographic differences in COVID-19 vaccination stage in the United States—April-May 2021. Prev Med. 2023;166:107341. [FREE Full text] [CrossRef] [Medline]
  10. Islam JY, Vidot DC, Havanur A, Camacho-Rivera M. Preventive behaviors and mental health-related symptoms among immunocompromised adults during the COVID-19 pandemic: an analysis of the COVID impact survey. AIDS Res Hum Retroviruses. 2021;37(4):304-313. [FREE Full text] [CrossRef] [Medline]
  11. Latkin CA, Dayton L, Yi G, Konstantopoulos A, Boodram B. Trust in a COVID-19 vaccine in the U.S.: a social-ecological perspective. Soc Sci Med. 2021;270:113684. [FREE Full text] [CrossRef] [Medline]
  12. Flentje A, Obedin-Maliver J, Lubensky ME, Dastur Z, Neilands T, Lunn MR. Depression and anxiety changes among sexual and gender minority people coinciding with onset of COVID-19 pandemic. J Gen Intern Med. 2020;35(9):2788-2790. [FREE Full text] [CrossRef] [Medline]
  13. The lives and livelihoods of many in the LGBTS+ community are at risk amidst the COVID-19 crisis. Human Rights Campaign Foundation. Washington, DC.; 2020. URL: https://tinyurl.com/54xjy5b8 [accessed 2023-09-22]
  14. Salerno JP, Pease M, Devadas J, Nketia B, Fish JN. COVID-19-related stress among LGBTQ+ University students: results of a U.S. National Survey. University of Maryland Digital Repository at the University of Maryland. College Park, MD.; 2020. URL: https://doi.org/10.13016/zug9-xtmi [accessed 2023-09-22]
  15. Charura D, Hill AP, Etherson ME. COVID-19 vaccine hesitancy, medical mistrust, and mattering in ethnically diverse communities. J Racial Ethn Health Disparities. 2023;10(3):1518-1525. [FREE Full text] [CrossRef] [Medline]
  16. Smith AC, Woerner J, Perera R, Haeny AM, Cox JM. An investigation of associations between race, ethnicity, and past experiences of discrimination with medical mistrust and COVID-19 protective strategies. J Racial Ethn Health Disparities. 2022;9(4):1430-1442. [FREE Full text] [CrossRef] [Medline]
  17. Thompson HS, Manning M, Mitchell J, Kim S, Harper FWK, Cresswell S, et al. Factors associated with racial/ethnic group-based medical mistrust and perspectives on COVID-19 vaccine trial participation and vaccine uptake in the US. JAMA Netw Open. 2021;4(5):e2111629. [FREE Full text] [CrossRef] [Medline]
  18. Hall EW, Luisi N, Zlotorzynska M, Wilde G, Sullivan P, Sanchez T, et al. Willingness to use home collection methods to provide specimens for SARS-CoV-2/COVID-19 research: survey study. J Med Internet Res. 2020;22(9):e19471. [FREE Full text] [CrossRef] [Medline]
  19. Valentine-Graves M, Hall E, Guest JL, Adam E, Valencia R, Shinn K, et al. At-home self-collection of saliva, oropharyngeal swabs and dried blood spots for SARS-CoV-2 diagnosis and serology: post-collection acceptability of specimen collection process and patient confidence in specimens. PLoS One. 2020;15(8):e0236775. [FREE Full text] [CrossRef] [Medline]
  20. MacCarthy S, Mendoza-Graf A, Wagner Z, Barreras JL, Kim A, Giguere R, et al. The acceptability and feasibility of a pilot study examining the impact of a mobile technology-based intervention informed by behavioral economics to improve HIV knowledge and testing frequency among Latinx sexual minority men and transgender women. BMC Public Health. 2021;21(1):341. [FREE Full text] [CrossRef] [Medline]
  21. Ybarra ML, Prescott TL, Philips GL, Bull SS, Parsons JT, Mustanski B. Iteratively developing an mHealth HIV prevention program for sexual minority adolescent men. AIDS Behav. 2016;20(6):1157-1172. [FREE Full text] [CrossRef] [Medline]
  22. Whaibeh E, Vogt EL, Mahmoud H. Addressing the behavioral health needs of sexual and gender minorities during the COVID-19 pandemic: a review of the expanding role of digital health technologies. Curr Psychiatry Rep. 2022;24(9):387-397. [CrossRef] [Medline]
  23. Drydakis N. M-health apps and physical and mental health outcomes of sexual minorities. J Homosex. 2023;70(14):3421-3448. [CrossRef] [Medline]
  24. Asadzadeh A, Kalankesh LR. A scope of mobile health solutions in COVID-19 pandemics. Inform Med Unlocked. 2021;23:100558. [FREE Full text] [CrossRef] [Medline]
  25. Siegler AJ, Hall E, Luisi N, Zlotorzynska M, Wilde G, Sanchez T, et al. Willingness to seek diagnostic testing for SARS-CoV-2 with home, drive-through, and clinic-based specimen collection locations. Open Forum Infect Dis. 2020;7(7):ofaa269. [FREE Full text] [CrossRef] [Medline]
  26. Maytin L, Maytin J, Agarwal P, Krenitsky A, Krenitsky J, Epstein RS. Attitudes and perceptions toward COVID-19 digital surveillance: survey of young adults in the United States. JMIR Form Res. 2021;5(1):e23000. [FREE Full text] [CrossRef] [Medline]
  27. Sorkin DH, Janio EA, Eikey EV, Schneider M, Davis K, Schueller SM, et al. Rise in use of digital mental health tools and technologies in the United States during the COVID-19 pandemic: survey study. J Med Internet Res. 2021;23(4):e26994. [FREE Full text] [CrossRef] [Medline]
  28. Vincent W. Developing and evaluating a measure of the willingness to use pandemic-related mHealth tools using national probability samples in the United States: quantitative psychometric analyses and tests of sociodemographic group differences. JMIR Form Res. 2023;7:e38298. [FREE Full text] [CrossRef] [Medline]
  29. Camacho-Rivera M, Islam JY, Rivera A, Vidot DC. Attitudes toward using COVID-19 mHealth tools among adults with chronic health conditions: secondary data analysis of the COVID-19 impact survey. JMIR Mhealth Uhealth. 2020;8(12):e24693. [FREE Full text] [CrossRef] [Medline]
  30. Jansen-Kosterink S, Hurmuz M, den Ouden M, van Velsen L. Predictors to use mobile apps for monitoring COVID-19 symptoms and contact tracing: survey among Dutch citizens. JMIR Form Res. 2021;5(12):e28416. [FREE Full text] [CrossRef] [Medline]
  31. Grande D, Mitra N, Marti XL, Merchant R, Asch D, Dolan A, et al. Consumer views on using digital data for COVID-19 control in the United States. JAMA Netw Open. 2021;4(5):e2110918. [FREE Full text] [CrossRef] [Medline]
  32. Crenshaw KW. Demarginalizing the intersection of race and sex: a Black feminist critique of antidiscrimination doctrine, feminist theory, and antiracist politics. In: Bartlett KT, Kennedy R, editors. Feminist Legal Theory: Reading in Law and Gender. New York. Routledge; 1991;57-80.
  33. Collins PH. Black Sexual Politics: African Americans, Gender, and the New Racism. New York. Routledge; 2004.
  34. Bowleg L, Malekzadeh AN, AuBuchon KE, Ghabrial MA, Bauer GR. Rare exemplars and missed opportunities: intersectionality within current sexual and gender diversity research and scholarship in psychology. Curr Opin Psychol. 2023;49:101511. [CrossRef] [Medline]
  35. Bauer GR, Churchill SM, Mahendran M, Walwyn C, Lizotte D, Villa-Rueda AA. Intersectionality in quantitative research: a systematic review of its emergence and applications of theory and methods. SSM Popul Health. 2021;14:100798. [FREE Full text] [CrossRef] [Medline]
  36. Bowleg L. When Black + Lesbian + Woman? Black lesbian woman: the methodological challenges of qualitative and quantitative intersectionality research. Sex Roles. 2008;59(5):312-325. [CrossRef]
  37. Bowleg L. "Once you've blended the cake, you can't take the parts back to the main ingredients": Black gay and bisexual men's descriptions and experiences of intersectionality. Sex Roles. 2012;68(11-12):754-767. [CrossRef]
  38. Husain L, Greenhalgh T, Hughes G, Finlay T, Wherton J. Desperately seeking intersectionality in digital health disparity research: narrative review to inform a richer theorization of multiple disadvantage. J Med Internet Res. 2022;24(12):e42358. [FREE Full text] [CrossRef] [Medline]
  39. Queen R, Courtney KL, Lau F, Davison K, Devor A, Antonio MG. What's next for modernizing gender, sex, and sexual orientation terminology in digital health systems? Viewpoint on research and implementation priorities. J Med Internet Res. 2023;25:e46773. [FREE Full text] [CrossRef] [Medline]
  40. Figueroa CA, Luo T, Aguilera A, Lyles CR. The need for feminist intersectionality in digital health. Lancet Digit Health. 2021;3(8):e526-e533. [FREE Full text] [CrossRef] [Medline]
  41. McConnell EA, Janulis P, Phillips G, Truong R, Birkett M. Multiple minority stress and LGBT community resilience among sexual minority men. Psychol Sex Orientat Gend Divers. 2018;5(1):1-12. [FREE Full text] [CrossRef] [Medline]
  42. Raymond HF, McFarland W. Racial mixing and HIV risk among men who have sex with men. AIDS Behav. 2009;13(4):630-637. [FREE Full text] [CrossRef] [Medline]
  43. Calabrese SK, Earnshaw VA, Magnus M, Hansen NB, Krakower DS, Underhill K, et al. Sexual stereotypes ascribed to Black men who have sex with men: an intersectional analysis. Arch Sex Behav. 2018;47(1):143-156. [FREE Full text] [CrossRef] [Medline]
  44. Petsko CD, Bodenhausen GV. Racial stereotyping of gay men: can a minority sexual orientation erase race? J Exp Soc Psychol. 2019;83:37-54. [CrossRef]
  45. Millett GA, Peterson JL, Wolitski RJ, Stall R. Greater risk for HIV infection of Black men who have sex with men: a critical literature review. Am J Public Health. 2006;96(6):1007-1019. [FREE Full text] [CrossRef] [Medline]
  46. Millett GA, Peterson JL, Flores SA, Hart TA, Jeffries WL, Wilson PA, et al. Comparisons of disparities and risks of HIV infection in black and other men who have sex with men in Canada, UK, and USA: a meta-analysis. Lancet. 2012;380(9839):341-348. [CrossRef] [Medline]
  47. Fields EL, Long A, Dangerfield DT, Morgan A, Uzzi M, Arrington-Sanders R, et al. There's an app for that: using geosocial networking apps to access young Black gay, bisexual, and other MSM at risk for HIV. Am J Health Promot. 2020;34(1):42-51. [FREE Full text] [CrossRef] [Medline]
  48. Dangerfield Ii DT, Anderson JN, Wylie C, Arrington-Sanders R, Bluthenthal RN, Beyrer C, et al. Refining a multicomponent intervention to increase perceived HIV risk and PrEP initiation: focus group study among Black sexual minority men. JMIR Form Res. 2022;6(8):e34181. [FREE Full text] [CrossRef] [Medline]
  49. von Elm E, Altman DG, Egger M, Pocock SJ, Gøtzsche PC, Vandenbroucke JP, et al. STROBE Initiative. The Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) statement: guidelines for reporting observational studies. Lancet. 2007;370(9596):1453-1457. [FREE Full text] [CrossRef] [Medline]
  50. Vandenbroucke JP, von Elm E, Altman DG, Gøtzsche PC, Mulrow CD, Pocock SJ, et al. Strengthening the Reporting of Observational Studies in Epidemiology (STROBE): explanation and elaboration. Int J Surg. 2014;12(12):1500-1524. [FREE Full text] [CrossRef] [Medline]
  51. Wozniak A, Willey J, Benz J, Hart N. Version 1 dataset. COVID Impact Survey. Chicago, IL. National Opinion Research Center URL: https://www.covid-impact.org/results [accessed 2024-01-10]
  52. StataCorp. Stata Statistical Software: Release 16. 2019. URL: https://www.stata.com/stata16/ [accessed 2024-01-16]
  53. Muthén LK, Muthén B. Mplus User's Guide: Statistical Analysis with Latent Variables. Los Angeles, CA. Muthén & Muthén; 2017.
  54. Hu L, Bentler PM. Cutoff criteria for fit indexes in covariance structure analysis: conventional criteria versus new alternatives. Struct Equ Modeling: Multidiscip J. 1999;6(1):1-55. [CrossRef]
  55. Bentler PM. On the fit of models to covariances and methodology to the Bulletin. Psychol Bull. 1992;112(3):400-404. [CrossRef] [Medline]
  56. Schmitt N, Kuljanin G. Measurement invariance: review of practice and implications. Hum Resour Manag Rev. 2008;18(4):210-222. [CrossRef]
  57. Putnick DL, Bornstein MH. Measurement invariance conventions and reporting: the state of the art and future directions for psychological research. Dev Rev. 2016;41:71-90. [FREE Full text] [CrossRef] [Medline]
  58. Chen FF. Sensitivity of goodness of fit indexes to lack of measurement invariance. Struct Equ Modeling: Multidiscip J. 2007;14(3):464-504. [CrossRef]
  59. Jackson JW, Williams DR, VanderWeele TJ. Disparities at the intersection of marginalized groups. Soc Psychiatry Psychiatr Epidemiol. 2016;51(10):1349-1359. [FREE Full text] [CrossRef] [Medline]
  60. VanderWeele TJ, Tchetgen Tchetgen EJ. Attributing effects to interactions. Epidemiology. 2014;25(5):711-722. [FREE Full text] [CrossRef] [Medline]
  61. Braveman P. Health disparities and health equity: concepts and measurement. Annu Rev Public Health. 2006;27:167-194. [CrossRef] [Medline]
  62. National Institute of Minority Health and Health Disparities. Minority Health and Health Disparities Definitions. United States Department of Health and Human Services. 2023. URL: https://tinyurl.com/2wa4w6np [accessed 2024-01-10]
  63. Bachtiger P, Adamson A, Quint JK, Peters NS. Belief of having had unconfirmed Covid-19 infection reduces willingness to participate in app-based contact tracing. NPJ Digit Med. 2020;3(1):146. [FREE Full text] [CrossRef] [Medline]
  64. Buyuker B, D'Urso AJ, Filindra A, Kaplan NJ. Race politics research and the American presidency: thinking about white attitudes, identities and vote choice in the Trump era and beyond. J Race Ethn Polit. 2020;6(3):600-641. [CrossRef]
  65. Knuckey J, Kim M. The politics of white racial identity and vote choice in the 2018 midterm elections. Soc Sci Q. 2020;101(4):1584-1599. [CrossRef]
  66. Reny TT, Collingwood L, Valenzuela AA. Vote switching in the 2016 election: how racial and immigration attitudes, not economics, explain shifts in white voting. Public Opin Q. 2016;83(1):91-113. [CrossRef]
  67. Wallace J, Goldsmith-Pinkham P, Schwartz JL. Excess death rates for republican and democratic registered voters in Florida and Ohio during the COVID-19 pandemic. JAMA Intern Med. 2023;183(9):916-923. [FREE Full text] [CrossRef] [Medline]
  68. Chen S, Sun G, Cen X, Liu J, Ye J, Chen J, et al. Characteristics and requirements of hypertensive patients willing to use digital health tools in the Chinese community: a multicentre cross-sectional survey. BMC Public Health. 2020;20(1):1333. [FREE Full text] [CrossRef] [Medline]
  69. Montagni I, Cariou T, Feuillet T, Langlois E, Tzourio C. Exploring digital health use and opinions of university students: field survey study. JMIR Mhealth Uhealth. 2018;6(3):e65. [FREE Full text] [CrossRef] [Medline]
  70. Palos-Sanchez PR, Saura JR, Martin MAR, Aguayo-Camacho M. Toward a better understanding of the intention to use mHealth apps: exploratory study. JMIR Mhealth Uhealth. 2021;9(9):e27021. [FREE Full text] [CrossRef] [Medline]
  71. Bennett BL, Goldstein CM, Gathright EC, Hughes JW, Latner JD. Internal health locus of control predicts willingness to track health behaviors online and with smartphone applications. Psychol Health Med. 2017;22(10):1224-1229. [FREE Full text] [CrossRef] [Medline]
  72. Committee on Lesbian, Gay, Bisexual, and Transgender Health Issues and Research Gaps and Opportunities; Institute of Medicine (US). The Health of Lesbian, Gay, Bisexual, and Transgender People: Building a Foundation for Better Understanding. Washington, DC. The National Academies Press; 2011.
  73. Delaney KP, Sanchez T, Hannah M, Edwards OW, Carpino T, Agnew-Brune C, et al. Strategies adopted by gay, bisexual, and other men who have sex with men to prevent monkeypox virus transmission-United States, august 2022. MMWR Morb Mortal Wkly Rep. 2022;71(35):1126-1130. [FREE Full text] [CrossRef] [Medline]
  74. Eaton LA, Driffin DD, Kegler C, Smith H, Conway-Washington C, White D, et al. The role of stigma and medical mistrust in the routine health care engagement of Black men who have sex with men. Am J Public Health. 2015;105(2):e75-e82. [FREE Full text] [CrossRef] [Medline]
  75. Litchfield I, Shukla D, Greenfield S. Impact of COVID-19 on the digital divide: a rapid review. BMJ Open. 2021;11(10):e053440. [FREE Full text] [CrossRef] [Medline]
  76. Lythreatis S, Singh SK, El-Kassar AN. The digital divide: a review and future research agenda. Technol Forecast Soc Change. 2022;175:121359. [CrossRef]
  77. Saeed SA, Masters RM. Disparities in health care and the digital divide. Curr Psychiatry Rep. 2021;23(9):61. [FREE Full text] [CrossRef] [Medline]
  78. Chan J, DiTullio DJ, Pagan Pirallo P, Foote M, Knutsen D, Kottkamp AC, et al. Implementation and early outcomes of a telehealth visit model to deliver tecovirimat for mpox infection in New York City. J Telemed Telecare. 2023.:1357633X231194796. [CrossRef] [Medline]
  79. Shepherd T, Robinson M, Mallen C. Online health information seeking for mpox in endemic and nonendemic countries: Google trends study. JMIR Form Res. 2023;7:e42710. [FREE Full text] [CrossRef] [Medline]
  80. Liu Q, Fu L, Wang B, Sun Y, Wu X, Peng X, et al. Clinical characteristics of human mpox (Monkeypox) in 2022: a systematic review and meta-analysis. Pathogens. 2023;12(1):146. [FREE Full text] [CrossRef] [Medline]
  81. McCollum AM, Shelus V, Hill A, Traore T, Onoja B, Nakazawa Y, et al. Epidemiology of human mpox—worldwide, 2018-2021. MMWR Morb Mortal Wkly Rep. 2023;72(3):68-72. [FREE Full text] [CrossRef] [Medline]
  82. Mitjà O, Alemany A, Marks M, Lezama Mora JI, Rodríguez-Aldama JC, Torres Silva MS, et al. Mpox in people with advanced HIV infection: a global case series. Lancet. 2023;401(10380):939-949. [FREE Full text] [CrossRef] [Medline]
  83. Hinchliffe N, Capehorn MS, Bewick M, Feenie J. The potential role of digital health in obesity care. Adv Ther. 2022;39(10):4397-4412. [FREE Full text] [CrossRef] [Medline]
  84. Patel ML, Wakayama LN, Bennett GG. Self-monitoring via digital health in weight loss interventions: a systematic review among adults with overweight or obesity. Obesity (Silver Spring). 2021;29(3):478-499. [CrossRef] [Medline]
  85. Redfern J, Coorey G, Mulley J, Scaria A, Neubeck L, Hafiz N, et al. A digital health intervention for cardiovascular disease management in primary care (CONNECT) randomized controlled trial. NPJ Digit Med. 2020;3:117. [FREE Full text] [CrossRef] [Medline]
  86. Jiang X, Ming WK, You JH. The cost-effectiveness of digital health interventions on the management of cardiovascular diseases: systematic review. J Med Internet Res. 2019;21(6):e13166. [FREE Full text] [CrossRef] [Medline]
  87. Simoni JM, Smith L, Oost KM, Lehavot K, Fredriksen-Goldsen K. Disparities in physical health conditions among lesbian and bisexual women: a systematic review of population-based studies. J Homosex. 2017;64(1):32-44. [FREE Full text] [CrossRef] [Medline]
  88. Potter EC, Patterson CJ. Health-related quality of life among lesbian, gay, and bisexual adults: the burden of health disparities in 2016 behavioral risk factor surveillance system data. LGBT Health. 2019;6(7):357-369. [CrossRef] [Medline]


CFI: comparative fit index
CIS: COVID Impact Survey
mHealth: mobile health
NORC: National Opinion Research Center
RMSEA: root-mean-square standard error of approximation
SRMR: standardized root-mean-square residual
STROBE: Strengthening the Reporting of Observational Studies in Epidemiology


Edited by A Mavragani; submitted 20.03.23; peer-reviewed by A Asadzadeh, J Jabson Tree; comments to author 19.07.23; revised version received 29.11.23; accepted 20.12.23; published 08.03.24.

Copyright

©Wilson Vincent. Originally published in the Journal of Medical Internet Research (https://www.jmir.org), 08.03.2024.

This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on https://www.jmir.org/, as well as this copyright and license information must be included.