Original Paper
- Jonathan J Shih1*, BS ;
- Magdalene Kuznia2*, MS-HCI, RN ;
- Sarah Nouri3, MPH, MD ;
- Elizabeth B Sherwin4, MPH ;
- Kathryn E Kemper4,5, MPH ;
- Anna D Rubinsky6, PhD ;
- Courtney R Lyles7,8, PhD ;
- Elaine C Khoong5,9, MS, MD
1School of Medicine, University of California, San Francisco, San Francisco, CA, United States
2School of Nursing, University of California, San Francisco, San Francisco, CA, United States
3Division of Palliative Medicine, Department of Medicine, University of California, San Francisco, San Francisco, CA, United States
4Department of Epidemiology and Biostatistics, University of California, San Francisco, San Francisco, CA, United States
5UCSF Action Research Center for Health Equity, University of California, San Francisco, San Francisco, CA, United States
6Academic Research Services, Information Technology, University of California, San Francisco, San Francisco, CA, United States
7Center for Healthcare Policy and Research, University of California, Davis, Davis, CA, United States
8Department of Public Heath Science, University of California, Davis, Davis, CA, United States
9Department of Medicine, Division of General Internal Medicine at Zuckerberg San Francisco General Hospital, University of California, San Francisco, San Francisco, CA, United States
*these authors contributed equally
Corresponding Author:
Elaine C Khoong, MS, MD
Department of Medicine
Division of General Internal Medicine at Zuckerberg San Francisco General Hospital
University of California, San Francisco
2540 23rd Street, Room 4708
San Francisco, CA, 94110
United States
Phone: 1 415 502 6300
Fax:1 415 443 4584
Email: Elaine.Khoong@ucsf.edu
Abstract
Background: The COVID-19 public health emergency catalyzed widespread adoption of both video- and audio-only telemedicine visits. This proliferation highlighted inequities in use by age, race and ethnicity, and preferred language. Few studies have investigated how differences in health system telemedicine implementation affected these inequities.
Objective: This study aims to describe patients who used telemedicine during the public health emergency and identify predictors of telemedicine use across 2 health systems with different telemedicine implementations.
Methods: This retrospective cohort study included adults with diabetes receiving primary care between July 2020 and March 2021 at 2 independent health systems in San Francisco, California. Participant sociodemographic characteristics, health information, and telemedicine utilization were acquired from electronic health records. The primary outcome was visit type (any audio or video telemedicine vs in-person only) during the study period. We used multivariable logistic regression to assess the association between visit type and key predictors associated with digital exclusion (age, race and ethnicity, preferred language, and neighborhood socioeconomic status), adjusting for baseline health. We included an interaction term to evaluate health system impact on each predictor and then stratified by health system (academic, which prioritized video-enabled visits, vs safety net, which prioritized audio-only visits).
Results: Among 10,201 patients, we found higher odds of telemedicine use in the safety net system compared with the academic system (adjusted odds ratio [aOR] 2.94, 95% CI 2.48-3.48). Patients with younger age (18-34 years: aOR 2.55, 95% CI 1.63-3.97; 35-49 years: aOR 1.39, 95% CI 1.12-1.73 vs 75+ years) and Chinese-language preference (aOR 2.04, 95% CI 1.66-2.5 vs English) had higher odds of having a telemedicine visit. Non-Hispanic Asian (aOR 0.67, 95% CI 0.56-0.79), non-Hispanic Black (aOR 0.83, 95% CI 0.68-1), and Hispanic or Latine (aOR 0.76, 95% CI 0.61-0.95) patients had lower odds of having a telemedicine visit than non-Hispanic White patients. We found significant interactions between health system and age, race and ethnicity, and preferred language (P<.05). After stratifying by health system, several differences persisted in the academic system: non-Hispanic Asian (aOR 0.57, 95% CI 0.46-0.70) and Latine (aOR 0.67, 95% CI 0.50-0.91) patients had lower odds of a telemedicine visit, and younger age groups had higher odds (18-34 years: aOR 3.97, 95% CI 1.99-7.93; 35-49 years: aOR 1.86, 95% CI 1.36-2.56). In the safety net system, Chinese-speaking patients had higher odds of having a telemedicine visit (aOR 2.52, 95% CI 1.85-3.42).
Conclusions: We found disparities in telemedicine utilization by age, race and ethnicity, and preferred language, primarily in the health system that used more video visits. While telemedicine expanded rapidly recently, certain populations remain at risk for digital exclusion. These findings suggest that system-level factors influence telemedicine adoption and implementation decisions impact accessibility for populations at risk for digital exclusion.
doi:10.2196/64635
Keywords
Introduction
Prior to the COVID-19 public health emergency (PHE), the adoption of telemedicine (defined here as real-time virtual visits between patients and clinicians) in the United States was limited due to both policy and implementation challenges [Lin CC, Dievler A, Robbins C, Sripipatana A, Quinn M, Nair S. Telehealth in health centers: key adoption factors, barriers, and opportunities. Health Aff (Millwood). 2018;37(12):1967-1974. [CrossRef] [Medline]1,Adler-Milstein J, Kvedar J, Bates DW. Telehealth among US hospitals: several factors, including state reimbursement and licensure policies, influence adoption. Health Aff (Millwood). 2014;33(2):207-215. [CrossRef] [Medline]2]. The PHE served as a catalyst for widespread adoption: telemedicine policies expanded coverage to include reimbursement parity for both video- and audio-only visits, with notably high adoption of audio-only visits in safety net settings [Uscher-Pines L, McCullough CM, Sousa JL, Lee SD, Ober AJ, Camacho D, et al. Changes in in-person, audio-only, and video visits in California's federally qualified health centers, 2019-2022. JAMA. 2023;329(14):1219-1221. [FREE Full text] [CrossRef] [Medline]3-Medicare and Medicaid programs, basic health program, and exchanges; additional policy and regulatory revisions in response to the COVID-19 public health emergency and delay of certain reporting requirements for the skilled nursing facility quality reporting program. Federal Register. 2020. URL: https://tinyurl.com/3c8j4nre [accessed 2023-10-16] 5]. The proliferation of telemedicine, however, also introduced important concerns about equity [Nouri S, Khoong E, Lyles C, Karliner L. Addressing equity in telemedicine for chronic disease management during the COVID-19 pandemic. NEJM Catalyst. May 4, 2020. [FREE Full text]6]. Persistent inequities in utilization and access have been documented, with studies indicating that older adults, racial and ethnic minority groups, individuals with limited English proficiency, and those with lower income are less likely to adopt telemedicine, particularly video-enabled services [Eberly LA, Kallan MJ, Julien HM, Haynes N, Khatana SAM, Nathan AS, et al. Patient characteristics associated with telemedicine access for primary and specialty ambulatory care during the COVID-19 pandemic. JAMA Netw Open. 2020;3(12):e2031640. [FREE Full text] [CrossRef] [Medline]7-Chang E, Penfold RB, Berkman ND. Patient characteristics and telemedicine use in the US, 2022. JAMA Netw Open. 2024;7(3):e243354. [FREE Full text] [CrossRef] [Medline]12]. These patterns of underutilization highlight the broader issues of digital exclusion, driven by challenges such as limited digital literacy and lack of access to technology and web-based service [Nouri S, Khoong E, Lyles C, Karliner L. Addressing equity in telemedicine for chronic disease management during the COVID-19 pandemic. NEJM Catalyst. May 4, 2020. [FREE Full text]6,Chang E, Penfold RB, Berkman ND. Patient characteristics and telemedicine use in the US, 2022. JAMA Netw Open. 2024;7(3):e243354. [FREE Full text] [CrossRef] [Medline]12].
However, an understudied aspect in these studies is how health system factors and their implementation of telemedicine impact these disparities. Audio visits, provided more frequently by community health centers and safety net systems, are predominantly used by low-income, older, or racially and ethnically minoritized patients [Uscher-Pines L, McCullough CM, Sousa JL, Lee SD, Ober AJ, Camacho D, et al. Changes in in-person, audio-only, and video visits in California's federally qualified health centers, 2019-2022. JAMA. 2023;329(14):1219-1221. [FREE Full text] [CrossRef] [Medline]3]. It remains unclear whether these patterns in telemedicine utilization are a result of patient characteristics or reflective of health systems being underresourced. Understanding the drivers of these patterns of telemedicine utilization is crucial, as it informs the development of interventions that address disparities and enhance equitable distribution of telehealth services.
To address this gap in the literature, we evaluated telemedicine use in 2 distinct health systems in San Francisco, California: University of California, San Francisco (UCSF), an academic medical system, and San Francisco Health Network (SFHN), a safety net system. Telemedicine implementation during the PHE differed across the systems. UCSF started implementing video visits and training prior to the PHE and encouraged video as the predominant modality during the PHE, resulting in 50% of all visits (including in-person and telemedicine) being video visits [Lyles C, Fields J, Sharma A, Aulakh V, Sarkar U. Launching a toolkit for safety-net clinics implementing telemedicine during the COVID-19 pandemic. Commonwealth Fund. 2020.13]. In contrast, SFHN encountered delays in video implementation and did not prioritize video visits, resulting in telemedicine visits being primarily delivered as audio-only encounters (>95%) [Nouri S, Lyles CR, Sherwin EB, Kuznia M, Rubinsky AD, Kemper KE, et al. Visit and between-visit interaction frequency before and after COVID-19 telehealth implementation. JAMA Netw Open. 2023;6(9):e2333944. [FREE Full text] [CrossRef] [Medline]14]. In this study, we aimed to (1) describe characteristics of patients with and without a telemedicine visit during the PHE in each health system, and (2) evaluate associations between key sociodemographic factors—age, race and ethnicity, preferred language, and neighborhood socioeconomic status (nSES)—and telemedicine use, including health system interaction effects. We sought to identify whether disparities in telemedicine use were driven by patient characteristics and by variations in the implementation of telemedicine across systems.
Methods
Study Setting and Data Source
This retrospective cohort study included patients with diabetes receiving primary care between July 1, 2020, and March 31, 2021, at 1 of 2 independent health care systems in San Francisco: UCSF and SFHN. UCSF is an academic tertiary care medical care center with 4 primary care practices. SFHN is a safety net health system for San Francisco County with 14 primary care practices.
Study Sample
The study cohort was identified using electronic health records (EHRs) and included adult patients (aged 18 years and older) with diabetes mellitus who had at least 1 primary care or endocrinology encounter between July 1, 2020, and March 31, 2021 (hereafter referred to as the study period). Participants were required to have a diagnosis of diabetes prior to the beginning of the study period. In addition, participants must have been empaneled in primary care as of April 1, 2019 (approximately 1 year before start of the PHE), defined as having assigned a primary care provider and at least 1 primary care encounter within the 3 years prior to April 1, 2019. Details on this cohort are provided in a prior publication [Nouri S, Lyles CR, Sherwin EB, Kuznia M, Rubinsky AD, Kemper KE, et al. Visit and between-visit interaction frequency before and after COVID-19 telehealth implementation. JAMA Netw Open. 2023;6(9):e2333944. [FREE Full text] [CrossRef] [Medline]14].
Ethical Considerations
Data were deidentified for analysis and reporting. This study was approved by the UCSF institutional review board (#20-31253) with waiver of informed consent.
Variables
Participants’ sociodemographic characteristics, health information (eg, comorbidities, vitals, and laboratory results), and telemedicine utilization were derived from EHRs. The primary outcome was defined as whether participants had any telemedicine visit (audio- or video-only visit vs in-person visit only) with their diabetes care team (primary care or endocrinology) during the study period. Key predictor variables were as follows: age (18-34, 35-49, 50-64, 65-74, and ≥75 years); race and ethnicity (non-Hispanic Asian, non-Hispanic Black, Hispanic or Latine, non-Hispanic White, and non-Hispanic other race); preferred language (English, Spanish, Chinese, and other); and nSES quintile at the census tract level based on geocoded residential address [Nouri S, Lyles CR, Sherwin EB, Kuznia M, Rubinsky AD, Kemper KE, et al. Visit and between-visit interaction frequency before and after COVID-19 telehealth implementation. JAMA Netw Open. 2023;6(9):e2333944. [FREE Full text] [CrossRef] [Medline]14]. nSES is a validated composite SES measure that incorporates 5-year census tract level data from the 2013-2017 American Community Survey on income, education, poverty, employment, occupation, housing, and rent values [Gomez SL, Glaser SL, McClure LA, Shema SJ, Kealey M, Keegan THM, et al. The California neighborhoods data system: a new resource for examining the impact of neighborhood characteristics on cancer incidence and outcomes in populations. Cancer Causes Control. 2011;22(4):631-647. [FREE Full text] [CrossRef] [Medline]15]. nSES quintiles are based on the distribution of nSES across US Census tracts from Bay Area counties, with the first quintile (Q1) reflecting lowest nSES and the fifth quintile (Q5) reflecting highest nSES.
Covariates included average baseline hemoglobin A1c control, baseline blood pressure (BP) control (≤120/80, 121/81-140/90, and >140/90 mm Hg), patient sex (male or female), insurance type (Medicare, Medicaid, commercial, Healthy Workers [county administered], or uninsured), patient portal enrollment (yes or no, as a proxy for digital access), and Charlson Comorbidity Index (CCI) score category (0-2 or 3+). Hemoglobin A1c control, BP control, and CCI were used to adjust for differences in utilization based on medical need.
Statistical Analysis
We described patient-level differences in telemedicine use associated with each predictor, overall and by health care system, using chi-square tests for categorical predictors and 2-tailed t tests for continuous predictors. Our regression analyses included a multivariable logistic regression model using the combined health system data to determine the adjusted effects of key predictors on telemedicine utilization and a second model using an interaction term to estimate the effect of health system on each of our key predictors (age, race and ethnicity, preferred language, and nSES). We calculated predicted margins for the significant key predictors. Next, we stratified models by health system. Each logistic regression model controlled for our listed covariates. Missing data for hemoglobin A1c values and BP measurements were imputed using multiple imputation by chained equations [van Buuren S, Groothuis-Oudshoorn CG. MICE: multivariate imputation by chained equations in R. J Stat Soft. 2011;45(3):1-67. [CrossRef]16]. Results were presented as adjusted odds ratios (aORs) with 95% CIs. Two-tailed significance was determined with α value of .05. All analyses were performed using Stata 17 [StataCorp. Stata Statistical Software: Release 17. College Station, TX. StatCorp LLC; 2021. 17].
Results
Included Participants
The final study cohort included a total of 10,201 adult patients with diabetes across the 2 health systems ( Patient characteristics by health system. Patient characteristics by health system.Table 1 and
Multimedia Appendix 1
Multimedia Appendix 1
Of the 10,201 patients in the cohort, 81% (n=8305) had at least 1 telemedicine visit during the study period. Patients in the safety net system were more likely to use telemedicine than patients in the academic health system (5655/6578, 86% vs 2650/3623, 73%; P<.001). Among the combined health systems, there were significant differences in telemedicine use by age (P<.001), language preference (P<.001), and nSES quintile (P<.001). Within the academic health system, there were only significant differences in telemedicine use by age group, with younger patients showing higher adoption (P<.001), and by racial or ethnic groups, with lower adoption by non-Hispanic Asian patients (P<.001). The safety net system showed significant differences in telemedicine use by racial and ethnic groups, with highest adoption by non-Hispanic Asian patients and lowest by non-Hispanic Black patients (P<.001), and by language preferences, with highest adoption by Chinese speakers (P<.001).
Patient characteristics | Combined health systems (N=10,201) | Academic system (n=3623) | Safety net system (n=6578) | ||||||||||||||||||
In-person visits only | Telemedicine visit | P value | In-person visits only | Telemedicine visit | P value | In-person visits only | Telemedicine visit | P value | |||||||||||||
Patients, n (%) | 1896 (19) | 8305 (81) | 973 (27) | 2650 (73) | 923 (14) | 5655 (86) | |||||||||||||||
Age group (years), n (%) | <.001 | <.001 | .16 | ||||||||||||||||||
18-34 | 26 (10) | 223 (90) | 10 (10) | 90 (90) | 16 (11) | 133 (89) | |||||||||||||||
35-49 | 228 (16) | 1198 (84) | 80 (19) | 346 (81) | 148 (15) | 852 (85) | |||||||||||||||
50-64 | 731 (18) | 3375 (82) | 285 (26) | 797 (74) | 446 (15) | 2578 (85) | |||||||||||||||
65-74 | 552 (20) | 2192 (80) | 320 (31) | 712 (69) | 232 (14) | 1480 (86) | |||||||||||||||
75+ | 359 (21) | 1317 (79) | 278 (28) | 705 (72) | 81 (12) | 612 (88) | |||||||||||||||
Race and ethnicity, n (%) | .47 | <.001 | <.001 | ||||||||||||||||||
Non-Hispanic White | 306 (18) | 1351 (82) | 201 (22) | 728 (78) | 105 (14) | 623 (86) | |||||||||||||||
Non-Hispanic Asian | 706 (19) | 3026 (81) | 459 (32) | 971 (68) | 247 (11) | 2055 (89) | |||||||||||||||
Non-Hispanic Black or African American | 285 (19) | 1192 (81) | 119 (24) | 371 (76) | 166 (17) | 821 (83) | |||||||||||||||
Hispanic or Latine | 469 (18) | 2211 (83) | 112 (26) | 324 (74) | 357 (16) | 1887 (84) | |||||||||||||||
Other or unknown | 130 (20) | 525 (80) | 82 (24) | 256 (76) | 48 (15) | 269 (85) | |||||||||||||||
Language, n (%) | <.001 | .17 | <.001 | ||||||||||||||||||
English | 1223 (21) | 4541 (79) | 768 (26) | 2149 (74) | 455 (16) | 2392 (84) | |||||||||||||||
Spanish | 315 (16) | 1630 (84) | 28 (24) | 91 (76) | 287 (16) | 1539 (84) | |||||||||||||||
Chinese | 176 (11) | 1371 (89) | 94 (32) | 203 (68) | 82 (7) | 1168 (93) | |||||||||||||||
Other or unknown | 182 (19) | 763 (81) | 83 (29) | 207 (71) | 99 (15) | 556 (85) | |||||||||||||||
nSESa quintiles, n (%) | <.001 | .26 | .05 | ||||||||||||||||||
1 (lowest) | 537 (17) | 2654 (83) | 156 (24) | 484 (76) | 381 (15) | 2170 (85) | |||||||||||||||
2 | 421 (17) | 2005 (83) | 173 (25) | 509 (75) | 248 (14) | 1496 (86) | |||||||||||||||
3 | 324 (19) | 1413 (81) | 206 (29) | 510 (71) | 118 (12) | 903 (88) | |||||||||||||||
4 | 364 (21) | 1396 (79) | 251 (28) | 632 (72) | 113 (13) | 764 (87) | |||||||||||||||
5 (highest) | 250 (23) | 837 (77) | 187 (27) | 515 (73) | 63 (16) | 322 (84) | |||||||||||||||
Baseline hemoglobin A1c (%), mean (SD) | 7.5 (1.7) | 7.6 (1.7) | .02 | 7.2 (1.3) | 7.4 (1.6) | <.001 | 7.9 (2.1) | 7.7 (1.8) | .02 | ||||||||||||
Blood pressure (mm Hg), n (%) | .17 | .91 | .59 | ||||||||||||||||||
≤120/80 | 402 (18) | 1856 (82) | 175 (26) | 488 (74) | 227 (14) | 1368 (86) | |||||||||||||||
≤140/90 | 992 (18) | 4471 (82) | 526 (27) | 1451 (73) | 466 (13) | 3020 (87) | |||||||||||||||
>140/90 | 413 (20) | 1670 (80) | 242 (27) | 645 (73) | 171 (14) | 1025 (86) | |||||||||||||||
Sex, n (%) | <.001 | .02 | <.001 | ||||||||||||||||||
Female | 916 (17) | 4,494 (83) | 502 (25) | 1480 (75) | 414 (12) | 3014 (88) | |||||||||||||||
Male | 980 (20) | 3811 (80) | 471 (29) | 1170 (71) | 509 (16) | 2641 (84) | |||||||||||||||
Insurance, n (%) | <.001 | .04 | <.001 | ||||||||||||||||||
Private | 448 (27) | 1184 (73) | 443 (28) | 1124 (72) | 5 (8) | 60 (92) | |||||||||||||||
Public | 529 (17) | 2512 (83) | 102 (22) | 354 (78) | 427 (17) | 2158 (83) | |||||||||||||||
Medicare | 721 (19) | 3083 (81) | 428 (27) | 1172 (73) | 293 (13) | 1911 (87) | |||||||||||||||
Uninsured | 111 (15) | 650 (85) | N/Ab | N/A | 111 (15) | 650 (85) | |||||||||||||||
Healthy Workersc | 87 (9) | 876 (91) | N/A | N/A | 87 (9) | 876 (91) | |||||||||||||||
Patient portal enrollment, n (%) | <.001 | <.001 | .007 | ||||||||||||||||||
Activated | 746 (22) | 2655 (78) | 685 (24) | 2126 (76) | 61 (10) | 529 (90) | |||||||||||||||
Charlson Comorbidity Index, n (%) | .18 | <.001 | .06 | ||||||||||||||||||
0-2 | 1531 (19) | 6591 (81) | 785 (29) | 1879 (71) | 746 (14) | 4712 (86) | |||||||||||||||
3+ | 365 (18) | 1714 (82) | 188 (20) | 771 (80) | 177 (16) | 943 (84) |
anSES: neighborhood socioeconomic status.
bN/A: not applicable.
cHealthy Workers is an insurance plan provided to temporary exempt employees of the City and County of San Francisco, including providers of in-home care.
Adjusted Analyses
Combined Health System Data
After adjusting for key predictors (age, race and ethnicity, language, and nSES) and covariates (baseline hemoglobin A1c, baseline BP, sex, insurance type, patient portal enrollment status, and CCI), safety net patients had higher odds of having a telemedicine visit compared with academic health system patients (aOR 2.94, 95% CI 2.48-3.48; Predictors of telemedicine use during the public health emergency by patient characteristics and health system interaction (N=10,201). Estimated predicted probabilities for significant key predictors of telemedicine use after applying the health system interaction term.Table 2). Patients aged 18-34 and 35-49 years also had higher odds of having a telemedicine visit than patients older than 75 years (aOR 2.55, 95% CI 1.63-3.97; aOR 1.39, 95% CI 1.12-1.73). Non-Hispanic Asian, non-Hispanic Black or African American, and Hispanic or Latine patients had lower odds of using telemedicine than non-Hispanic White patients (aOR 0.67, 95% CI 0.56-0.79; aOR 0.83, 95% CI 0.68-1.00; aOR 0.76, 95% CI 0.61-0.95, respectively), whereas patients with Chinese as their preferred language had higher odds of using telemedicine than those with an English-language preference (aOR 2.04, 95% CI 1.66-2.50). No significant differences were found among nSES. Results are displayed in
Table 2. There was a significant interaction between health care system and each individual-level key predictor (P<.05;
Multimedia Appendix 2
Figure 1A-C, respectively. Estimated predicted probabilities for significant key predictors after applying the health system interaction term are provided in
Multimedia Appendix 3
Predictors | Combined health systems (N=10,201) | Academic system (N=3623) | Safety net system (N=6578) | ||||||||||
aORa | 95% CI | aOR | 95% CI | aOR | 95% CI | ||||||||
Health system (reference: UCSFb) | |||||||||||||
SFHNc | 2.94d | 2.48-3.48 | N/Ae | N/A | N/A | N/A | |||||||
Age group (years; reference: 75+) | |||||||||||||
18-34 | 2.55d | 1.63-3.97 | 3.97d | 1.99-7.93 | 1.42 | 0.78-2.60 | |||||||
35-49 | 1.39f | 1.12-1.73 | 1.86d | 1.36-2.56 | 0.98 | 0.70-1.37 | |||||||
50-64 | 1.09 | 0.92-1.30 | 1.15 | 0.91-1.45 | 0.87 | 0.65-1.16 | |||||||
65-74 | 0.95 | 0.81-1.12 | 0.91 | 0.74-1.11 | 0.84 | 0.64-1.11 | |||||||
Race and ethnicity (reference: White) | |||||||||||||
Asian | 0.67d | 0.56-0.79 | 0.57d | 0.46-0.70 | 0.88 | 0.67-1.17 | |||||||
Black or African American | 0.83g | 0.68-1.00 | 0.81 | 0.61-1.07 | 0.90 | 0.68-1.19 | |||||||
Hispanic or Latine | 0.76f | 0.61-0.95 | 0.67g | 0.50-0.91 | 0.86 | 0.62-1.18 | |||||||
Other or unknown | 0.89 | 0.70-1.13 | 0.86 | 0.63-1.16 | 0.94 | 0.64-1.38 | |||||||
Language (reference: English) | |||||||||||||
Spanish | 1.04 | 0.83-1.30 | 1.49 | 0.90-2.48 | 1.02 | 0.78-1.35 | |||||||
Chinese | 2.04d | 1.66-2.50 | 1.16 | 0.86-1.56 | 2.52d | 1.85-3.42 | |||||||
Other or unknown | 1.11 | 0.91-1.35 | 1.09 | 0.81-1.47 | 0.99 | 0.76-1.30 | |||||||
nSESh quintiles (reference: 5) | |||||||||||||
1 | 1.08 | 0.90-1.30 | 1.16 | 0.89-1.52 | 1.10 | 0.81-1.48 | |||||||
2 | 1.14 | 0.95-1.38 | 1.11 | 0.86-1.43 | 1.19 | 0.88-1.62 | |||||||
3 | 1.11 | 0.92-1.35 | 0.95 | 0.74-1.21 | 1.36 | 0.97-1.91 | |||||||
4 | 1.05 | 0.87-1.27 | 0.95 | 0.75-1.19 | 1.23 | 0.88-1.73 | |||||||
Baseline hemoglobin A1c | 1.03 | 0.99-1.07 | 1.11d | 1.05-1.18 | 0.99 | 0.95-1.04 | |||||||
Baseline BPi (mm Hg; reference: ≤120/80) | |||||||||||||
≤140/90 | 1.08 | 0.95-1.23 | 1.04 | 0.85-1.28 | 1.10 | 0.93-1.31 | |||||||
>140/90 | 1.04 | 0.89-1.23 | 0.99 | 0.78-1.26 | 1.09 | 0.88-1.36 | |||||||
Sex (reference: male) | |||||||||||||
Female | 1.36d | 1.22-1.51 | 1.36d | 1.16-1.59 | 1.34d | 1.15-1.55 | |||||||
Insurance type (reference: Medicare) | |||||||||||||
Private | 0.85g | 0.72-1.00 | 0.82g | 0.68-0.99 | 2.02 | 0.80-5.11 | |||||||
Public | 0.84g | 0.72-0.98 | 1.03 | 0.78-1.37 | 0.83 | 0.69-1.00 | |||||||
Uninsured | 0.95 | 0.73-1.23 | N/A | N/A | 1.03 | 0.77-1.37 | |||||||
Healthy Workersj | 1.35g | 1.04-1.76 | N/A | N/A | 1.18 | 0.89-1.57 | |||||||
Patient portal status (reference: inactivated) | |||||||||||||
Activated | 1.71d | 1.47-2.00 | 1.86d | 1.55-2.23 | 1.46f | 1.10-1.94 | |||||||
Charlson Comorbidity Index (reference: 0-2) | |||||||||||||
3+ | 1.33d | 1.17-1.53 | 1.90d | 1.57-2.30 | 0.93 | 0.77-1.12 |
aaOR: adjusted odds ratio.
bUCSF: University of California, San Francisco.
cSFHN: San Francisco Health Network.
dP<.001.
eN/A: not applicable.
fP<.01.
gP<.05.
hnSES: neighborhood socioeconomic status.
iBP: blood pressure.
jHealthy Workers is an insurance plan provided to temporary exempt employees of the City and County of San Francisco, including providers of in-home care.

Stratified Data by Health System
Given the significant interactions by health system, we analyzed each system independently. At the academic health system, participants in the younger age groups (aged 18-34 years and 35-49 years) had higher odds of having a telemedicine visit than those aged 75 years and older (aOR 3.97, 95% CI 1.99-7.93; and aOR 1.86, 95% CI 1.36-2.56, respectively; Table 2). In the academic health system, non-Hispanic Asian (aOR 0.57, 95% CI 0.46-0.70) and Hispanic or Latine (aOR 0.67, 95% CI 0.50-0.91) participants were less likely to have a telemedicine visit than non-Hispanic White participants. There were no significant differences in telemedicine utilization based on language preference or nSES in the academic health system.
On the other hand, in the safety net system, patients with a Chinese language preference had higher odds of having a telemedicine visit (aOR 2.52, 95% CI 1.85-3.42; Table 2). In the safety net system, there were no significant differences in telemedicine utilization based on age, race and ethnicity, or nSES. These findings were consistent with the interaction analysis (
Figure 1).
Discussion
Principal Results
Our study explored differences in telemedicine uptake among a cohort of primary care patients with diabetes across 2 large, unaffiliated health systems in San Francisco, California, during the COVID-19 PHE. Our final adjusted results highlight that health system is a significant predictor of telemedicine use and that disparities in telemedicine utilization may arise from differing implementation strategies by health systems, such as prioritization of audio-only versus video visits. Potential inequities could arise if audio-only visits are not widely implemented or perceived as inferior, despite payor policies that are meant to increase their implementation. Health systems may need to tailor and evaluate telemedicine implementation strategies to address disparities in utilization and ensure equitable access to services, especially for populations at greatest risk for digital exclusion.
Comparison With Prior Work
Our findings using the combined health system data are consistent with prior studies and indicated that groups traditionally vulnerable to digital exclusion (older and minoritized racial and ethnic groups) have lower odds of digital health uptake. These disparities in the context of telemedicine utilization have been well documented since the early stages of the PHE and have also been noted in the post-PHE era [Nouri S, Khoong E, Lyles C, Karliner L. Addressing equity in telemedicine for chronic disease management during the COVID-19 pandemic. NEJM Catalyst. May 4, 2020. [FREE Full text]6,Rodriguez JA, Betancourt JR, Sequist TD, Ganguli I. Differences in the use of telephone and video telemedicine visits during the COVID-19 pandemic. Am J Manag Care. 2021;27(1):21-26. [FREE Full text] [CrossRef] [Medline]11,Zeng B, Rivadeneira NA, Wen A, Sarkar U, Khoong EC. The impact of the COVID-19 pandemic on internet use and the use of digital health tools: secondary analysis of the 2020 health information national trends survey. J Med Internet Res. 2022;24(9):e35828. [FREE Full text] [CrossRef] [Medline]18-Chang JE, Lai AY, Gupta A, Nguyen AM, Berry CA, Shelley DR. Rapid transition to telehealth and the digital divide: implications for primary care access and equity in a post-COVID era. Milbank Q. 2021;99(2):340-368. [FREE Full text] [CrossRef] [Medline]22]. Novel to other studies, we found that these disparities differed across health systems with different telehealth implementation, even after adjustment for patient characteristics. When stratifying our models by health system, more disparities were found within the academic health system, where older, Asian, and Hispanic or Latine patients had lower odds of having a telemedicine visit than younger and non-Hispanic White patients, respectively; these disparities were not significant in the safety net system. In contrast, within the safety net system, Chinese-speaking patients had higher odds of having a telemedicine visit than other language preference groups.
Offering Audio-Only Visits May Increase Telemedicine Accessibility
The safety net system evaluated in our study serves a diverse group of patients who are at an increased risk for digital exclusion [Nouri S, Lyles CR, Sherwin EB, Kuznia M, Rubinsky AD, Kemper KE, et al. Visit and between-visit interaction frequency before and after COVID-19 telehealth implementation. JAMA Netw Open. 2023;6(9):e2333944. [FREE Full text] [CrossRef] [Medline]14]. Despite this challenge, its adoption of a telemedicine infrastructure that primarily uses audio-only visits may have mitigated potential disparities in telemedicine access. While in-person visits remain the gold standard for primary care, robust audio-only options can augment the accessibility of care to patients reliant on telemedicine [Baughman DJ, Jabbarpour Y, Westfall JM, Jetty A, Zain A, Baughman K, et al. Comparison of quality performance measures for patients receiving in-person vs telemedicine primary care in a large integrated health system. JAMA Netw Open. 2022;5(9):e2233267. [FREE Full text] [CrossRef] [Medline]23]. Studies have suggested that patients are more satisfied with telehealth modalities overall compared with in-person visits in terms of access and care provided, with no preference between video and audio-only visits [Allen AZ, Zhu D, Shin C, Glassman DT, Abraham N, Watts KL. Patient satisfaction with telephone versus video-televisits: a cross-sectional survey of an urban, multiethnic population. Urology. 2021;156:110-116. [CrossRef] [Medline]24,Chen K, Lodaria K, Jackson HB. Patient satisfaction with telehealth versus in-person visits during COVID-19 at a large, public healthcare system. J Eval Clin Pract. 2022;28(6):986-990. [FREE Full text] [CrossRef] [Medline]25]. Audio-only visits may be more accessible than video visits due to increased ease of use and lower technological requirements such as high-speed web access, smartphones, and laptops. Excluding or limiting these audio-only options may disproportionately impair access for minoritized racial and ethnicity groups, older adult patients, and non–English-speaking patients.
Our findings may have implications for patients in rural areas. Like urban safety net systems, patient served by rural health care systems are often at risk for digital exclusion, including having limited broadband access, lower rates of device ownership, and lower rates of digital literacy, suggesting that audio-only telemedicine may be necessary to prevent exacerbating health access disparities in these regions [Cuadros DF, Moreno CM, Miller FD, Omori R, MacKinnon NJ. Assessing access to digital services in health care–underserved communities in the United States: a cross-sectional study. Mayo Clin Proc Digital Health. 2023;1(3):217-225. [CrossRef]26].
Considerations for Policy Makers and Health Care System Leaders to Ensure Telemedicine Equity
Our findings raise important considerations for future telemedicine policy, especially when considering the disparities observed within the academic health system. These disparities may partly be a consequence of the delayed and temporary approval for reimbursement of audio-only visits at a level similar to in-person visits by the Centers for Medicare & Medicaid Services [Coronavirus Preparedness and Response Supplemental Appropriations Act, 2020. Wikipedia. URL: https://en.wikipedia.org/wiki/Coronavirus_Preparedness_and_Response_Supplemental_Appropriations_Act,_2020 [accessed 2025-02-14] 4]. The safety net system primarily served uninsured patients or those with public insurance (Medi-Cal) and Healthy Workers, where reimbursement rates were similar across audio-only and in-person visits. In contrast, the academic health system serves patients with private insurance or Medicare, both of which reimbursed video visits at lower rates than in-person or audio-only visits and thus had different incentives for telemedicine implementation. Inconsistent reimbursement across different telemedicine modalities can disproportionately impact populations at risk of digital exclusion and exacerbate existing health inequities. While video-enabled telemedicine care has been perceived in the United States to be more equivalent to in-person care and, therefore, reimbursed at a similar level for a longer period, audio-only telemedicine care has been perceived as providing lower quality and inadequate care, and therefore is reimbursed often at a much lower rate. This has resulted in limited motivation from many health care systems to provide audio-only encounters, which are more accessible to the populations that have experienced barriers to accessing traditional face-to-face health care and have limited digital literacy or access to digital tools [Fisher R, Sarkar U, Adler-Milstein J. Audio-only telemedicine in primary care: embraced in the NHS, second rate in the US. Health Affairs Forefront. 2022.27].
Policy makers should assess the impact of reimbursement policies across different telemedicine modalities and payors to ensure equitable adoption and appropriate utilization among all patient groups, especially patients who may forgo care otherwise without accessible telemedicine modalities. While most payor are concerned that increased accessibility may lead to higher utilization and costs, payors should also recognize the value of this opportunity to improve health care access for historically excluded populations.
Policies for encouraging delivery of more accessible telemedicine services should be implemented in conjunction with policies that address the barriers to accessing video-based telemedicine care. This may include policies that increase affordability of web access and devices as well as targeted investments in digital literacy programs [Sheon A, Khoong E. Pillars, policies, and plausible pathways linking digital inclusion and health equity. Health Affairs. 2024.28]. Community-based initiatives, such as mobile technology training program and device distribution efforts, may reduce barriers to telehealth adoption [Lyles CR, Nguyen OK, Khoong EC, Aguilera A, Sarkar U. Multilevel determinants of digital health equity: a literature synthesis to advance the field. Annu Rev Public Health. 2023;44:383-405. [FREE Full text] [CrossRef] [Medline]29]. These programs can be scaled to address the needs of populations with low digital literacy or limited access to digital tools [Lyles CR, Nguyen OK, Khoong EC, Aguilera A, Sarkar U. Multilevel determinants of digital health equity: a literature synthesis to advance the field. Annu Rev Public Health. 2023;44:383-405. [FREE Full text] [CrossRef] [Medline]29].
Health systems leaders need to evaluate both the technologic needs and the health care requirements of their populations when developing telemedicine strategies, ensuring accessibility and equity while adapting to evolving policies and regulations. Incorporating multiple telemedicine options into care models can improve accessibility for older adults, patients with language barriers, and those in areas with limited broadband connectivity.
Both policy makers and health care leaders must evaluate the impact of policies on health equity over time. Consistent, systematic data collection and reporting on telemedicine utilization and its impact on clinical outcomes by sociodemographic characteristic such as race and ethnicity, language preference, and insurance coverage can help identify persistent gaps and guide future policy. When policies and implementation methods are aligned with real-world patient needs, particularly for populations at high risk of digital exclusion, telemedicine can serve as a tool to effectively reduce health disparities.
Limitations
Our sample included data from 2 urban health systems through March 2021, limiting generalizability to other systems and to later periods of the PHE. Future research evaluating the impact of telemedicine implementation in rural settings and examining trends in later post-PHE periods could further validate and broaden the applicability of these findings. However, more than 80% of the US population resides in urban areas, so our findings still have great relevance to many individuals [United States Census Bureau. Urban areas facts. 2021. URL: https://www.census.gov/programs-surveys/geography/guidance/geo-areas/urban-rural/ua-facts.html [accessed 2024-12-21] 30]. In addition, differences in patient populations and institutional practices may be contributed to our findings. The safety net system may have had fewer disparities in telehealth use due to greater experience serving patients with limited digital access and stronger support for digital health literacy. However, our findings align with prior studies suggesting that telephone-based telehealth may improve accessibility and adoption among patient facing barriers to video-based services. We did not have access to the EHRs from outside systems, so we could not account for external encounters, although we limited our cohort to patients actively receiving primary care at UCSF or SFHN to mitigate this. Baseline measures of diabetes and BP control relied on single time points and may not perfectly reflect control through the study period. Incorporating longitudinal data in future analyses may help provide a more nuanced understanding of how disease control may be associated with telemedicine use.
Conclusions
This retrospective study examined a cohort of 10,201 primary care patients with diabetes during the PHE and found that inequities in telemedicine utilization varied across health systems with differing telemedicine implementation. Notably, disparities related to patient age and racial and ethnic identity underscore potential barriers to health care access. Compared with the safety net system with widespread adoption of audio-only visits, patients in the academic health system were less likely to have any telemedicine visit. Furthermore, lower telemedicine utilization was observed among older patients and minoritized racial and ethnic groups in the academic health system—disparities that were not present in the safety net system, which serves a more diverse population. Ultimately, our findings suggest that rapid, widespread telemedicine implementation prioritizing video telemedicine may exacerbate disparities in telemedicine utilization. Providing both audio-only and video appointments may enhance accessibility to care for populations historically at risk for digital exclusion.
Acknowledgments
This study is supported by the University of California, San Francisco (UCSF) Center for Healthcare Value; the UCSF Population Health Data initiative; and grants from the National Institute of Diabetes and Digestive and Kidney Diseases (NIDDK P30DK092924); the National Heart, Lung, and Blood Institute (NHLBI K23HL157750); the National Institute on Aging (NIA K76AG088348); and the National Center for Advancing Translational Sciences (UCSF-CTSI grant UL1TR001872). MK is supported by UCSF School of Nursing Doctoral Student Funding. KEK and ADR are supported by the UCSF Population Health Data Initiative through residual class settlement funds in the matter of April Krueger v Wyeth, Inc, case no. 03-cv-2496 (US District Court, SD of California).
Funding sources had no role in the design and conduct of the study; collection, management, analysis, and interpretation of the data; preparation, review, or approval of the manuscript; and decision to submit the manuscript for publication. Its contents are solely the responsibility of the authors and do not necessarily represent the official views of UCSF or the National Institutes of Health.
Data Availability
The data collected during this study are available from the corresponding author on reasonable request.
Authors' Contributions
SN, CRL, and ECK made substantial contributions to the conception or design of the work. All made substantial contribution to the analysis and interpretation of data for the work. JJS and MK drafted the manuscript. All critically revised the work, provided final approval of the submitted version, and agreed to be accountable for the accuracy and integrity of all parts of the work.
Conflicts of Interest
None declared.
Multimedia Appendix 2
Predictors of telemedicine use during the public health emergency by patient characteristics and health system interaction (N=10,201).
DOCX File , 18 KBMultimedia Appendix 3
Estimated predicted probabilities for significant key predictors of telemedicine use after applying the health system interaction term.
DOCX File , 16 KBReferences
- Lin CC, Dievler A, Robbins C, Sripipatana A, Quinn M, Nair S. Telehealth in health centers: key adoption factors, barriers, and opportunities. Health Aff (Millwood). 2018;37(12):1967-1974. [CrossRef] [Medline]
- Adler-Milstein J, Kvedar J, Bates DW. Telehealth among US hospitals: several factors, including state reimbursement and licensure policies, influence adoption. Health Aff (Millwood). 2014;33(2):207-215. [CrossRef] [Medline]
- Uscher-Pines L, McCullough CM, Sousa JL, Lee SD, Ober AJ, Camacho D, et al. Changes in in-person, audio-only, and video visits in California's federally qualified health centers, 2019-2022. JAMA. 2023;329(14):1219-1221. [FREE Full text] [CrossRef] [Medline]
- Coronavirus Preparedness and Response Supplemental Appropriations Act, 2020. Wikipedia. URL: https://en.wikipedia.org/wiki/Coronavirus_Preparedness_and_Response_Supplemental_Appropriations_Act,_2020 [accessed 2025-02-14]
- Medicare and Medicaid programs, basic health program, and exchanges; additional policy and regulatory revisions in response to the COVID-19 public health emergency and delay of certain reporting requirements for the skilled nursing facility quality reporting program. Federal Register. 2020. URL: https://tinyurl.com/3c8j4nre [accessed 2023-10-16]
- Nouri S, Khoong E, Lyles C, Karliner L. Addressing equity in telemedicine for chronic disease management during the COVID-19 pandemic. NEJM Catalyst. May 4, 2020. [FREE Full text]
- Eberly LA, Kallan MJ, Julien HM, Haynes N, Khatana SAM, Nathan AS, et al. Patient characteristics associated with telemedicine access for primary and specialty ambulatory care during the COVID-19 pandemic. JAMA Netw Open. 2020;3(12):e2031640. [FREE Full text] [CrossRef] [Medline]
- Eberly LA, Khatana SAM, Nathan AS, Snider C, Julien HM, Deleener ME, et al. Telemedicine outpatient cardiovascular care during the COVID-19 pandemic: bridging or opening the digital divide? Circulation. 2020;142(5):510-512. [FREE Full text] [CrossRef] [Medline]
- Madjid K, Lee E, Couture S, Gonzales A, Grigorescu V, Smith S, et al. National Survey Trends in Telehealth Use in 2021: Disparities in Utilization and Audio vs. Video Services. Washington, DC. Office of the Assistant Secretary for Planning and Evaluation, Office of Health Policy; Feb 01, 2022:15.
- Hsueh L, Huang J, Millman AK, Gopalan A, Parikh RK, Teran S, et al. Disparities in use of video telemedicine among patients with limited english proficiency during the COVID-19 pandemic. JAMA Netw Open. 2021;4(11):e2133129. [FREE Full text] [CrossRef] [Medline]
- Rodriguez JA, Betancourt JR, Sequist TD, Ganguli I. Differences in the use of telephone and video telemedicine visits during the COVID-19 pandemic. Am J Manag Care. 2021;27(1):21-26. [FREE Full text] [CrossRef] [Medline]
- Chang E, Penfold RB, Berkman ND. Patient characteristics and telemedicine use in the US, 2022. JAMA Netw Open. 2024;7(3):e243354. [FREE Full text] [CrossRef] [Medline]
- Lyles C, Fields J, Sharma A, Aulakh V, Sarkar U. Launching a toolkit for safety-net clinics implementing telemedicine during the COVID-19 pandemic. Commonwealth Fund. 2020.
- Nouri S, Lyles CR, Sherwin EB, Kuznia M, Rubinsky AD, Kemper KE, et al. Visit and between-visit interaction frequency before and after COVID-19 telehealth implementation. JAMA Netw Open. 2023;6(9):e2333944. [FREE Full text] [CrossRef] [Medline]
- Gomez SL, Glaser SL, McClure LA, Shema SJ, Kealey M, Keegan THM, et al. The California neighborhoods data system: a new resource for examining the impact of neighborhood characteristics on cancer incidence and outcomes in populations. Cancer Causes Control. 2011;22(4):631-647. [FREE Full text] [CrossRef] [Medline]
- van Buuren S, Groothuis-Oudshoorn CG. MICE: multivariate imputation by chained equations in R. J Stat Soft. 2011;45(3):1-67. [CrossRef]
- StataCorp. Stata Statistical Software: Release 17. College Station, TX. StatCorp LLC; 2021.
- Zeng B, Rivadeneira NA, Wen A, Sarkar U, Khoong EC. The impact of the COVID-19 pandemic on internet use and the use of digital health tools: secondary analysis of the 2020 health information national trends survey. J Med Internet Res. 2022;24(9):e35828. [FREE Full text] [CrossRef] [Medline]
- Khoong EC, Butler BA, Mesina O, Su G, DeFries TB, Nijagal M, et al. Patient interest in and barriers to telemedicine video visits in a multilingual urban safety-net system. J Am Med Inform Assoc. 2021;28(2):349-353. [FREE Full text] [CrossRef] [Medline]
- Chunara R, Zhao Y, Chen J, Lawrence K, Testa P, Nov O, et al. Telemedicine and healthcare disparities: a cohort study in a large healthcare system in New York City during COVID-19. J Am Med Inform Assoc. 2021;28(1):33-41. [FREE Full text] [CrossRef] [Medline]
- Ruberto RA, Schweppe EA, Ahmed R, Swindell HW, Cordero CA, Lanham NS, et al. Disparities in telemedicine utilization during covid-19 pandemic: analysis of demographic data from a large academic orthopaedic practice. JB JS Open Access. 2022;7(2):e21.00116. [FREE Full text] [CrossRef] [Medline]
- Chang JE, Lai AY, Gupta A, Nguyen AM, Berry CA, Shelley DR. Rapid transition to telehealth and the digital divide: implications for primary care access and equity in a post-COVID era. Milbank Q. 2021;99(2):340-368. [FREE Full text] [CrossRef] [Medline]
- Baughman DJ, Jabbarpour Y, Westfall JM, Jetty A, Zain A, Baughman K, et al. Comparison of quality performance measures for patients receiving in-person vs telemedicine primary care in a large integrated health system. JAMA Netw Open. 2022;5(9):e2233267. [FREE Full text] [CrossRef] [Medline]
- Allen AZ, Zhu D, Shin C, Glassman DT, Abraham N, Watts KL. Patient satisfaction with telephone versus video-televisits: a cross-sectional survey of an urban, multiethnic population. Urology. 2021;156:110-116. [CrossRef] [Medline]
- Chen K, Lodaria K, Jackson HB. Patient satisfaction with telehealth versus in-person visits during COVID-19 at a large, public healthcare system. J Eval Clin Pract. 2022;28(6):986-990. [FREE Full text] [CrossRef] [Medline]
- Cuadros DF, Moreno CM, Miller FD, Omori R, MacKinnon NJ. Assessing access to digital services in health care–underserved communities in the United States: a cross-sectional study. Mayo Clin Proc Digital Health. 2023;1(3):217-225. [CrossRef]
- Fisher R, Sarkar U, Adler-Milstein J. Audio-only telemedicine in primary care: embraced in the NHS, second rate in the US. Health Affairs Forefront. 2022.
- Sheon A, Khoong E. Pillars, policies, and plausible pathways linking digital inclusion and health equity. Health Affairs. 2024.
- Lyles CR, Nguyen OK, Khoong EC, Aguilera A, Sarkar U. Multilevel determinants of digital health equity: a literature synthesis to advance the field. Annu Rev Public Health. 2023;44:383-405. [FREE Full text] [CrossRef] [Medline]
- United States Census Bureau. Urban areas facts. 2021. URL: https://www.census.gov/programs-surveys/geography/guidance/geo-areas/urban-rural/ua-facts.html [accessed 2024-12-21]
Abbreviations
aOR: adjusted odds ratio |
BP: blood pressure |
CCI: Charlson Comorbidity Index |
EHR: electronic health record |
nSES: neighborhood socioeconomic status |
PHE: public health emergency |
SFHN: San Francisco Health Network |
UCSF: University of California, San Francisco |
Edited by A Coristine; submitted 23.07.24; peer-reviewed by D Valvi, Z Ehtesham, ND Berkman; comments to author 07.12.24; revised version received 31.01.25; accepted 06.02.25; published 24.03.25.
Copyright©Jonathan J Shih, Magdalene Kuznia, Sarah Nouri, Elizabeth B Sherwin, Kathryn E Kemper, Anna D Rubinsky, Courtney R Lyles, Elaine C Khoong. Originally published in the Journal of Medical Internet Research (https://www.jmir.org), 24.03.2025.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research (ISSN 1438-8871), is properly cited. The complete bibliographic information, a link to the original publication on https://www.jmir.org/, as well as this copyright and license information must be included.