Research Letter
doi:10.2196/40827
Keywords
Introduction
Telehealth has the potential to improve access to and quality of care for low-income patients with chronic conditions such as diabetes [
- ]. This includes patients served by federally qualified health centers (FQHCs), which provide comprehensive primary and preventive care services to millions of low-income patients across the United States. In 2019, only 8% of FQHCs in Massachusetts were using telehealth to deliver primary care or chronic disease management services to patients [ ]. By 2020, 100% of FQHCs in Massachusetts delivered at least some primary care or chronic disease care virtually via telehealth, with vast heterogeneity in the extent of adoption across FQHCs [ ]. Our objective was to assess how FQHC-level use of telehealth was associated with access to and quality of care for low-income patients with diabetes at Community Care Cooperative (C3)—the largest FQHC-based Medicaid-accountable care organization (ACO) in the United States, which supported the adoption of telehealth delivery across FQHCs in Massachusetts during the COVID-19 pandemic [ ].Methods
Overview
Our study population included Medicaid-enrolled patients with a diagnosis of diabetes, aged 18-64 years, who were attributed to the C3 ACO, had at least 1 primary care visit to a C3 FQHC within the last 18 months, and otherwise met Healthcare Effectiveness Data and Information Set (HEDIS) denominator criteria for patients with diabetes (N=11,503 patient-months after exclusions). Our data source was the 2019-2021 Electronic Data Warehouse, which stores electronic health record (EHR) and claims data from C3; this included data from 11 FQHCs after excluding FQHCs with invalid EHR telehealth identifiers.
Study outcomes included three quality-of-care diabetes HEDIS measures (annual retinal exam, blood pressure control, blood glucose control) and a primary care engagement measure (number of FQHC visits). Our treatment group included FQHCs with high telehealth use during COVID-19 (≥50% of all visits mean 67.6%), and our comparison group included FQHCs with lower telehealth use during COVID-19 (<50% of all visits mean 36.7%). Telehealth included real-time video and audio-only visits delivered directly to remote patients.
Our unit of analysis was the patient-month. We used a difference-in-differences approach with linear probability models and negative binomial models to examine changes in patient-level outcomes for patients at high- versus low-telehealth FQHCs before (March 2019-February 2020) versus after (April 2020-March 2021) the rapid adoption of telehealth. All models adjusted for patient age, sex, and clinical risk score, applied month and FQHC fixed effects, used robust variance estimators, and applied inverse probability of treatment weights based on propensity scores to balance on 16 patient-level baseline covariates.
P values were 2-tailed, and statistical significance was set at P=.05. Analyses were performed using Stata 17.0 (StataCorp).
Ethical Considerations
Boston University’s institutional review board deemed the study exempt because we used secondary deidentified data.
Results
Of the 11,503 diabetic patient-months included in the study, the mean age was 48.1 years and 56.3% (n=6474) were female, with 27.3% (n=3142) being non-Hispanic White, 10.7% (n=1235) being non-Hispanic Black, and 53.4% (n=6139) being Hispanic based on self-reported race/ethnicity (
). High telehealth use was associated with increases in 2 of 4 study outcomes, while 1 measure decreased ( ). Telehealth was associated with a relative 10.7 percentage point (95% CI 6.3-15.0; P<.001) increase in rates of annual retinal exams and a relative rate increase of 1.5 (95% CI 1.2-1.8; P<.001) in the number of visits among patients with diabetes, although overall visit rates fell in both groups during COVID-19. Telehealth was further associated with a 5.6 percentage point decrease (95% CI 9.7-1.5; P=.008) in the HEDIS blood pressure control measure and with no statistical change in the blood glucose control measure (P=.97).Characteristicsa | Full sample (N=11,503 person-months, representing 1417 unique persons) | High telehealthb (n=8196 person-months, representing 1022 unique persons) | Low telehealthc (n=3307 person-months, representing 395 unique persons) | Standardized difference | |||||||
Before propensity weighting | After propensity weighting | ||||||||||
Age (years), mean (SD) | 48.1 (11.4) | 48.1 (11.5) | 48.2 (11.1) | –0.0755 | –0.0093 | ||||||
Sex (female), n (%) | 6474 (56.3) | 4823 (58.8) | 1651 (49.9) | 0.0889 | 0.0026 | ||||||
Race/ethnicityd, n (%) | |||||||||||
White, non-Hispanic | 3142 (27.3) | 2337 (28.4) | 805 (24.2) | 0.1153 | –0.0025 | ||||||
Black, non-Hispanic | 1235 (10.7) | 763 (9.4) | 472 (14.4) | –0.4141 | –0.0018 | ||||||
Hispanic | 6139 (53.4) | 4219 (51.6) | 1920 (58.3) | 0.1342 | 0.0010 | ||||||
Other or multirace | 987 (8.6) | 877 (10.6) | 110 (3.2) | 0.0936 | 0.0023 | ||||||
Primary languagee, n (%) | |||||||||||
English | 6447 (56.0) | 4421 (54.0) | 2026 (61.3) | 0.0139 | 0.0114 | ||||||
Spanish | 3954 (34.4) | 2769 (33.8) | 1186 (35.9) | 0.0799 | –0.0016 | ||||||
Other | 1103 (9.6) | 1006 (12.2) | 97 (2.9) | –0.0851 | –0.0074 | ||||||
CDPSf risk score, mean (SD) | 3.65 (2.28) | 3.56 (2.27) | 3.90 (2.32) | 0.1083 | 0.0054 | ||||||
Clinical diagnoses, n (%) | |||||||||||
Hypertension | 6557 (57.0) | 4513 (55.1) | 2044 (61.9) | –0.1115 | 0.0024 | ||||||
Hyperlipidemia | 4039 (35.1) | 3192 (38.8) | 847 (25.4) | 0.0644 | –0.0106 | ||||||
Overweight or obese | 6626 (57.6) | 4789 (58.4) | 1836 (55.5) | 0.1284 | –0.0118 | ||||||
Morbidly obese | 2401 (20.9) | 1855 (22.6) | 546 (16.4) | 0.2141 | 0.0013 | ||||||
Asthma | 2388 (20.8) | 1591 (19.4) | 797 (24.2) | 0.1134 | 0.0031 | ||||||
COPDg | 1186 (10.3) | 905 (11.0) | 281 (8.5) | 0.1254 | 0.0057 | ||||||
Tobacco use | 3070 (26.7) | 2192 (26.7) | 878 (26.6) | 0.0936 | 0.0153 | ||||||
Alcohol use disorder | 1042 (9.1) | 629 (7.7) | 414 (12.6) | –0.0205 | –0.0092 | ||||||
Major depression | 4896 (42.6) | 3853 (46.9) | 1043 (31.3) | 0.2817 | –0.0048 | ||||||
Other depression | 746 (6.5) | 603 (7.3) | 143 (4.3) | 0.0843 | –0.0032 | ||||||
Anxiety | 3901 (33.9) | 2976 (36.2) | 925 (27.9) | 0.2245 | –0.0026 |
aBaseline characteristics shown reflect characteristics in the unweighted sample. After applying inverse probability of treatment weights based on propensity scores, standardized differences between high vs low telehealth FQHCs for all 16 characteristics were less than 10%—a common threshold denoting negligible imbalance between groups.
bHigh telehealth includes patients at FQHCs where ≥50% of all visits to the FQHCs in the postperiod were delivered via telehealth (mean 67.6%), where telehealth includes real-time video and audio-only visits.
cLow telehealth includes patients at FQHCs where <50% of all visits to the FQHCs in the postperiod were delivered via telehealth (mean 36.7%), where telehealth includes real-time video and audio-only visits.
dRace/ethnicity of known (n=1983 person-months, 17.2% unknown race/ethnicity in full sample; n=1297 person-months, 15.9% unknown in high telehealth; and n=686 person-months, 20.8% unknown in low telehealth).
eLanguage of known (n=224, 2% unknown in full sample; n=196, 2.4% unknown in high telehealth; and n=28, 0.9% unknown in low telehealth).
fCDPS: Chronic Illness and Disability Payment System.
gCOPD: chronic obstructive pulmonary disease.
Outcomea | High telehealthb | Low telehealthc | Adjusted coefficientd, DIDe (95% CI) | P value | |||
Pre | Post | Pre | Post | ||||
Annual retinal exam, % | 59.22 | 55.09 | 69.37 | 52.61 | 10.7 (6.29 to 15.0) | <.001 | |
Blood pressure controlf, % | 81.06 | 53.06 | 78.20 | 54.69 | –5.57 (–9.67 to –1.47) | .008 | |
Blood glucose controlg, % | 67.33 | 51.54 | 63.26 | 47.66 | –0.07 (–4.45 to 4.30) | .97 | |
Number of visitsh | 0.92 | 0.46 | 2.44 | 0.72 | 1.48 (1.24 to 1.77) | <.001 |
aFor all outcomes, 11503 person-months, representing 1417 unique patients. Sample sizes and analyses exclude the first 6 months of the postperiod due to the rolling, look-back nature of Healthcare Effectiveness Data and Information Set (HEDIS) measure calculation. For all outcomes, we tested the parallel trends assumption by interacting linear months with treatment status in the preperiod. No differential preperiod trends were detected (P>.05 for all).
bHigh telehealth includes patients at FQHCs where ≥50% of all visits to the FQHCs in the postperiod were delivered via telehealth (mean 67.6%), where telehealth includes real-time video and audio-only visits.
cLow telehealth includes patients at FQHCs where <50% of all visits to the FQHCs in the postperiod were delivered via telehealth (mean 36.7%), where telehealth includes real-time video and audio-only visits.
dCoefficients for HEDIS quality measures are from linear probability models, where coefficients are reported on an absolute percentage point scale; values >0 indicate that telehealth was associated with an increase in the measure. The coefficient for the number of visits is from a negative binomial model, where the coefficient is reported as a relative incidence rate ratio; values >1 indicate that telehealth was associated with an increase in the measure.
eDID: difference-in-differences.
fBlood pressure control indicates that a patient had a measurement documented within the last 12 months and a most recent result of <140/90 mmHg.
gBlood glucose control indicates that a patient had a measurement documented within the last 12 months and a most recent result ≤9.0%.
hThe number of visits is measured as the mean number of FQHC visits per patient per month.
Discussion
This study indicates that high FQHC-level telehealth use was associated with more sustained engagement in care for patients with diabetes at FQHCs in Massachusetts, with mixed effects on quality of care measures. Telehealth availability likely helped to partially mitigate the overall decrease in visit rates during COVID-19 by improving care access, while telehealth visits may have also provided the opportunity to encourage patients to return for in-person retinal screenings [
]. In contrast, decreases in measured blood pressure control may have resulted from the lack of standardized blood pressure documentation in EHRs during telehealth visits rather than poor control, although this was untestable in our data. While these findings fill an important evidence gap by focusing on Medicaid-enrolled FQHC patients, they are largely consistent with previous literature showing the potential for telehealth to improve access and some quality of care–sensitive outcomes in diabetic populations [ - ].The results have important implications. First, telehealth has the potential to improve some measured quality, which suggests that incorporating telehealth into care delivery models and supporting telehealth sustainability through telehealth reimbursement may benefit patients with diabetes. Second, providers must simultaneously consider how to best adapt quality measures and underlying data reporting to ensure that quality-reliant payment models validly capture the quality of care under new delivery modalities, as measures such as blood pressure control may not be validly captured during telehealth encounters.
This research is not without limitations. Limitations include potential measurement error in the data, unmeasured confounding due to simultaneous implementation of telehealth and other service capacity changes during COVID-19, lack of subgroup analyses that explore heterogeneity in effects, and FQHC-level assignment of exposure. Nonetheless, based on this study, Medicaid reimbursement policies and care delivery models that support the use of telehealth as part of chronic disease care may be associated with better care engagement for low-income patients with diabetes.
Acknowledgments
The authors acknowledge their health system partner, Community Care Cooperative, for ongoing study input and interpretation, and for providing access to all data. The authors further acknowledge analytics vendor Arcadia for extracting requested data from the Electronic Data Warehouse.
This research was funded by the Donaghue Foundation, Greater Value Portfolio, grant ID not applicable (principal investigators: MBC and JHK) and by the Robert Wood Johnson Foundation, Research to Advance Models of Care for Medicaid-Eligible Populations, grant ID 78235, (principal investigators: MBC and JHK).
Funders had no role in the design and conduct of the study; collection, management, analysis, and interpretation of the data; preparation, review, or approval of the manuscript; or decision to submit the manuscript for publication.
An earlier version of this work was presented by MBC at the June 2022 AcademyHealth Annual Research Meeting and the June 2022 American Society for Health Economists Annual Meeting.
Data Availability
Data used for these analyses are governed by a data use agreement with Community Care Cooperative and all of its affiliated federally qualified health centers. Per the data use agreement, data are restricted and cannot be shared with outside parties. For further information regarding data availability, you may reach out to MBC at mbcole@bu.edu.
Authors' Contributions
MBC and JHK developed the concept and design. All authors contributed to the acquisition, analysis, or interpretation of data. MBC drafted the manuscript. All authors critically revised the manuscript for important intellectual content. MBC performed the statistical analysis. MBC and JHK obtained the funding. MBC, NJ, and EKL provided administrative, technical, or material support.
MBC had full access to all the data in the study and takes responsibility for the integrity of the data and the accuracy of the data analysis.
Conflicts of Interest
MBC discloses receiving research grant funding from the National Institutes of Health (National Center Advancing Translational Sciences, National Institute on Minority Health and Health Disparities, National Institute of Mental Health), the Agency for Healthcare Research and Quality, Health Resources and Services Administration, the Smith Family Foundation, the Klarman Family Foundation, the Peterson Foundation, and the Society of Family Planning—none of which relate to the contents of this manuscript. The authors have no other conflicts of interest to report.
References
- Eberle C, Stichling S. Clinical improvements by telemedicine interventions managing type 1 and type 2 diabetes: systematic meta-review. J Med Internet Res 2021 Feb 19;23(2):e23244 [FREE Full text] [CrossRef] [Medline]
- Dhediya R, Chadha M, Bhattacharya AD, Godbole S, Godbole S. Role of telemedicine in diabetes management. J Diabetes Sci Technol 2022 Feb 28:19322968221081133. [CrossRef] [Medline]
- Zhang A, Wang J, Wan X, Zhang Z, Zhao S, Guo Z, et al. A meta-analysis of the effectiveness of telemedicine in glycemic management among patients with type 2 diabetes in primary care. Int J Environ Res Public Health 2022 Mar 31;19(7):4173 [FREE Full text] [CrossRef] [Medline]
- Cantor J, Chakravarty S, Farnham J, Nova J, Ahmad S, Flory J. Impact of a provider tele-mentoring learning model on the care of medicaid-enrolled patients with diabetes. Med Care 2022 Jul 01;60(7):481-487 [FREE Full text] [CrossRef] [Medline]
- Health Center Program Uniform Data System (UDS) data overview. Health Resources & Services Administration. 2020. URL: https://data.hrsa.gov/tools/data-reporting/program-data [accessed 2022-02-19]
- FQHC Telehealth Consortium. 2021. URL: https://fqhctelehealth.org/ [accessed 2022-03-04]
- Ramsey DJ, Lasalle CC, Anjum S, Marx JL, Roh S. Telehealth encourages patients with diabetes in racial and ethnic minority groups to return for in-person ophthalmic care during the COVID-19 pandemic. Clin Ophthalmol 2022;16:2157-2166 [FREE Full text] [CrossRef] [Medline]
- Patel SY, McCoy RG, Barnett ML, Shah ND, Mehrotra A. Diabetes care and glycemic control during the COVID-19 pandemic in the United States. JAMA Intern Med 2021 Oct 01;181(10):1412-1414 [FREE Full text] [CrossRef] [Medline]
- Sacre JW, Holmes-Truscott E, Salim A, Anstey KJ, Drummond GR, Huxley RR, et al. Impact of the COVID-19 pandemic and lockdown restrictions on psychosocial and behavioural outcomes among Australian adults with type 2 diabetes: Findings from the PREDICT cohort study. Diabet Med 2021 Sep;38(9):e14611 [FREE Full text] [CrossRef] [Medline]
- Woodhouse AG, Orvin C, Rich C, Crosby J, Keedy CA. Diabetes outcomes before and during telehealth advancements surrounding COVID-19. J Am Pharm Assoc (2003) 2022;62(1):214-217 [FREE Full text] [CrossRef] [Medline]
Abbreviations
ACO: accountable care organization |
C3: Community Care Cooperative |
EHR: electronic health record |
FQHC: federally qualified health center |
HEDIS: Healthcare Effectiveness Data and Information Set |
Edited by A Mavragani; submitted 06.07.22; peer-reviewed by S Sarejloo, SJC Soerensen , F Petrazzuoli; comments to author 30.11.22; revised version received 20.01.23; accepted 31.01.23; published 02.03.23
Copyright©Megan B Cole, Nicholas Jones, Eun Kyung Lee, June-Ho Kim. Originally published in the Journal of Medical Internet Research (https://www.jmir.org), 02.03.2023.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on https://www.jmir.org/, as well as this copyright and license information must be included.