Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/40827, first published .
The Association of Telehealth Availability and Quality of Care Measures for Patients With Diabetes at Federally Qualified Health Centers: Retrospective Cohort Study

The Association of Telehealth Availability and Quality of Care Measures for Patients With Diabetes at Federally Qualified Health Centers: Retrospective Cohort Study

The Association of Telehealth Availability and Quality of Care Measures for Patients With Diabetes at Federally Qualified Health Centers: Retrospective Cohort Study

Research Letter

1Boston University School of Public Health, Boston, MA, United States

2Brown University School of Public Health, Providence, RI, United States

3Ariadne Labs, Harvard T H Chan School of Public Health, Boston, MA, United States

4Division of General Internal Medicine & Primary Care, Brigham and Women’s Hospital, Boston, MA, United States

Corresponding Author:

Megan B Cole, PhD

Boston University School of Public Health

715 Albany Street

Boston, MA, 02118

United States

Phone: 1 6173581901

Email: mbcole@bu.edu




Telehealth has the potential to improve access to and quality of care for low-income patients with chronic conditions such as diabetes [1-4]. This includes patients served by federally qualified health centers (FQHCs), which provide comprehensive primary and preventive care services to millions of low-income patients across the United States. In 2019, only 8% of FQHCs in Massachusetts were using telehealth to deliver primary care or chronic disease management services to patients [5]. By 2020, 100% of FQHCs in Massachusetts delivered at least some primary care or chronic disease care virtually via telehealth, with vast heterogeneity in the extent of adoption across FQHCs [5]. Our objective was to assess how FQHC-level use of telehealth was associated with access to and quality of care for low-income patients with diabetes at Community Care Cooperative (C3)—the largest FQHC-based Medicaid-accountable care organization (ACO) in the United States, which supported the adoption of telehealth delivery across FQHCs in Massachusetts during the COVID-19 pandemic [6].


Overview

Our study population included Medicaid-enrolled patients with a diagnosis of diabetes, aged 18-64 years, who were attributed to the C3 ACO, had at least 1 primary care visit to a C3 FQHC within the last 18 months, and otherwise met Healthcare Effectiveness Data and Information Set (HEDIS) denominator criteria for patients with diabetes (N=11,503 patient-months after exclusions). Our data source was the 2019-2021 Electronic Data Warehouse, which stores electronic health record (EHR) and claims data from C3; this included data from 11 FQHCs after excluding FQHCs with invalid EHR telehealth identifiers.

Study outcomes included three quality-of-care diabetes HEDIS measures (annual retinal exam, blood pressure control, blood glucose control) and a primary care engagement measure (number of FQHC visits). Our treatment group included FQHCs with high telehealth use during COVID-19 (≥50% of all visits mean 67.6%), and our comparison group included FQHCs with lower telehealth use during COVID-19 (<50% of all visits mean 36.7%). Telehealth included real-time video and audio-only visits delivered directly to remote patients.

Our unit of analysis was the patient-month. We used a difference-in-differences approach with linear probability models and negative binomial models to examine changes in patient-level outcomes for patients at high- versus low-telehealth FQHCs before (March 2019-February 2020) versus after (April 2020-March 2021) the rapid adoption of telehealth. All models adjusted for patient age, sex, and clinical risk score, applied month and FQHC fixed effects, used robust variance estimators, and applied inverse probability of treatment weights based on propensity scores to balance on 16 patient-level baseline covariates.

P values were 2-tailed, and statistical significance was set at P=.05. Analyses were performed using Stata 17.0 (StataCorp).

Ethical Considerations

Boston University’s institutional review board deemed the study exempt because we used secondary deidentified data.


Of the 11,503 diabetic patient-months included in the study, the mean age was 48.1 years and 56.3% (n=6474) were female, with 27.3% (n=3142) being non-Hispanic White, 10.7% (n=1235) being non-Hispanic Black, and 53.4% (n=6139) being Hispanic based on self-reported race/ethnicity (Table 1). High telehealth use was associated with increases in 2 of 4 study outcomes, while 1 measure decreased (Table 2). Telehealth was associated with a relative 10.7 percentage point (95% CI 6.3-15.0; P<.001) increase in rates of annual retinal exams and a relative rate increase of 1.5 (95% CI 1.2-1.8; P<.001) in the number of visits among patients with diabetes, although overall visit rates fell in both groups during COVID-19. Telehealth was further associated with a 5.6 percentage point decrease (95% CI 9.7-1.5; P=.008) in the HEDIS blood pressure control measure and with no statistical change in the blood glucose control measure (P=.97).

Table 1. Baseline characteristics of patients with diabetes served at high vs low telehealth federally qualified health centers (FQHCs).
CharacteristicsaFull sample (N=11,503 person-months, representing 1417 unique persons)High telehealthb (n=8196 person-months, representing 1022 unique persons)Low telehealthc (n=3307 person-months, representing 395 unique persons)Standardized difference




Before propensity weightingAfter propensity weighting
Age (years), mean (SD)48.1 (11.4)48.1 (11.5)48.2 (11.1)–0.0755–0.0093
Sex (female), n (%)6474 (56.3)4823 (58.8)1651 (49.9)0.08890.0026
Race/ethnicityd, n (%)

White, non-Hispanic3142 (27.3)2337 (28.4)805 (24.2)0.1153–0.0025

Black, non-Hispanic1235 (10.7)763 (9.4)472 (14.4)–0.4141–0.0018

Hispanic6139 (53.4)4219 (51.6)1920 (58.3)0.13420.0010

Other or multirace987 (8.6)877 (10.6)110 (3.2)0.09360.0023
Primary languagee, n (%)

English6447 (56.0)4421 (54.0)2026 (61.3)0.01390.0114

Spanish3954 (34.4)2769 (33.8)1186 (35.9)0.0799–0.0016

Other1103 (9.6)1006 (12.2)97 (2.9)–0.0851–0.0074
CDPSf risk score, mean (SD)3.65 (2.28)3.56 (2.27)3.90 (2.32)0.10830.0054
Clinical diagnoses, n (%)

Hypertension6557 (57.0)4513 (55.1)2044 (61.9)–0.11150.0024

Hyperlipidemia4039 (35.1)3192 (38.8)847 (25.4)0.0644–0.0106

Overweight or obese6626 (57.6)4789 (58.4)1836 (55.5)0.1284–0.0118

Morbidly obese2401 (20.9)1855 (22.6)546 (16.4)0.21410.0013

Asthma2388 (20.8)1591 (19.4)797 (24.2)0.11340.0031

COPDg1186 (10.3)905 (11.0)281 (8.5)0.12540.0057

Tobacco use3070 (26.7)2192 (26.7)878 (26.6)0.09360.0153

Alcohol use disorder1042 (9.1)629 (7.7)414 (12.6)–0.0205–0.0092

Major depression4896 (42.6)3853 (46.9)1043 (31.3)0.2817–0.0048

Other depression746 (6.5)603 (7.3)143 (4.3)0.0843–0.0032

Anxiety3901 (33.9)2976 (36.2)925 (27.9)0.2245–0.0026

aBaseline characteristics shown reflect characteristics in the unweighted sample. After applying inverse probability of treatment weights based on propensity scores, standardized differences between high vs low telehealth FQHCs for all 16 characteristics were less than 10%—a common threshold denoting negligible imbalance between groups.

bHigh telehealth includes patients at FQHCs where ≥50% of all visits to the FQHCs in the postperiod were delivered via telehealth (mean 67.6%), where telehealth includes real-time video and audio-only visits.

cLow telehealth includes patients at FQHCs where <50% of all visits to the FQHCs in the postperiod were delivered via telehealth (mean 36.7%), where telehealth includes real-time video and audio-only visits.

dRace/ethnicity of known (n=1983 person-months, 17.2% unknown race/ethnicity in full sample; n=1297 person-months, 15.9% unknown in high telehealth; and n=686 person-months, 20.8% unknown in low telehealth).

eLanguage of known (n=224, 2% unknown in full sample; n=196, 2.4% unknown in high telehealth; and n=28, 0.9% unknown in low telehealth).

fCDPS: Chronic Illness and Disability Payment System.

gCOPD: chronic obstructive pulmonary disease.

Table 2. Association between federally qualified health center (FQHC)–level telehealth use and quality of care and visit volume among patients with diabetes.
OutcomeaHigh telehealthbLow telehealthcAdjusted coefficientd, DIDe (95% CI)P value

PrePostPrePost

Annual retinal exam, %59.2255.0969.3752.6110.7 (6.29 to 15.0)<.001
Blood pressure controlf, %81.0653.0678.2054.69–5.57 (–9.67 to –1.47).008
Blood glucose controlg, %67.3351.5463.2647.66–0.07 (–4.45 to 4.30).97
Number of visitsh0.920.462.440.721.48 (1.24 to 1.77)<.001

aFor all outcomes, 11503 person-months, representing 1417 unique patients. Sample sizes and analyses exclude the first 6 months of the postperiod due to the rolling, look-back nature of Healthcare Effectiveness Data and Information Set (HEDIS) measure calculation. For all outcomes, we tested the parallel trends assumption by interacting linear months with treatment status in the preperiod. No differential preperiod trends were detected (P>.05 for all).

bHigh telehealth includes patients at FQHCs where ≥50% of all visits to the FQHCs in the postperiod were delivered via telehealth (mean 67.6%), where telehealth includes real-time video and audio-only visits.

cLow telehealth includes patients at FQHCs where <50% of all visits to the FQHCs in the postperiod were delivered via telehealth (mean 36.7%), where telehealth includes real-time video and audio-only visits.

dCoefficients for HEDIS quality measures are from linear probability models, where coefficients are reported on an absolute percentage point scale; values >0 indicate that telehealth was associated with an increase in the measure. The coefficient for the number of visits is from a negative binomial model, where the coefficient is reported as a relative incidence rate ratio; values >1 indicate that telehealth was associated with an increase in the measure.

eDID: difference-in-differences.

fBlood pressure control indicates that a patient had a measurement documented within the last 12 months and a most recent result of <140/90 mmHg.

gBlood glucose control indicates that a patient had a measurement documented within the last 12 months and a most recent result ≤9.0%.

hThe number of visits is measured as the mean number of FQHC visits per patient per month.


This study indicates that high FQHC-level telehealth use was associated with more sustained engagement in care for patients with diabetes at FQHCs in Massachusetts, with mixed effects on quality of care measures. Telehealth availability likely helped to partially mitigate the overall decrease in visit rates during COVID-19 by improving care access, while telehealth visits may have also provided the opportunity to encourage patients to return for in-person retinal screenings [7]. In contrast, decreases in measured blood pressure control may have resulted from the lack of standardized blood pressure documentation in EHRs during telehealth visits rather than poor control, although this was untestable in our data. While these findings fill an important evidence gap by focusing on Medicaid-enrolled FQHC patients, they are largely consistent with previous literature showing the potential for telehealth to improve access and some quality of care–sensitive outcomes in diabetic populations [8-10].

The results have important implications. First, telehealth has the potential to improve some measured quality, which suggests that incorporating telehealth into care delivery models and supporting telehealth sustainability through telehealth reimbursement may benefit patients with diabetes. Second, providers must simultaneously consider how to best adapt quality measures and underlying data reporting to ensure that quality-reliant payment models validly capture the quality of care under new delivery modalities, as measures such as blood pressure control may not be validly captured during telehealth encounters.

This research is not without limitations. Limitations include potential measurement error in the data, unmeasured confounding due to simultaneous implementation of telehealth and other service capacity changes during COVID-19, lack of subgroup analyses that explore heterogeneity in effects, and FQHC-level assignment of exposure. Nonetheless, based on this study, Medicaid reimbursement policies and care delivery models that support the use of telehealth as part of chronic disease care may be associated with better care engagement for low-income patients with diabetes.

Acknowledgments

The authors acknowledge their health system partner, Community Care Cooperative, for ongoing study input and interpretation, and for providing access to all data. The authors further acknowledge analytics vendor Arcadia for extracting requested data from the Electronic Data Warehouse.

This research was funded by the Donaghue Foundation, Greater Value Portfolio, grant ID not applicable (principal investigators: MBC and JHK) and by the Robert Wood Johnson Foundation, Research to Advance Models of Care for Medicaid-Eligible Populations, grant ID 78235, (principal investigators: MBC and JHK).

Funders had no role in the design and conduct of the study; collection, management, analysis, and interpretation of the data; preparation, review, or approval of the manuscript; or decision to submit the manuscript for publication.

An earlier version of this work was presented by MBC at the June 2022 AcademyHealth Annual Research Meeting and the June 2022 American Society for Health Economists Annual Meeting.

Data Availability

Data used for these analyses are governed by a data use agreement with Community Care Cooperative and all of its affiliated federally qualified health centers. Per the data use agreement, data are restricted and cannot be shared with outside parties. For further information regarding data availability, you may reach out to MBC at mbcole@bu.edu.

Authors' Contributions

MBC and JHK developed the concept and design. All authors contributed to the acquisition, analysis, or interpretation of data. MBC drafted the manuscript. All authors critically revised the manuscript for important intellectual content. MBC performed the statistical analysis. MBC and JHK obtained the funding. MBC, NJ, and EKL provided administrative, technical, or material support.

MBC had full access to all the data in the study and takes responsibility for the integrity of the data and the accuracy of the data analysis.

Conflicts of Interest

MBC discloses receiving research grant funding from the National Institutes of Health (National Center Advancing Translational Sciences, National Institute on Minority Health and Health Disparities, National Institute of Mental Health), the Agency for Healthcare Research and Quality, Health Resources and Services Administration, the Smith Family Foundation, the Klarman Family Foundation, the Peterson Foundation, and the Society of Family Planning—none of which relate to the contents of this manuscript. The authors have no other conflicts of interest to report.

  1. Eberle C, Stichling S. Clinical improvements by telemedicine interventions managing type 1 and type 2 diabetes: systematic meta-review. J Med Internet Res 2021 Feb 19;23(2):e23244 [FREE Full text] [CrossRef] [Medline]
  2. Dhediya R, Chadha M, Bhattacharya AD, Godbole S, Godbole S. Role of telemedicine in diabetes management. J Diabetes Sci Technol 2022 Feb 28:19322968221081133. [CrossRef] [Medline]
  3. Zhang A, Wang J, Wan X, Zhang Z, Zhao S, Guo Z, et al. A meta-analysis of the effectiveness of telemedicine in glycemic management among patients with type 2 diabetes in primary care. Int J Environ Res Public Health 2022 Mar 31;19(7):4173 [FREE Full text] [CrossRef] [Medline]
  4. Cantor J, Chakravarty S, Farnham J, Nova J, Ahmad S, Flory J. Impact of a provider tele-mentoring learning model on the care of medicaid-enrolled patients with diabetes. Med Care 2022 Jul 01;60(7):481-487 [FREE Full text] [CrossRef] [Medline]
  5. Health Center Program Uniform Data System (UDS) data overview. Health Resources & Services Administration. 2020.   URL: https://data.hrsa.gov/tools/data-reporting/program-data [accessed 2022-02-19]
  6. FQHC Telehealth Consortium. 2021.   URL: https://fqhctelehealth.org/ [accessed 2022-03-04]
  7. Ramsey DJ, Lasalle CC, Anjum S, Marx JL, Roh S. Telehealth encourages patients with diabetes in racial and ethnic minority groups to return for in-person ophthalmic care during the COVID-19 pandemic. Clin Ophthalmol 2022;16:2157-2166 [FREE Full text] [CrossRef] [Medline]
  8. Patel SY, McCoy RG, Barnett ML, Shah ND, Mehrotra A. Diabetes care and glycemic control during the COVID-19 pandemic in the United States. JAMA Intern Med 2021 Oct 01;181(10):1412-1414 [FREE Full text] [CrossRef] [Medline]
  9. Sacre JW, Holmes-Truscott E, Salim A, Anstey KJ, Drummond GR, Huxley RR, et al. Impact of the COVID-19 pandemic and lockdown restrictions on psychosocial and behavioural outcomes among Australian adults with type 2 diabetes: Findings from the PREDICT cohort study. Diabet Med 2021 Sep;38(9):e14611 [FREE Full text] [CrossRef] [Medline]
  10. Woodhouse AG, Orvin C, Rich C, Crosby J, Keedy CA. Diabetes outcomes before and during telehealth advancements surrounding COVID-19. J Am Pharm Assoc (2003) 2022;62(1):214-217 [FREE Full text] [CrossRef] [Medline]


ACO: accountable care organization
C3: Community Care Cooperative
EHR: electronic health record
FQHC: federally qualified health center
HEDIS: Healthcare Effectiveness Data and Information Set


Edited by A Mavragani; submitted 06.07.22; peer-reviewed by S Sarejloo, SJC Soerensen , F Petrazzuoli; comments to author 30.11.22; revised version received 20.01.23; accepted 31.01.23; published 02.03.23

Copyright

©Megan B Cole, Nicholas Jones, Eun Kyung Lee, June-Ho Kim. Originally published in the Journal of Medical Internet Research (https://www.jmir.org), 02.03.2023.

This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on https://www.jmir.org/, as well as this copyright and license information must be included.