Published on in Vol 27 (2025)

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/80794, first published .
Engagement With Text Messaging Improves Cardiovascular Medication Adherence: Secondary Analysis of a Randomized Controlled Trial

Engagement With Text Messaging Improves Cardiovascular Medication Adherence: Secondary Analysis of a Randomized Controlled Trial

Engagement With Text Messaging Improves Cardiovascular Medication Adherence: Secondary Analysis of a Randomized Controlled Trial

1College of Natural Sciences and Mathematics, University of Denver, Denver, CO, United States

2Institute for Health Research, Kaiser Permanente Colorado, 16601 East Centretech Parkway, Aurora, CO, United States

3Clinical Assessment, Reporting, and Tracking Program, Office of Quality and Patient Safety, Veterans Health Administration, Washington, DC, United States

4Clinic Chat LLC, Denver, CO, United States

5Division of Cardiology, School of Medicine, University of Colorado Anschutz Medical Campus, Aurora, CO, United States

6Department of Family Medicine, School of Medicine, University of Colorado Anschutz Medical Campus, Aurora, CO, United States

7Department of Clinical Pharmacy, Skaggs School of Pharmacy and Pharmaceutical Sciences, University of Colorado Anschutz Medical Campus, Aurora, CO, United States

8Adult and Child Center for Outcomes Research and Delivery Science (ACCORDS), School of Medicine, University of Colorado Anschutz Medical Campus, Aurora, CO, United States

Corresponding Author:

Rachel Zucker, MPH




Medication nonadherence remains a significant barrier to the optimal management of chronic cardiovascular diseases, leading to increased morbidity and health care costs [1]. Digital interventions, particularly text-based nudges, are potential strategies for enhancing medication adherence [2-5]. The Nudge study (NCT 03973931) compared the effectiveness of three different text-based interventions versus usual care to improve medication adherence among patients with documented medication refill gaps (time between medication supply end and the next refill) [6]. There was no difference in adherence (assessed by proportion of days covered [PDC]) at 12 months between any of the intervention groups and usual care [6].

While the main Nudge study results were null [6], prior studies suggest patient engagement in mHealth interventions is critical to their success [2,7,8]. We conducted this secondary analysis to assess whether greater engagement with the text messaging interventions was associated with improved medication adherence at 12 months. We hypothesized that patients who replied to study texts would have higher medication adherence defined by a shorter gap length between medication refills and higher refill adherence.


Ethical Considerations

The study was deemed minimal risk, and a waiver of consent was obtained from the Colorado Multiple Institutional Review Board (18‐2779). A deidentified dataset was used for the current analyses. Patients were not compensated to participate in the study.

Study Overview

Details of the main Nudge study have been previously described, including the inclusion and exclusion criteria [1]. For secondary analyses, we restricted the cohort to patients randomized to text messaging arms in the study. During the intervention period, patients receiving study texts could respond: (1) “STOP” to opt-out of the study; (2) “DONE” if medication had been refilled; (3) numeric response in reply to a chatbot question; or (4) free text response. We categorized patient engagement into four mutually exclusive groups: (1) “Opt-out Response” for “STOP;” (2) “Other Response” for any non‐standard, free text reply (“Multimedia Appendix 1); (3) “Standard Response” for standard replies like “DONE” or a numeric response; and (4) “No response” for patients who did not reply to any messages.

Differences between groups were tested using ANOVA for continuous variables and multiple degree of freedom chi-squared tests for categorical variables (Table 1). Adjusted PDC differences between responders and nonresponders were estimated using a Generalized Estimating Equation model with an identity link and independent covariance, adjusting for the treatment arm and relevant patient characteristics (Table 1). The median unadjusted gap lengths (calculated as the number of days from the end of medication supply to the subsequent refill) with interquartile ranges were calculated for initial enrollment gaps using Kaplan-Meier estimates. Unadjusted gap lengths and the 1-year PDC by response status were reported along with adjusted estimates of differences in PDC relative to those without a response. Analyses were performed using R software (version 4.4.1; R Foundation for Statistical Computing), with α=.05.

Table 1. Patient demographics, clinical characteristics and study assignment across response groups.
VariableCounts of type of responseP value
No (n=3686)Opt-out (n=456)Other (n=843)Standard (n=1963)
Study arm, n (%)<.001
  Generic1395 (38)155 (34)233 (28)541 (28)
  Behavioral1184 (32)139 (30)251 (30)731 (37)
 Behavioral + Chatbot1107 (30)162 (36)359 (42)691 (35)
Health care system, n (%)<.001
  Denver Health3083 (84)277 (61)668 (79)1314 (67)
  UCHealth290 (8)100 (22)53 (6)261 (13)
 Veterans Affairs313 (8)79 (17)122 (15)388 (20)
Demographics
  Age, mean (SD)59.9 (12.9)62.9 (13.2)59.5 (11.2)59.9 (12.7)<.001
  Female, (n) %1732 (47)189 (41)413 (49)929 (47).07
  Race, n (%).01
  American Indian or Alaska Native37 (1)5 (1)12 (1)18 (1)
  Asian50 (1)1 (1)7 (1)23 (1)
  Black or African American636 (17)47 (10)137 (16)305 (16)
  Native Hawaiian/Pacific Islander7 (1)0 (0)0 (0)4 (1)
  White2522 (68)362 (79)579 (69)1339 (70)
  Multiple20 (1)4 (1)6 (1)10 (1)
  Unknown414 (11)37 (8)102 (12)204 (10)
  Ethnicity, n (%)<.001
  Hispanic1904 (51)0150 (33)470 (56)891 (45)
  Non-Hispanic1759 (48)302 (66)367 (43)1051 (54)
  Unknown23 (1)4 (1)6 (1)21 (1)
Spanish speaking, n (%)1033 (28)70 (15)335 (4)513 (26)<.001
  Marital status, n (%)<.001
  Married1430 (38)200 (44)375 (44)909 (46)
  Single1545 (42)156 (34)288 (34)647 (33)
  Divorced/Widowed693 (19)97 (21)177 (21)383 (20)
  Unknown18 (1)3 (1)3 (1)24 (1)
  Insurance, n (%)<.001
  Medicare1446 (39)213 (47)274 (32)658 (33)
  Medicaid1141 (31)90 (20)212 (25)477 (24)
  Commercial649 (17)75 (16)239 (28)471 (24)
 Veterans Affairs9 (1)3 (1)1 (1)10 (1)
  None299 (8)36 (8)87 (10)209 (11)
  Unknown142 (4)39 (8)30 (4)138 (7)
  At least 1 interactive voice response
 message, n (%)
273 (7)57 (12)17 (2)269 (14)<.001
Qualifying condition(s)a, n (%)
  Atrial fibrillation206 (6)41 (9)40 (5)127 (6).01
 Coronary artery disease537 (15)80 (18)93 (11)272 (14).01
  Diabetes mellitus1883 (51)229 (50)438 (52)924 (47).02
 Hyperlipidemia1634 (44)246 (54)382 (45)951 (48)<.001
 Hypertension2922 (79)367 (8)657 (78)1541 (79).65
Medical history, n (%)
 Congestive heart failure298 (8)39 (9)52 (6)133 (7).10
 Chronic kidney disease355 (10)39 (9)61 (7)141 (7).01
 Cardiovascular disease244 (7)32 (7)40 (5)96 (5).02
  Depression675 (18)88 (19)164 (19)399 (20).32
  Prior myocardial infarction185 (5)23 (5)34 (4)83 (4).43
  Prior revascularization100 (3)21 (5)22 (3)46 (2).07
 Posttraumatic stress disorder144 (4)26 (6)47 (6)117 (6)<.01
  Substance abuse170 (5)21 (5)39 (5)76 (4).61
Baseline medication class, % (n)
  Active class.04
  1917 (25)97 (21)192 (23)522 (26)
  2876 (24)115 (25)210 (25)586 (26)
  3+1893 (51)244 (54)441 (52)935 (48)
  Study class<.001
  12467 (67)345 (76)588 (70)1433 (73)
  2770 (21)70 (15)167 (20)361 (18)
  3+449 (12)41 (9)88 (10)169 (9)

aThis number exceeds 100% due to the fact that one patient can have more than one qualifying condition(s) for this study.


A total of 9501 patients were enrolled; 9269 had complete follow-up data (the CONSORT diagram has been published previously [6]). After excluding 2321 usual care patients, we analyzed 6948 individuals; 3262 (46.9%) responded to an intervention message. Among the 3262 responders, 456 (14%) opted out, 843 (25.8%) provided other responses and 1963 (60.2%) provided standard responses. Patients who engaged with the messages, particularly standard responders, differed significantly from nonresponders, with engagement more likely among those in certain health care systems or on fewer medications (Table 1).

Patients who engaged with the texts, regardless of response type, had a shorter gap length compared to patients who did not respond. In addition, patients who responded to any messages had a higher adherence at 12 months, which persisted after the adjustment for demographics and clinical characteristics (Table 2).

Table 2. Initial gap length and 1-year medication adherence (proportion of days covered; PDC) by patient response type.
Patient response typeUnadjustedAdjusted
Initial gap length in days, median (IQR)1-year PDCDifference in PDC95% CIP value
Response
  No response (Ref)16 (1-109)55.9a
  Any response7 (1-29)7115.213.7-16.8<.001
Sub-groups (Ref: No response)
  Opt-out8 (1-41)67.59.66.1-13.1<.001
  Other7 (1-32)7014.512.2-16.7<.001
  Standard7 (1-25)72.116.614.9-18.4<.001

anot applicable.


This secondary analysis assessed the association between engagement and medication adherence in a text messaging clinical trial. We enrolled a diverse patient population including a large proportion of Hispanic and Spanish-speaking patients as well as patients who are traditionally medically underserved (ie, receiving care at federally qualified health centers and veterans affairs centers). Overall, 47% of intervention arm patients engaged with texts. Any engagement was associated with shorter medication gap lengths, and higher medication adherence at 12 months. While our participants included diverse and traditionally underserved patients, these findings may not be generalizable to patients without access to or comfort with text messaging, who would have been ineligible for the parent trial.

Another potential limitation lies in our response classification criteria. Patients who submitted nonstandard responses were placed exclusively in the “Other Response” group, which may conflate ambiguous interactions with more meaningful engagement. Furthermore, we cannot determine causality between engagement and adherence given this post-hoc analysis.

Our findings are consistent with prior literature highlighting the importance of patient engagement in mHealth interventions to improve adherence and self-management [2-5]. Collectively, these findings suggest that patient engagement is a strong marker for, and is closely associated with, higher medication adherence.

Acknowledgments

This work received logistical and technical support from the NIH Pragmatic Trials Collaboratory Coordinating Center through cooperative agreement U24AT009676 from the National Center for Complementary and Integrative Health (NCCIH), National Institute of Allergy and Infectious Diseases (NIAID), National Cancer Institute (NCI), National Institute on Aging (NIA), National Heart, Lung, and Blood Institute (NHLBI), National Institute of Nursing Research (NINR), National Institute of Minority Health and Health Disparities (NIMHD), National Institute of Arthritis and Musculoskeletal and Skin Diseases (NIAMS), NIH Office of Behavioral and Social Sciences Research (OBSSR), and NIH Office of Disease Prevention (ODP). The content is solely the responsibility of the authors and does not necessarily represent the official views of the NHLBI or the NCCIH, NIAID, NCI, NIA, NINR, NIMHD, NIAMS, OBSSR, or ODP, or the NIH. No generative AI was used in any portion of the manuscript generation.

Funding

This work was supported within the National Institutes of Health (NIH) Pragmatic Trials Collaboratory by cooperative agreement UG3HL168504 from the National Heart, Lung, and Blood Institute (NHLBI).

Data Availability

The datasets generated or analyzed during this study are available from the corresponding author on reasonable request.

Authors' Contributions

Conceptualization: SB, MH, LA, JS, KT and PP

Data curation: TG

Formal analysis: TG

Funding acquisition: SB and MH

Methodology: SB, MH, LA, JS, KT and PP

Project administration: JW

Writing – original draft: RSP and RZ

Writing – review & editing: SB, MH, LA, JS, KT, PP, and JW

Conflicts of Interest

SB is the President and a Co-Founder of Clinic Chat, LLC, the company that developed and deployed the AI Chatbot described in this article.

Multimedia Appendix 1

Examples of text message responses from participants classified as "Other Response."

XLSX File, 17 KB

  1. Glasgow RE, Knoepke CE, Magid D, et al. The NUDGE trial pragmatic trial to enhance cardiovascular medication adherence: study protocol for a randomized controlled trial. Trials. Aug 11, 2021;22(1):528. [CrossRef] [Medline]
  2. Horne BD, Muhlestein JB, Lappé DL, et al. Behavioral nudges as patient decision support for medication adherence: the ENCOURAGE randomized controlled trial. Am Heart J. Feb 2022;244:125-134. [CrossRef] [Medline]
  3. Miao Y, Luo Y, Zhao Y, Liu M, Wang H, Wu Y. Effectiveness of eHealth interventions in improving medication adherence among patients with cardiovascular disease: systematic review and meta-analysis. J Med Internet Res. Jul 15, 2024;26:e58013. [CrossRef] [Medline]
  4. Calderon Martinez E, Zachariah Saji S, Salazar Ore JV, et al. Text messages as a tool to improve cardiovascular disease risk factors control: a systematic review and meta-analysis of randomized clinical trials. BMC Public Health. Apr 4, 2025;25(1):1284. [CrossRef] [Medline]
  5. Qi Y, Mohamad E, Azlan AA, Zhang C, Ma Y, Wu A. Digital health solutions for cardiovascular disease prevention: systematic review. J Med Internet Res. Jan 23, 2025;27:e64981. [CrossRef] [Medline]
  6. Ho PM, Glorioso TJ, Allen LA, et al. Personalized patient data and behavioral nudges to improve adherence to chronic cardiovascular medications: a randomized pragmatic trial. JAMA. Jan 7, 2025;333(1):49-59. [CrossRef] [Medline]
  7. Waughtal J, Glorioso TJ, Sandy LM, et al. Patient engagement with prescription refill text reminders across time and major societal events. Cardiovasc Digit Health J. Aug 2023;4(4):133-136. [CrossRef] [Medline]
  8. Waughtal J, Luong P, Sandy L, Chavez C, Ho PM, Bull S. Nudge me: tailoring text messages for prescription adherence through N-of-1 interviews. Transl Behav Med. Oct 23, 2021;11(10):1832-1838. [CrossRef] [Medline]


PDC: proportion of days covered


Edited by Andrew Coristine; submitted 16.Jul.2025; peer-reviewed by Odumbo Oluwole, Rebecca Omachonu; final revised version received 24.Oct.2025; accepted 24.Oct.2025; published 24.Nov.2025.

Copyright

© Rowan Shore-Plavec, Rachel Zucker, Thomas J Glorioso, Sheana Bull, Larry A Allen, Joseph J Saseen, Katy E Trinkley, Pamela Peterson, Joy Waughtal, P Michael Ho. Originally published in the Journal of Medical Internet Research (https://www.jmir.org), 24.Nov.2025.

This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research (ISSN 1438-8871), is properly cited. The complete bibliographic information, a link to the original publication on https://www.jmir.org/, as well as this copyright and license information must be included.