Published on in Vol 26 (2024)

This is a member publication of Open University

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/43894, first published .
Investigating How the Use of Technology Can Reduce Missed Appointments: Quantitative Case Study at a General Practitioner Surgery

Investigating How the Use of Technology Can Reduce Missed Appointments: Quantitative Case Study at a General Practitioner Surgery

Investigating How the Use of Technology Can Reduce Missed Appointments: Quantitative Case Study at a General Practitioner Surgery

Authors of this article:

Teresa Sides1, 2 Author Orcid Image ;   Dhouha Kbaier1 Author Orcid Image

Short Paper

1The Open University, Milton Keynes, United Kingdom

2Glyndwr University, Wrexham, United Kingdom

*all authors contributed equally

Corresponding Author:

Teresa Sides, BSc, MSc

The Open University

Walton Hall

Kents Hill

Milton Keynes, MK7 6AA

United Kingdom

Phone: 44 0300 303 5303

Email: Teresa.Sides@open.ac.uk


Background: SMS texting systems have been considered a potential solution to reduce missed appointments in primary care. Existing research in this area focuses on qualitative studies investigating the attitudes of SMS text users and receivers.

Objective: This study aimed to examine appointment data from an independent general practitioner (GP) surgery in Wrexham, United Kingdom, with approximately 15,000 patients, to determine the impact of text messaging systems on reducing missed appointments. The objective of this study was to investigate whether the use of text messages can effectively reduce missed appointments.

Methods: To collect data for the study, SQL reports were run on EMIS Web, the United Kingdom’s most widely used clinical system. The data spanned 10 years, from September 1, 2010, to March 31, 2020. Data accuracy was verified by cross-referencing with appointment diary records. Mann-Whitney and Kruskal-Wallis tests, chosen for their suitability in comparing groups in nonparametric settings, were conducted in Microsoft Excel due to its accessibility.

Results: Statistical analyses were conducted to compare data before and after implementation of the text messaging system. The results revealed a significant 42.8% reduction in missed appointments (before: 5848; after: 3343; P<.001). Further analysis of demographic characteristics revealed interesting trends, with no significant difference in missed appointments between genders, and variations observed across different age groups. The median number of missed appointments was not significantly different between genders (women: 1.55, IQR 1.11-2.16; men: 1.61, IQR 1.08-2.12; P=.73). Despite the prevalence of mobile phone use among young adults aged 20-25 years, the highest rates of missed appointments (848/7256, 11.7%) were noted in this group, whereas the lowest rates were noted in the 75-80 years age group (377/7256; 5.2%; P<.001). Analysis by age and gender indicated inconsistencies: women aged 20-25 years (571/4216) and men aged 35-40 years (306/3040) had the highest rates of missed appointments, whereas women aged 70-75 years (177/4216) and men aged 75-80 years (129/3040) had the lowest rates (P<.001 for both).

Conclusions: This study demonstrates that SMS text messaging in primary care can significantly reduce missed appointments. Implementing technology such as SMS text messaging systems enables patients to cancel appointments on time, leading to improved efficiency in primary care settings.

J Med Internet Res 2024;26:e43894

doi:10.2196/43894

Keywords



In recent years, primary care has adopted SMS text messaging systems for patient communication, yet their efficacy in achieving positive outcomes remains unknown. For general practitioner (GP) practices, the National Health Service (NHS) sets annual targets that determine their funding. Since 2019, in addition to clinical outcomes, there has been a shift toward enhancing accessibility and appointment availability [1].

The widespread use of mobile phones in daily lives across all age groups [2] has facilitated the development of cost-effective, bulk text messaging systems for businesses [3]. Text messages are universally compatible and accessible across various network speeds, and do not require upgrades [4]. While bulk text messaging has been widely explored in business, its applications and potential impact within health care remain underexplored, which is the focus of this study.

Numerous scholarly articles have delved into the perspectives of patients about text message reminders [5-7]. Sherman et al [8] found that while text messages were deemed useful, patients wanted the option to reply to the messages. Maslakpak and Safaie [9] compared treatment compliance between groups receiving text messages, reminder cards, or no reminders; they found no significant difference between reminder cards and text messages.

Hirst et al [10] reported that patients received a postal reminder with or without a text reminder (generated by the iPlato texting system [11] integrated with EMIS Web [12]). They reported a slight improvement in screening uptake from 39.9% to 40.5%, but the difference was not statistically significant.

In a study involving 18,138 participants, Fisher et al [13] evaluated the effectiveness and utility of text messages in health care, noting that text messages increased appointment attendance and patient satisfaction. However, nonrandom sampling may compromise validity. Since participants volunteered, their willingness to engage might influence appointment attendance, potentially introducing bias to the results.

Research on GPs using text messaging systems primarily investigates patient preferences for receiving texts and doctors’ willingness to send them [14]. The literature predominantly discusses the advantages and disadvantages of such systems from the GP standpoint, rather than assessing their impact on patient appointment attendance. Trials evaluating text reminder systems have yielded mixed results, with no significant overall improvement in attendance rates [5,6]. Even trials with substantial cohorts exhibited only a modest 0.6% attendance increase, suggesting limited benefits of using text reminders [13].

This study adds to the expanding knowledge base in the field and offers insights into implementing effective appointment management strategies in primary care.


Overview

This study analyzed missed appointment data from an independent GP practice in Wrexham, United Kingdom, spanning a decade (September 1, 2010, to March 31, 2020). Data were gathered from EMIS web, and the iPlato texting system was implemented on September 15, 2015. iPlato messages contained standard appointment information and allowed patients to respond or cancel the appointment. Before iPlato, patients often relied on appointment cards or memory. Approximately 74% of appointments were associated with a mobile number.

Data included adults aged 18-79 years, excluding children due to parental responsibility for missed appointments and older adults aged 80 years and above due to frailty or care home residence. Nurse data were not integrated into the system until September 2015, so only missed GP appointments were analyzed.

Missed appointments data over a decade were gathered using SQL reports to compare 5 years before and after text reminders were implemented. The collected figures were cross-referenced with appointment diary records to ensure accuracy.

Mann-Whitney and Kruskal-Wallis tests were used for quantitative analysis due to their suitability for nonparametric comparisons [15,16]. Mann-Whitney test, known for its efficiency and robustness [17], was used to assess gender categories, and Kruskal-Wallis test was applied across various age groups due to its suitability for comparing more than 2 groups.

Ethics Approval

The Open University Human Research Ethics Committee approved this project (HREC/4180/Sides).


This study aimed to analyze missed appointment frequencies and demographic characteristics of patients who missed appointments. Of the 572,794 appointments booked, 9191 were missed, with 5286 (57.5%) attributed to women and 3905 (42.5%) to men (Table 1).

Mann-Whitney test results (Table 2) indicated higher rates of missed appointments before text messaging was implemented compared to after implementation, suggesting that text messaging can be an effective strategy for reducing missed appointments, particularly among women.

To assess the data more accurately, missed appointment rates were calculated for each age group (Figure 1). Significant differences in median missed appointment numbers across different age groups were observed (Table 3). The 20-25 years age group had the highest median number of missed appointments, whereas the 65-80 years age group had the lowest. Further information and statistical data are available in Multimedia Appendix 1.

Data analysis showed that text message reminders reduced missed appointments at the GP practice. Missed appointment frequency decreased before text messaging was introduced in September 2015 (Figure 2). Then, shortly after text messaging implementation, it increased, followed by a further decline to the lowest level noted in 10 years. Several factors may have contributed to this trend, including increased attention and improved data recording practices. Despite this factor, texting resulted in a statistically significant decrease in nonattendance at appointments (Table 1). These findings demonstrate the effectiveness of text messaging in reducing missed appointments.

Table 1. Population and gender descriptive statistics before and after text messaging implementation (N=9191 missed appointments).
Study PopulationMissed appointments, n (%)Reduction in missed appointments (%)

Before text messaging implementationAfter text messaging implementation
Total population5848 (63.6)3343 (36.3)42.8

Women3435 (37.4)1851 (20.1)46.1

Men2413 (26.3)1492 (16.2)38.2
Table 2. Mann-Whitney test results (N=9191 missed appointments; 5286 by women and 3905 by men).
Patient population and frequency of missed appointmentsBefore text messaging implementation, median (IQR)After text messaging implementation, median (IQR)Uaz scoreP value
Total population

Quarterly1.8 (1.4-2.5)1.1 (0.9-1.6)743.1.002

Monthly1.9 (1.5-2.7)1.2 (0.8-1.6)7195.2<.001
Women

Quarterly1.9 (1.5-2.3)1.1 (0.8-1.5)723.2.002

Monthly1.9 (1.5-2.5)1.2 (0.7-1.6)6945.3<.001
Men

Quarterly1.8 (1.4-2.1)1.1 (1.0-1.5)802.9.003

Monthly1.9 (1.5-2.5)1.3 (1.0-1.7)8334.6<.001

aMann-Whitney U (Wilcoxon) statistic.

Figure 1. Missed appointment frequency across 5-year age groups.
Table 3. Statistical results for missed appointments across 5-year age ranges (N=7256 missed appointments; 4216 by women and 3040 by men).
Study population and age range (years)

Patients, n (%)rMean (SD)s2Median (IQR)
Total population

20-25848 (11.7)1.03.2 (1.5)2.42.6 (1.9-4.5)

25-30832 (11.5)0.92.7 (1.3)1.82.2 (1.8-3.8)

30-35665 (9.2)0.72.2 (1)1.01.9 (1.5-2.6)

35-40628 (8.7)1.02.3 (1)1.02.3 (1.5-3)

40-45734 (10.1)0.92.4 (0.9)0.92.1 (1.8-2.8)

45-50690 (9.5)1.02.0 (0.9)0.92.1 (1.3-2.5)

50-55603 (8.3)0.91.6 (0.6)0.41.5 (1.3-2)

55-60564 (7.8)0.71.4 (0.6)0.41.4 (0.9-1.7)

60-65554 (7.6)0.61.3 (0.6)0.41.4 (0.7-1.8)

65-70403 (5.6)0.90.9 (0.5)0.20.9 (0.6-1.2)

70-75358 (4.9)0.90.9 (0.4)0.20.9 (0.5-1.2)

75-80377 (5.2)0.10.9 (0.4)0.20.9 (0.6-1.3)
Women

20-25571 (13.5)1.03.3 (1.6)2.92.8 (2-4.9)

25-30570 (13.5)0.92.7 (1.3)22.3 (1.8-3.6)

30-35416 (9.9)0.82.2 (0.9)0.91.9 (1.6-2.4)

35-40322 (7.6)0.82 (0.9)0.81.8 (1.4-2.5)

40-45401 (9.5)0.92.5 (1.5)2.52 (1.4-3.5)

45-50406 (9.6)0.72 (0.9)12.3 (1.5-2.5)

50-55334 (7.9)0.81.5 (0.6)0.41.5 (1-2)

55-60300 (7.1)0.81.2 (0.6)0.41.3 (0.7-1.7)

60-65258 (6.1)0.31 (0.5)0.31.1 (0.7-1.3)

65-70213 (5.1)0.90.9 (0.5)0.30.9 (0.4-1.2)

70-75177 (4.2)0.90.8 (0.4)0.20.9 (0.5-1)

75-80248 (5.8)0.21.3 (1.2)1.51.1 (0.7-1.3)
Men

20-25277 (9.1)0.73 (1.3)1.92.5 (2-3.8)

25-30262 (8.6)0.92.7 (1.3)1.82.4 (1.7-3.7)

30-35249 (8.2)0.52.3 (1.1)1.21.7 (1.5-2.9)

35-40306 (10.1)0.92.8 (1.2)1.72.6 (1.5-3.8)

40-45333 (11)0.52.5 (0.7)0.62.4 (2.1-2.7)

45-50284 (9.3)0.81.9 (1)1.11.9 (1.2-2.5)

50-55269 (8.8)0.91.8 (0.6)0.41.8 (1.4-2.1)

55-60264 (8.7)0.71.5 (0.7)0.51.4 (1-2.1)

60-65296 (9.7)0.91.4 (0.7)0.51.7 (0.7-1.9)

65-70190 (6.3)0.90.9 (0.4)0.10.8 (0.7-1)

70-75181 (6)0.90.9 (0.5)0.30.9 (0.6-1.2)

75-80129 (4.2)0.40.8 (0.3)0.10.8 (0.6-1.1)
Figure 2. Missed appointment frequency by gender (with trend lines) before and after implementation of the SMS text messaging system.

This study explores the impact of SMS text messaging systems on reducing missed appointments in primary care, focusing on a single GP practice. While a significant 42.8% decrease in missed appointments was noted after implementation of text messaging reminders, caution is warranted in generalizing these results to broader health care settings. This 42.8% reduction is significant when compared with the findings of Maslakpak and Safaie [9] who found no significant difference.

Age group analysis revealed interesting findings regarding missed appointments. Surprisingly, the 20-25 age group emerged as significant overall, with a higher percentage of missed appointments, contrary to expectations given their high mobile phone use. De-Sola et al [18] observed increased phone use for the 16-25 years age group. However, despite prolific phone usage, the 20-25 years age group patients did not exhibit reduced missed appointments. These findings highlight the positive impact of text reminder systems on missed appointments overall, yet further exploration is needed to understand factors influencing attendance in specific demographics.

In conclusion, text messaging reminders can effectively reduce missed appointments, enabling more GP consultations. However, it is unlikely that missed appointments can be completely avoided. Health care technology offers opportunities for further improvement, including timely text reminders and systematic patient data maintenance. By embracing technology in health care, we can overcome challenges, maximize appointment availability, and enhance patient care.

Acknowledgments

We thank Prof Dr Vic Grout and Bindu Jose (BEng) for their valuable suggestions.

Data Availability

All data generated or analyzed during this study are included in Multimedia Appendix 1.

Conflicts of Interest

None declared.

Multimedia Appendix 1

Study data and Mann-Whitney and Kruskal-Wallis test results.

XLSX File (Microsoft Excel File), 205 KB

  1. NHS. NHS Long Term Plan. 2019. URL: https://www.longtermplan.nhs.uk [accessed 2022-05-22]
  2. Plateauing at the peak. Deloitte. URL: https:/​/www2.​deloitte.com/​content/​dam/​Deloitte/​uk/​Documents/​technology-media-telecommunications/​deloitte-uk-plateauing-at-the-peak-the-state-of-the-smartphone.​pdf [accessed 2024-07-15]
  3. Cheng C, Brown CR, Venugopalan J, Wang MD. Towards an effective patient health engagement system using cloud-based text messaging technology. IEEE J Transl Eng Health Med. 2020;8:1-7. [CrossRef]
  4. Siang BK, Ramli AR, Prakash V, Bin Syed Mohamed SAR. SMS gateway interface remote monitoring and controlling via GSM SMS. In: NCTT 2003 Proceedings. 2003. Presented at: 4th National Conference of Telecommunication Technology; Jan 14-15, 2023:84-87; Shah Alam, Malaysia. [CrossRef]
  5. Liu JX, Modrek S. Evaluation of SMS reminder messages for altering treatment adherence and health seeking perceptions among malaria care-seekers in Nigeria. Health Policy Plan. Dec 16, 2016;31(10):1374-1383. [FREE Full text] [CrossRef] [Medline]
  6. Domek GJ, Contreras-Roldan IL, O'Leary ST, Bull S, Furniss A, Kempe A, et al. SMS text message reminders to improve infant vaccination coverage in Guatemala: a pilot randomized controlled trial. Vaccine. May 05, 2016;34(21):2437-2443. [FREE Full text] [CrossRef] [Medline]
  7. Owolabi EO, Goon DT, Ajayi AI. Impact of mobile phone text messaging intervention on adherence among patients with diabetes in a rural setting: A randomized controlled trial. Medicine (Baltimore). Mar 2020;99(12):e18953. [FREE Full text] [CrossRef] [Medline]
  8. Sherman E, Clauson KA, Elrod S, Eckardt P, Alkhateeb F, Jacobs R. Patient perceptions of text messaging to improve antiretroviral therapy adherence: a qualitative study of patients in a Ryan White Clinic. J Int Assoc Provid AIDS Care. 2018;17:2325958218759209. [FREE Full text] [CrossRef] [Medline]
  9. Maslakpak MH, Safaie M. A comparison between the effectiveness of short message service and reminder cards regarding medication adherence in patients with hypertension: a randomized controlled clinical trial. Int J Community Based Nurs Midwifery. Jul 2016;4(3):209-218. [FREE Full text] [Medline]
  10. Hirst Y, Kerrison R, Kobayashi LC, Counsell N, Djedovic N, Ruwende J, et al. Text reminders in colorectal cancer screening (TRICCS): protocol for a randomised controlled trial. BMC Public Health. Jan 25, 2016;16(1):74. [FREE Full text] [CrossRef] [Medline]
  11. iPlato. URL: https://www.iplato.com/ [accessed 2024-07-15]
  12. EMIS Web. URL: https://www.emishealth.com/products/emis-web [accessed 2024-07-15]
  13. Fischer HH, Moore SL, Johnson TL, Everhart RM, Batal H, Davidsoni AJ. Appointment reminders by text message in a safety net health care system: a pragmatic investigation. EGEMS (Wash DC). Sep 04, 2017;5(1):20. [FREE Full text] [CrossRef] [Medline]
  14. Leahy D, Lyons A, Dahm M, Quinlan D, Bradley C. Use of text messaging in general practice: a mixed methods investigation on GPs’ and patients’ views. Br J Gen Pract. Sep 25, 2017;67(664):e744-e750. [CrossRef]
  15. Mann HB, Whitney DR. On a test of whether one of two random variables is stochastically larger than the other. Ann Math Statist. Mar 1947;18(1):50-60. [CrossRef]
  16. Fay MP, Malinovsky Y. Confidence intervals of the Mann-Whitney parameter that are compatible with the Wilcoxon-Mann-Whitney test. Stat Med. Nov 30, 2018;37(27):3991-4006. [FREE Full text] [CrossRef] [Medline]
  17. Kruskal WH, Wallis WA. Use of ranks in one-criterion variance analysis. J Am Stat Assoc. Dec 1952;47(260):583-621. [CrossRef]
  18. de-Sola J, Talledo H, Rodríguez de Fonseca F, Rubio G. Prevalence of problematic cell phone use in an adult population in Spain as assessed by the Mobile Phone Problem Use Scale (MPPUS). PLoS One. Aug 3, 2017;12(8):e0181184. [FREE Full text] [CrossRef] [Medline]


GP: general practitioner
NHS: National Health Service


Edited by T Leung, A Mavragani; submitted 28.10.22; peer-reviewed by M Blanker, A Fosse, A Singleton; comments to author 09.03.23; revised version received 23.06.23; accepted 30.05.24; published 29.07.24.

Copyright

©Teresa Sides, Dhouha Kbaier. Originally published in the Journal of Medical Internet Research (https://www.jmir.org), 29.07.2024.

This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research (ISSN 1438-8871), is properly cited. The complete bibliographic information, a link to the original publication on https://www.jmir.org/, as well as this copyright and license information must be included.