This paper is in the following e-collection/theme issue:

Digital Health Reviews (1724) mHealth for Screening (296) Symptom Checkers (42) mHealth for Symptom and Disease Monitoring, Chronic Disease Management (1732)

Published on in Vol 25 (2023)

This is a member publication of Imperial College London (Jisc)

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/43803, first published .
Triage and Diagnostic Accuracy of Online Symptom Checkers: Systematic Review

Triage and Diagnostic Accuracy of Online Symptom Checkers: Systematic Review

Triage and Diagnostic Accuracy of Online Symptom Checkers: Systematic Review

Authors of this article:

Eva Riboli-Sasco1 Author Orcid Image ;   Austen El-Osta1 Author Orcid Image ;   Aos Alaa1 Author Orcid Image ;   Iman Webber1 Author Orcid Image ;   Manisha Karki1 Author Orcid Image ;   Marie Line El Asmar1 Author Orcid Image ;   Katie Purohit1 Author Orcid Image ;   Annabelle Painter1 Author Orcid Image ;   Benedict Hayhoe1 Author Orcid Image
Article Authors Cited by (35) Tweetations (7) Metrics

Journals

  1. Kuroiwa T, Sarcon A, Ibara T, Yamada E, Yamamoto A, Tsukamoto K, Fujita K. The Potential of ChatGPT as a Self-Diagnostic Tool in Common Orthopedic Diseases: Exploratory Study. Journal of Medical Internet Research 2023;25:e47621 View
  2. Sellin J, Pantel J, Börsch N, Conrad R, Mücke M. Kurze Wege zur Diagnose mit künstlicher Intelligenz – systematische Literaturrecherche zu „diagnostic decision support systems“. Der Schmerz 2024;38(1):19 View
  3. Fukuzawa F, Yanagita Y, Yokokawa D, Uchida S, Yamashita S, Li Y, Shikino K, Tsukamoto T, Noda K, Uehara T, Ikusaka M. Importance of Patient History in Artificial Intelligence–Assisted Medical Diagnosis: Comparison Study. JMIR Medical Education 2024;10:e52674 View
  4. Biln N, Bansback N, Shojania K, Puil L, Harrison M. A scoping review of triage approaches for the referral of patients with suspected inflammatory arthritis, from primary to rheumatology care. Rheumatology International 2024;44(11):2279 View
  5. Meczner A, Cohen N, Qureshi A, Reza M, Sutaria S, Blount E, Bagyura Z, Malak T. Controlling Inputter Variability in Vignette Studies Assessing Web-Based Symptom Checkers: Evaluation of Current Practice and Recommendations for Isolated Accuracy Metrics. JMIR Formative Research 2024;8:e49907 View
  6. Hammoud M, Douglas S, Darmach M, Alawneh S, Sanyal S, Kanbour Y. Evaluating the Diagnostic Performance of Symptom Checkers: Clinical Vignette Study. JMIR AI 2024;3:e46875 View
  7. Andreadis K, Newman D, Twan C, Shunk A, Mann D, Stevens E. Mixed methods assessment of the influence of demographics on medical advice of ChatGPT. Journal of the American Medical Informatics Association 2024;31(9):2002 View
  8. Augusto Duenhas Accorsi T, Tocci Moreira F, Aires Eduardo A, Albaladejo Morbeck R, Francine Köhler K, De Amicis Lima K, Henrique Sartorato Pedrotti C. Outcome After Self-Triage App Referral in Urgent Direct-to-Consumer Telemedicine Encounter. Telemedicine and e-Health 2024;30(8):2142 View
  9. Meer A, Rahm P, Schwendinger M, Vock M, Grunder B, Demurtas J, Rutishauser J. A Symptom-Checker for Adult Patients Visiting an Interdisciplinary Emergency Care Center and the Safety of Patient Self-Triage: Real-Life Prospective Evaluation. Journal of Medical Internet Research 2024;26:e58157 View
  10. Liu V, Kaila M, Koskela T. Triage Accuracy and the Safety of User-Initiated Symptom Assessment With an Electronic Symptom Checker in a Real-Life Setting: Instrument Validation Study. JMIR Human Factors 2024;11:e55099 View
  11. Knitza J, Tascilar K, Fuchs F, Mohn J, Kuhn S, Bohr D, Muehlensiepen F, Bergmann C, Labinsky H, Morf H, Araujo E, Englbrecht M, Vorbrüggen W, von der Decken C, Kleinert S, Ramming A, Distler J, Bartz-Bazzanella P, Vuillerme N, Schett G, Welcker M, Hueber A. Diagnostic Accuracy of a Mobile AI-Based Symptom Checker and a Web-Based Self-Referral Tool in Rheumatology: Multicenter Randomized Controlled Trial. Journal of Medical Internet Research 2024;26:e55542 View
  12. Kopka M, Feufel M. Software symptomcheckR: an R package for analyzing and visualizing symptom checker triage performance. BMC Digital Health 2024;2(1) View
  13. Viswanathan V, Jain V, Vaish A, Jeyaraman M, Iyengar K, Vaishya R. Chatbots and Their Applications in Medical Fields: Current Status and Future Trends: A Scoping Review. Apollo Medicine 2024;21(4):386 View
  14. Cresswell K, de Keizer N, Magrabi F, Williams R, Rigby M, Prgomet M, Kukhareva P, Wong Z, Scott P, Craven C, Georgiou A, Medlock S, Brender McNair J, Ammenwerth E. Evaluating Artificial Intelligence in Clinical Settings—Let Us Not Reinvent the Wheel. Journal of Medical Internet Research 2024;26:e46407 View
  15. Gellert G, Galvão P, Gomes S, Carvalho D, Price T, Kabat-Karabon A, Gellert G, Orzechowski P. Impact of Integrated Virtual and Live Nurse Triage on Patient Care Seeking and Health Care Delivery Effectiveness and Efficiency. Telemedicine Reports 2024;5(1):330 View
  16. Kopka M, Napierala H, Privoznik M, Sapunova D, Zhang S, Feufel M. The RepVig framework for designing use-case specific representative vignettes and evaluating triage accuracy of laypeople and symptom assessment applications. Scientific Reports 2024;14(1) View
  17. Sellin J, Pantel J, Börsch N, Conrad R, Mücke M. Kurze Wege zur Diagnose mit künstlicher Intelligenz – systematische Literaturrecherche zu „diagnostic decision support systems“. Zeitschrift für Pneumologie 2025;22(2):78 View
  18. Kopka M, von Kalckreuth N, Feufel M. Accuracy of online symptom assessment applications, large language models, and laypeople for self–triage decisions. npj Digital Medicine 2025;8(1) View
  19. Schmieding M, Kopka M, Bolanaki M, Napierala H, Altendorf M, Kuschick D, Piper S, Scatturin L, Schmidt K, Schorr C, Thissen A, Wäscher C, Heintze C, Möckel M, Balzer F, Slagman A. Impact of a Symptom Checker App on Patient-Physician Interaction Among Self-Referred Walk-In Patients in the Emergency Department: Multicenter, Parallel-Group, Randomized, Controlled Trial. Journal of Medical Internet Research 2025;27:e64028 View
  20. Chorna V, Zimbovskyi Y, Hryshchenko А, Ivashkevych Y, Gumeniuk N, Anhelska V, Poliarush V, Sydorchuk T. Determining the awareness of SESU employees in providing medical care at the scene and assessing their psychological state. Reports of Vinnytsia National Medical University 2025;29(1):128 View
  21. Curry E, Miller N, North F, Thompson M, Pecina J. Congruency of Symptom Choice Between Patients Performing Online Self-Triage and Nurse Phone Triage. Telemedicine and e-Health 2025;31(9):1127 View
  22. Mentzou A, Rogers A, Carvalho E, Daly A, Malone M, Kerasidou X. Artificial Intelligence in Digital Self-Diagnosis Tools: A Narrative Overview of Reviews. Mayo Clinic Proceedings: Digital Health 2025;3(3):100242 View
  23. Masayoshi K, Hashimoto M, Toda N, Mori H, Kobayashi G, Haque H, So M, Jinzaki M. Training Language Models for Estimating Priority Levels in Ultrasound Examination Waitlists: Algorithm Development and Validation. JMIR AI 2025;4:e68020 View
  24. Oslislo S, Witt K, Bayeff-Filloff M, Herdtle S, Carnarius S, von Stillfried D, Holder M, Pfeiffer C. DispoDigital: Studienprotokoll zur digitalen Steuerung weniger dringlicher Notaufnahmepatienten mittels Symptom-Checker und Terminvermittlung. Notfall + Rettungsmedizin 2025;28(7):540 View
  25. El-Osta A, Riboli-Sasco E, Al Ammouri M, Altalib S, Luisa Neves A, Majeed A, Hayhoe B. Factors Influencing the Use of Online Symptom Checkers in the United Kingdom: Cross-Sectional Study. JMIR Formative Research 2025;9:e65314 View
  26. Ilicki J, Edman S, Stalfors J, Molin C. Evaluating digital triage symptom checker with historical triage-related adverse events. Scandinavian Journal of Primary Health Care 2025:1 View
  27. Haskell H, Giardina T, Dolka I, McDonald K. Ten years on: how far have we come in patient engagement in diagnosis?. Diagnosis 2025;12(4):538 View
  28. Sutaria S, Devakumar D, Mallinson P, Kinra S, Malak T, Meczner A. Evaluating the use of red flags by online symptom checkers. BMC Health Services Research 2025;25(1) View
  29. Pecina J, Curry E, Miller N, Thompson M, North F. To Choose or Not to Choose: Patients with Chest Pain Often Do Not Choose to Triage for Chest Pain During Online Self-Triage. Health Services Insights 2025;18 View
  30. Krüger D, Legg D, Jouhoff D, Eienbröker L, Köhne N, Neumann K, Möckel M, Slagman A. Evaluation of the accuracy, safety, utility and feasibility of using an urgency self-assessment application in self-referred patients in the emergency department: study protocol for a prospective, multicenter cohort trial. Trials 2025;26(1) View
  31. Accorsi T, Moreira F, Eduardo A, Morbeck R, Köhler K, De Amicis Lima K, Pedrotti C. Patient Navigation Behavior in a Symptom-Based Self-Triage Mobile App for Direct-to-Consumer Urgent Care: Retrospective Observational Study. Journal of Medical Internet Research 2025;27:e63816 View
  32. Litchfield I, Delanerolle G, Harper L, Dunning S. Understanding Acceptability of AI Triage Tools Amongst Underserved Populations: Lessons From the Early Phases of Co‐Production With Bangladeshi Communities in Birmingham, UK. Health Expectations 2025;28(6) View

Books/Policy Documents

  1. Demurtas J, Crescitelli M, Meer A, Laranjo L, Oyugi J, Kirk U, Huibers L. Remote Consultation in Primary Care. View

Conference Proceedings

  1. Koulache C, Fleming B. SPE International Health, Safety, Environment and Sustainability Conference and Exhibition. The Benefits of Nurse Telemedicine Triage: A Case Study from North America View
  2. Doughan Z, Hammoud R, Ghalayini M, Darweesh D, Chehade O, Itani S. 2025 Eighth International Conference on Advances in Biomedical Engineering (ICABME). Machine Learning Driven Symptoms Diagnosis System View