This paper is in the following e-collection/theme issue:

Generative Language Models Including ChatGPT (708) Decision Support for Health Professionals (1539) Natural Language Processing (917) Clinical Information and Decision Making (1915) Formative Evaluation of Digital Health Interventions (3229) mHealth for Diagnosis (81)

Published on in Vol 26 (2024)

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/56110, first published .
ChatGPT With GPT-4 Outperforms Emergency Department Physicians in Diagnostic Accuracy: Retrospective Analysis

ChatGPT With GPT-4 Outperforms Emergency Department Physicians in Diagnostic Accuracy: Retrospective Analysis

ChatGPT With GPT-4 Outperforms Emergency Department Physicians in Diagnostic Accuracy: Retrospective Analysis

Authors of this article:

John Michael Hoppe1 Author Orcid Image ;   Matthias K Auer1 Author Orcid Image ;   Anna Strüven2, 3 Author Orcid Image ;   Steffen Massberg2, 3 Author Orcid Image ;   Christopher Stremmel2, 3 Author Orcid Image
Article Authors Cited by (32) Tweetations (6) Metrics

Journals

  1. Armbruster J, Bussmann F, Rothhaas C, Titze N, Grützner P, Freischmidt H. “Doctor ChatGPT, Can You Help Me?” The Patient’s Perspective: Cross-Sectional Study. Journal of Medical Internet Research 2024;26:e58831 View
  2. Le K, Chen J, Mai D, Le K. An Evaluation on the Potential of Large Language Models for Use in Trauma Triage. Emergency Care and Medicine 2024;1(4):350 View
  3. Leon M, Ruaengsri C, Pelletier G, Bethencourt D, Shibata M, Flores M, Shudo Y. Harnessing the Power of ChatGPT in Cardiovascular Medicine: Innovations, Challenges, and Future Directions. Journal of Clinical Medicine 2024;13(21):6543 View
  4. Wals Zurita A, Miras del Rio H, Ugarte Ruiz de Aguirre N, Nebrera Navarro C, Rubio Jimenez M, Muñoz Carmona D, Miguez Sanchez C. The Transformative Potential of Large Language Models in Mining Electronic Health Records Data: Content Analysis. JMIR Medical Informatics 2025;13:e58457 View
  5. Shool S, Adimi S, Saboori Amleshi R, Bitaraf E, Golpira R, Tara M. A systematic review of large language model (LLM) evaluations in clinical medicine. BMC Medical Informatics and Decision Making 2025;25(1) View
  6. Liu J, Segal K, Daher M, Ozolin J, Binder W, Bergen M, McDonald C, Owens B, Antoci V. Artificial intelligence versus orthopedic surgeons as an orthopedic consultant in the emergency department. Injury 2025;56(4):112297 View
  7. Wang J, Shue K, Liu L, Hu G. Preliminary evaluation of ChatGPT model iterations in emergency department diagnostics. Scientific Reports 2025;15(1) View
  8. Meyer N, Meyer J. A Practical Guide to the Utilization of ChatGPT in the Emergency Department: A Systematic Review of Current Applications, Future Directions, and Limitations. Cureus 2025 View
  9. Zakirah A, Saniasiaya J. Parental Perception on Usage of AI Chatbot to Understand Paediatric Otorhinolaryngology Condition: A Survey. Indian Journal of Otolaryngology and Head & Neck Surgery 2025;77(5):2078 View
  10. Berikol G, Kanbakan A, Ilhan B, Doğanay F. Mapping artificial intelligence models in emergency medicine: A scoping review on artificial intelligence performance in emergency care and education. Turkish Journal of Emergency Medicine 2025;25(2):67 View
  11. Essis M, Hartman H, Tung W, Oh I, Peden S, Gianakos A. Comparison of ChatGPT's Diagnostic and Management Accuracy of Foot and Ankle Bone–Related Pathologies to Orthopaedic Surgeons. Journal of the American Academy of Orthopaedic Surgeons 2025;33(16):e949 View
  12. Luo X, Tham Y, Giuffrè M, Ranisch R, Daher M, Lam K, Eriksen A, Hsu C, Ozaki A, Moraes F, Khanna S, Su K, Begagić E, Bian Z, Chen Y, Estill J. Reporting guideline for the use of Generative Artificial intelligence tools in MEdical Research: the GAMER Statement. BMJ Evidence-Based Medicine 2025;30(6):390 View
  13. Su H, Sun Y, Li R, Zhang A, Yang Y, Xiao F, Duan Z, Chen J, Hu Q, Yang T, Xu B, Zhang Q, Zhao J, Li Y, Li H. Large Language Models in Medical Diagnostics: Scoping Review With Bibliometric Analysis. Journal of Medical Internet Research 2025;27:e72062 View
  14. Wang Z, Zhou H, Song T. A bibliometric analysis of large language model-based AI chatbots in surgery. Annals of Medicine & Surgery 2025;87(7):4127 View
  15. Kuas C, Canakci M, Acar N, Kanbakan A, Cetin M, Gunsoy E. The Potential and Pitfalls of ChatGPT in Toxicological Emergencies. The Journal of Emergency Medicine 2025;76:17 View
  16. Hoppe J, Kellnar A, Esser D, Diegruber K, Stremmel C. Artificial intelligence in coronary angiography: benchmarking the diagnostic accuracy of ChatGPT-4o against interventional cardiologists. Open Heart 2025;12(2):e003316 View
  17. Lee N, Richards N, Grandominico J, Cronin R, Hendricks A, Tripathi R, Jonas D. Use of a Medical Communication Framework to Assess the Quality of Generative Artificial Intelligence Replies to Primary Care Patient Portal Messages: Content Analysis. JMIR Formative Research 2025;9:e71966 View
  18. Gün M. Can AI match emergency physicians in managing common emergency cases? A comparative performance evaluation. BMC Emergency Medicine 2025;25(1) View
  19. Kular S, Kumar V. Artificial Intelligence Chatbots in Pediatric Emergencies: A Reliable Lifeline or a Risk?. Cureus 2025 View
  20. Yang X, Chen W. The performance of ChatGPT on medical image-based assessments and implications for medical education. BMC Medical Education 2025;25(1) View
  21. Villarreal J, Suh E, Forrester J, Jopling J, Dumas R. Current State of Artificial Intelligence and Trauma Video Review: Insights for Trauma Resuscitation. Current Trauma Reports 2025;11(1) View
  22. Liu Z, Ai Q, Yeung A, Tanaka R, Nalley A, Hung K. Performance of a Vision-Language Model in Detecting Common Dental Conditions on Panoramic Radiographs Using Different Tooth Numbering Systems. Diagnostics 2025;15(18):2315 View
  23. Gorenshtein A, Fistel S, Sorka M, Telman G, Winer R, Peretz S, Aran D, Shelly S. AI Based Clinical Decision-Making Tool for Neurologists in the Emergency Department. Journal of Clinical Medicine 2025;14(17):6333 View
  24. Liu Y, Zhang Y. ChatGPT as a clinical support tool: A comprehensive review of applications, assessment, and implementation challenges. Physiotherapy Practice and Research 2025 View
  25. Yıldırım C, Aykut A, Günsoy E, Öncül M. Evaluating GPT-4o for emergency disposition of complex respiratory cases with pulmonology consultation: a diagnostic accuracy study. Scandinavian Journal of Trauma, Resuscitation and Emergency Medicine 2025;33(1) View
  26. Jarrett P, Hill J, Howell M, Grabow Moore K, Thoppil J, Vargas Ortiz L, Parnell S, Courtney D, McDonald S, Diercks D, Jamieson A, Cao D. Piloting Temperature-Driven Variability in Emergency Diagnostic Accuracy Using a Leading Large Language Model. Cureus 2025 View
  27. Chen G, Lin C, Zhang L, Luo Z, Shin Y, Li X. Virtual case reasoning and AI-assisted diagnostic instruction: an empirical study based on body interact and large language models. BMC Medical Education 2025;25(1) View
  28. Kosiba B, Brzozowska A, Lipińska M, Konieczny M. Ethical challenges of artificial intelligence (AI) in medicine. Analysis on selected examples. Journal of Modern Science 2025;63(3):658 View
  29. Zand J, Miao J, Hommos M, Schwartz G, Taler S, Nejat P, Cheungpasitporn W, Garovic V, Zoghby Z. Performance of Large Language Models in Analyzing Common Hypertension Scenarios. Hypertension 2025 View
  30. Banskota B, Bhusal R, Yadav P, Banskota A. Artificial intelligence in orthopaedic education, training and research: a systematic review. BMC Medical Education 2025;25(1) View
  31. Wong A, Roberts M, Pantangco M, Arnold A, Philp A, Šlapeta J, Livingstone S. When used for veterinary triage, artificial intelligence models recognise emergencies but are more likely than veterinary staff to flag non‐urgent cases as urgent. Veterinary Record 2025 View

Books/Policy Documents

  1. Mukisa R, Matovu R. Intelligent Computing. View