This paper is in the following e-collection/theme issue:

Artificial Intelligence (1747) Generative Language Models Including ChatGPT (501) Decision Support for Health Professionals (1342) Clinical Communication, Electronic Consultation and Telehealth (682) Ethics, Privacy, and Legal Issues (551) Chatbots and Conversational Agents (635) Natural Language Processing (803)

Published on in Vol 26 (2024)

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/54571, first published .
Assessing Generative Pretrained Transformers (GPT) in Clinical Decision-Making: Comparative Analysis of GPT-3.5 and GPT-4

Assessing Generative Pretrained Transformers (GPT) in Clinical Decision-Making: Comparative Analysis of GPT-3.5 and GPT-4

Assessing Generative Pretrained Transformers (GPT) in Clinical Decision-Making: Comparative Analysis of GPT-3.5 and GPT-4

Authors of this article:

Adi Lahat1, 2 Author Orcid Image ;   Kassem Sharif1, 3 Author Orcid Image ;   Narmin Zoabi1 Author Orcid Image ;   Yonatan Shneor Patt3 Author Orcid Image ;   Yousra Sharif4 Author Orcid Image ;   Lior Fisher3 Author Orcid Image ;   Uria Shani3 Author Orcid Image ;   Mohamad Arow3 Author Orcid Image ;   Roni Levin3 Author Orcid Image ;   Eyal Klang5 Author Orcid Image
Article Authors Cited by (18) Tweetations Metrics

Journals

  1. Zhao B, Liu H, Liu Q, Qi W, Zhang W, Du J, Jin Y, Weng X. Breaking Boundaries in Spinal Surgery: GPT-4's Quest to Revolutionize Surgical Site Infection Management. The Journal of Infectious Diseases 2025;231(2):e345 View
  2. Brin D, Sorin V, Konen E, Nadkarni G, Glicksberg B, Klang E. How GPT models perform on the United States medical licensing examination: a systematic review. Discover Applied Sciences 2024;6(10) View
  3. Le K, Chen J, Mai D, Le K. An Evaluation on the Potential of Large Language Models for Use in Trauma Triage. Emergency Care and Medicine 2024;1(4):350 View
  4. Azeroual O. Can generative AI transform data quality? a critical discussion of ChatGPT’s capabilities. Academia Engineering 2024;1(4) View
  5. Camlet A, Kusiak A, Świetlik D. Application of Conversational AI Models in Decision Making for Clinical Periodontology: Analysis and Predictive Modeling. AI 2025;6(1):3 View
  6. Janumpally R, Nanua S, Ngo A, Youens K. Generative artificial intelligence in graduate medical education. Frontiers in Medicine 2025;11 View
  7. Öztürk Z, Bal C, Çelikkaya B. Evaluation of Information Provided by ChatGPT Versions on Traumatic Dental Injuries for Dental Students and Professionals. Dental Traumatology 2025 View
  8. Erdat E, Kavak E. Benchmarking LLM chatbots’ oncological knowledge with the Turkish Society of Medical Oncology’s annual board examination questions. BMC Cancer 2025;25(1) View
  9. Waaler P, Hussain M, Molchanov I, Bongo L, Elvevåg B. Prompt Engineering an Informational Chatbot for Education on Mental Health Using a Multiagent Approach for Enhanced Compliance With Prompt Instructions: Algorithm Development and Validation. JMIR AI 2025;4:e69820 View
  10. Çalışkan E. Exploring possibilities and limits of ChatGPT: Usage in building design studies. Turkish Journal of Engineering 2025;9(3):490 View
  11. Demir S. Comparison of ChatGPT-4o, Google Gemini 1.5 Pro, Microsoft Copilot Pro, and Ophthalmologists in the management of uveitis and ocular inflammation: A comparative study of large language models. Journal Français d'Ophtalmologie 2025;48(4):104468 View
  12. Coen E, Del Fiol G, Kaphingst K, Borsato E, Shannon J, Stevens Smith H, Masino A, Allen C. Chatbot for the Return of Positive Genetic Screening Results for Hereditary Cancer Syndromes: A Prompt Engineering Project (Preprint). JMIR Cancer 2024 View
  13. Liu J, Segal K, Daher M, Ozolin J, Binder W, Bergen M, McDonald C, Owens B, Antoci V. Artificial intelligence versus orthopedic surgeons as an orthopedic consultant in the emergency department. Injury 2025;56(4):112297 View
  14. Meyer N, Meyer J. A Practical Guide to the Utilization of ChatGPT in the Emergency Department: A Systematic Review of Current Applications, Future Directions, and Limitations. Cureus 2025 View
  15. Saglam S, Uludag V, Karaduman Z, Arıcan M, Yücel M, Dalaslan R. Comparative evaluation of artificial intelligence models GPT-4 and GPT-3.5 in clinical decision-making in sports surgery and physiotherapy: a cross-sectional study. BMC Medical Informatics and Decision Making 2025;25(1) View
  16. Yang X, Xiao Y, Liu D, Deng H, Huang J, Zhou Y, Dai C, Wu J, Liu D, Liang M, Xu C. Cross language transformation of free text into structured lobectomy surgical records from a multi center study. Scientific Reports 2025;15(1) View
  17. Chen R, Zhang S, Zheng Y, Yu Q, Wang C. Enhancing treatment decision-making for low back pain: a novel framework integrating large language models with retrieval-augmented generation technology. Frontiers in Medicine 2025;12 View

Books/Policy Documents

  1. Dehankar P, Das S. Exploration of Transformative Technologies in Healthcare 6.0. View