This paper is in the following e-collection/theme issue:

Chatbots and Conversational Agents (458) Artificial Intelligence (1186) Clinical Information and Decision Making (1314) Clinical Informatics (904) Generative Language Models Including ChatGPT (201)

Published on in Vol 25 (2023)

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/47479, first published .
Reliability of Medical Information Provided by ChatGPT: Assessment Against Clinical Guidelines and Patient Information Quality Instrument

Reliability of Medical Information Provided by ChatGPT: Assessment Against Clinical Guidelines and Patient Information Quality Instrument

Reliability of Medical Information Provided by ChatGPT: Assessment Against Clinical Guidelines and Patient Information Quality Instrument

Authors of this article:

Harriet Louise Walker1 Author Orcid Image ;   Shahi Ghani1 Author Orcid Image ;   Christoph Kuemmerli2 Author Orcid Image ;   Christian Andreas Nebiker3 Author Orcid Image ;   Beat Peter Müller2 Author Orcid Image ;   Dimitri Aristotle Raptis4 Author Orcid Image ;   Sebastian Manuel Staubli1, 2 Author Orcid Image
Article Authors Cited by (54) Tweetations (21) Metrics

Journals

  1. Levkovich I, Elyoseph Z. Suicide Risk Assessments Through the Eyes of ChatGPT-3.5 Versus ChatGPT-4: Vignette Study. JMIR Mental Health 2023;10:e51232 View
  2. ALİMEN N. Makine çevirisinden sohbet robotu çevirisine: ChatGPT ile deneysel bir çalışma. RumeliDE Dil ve Edebiyat Araştırmaları Dergisi 2023;(36):1532 View
  3. Hu J, Liu F, Chu C, Chang Y. Health Care Trainees’ and Professionals’ Perceptions of ChatGPT in Improving Medical Knowledge Training: Rapid Survey Study. Journal of Medical Internet Research 2023;25:e49385 View
  4. Abuyaman O. Strengths and Weaknesses of ChatGPT Models for Scientific Writing About Medical Vitamin B12: Mixed Methods Study. JMIR Formative Research 2023;7:e49459 View
  5. Mese I, Taslicay C, Sivrioglu A. Improving radiology workflow using ChatGPT and artificial intelligence. Clinical Imaging 2023;103:109993 View
  6. Orlando N, Qiu C, ElNemer W, Tuffaha S. Google Trends Analysis of Peripheral Nerve Disease and Surgery. World Neurosurgery 2023;180:e135 View
  7. Gao Z, Li L, Ma S, Wang Q, Hemphill L, Xu R. Examining the Potential of ChatGPT on Biomedical Information Retrieval: Fact-Checking Drug-Disease Associations. Annals of Biomedical Engineering 2023 View
  8. Singh A, Das S, Mishra R, Agrawal A. Artificial intelligence and machine learning in healthcare: Scope and opportunities to use ChatGPT. Journal of Neurosciences in Rural Practice 2023;14:391 View
  9. Barrington N, Gupta N, Musmar B, Doyle D, Panico N, Godbole N, Reardon T, D’Amico R. A Bibliometric Analysis of the Rise of ChatGPT in Medical Research. Medical Sciences 2023;11(3):61 View
  10. Ayre J, Mac O, McCaffery K, McKay B, Liu M, Shi Y, Rezwan A, Dunn A. New Frontiers in Health Literacy: Using ChatGPT to Simplify Health Information for People in the Community. Journal of General Internal Medicine 2024;39(4):573 View
  11. Mondal H, Dash I, Mondal S, Behera J. ChatGPT in Answering Queries Related to Lifestyle-Related Diseases and Disorders. Cureus 2023 View
  12. Hernandez C, Vazquez Gonzalez A, Polianovskaia A, Amoro Sanchez R, Muyolema Arce V, Mustafa A, Vypritskaya E, Perez Gutierrez O, Bashir M, Eighaei Sedeh A. The Future of Patient Education: AI-Driven Guide for Type 2 Diabetes. Cureus 2023 View
  13. Scquizzato T, Semeraro F, Swindell P, Simpson R, Angelini M, Gazzato A, Sajjad U, Bignami E, Landoni G, Keeble T, Mion M. Testing ChatGPT ability to answer laypeople questions about cardiac arrest and cardiopulmonary resuscitation. Resuscitation 2024;194:110077 View
  14. Mohammad‐Rahimi H, Ourang S, Pourhoseingholi M, Dianat O, Dummer P, Nosrat A. Validity and reliability of artificial intelligence chatbots as public sources of information on endodontics. International Endodontic Journal 2024;57(3):305 View
  15. Yurdakurban E, Topsakal K, Duran G. A comparative analysis of AI-based chatbots: Assessing data quality in orthognathic surgery related patient information. Journal of Stomatology, Oral and Maxillofacial Surgery 2024;125(5):101757 View
  16. Feng R, Zhang C, Zhang Y. Large language models for biomolecular analysis: From methods to applications. TrAC Trends in Analytical Chemistry 2024;171:117540 View
  17. Blease C, Worthen A, Torous J. Psychiatrists’ experiences and opinions of generative artificial intelligence in mental healthcare: An online mixed methods survey. Psychiatry Research 2024;333:115724 View
  18. Patel H, Zanos T, Hewitt D. Deep Learning Applications in Pancreatic Cancer. Cancers 2024;16(2):436 View
  19. Yang J, Ardavanis K, Slack K, Fernando N, Della Valle C, Hernandez N. Chat Generative Pretrained Transformer (ChatGPT) and Bard: Artificial Intelligence Does not yet Provide Clinically Supported Answers for Hip and Knee Osteoarthritis. The Journal of Arthroplasty 2024;39(5):1184 View
  20. Jin X, Frock A, Nagaraja S, Wallqvist A, Reifman J. AI algorithm for personalized resource allocation and treatment of hemorrhage casualties. Frontiers in Physiology 2024;15 View
  21. Sallam M, Barakat M, Sallam M. A Preliminary Checklist (METRICS) to Standardize the Design and Reporting of Studies on Generative Artificial Intelligence–Based Models in Health Care Education and Practice: Development Study Involving a Literature Review. Interactive Journal of Medical Research 2024;13:e54704 View
  22. Dyckhoff-Shen S, Koedel U, Brouwer M, Bodilsen J, Klein M. ChatGPT fails challenging the recent ESCMID brain abscess guideline. Journal of Neurology 2024;271(4):2086 View
  23. Mohammad-Rahimi H, Khoury Z, Alamdari M, Rokhshad R, Motie P, Parsa A, Tavares T, Sciubba J, Price J, Sultan A. Performance of AI chatbots on controversial topics in oral medicine, pathology, and radiology. Oral Surgery, Oral Medicine, Oral Pathology and Oral Radiology 2024;137(5):508 View
  24. Kumar S, Rao P, Singhania S, Verma S, Kheterpal M. Will artificial intelligence drive the advancements in higher education? A tri-phased exploration. Technological Forecasting and Social Change 2024;201:123258 View
  25. McMahon H, McMahon B. Automating untruths: ChatGPT, self-managed medication abortion, and the threat of misinformation in a post-Roe world. Frontiers in Digital Health 2024;6 View
  26. Eleiwa T, Elhusseiny A. Re: Kianian et al.: Enhancing the assessment of large language models in medical information generation (Ophthalmol Retina. 2024;8:195-201). Ophthalmology Retina 2024;8(5):e15 View
  27. Mishra V, Jafri F, Abdul Kareem N, Aboobacker R, Noora F. Evaluation of accuracy and potential harm of ChatGPT in medical nutrition therapy - a case-based approach. F1000Research 2024;13:137 View
  28. Wang L, Chen X, Deng X, Wen H, You M, Liu W, Li Q, Li J. Prompt engineering in consistency and reliability with the evidence-based guideline for LLMs. npj Digital Medicine 2024;7(1) View
  29. Bektaş M, Pereira J, Daams F, van der Peet D. ChatGPT in surgery: a revolutionary innovation?. Surgery Today 2024 View
  30. Fuchs A, Trachsel T, Weiger R, Eggmann F. ChatGPT’s performance in dentistry and allergyimmunology assessments: a comparative study. SWISS DENTAL JOURNAL SSO – Science and Clinical Topics 2023;134(2):1 View
  31. Topsakal O, Sawyer P, Akinci T, Topsakal E, Celikoyar M. Reliability and Agreement of Free Web-Based 3D Software for Computing Facial Area and Volume Measurements. BioMedInformatics 2024;4(1):690 View
  32. Mu Y, He D. The Potential Applications and Challenges of ChatGPT in the Medical Field. International Journal of General Medicine 2024;Volume 17:817 View
  33. Çoban E, Altay B. Assessing the Potential Role of Artificial Intelligence in Medication-Related Osteonecrosis of the Jaw Information Sharing. Journal of Oral and Maxillofacial Surgery 2024;82(6):699 View
  34. Chen Y, Esmaeilzadeh P. Generative AI in Medical Practice: In-Depth Exploration of Privacy and Security Challenges. Journal of Medical Internet Research 2024;26:e53008 View
  35. Chow J, Wong V, Li K. Generative Pre-Trained Transformer-Empowered Healthcare Conversations: Current Trends, Challenges, and Future Directions in Large Language Model-Enabled Medical Chatbots. BioMedInformatics 2024;4(1):837 View
  36. Kernberg A, Gold J, Mohan V. Using ChatGPT-4 to Create Structured Medical Notes From Audio Recordings of Physician-Patient Encounters: Comparative Study. Journal of Medical Internet Research 2024;26:e54419 View
  37. Staubli S, Jobeir B, Spiro M, Raptis D. Invitation to join the Healthcare AI Language Group: HeALgroup.AI Initiative. BMJ Health & Care Informatics 2024;31(1):e100884 View
  38. Mastrokostas P, Mastrokostas L, Emara A, Wellington I, Ginalis E, Houten J, Khalsa A, Saleh A, Razi A, Ng M. GPT-4 as a Source of Patient Information for Anterior Cervical Discectomy and Fusion: A Comparative Analysis Against Google Web Search. Global Spine Journal 2024 View
  39. Parikh A, Oca M, Conger J, McCoy A, Chang J, Zhang-Nunes S. Accuracy and Bias in Artificial Intelligence Chatbot Recommendations for Oculoplastic Surgeons. Cureus 2024 View
  40. Hanai A, Ishikawa T, Kawauchi S, Iida Y, Kawakami E. Generative artificial intelligence and non-pharmacological bias: an experimental study on cancer patient sexual health communications. BMJ Health & Care Informatics 2024;31(1):e100924 View
  41. Shiraishi M, Tanigawa K, Tomioka Y, Miyakuni A, Moriwaki Y, Yang R, Oba J, Okazaki M. Blepharoptosis Consultation with Artificial Intelligence: Aesthetic Surgery Advice and Counseling from Chat Generative Pre-Trained Transformer (ChatGPT). Aesthetic Plastic Surgery 2024;48(11):2057 View
  42. Luo S, Canavese F, Aroojis A, Andreacchio A, Anticevic D, Bouchard M, Castaneda P, De Rosa V, Fiogbe M, Frick S, Hui J, Johari A, Loro A, Lyu X, Matsushita M, Omeroglu H, Roye D, Shah M, Yong B, Li L. Are Generative Pretrained Transformer 4 Responses to Developmental Dysplasia of the Hip Clinical Scenarios Universal? An International Review. Journal of Pediatric Orthopaedics 2024;44(6):e504 View
  43. Deng L, Wang T, Yangzhang , Zhai Z, Tao W, Li J, Zhao Y, Luo S, Xu J. Evaluation of large language models in breast cancer clinical scenarios: a comparative analysis based on ChatGPT-3.5, ChatGPT-4.0, and Claude2. International Journal of Surgery 2024;110(4):1941 View
  44. Huo B, Calabrese E, Sylla P, Kumar S, Ignacio R, Oviedo R, Hassan I, Slater B, Kaiser A, Walsh D, Vosburg W. The performance of artificial intelligence large language model-linked chatbots in surgical decision-making for gastroesophageal reflux disease. Surgical Endoscopy 2024;38(5):2320 View
  45. Guo S, Li R, Li G, Chen W, Huang J, He L, Ma Y, Wang L, Zheng H, Tian C, Zhao Y, Pan X, Wan H, Liu D, Li Z, Lei J. Comparing ChatGPT's and Surgeon's Responses to Thyroid-related Questions From Patients. The Journal of Clinical Endocrinology & Metabolism 2024 View
  46. Amaral J, Schultz R, Martin B, Taylor T, Touban B, McGraw-Heinrich J, McKay S, Rosenfeld S, Smith B. Evaluating Chat Generative Pre-trained Transformer Responses to Common Pediatric In-toeing Questions. Journal of Pediatric Orthopaedics 2024 View
  47. Moulaei K, Yadegari A, Baharestani M, Farzanbakhsh S, Sabet B, Reza Afrash M. Generative artificial intelligence in healthcare: A scoping review on benefits, challenges and applications. International Journal of Medical Informatics 2024;188:105474 View
  48. Grimm D, Lee Y, Hu K, Liu L, Garcia O, Balakrishnan K, Ayoub N. The utility of ChatGPT as a generative medical translator. European Archives of Oto-Rhino-Laryngology 2024 View
  49. Gibson D, Jackson S, Shanmugasundaram R, Seth I, Siu A, Ahmadi N, Kam J, Mehan N, Thanigasalam R, Jeffery N, Patel M, Leslie S. Evaluating the Efficacy of ChatGPT as a Patient Education Tool in Prostate Cancer: A Multi-Metric Assessment (Preprint). Journal of Medical Internet Research 2024 View
  50. Ozden I, Gokyar M, Ozden M, Sazak Ovecoglu H. Assessment of artificial intelligence applications in responding to dental trauma. Dental Traumatology 2024 View
  51. Buldur M, Sezer B. Evaluating the accuracy of Chat Generative Pre-trained Transformer version 4 (ChatGPT-4) responses to United States Food and Drug Administration (FDA) frequently asked questions about dental amalgam. BMC Oral Health 2024;24(1) View
  52. Bhattaru A, Yanamala N, Sengupta P. Revolutionizing Cardiology with Words: Unveiling the Impact of Large Language Models in Medical Science Writing. Canadian Journal of Cardiology 2024 View
  53. Thongsri N, Tripak O, Bao Y. Do learners exhibit a willingness to use ChatGPT? An advanced two-stage SEM-neural network approach for forecasting factors influencing ChatGPT adoption. Interactive Technology and Smart Education 2024 View
  54. Min L, Fan Z, Dou F, Sun J, Luo C, Lv Q. Adaption BERT for Medical Information Processing with ChatGPT and Contrastive Learning. Electronics 2024;13(13):2431 View