Large Language Model–Based Assessment of Clinical Reasoning Documentation in the Electronic Health Record Across Two Institutions: Development and Validation Study

Verity Schaye   ^{1, 2} , MD, MHPE ;   David DiTullio   ¹ , MD, PhD ;   Benedict Vincent Guzman   ³ , MS ;   Scott Vennemeyer   ⁴ , BS ;   Hanniel Shih   ⁴ , MS ;   Ilan Reinstein   ² , MS ;   Danielle E Weber   ^{5, 6} , MD, MEd ;   Abbie Goodman   ^{5, 6} , MD ;   Danny T Y Wu   ⁴ , PhD ;   Daniel J Sartori   ¹ , MD ;   Sally A Santen   ⁷ , MD, PhD ;   Larry Gruppen   ⁸ , PhD ;   Yindalon Aphinyanaphongs   ³ , MD, PhD ;   Jesse Burk-Rafel   ^{1, 2} , MD, MRes

¹ Department of Medicine, NYU Grossman School of Medicine, New York, NY, United States

² Institute for Innovations in Medical Education, NYU Grossman School of Medicine, New York, NY, United States

³ Division of Applied AI Technologies, NYU Langone Health, New York, NY, United States

⁴ Department of Biostatistics, Health informatics, and Data Sciences, University of Cincinnati College of Medicine, Cincinnati, OH, United States

⁵ Division of Hospital Medicine, Department of Pediatrics, Cincinnati Children's Hospital Medical Center, University of Cincinnati College of Medicine, Cincinnati, OH, United States

⁶ Division of Hospital Medicine, Department of Internal Medicine, University of Cincinnati College of Medicine, Cincinnati, OH, United States

⁷ Department of Emergency Medicine, University of Cincinnati College of Medicine, Cincinnati, OH, United States

⁸ Department of Learning Health Sciences, University of Michigan Medical School, Ann Arbor, MI, United States