Search Articles

View query in Help articles search

Search Results (1 to 6 of 6 Results)

Download search results: CSV END BibTex RIS


Unveiling GPT-4V's hidden challenges behind high accuracy on USMLE questions: Observational Study

Unveiling GPT-4V's hidden challenges behind high accuracy on USMLE questions: Observational Study

USMLE consists of 3 steps required to obtain a medical license in the United States. USMLE assesses a physician’s ability to apply knowledge, concepts, and principles, which is critical to both health and disease management and is the foundation for safe, efficient patient care.

Zhichao Yang, Zonghai Yao, Mahbuba Tasmin, Parth Vashisht, Won Seok Jang, Feiyun Ouyang, Beining Wang, David McManus, Dan Berlowitz, Hong Yu

J Med Internet Res 2025;27:e65146

ChatGPT-4 Omni Performance in USMLE Disciplines and Clinical Skills: Comparative Analysis

ChatGPT-4 Omni Performance in USMLE Disciplines and Clinical Skills: Comparative Analysis

Some studies suggest LLMs perform better on USMLE sample items compared to third-party question banks [20], and newer versions of LLMs such as Chat GPT 4 (GPT-4) outperform their earlier counterparts [22]. Evaluations of Chat GPT 3.0 found it was able to accurately answer USMLE sample items 36.7% of the time [23], improving to more than 50% correct in a matter of months [21]. Performance also appears to depend on the specific skills tested and the language used in training [24,25].

Brenton T Bicknell, Danner Butler, Sydney Whalen, James Ricks, Cory J Dixon, Abigail B Clark, Olivia Spaedy, Adam Skelton, Neel Edupuganti, Lance Dzubinski, Hudson Tate, Garrett Dyess, Brenessa Lindeman, Lisa Soleymani Lehmann

JMIR Med Educ 2024;10:e63430

Pure Wisdom or Potemkin Villages? A Comparison of ChatGPT 3.5 and ChatGPT 4 on USMLE Step 3 Style Questions: Quantitative Analysis

Pure Wisdom or Potemkin Villages? A Comparison of ChatGPT 3.5 and ChatGPT 4 on USMLE Step 3 Style Questions: Quantitative Analysis

Since its inception in 1992, the United States Medical Licensing Examination (USMLE) has been considered an integral milestone in medical education [1]. The 3 USMLE steps are jointly sponsored by the Federation of State Medical Boards and the National Board of Medical Examiners. Each step is designed to specifically test another facet of the examinee’s skill set.

Leonard Knoedler, Michael Alfertshofer, Samuel Knoedler, Cosima C Hoch, Paul F Funk, Sebastian Cotofana, Bhagvat Maheta, Konstantin Frank, Vanessa Brébant, Lukas Prantl, Philipp Lamby

JMIR Med Educ 2024;10:e51148

Additional Considerations for US Residency Selection After Pass/Fail USMLE Step 1. Comment on “The US Residency Selection Process After the United States Medical Licensing Examination Step 1 Pass/Fail Change: Overview for Applicants and Educators”

Additional Considerations for US Residency Selection After Pass/Fail USMLE Step 1. Comment on “The US Residency Selection Process After the United States Medical Licensing Examination Step 1 Pass/Fail Change: Overview for Applicants and Educators”

As medical students navigating the new landscape of residency selection after the switch to a pass/fail USMLE (United States Medical Licensing Examination) Step 1, we read a recent viewpoint by Ozair et al [1] with great interest. We hope to offer a unique perspective and present additional potential solutions for residency programs and medical schools to consider. We agree with the authors’ observation that research productivity is now necessary for a successful match with competitive specialties.

Yacine Sow, Ameya Gangal, Howa Yeung, Travis Blalock, Benjamin Stoff

JMIR Med Educ 2023;9:e47763

The United States Medical Licensing Exam Step 2 Clinical Skills Examination: Potential Alternatives During and After the COVID-19 Pandemic

The United States Medical Licensing Exam Step 2 Clinical Skills Examination: Potential Alternatives During and After the COVID-19 Pandemic

Adding to the uncertainty, on May 26, 2020, NRMP announced suspension of the United States Medical Licensing Examination (USMLE) Step 2 Clinical Skills (CS) examination for a period of 12-18 months. It was stated that “The NRMP does not specifically require applicants to take or pass the CS examination in order to participate in the Match.

Rawish Fatima, Ahmad R Assaly, Muhammad Aziz, Mohamad Moussa, Ragheb Assaly

JMIR Med Educ 2021;7(2):e25903

The United States Medical Licensing Examination Step 1 Is Changing—US Medical Curricula Should Too

The United States Medical Licensing Examination Step 1 Is Changing—US Medical Curricula Should Too

In addition to the pandemic and an increasing number of zero tuition medical schools, the United States Medical Licensing Examination (USMLE) Step 1 has adopted a pass/fail grading system. The percentile students scored on this test has historically been one of the most important determinants of which residency program or even which area of medicine students could apply to. Now that it is pass/fail, doing anything more than just passing has no effect on a student’s residency competitiveness.

Benjamin Douglas Liu

JMIR Med Educ 2020;6(2):e20182