How Does ChatGPT Perform on the United States Medical Licensing Examination (USMLE)? The Implications of Large Language Models for Medical Education and Knowledge Assessment

Gilson, Aidan; Safranek, Conrad; Huang, Thomas; Socrates, Vimig; Chi, Ling; A. Taylor, Richard; Chartash, David

doi:10.2196/45312

Public

How Does ChatGPT Perform on the United States Medical Licensing Examination (USMLE)? The Implications of Large Language Models for Medical Education and Knowledge Assessment

Published in JMIR Medical Education • Feb 8, 2023

Authors:

Aidan Gilson

Conrad Safranek

Thomas Huang

Abstract

BACKGROUND: Chat Generative Pre-trained Transformer (ChatGPT) is a 175-billion-parameter natural language processing model that can generate conversation-style responses to user input. OBJECTIVE: This study aimed to evaluate the performance of ChatGPT on questions within the scope of the United Stat...

Subject

Interpretability

United States Medical Licensing Examination

Computer science

Research Assistant

AI chat, annotations, notes & similar papers

Finding related papers...

Discussions

(0)

No comments yet

Be the first to share your thoughts!