ChatGPT fails self-assessment exam
-
Introduction:
Chat Generative Pre-trained Transformer (ChatGPT) is a natural language processing model that generates human-like text.Methods:
ChatGPT-3 and ChatGPT-4 were used to answer the 2022 and 2021 American College of Gastroenterology (ACG) Self-Assessment Tests. The exact questions were inputted in both versions of ChatGPT. A 70% or higher was required to pass the assessment.Results:
Overall ChatGPT-3 scored a 65.1% on 455 included questions, and GPT-4 scored 62.4%.Conclusion:
ChatGPT did not pass the ACG self-assessment test. We don’t recommend its use for medical education in gastroenterology in its current form.
Hello! It looks like you're interested in this conversation, but you don't have an account yet.
Getting fed up of having to scroll through the same posts each visit? When you register for an account, you'll always come back to exactly where you were before, and choose to be notified of new replies (either via email, or push notification). You'll also be able to save bookmarks and upvote posts to show your appreciation to other community members.
With your input, this post could be even better 💗
Register Login