Performance of Three Artificial Intelligence Chatbots on Ophthalmic Knowledge Assessment Program Materials

Document Type

Article

Publication Title

Canadian Journal of Ophthalmology

Abstract

Artificial intelligence (AI) language-learning models (LLMs) are programs that have been developed to assist users in answering a wide range of questions in a conversational format. Recently, evaluations of the ability of such programs to diagnose and treat ophthalmic conditions have yielded mixed results. In this study, we chose to evaluate the performance of ChatGPT 3.5 versus 2 other LLMs, Google Bard (now known as Gemini) and Bing AI, on standardized, multiple-choice questions from the American Academy of Ophthalmology.

DOI

10.1016/j.jcjo.2024.01.011

Publication Date

2-23-2024

ISSN

0008-4182

Share

COinS