Category Ranking

98%

Total Visits

921

Avg Visit Duration

2 minutes

Citations

20

Article Abstract

Introduction: In November 2022, the online artificial intelligence (AI) chatbot ChatGPT was released to the public, and swiftly garnered global attention because of its ability to provide detailed answers to complex queries. In medical field, ChatGPT has shown great potential to be used in medical education and has excelled in many English-language medical licensing examinations. However, due to the variability of medical licensing examinations in different countries, and ChatGPT's particular proficiency in English, the previous literatures showed that ChatGPT is unable to pass medical licensing examinations from non-English-speaking countries or those not administered in English. To the best of our knowledge, this is the first study to review whether ChatGPT can demonstrate consistent accuracy across diverse medical licensing examinations and be used in medical education across countries.

Objective: In this study protocol, we aimed to analyze and review the differences in performance of ChatGPT in medical exams in various language environments and countries, as well as its potential in medical education.

Methods And Analysis: A systematic review and meta-analysis was conducted using PubMed, Web of Science, and Scopus to collect papers testing the performance of ChatGPT in medical licensing examinations. We imported all the collected literatures into Rayyan and screened the literatures based on the selection criteria and exclusion criteria. The risk of bias and quality of included studies was assessed by using Mixed Methods Appraisal Tool (MMAT). Data from included studies was extracted into an Excel spreadsheet. All of the above processes were completed by two reviewers independently. A third reviewer was consulted in cases of disagreement. Finally, we provided both quantitative and qualitative analysis of the findings from the included studies.

Trial Registration: PROSPERO registration number: CRD42024506687.

Download full-text PDF

Source
http://www.ncbi.nlm.nih.gov/pmc/articles/PMC11515974PMC
http://journals.plos.org/plosone/article?id=10.1371/journal.pone.0312771PLOS

Publication Analysis

Top Keywords

medical licensing
24
licensing examinations
24
performance chatgpt
12
chatgpt medical
12
medical
11
examinations countries
8
systematic review
8
review meta-analysis
8
potential medical
8
medical education
8

Similar Publications

Aims: The number of hip fractures is increasing, with significant mortality and morbidity, particularly among frail and comorbid patients. Enhanced recovery after surgery (ERAS) pathways have proven effective in elective orthopaedics, but this has not been investigated in people with hip fractures. This study aimed to identify current perioperative practice and develop a cohesive ERAS pathway tailored for hip fracture patients, to standardize and optimize care.

View Article and Find Full Text PDF

Social cognition training improves recognition of individual emotions in schizophrenia disorder.

Psychiatry Res

August 2025

Department of Psychiatry and Behavioral Sciences, Rush University Medical Center, 1645W. Jackson Blvd. Suite 600, Chicago, IL, USA 60612. Electronic address:

Impaired recognition of angry, fearful, and emotionless (i.e., neutral) faces is associated with poor social functioning among individuals with schizophrenia disorder (SZ).

View Article and Find Full Text PDF

Remodeling the sarcoma microenvironment by simultaneous targeting of urokinase-type plasminogen activator receptors and epidermal growth factor receptors to promote antitumor activity.

J Pharmacol Exp Ther

August 2025

Animal Cancer Care and Research Program, University of Minnesota, St Paul, Minnesota; Department of Veterinary Clinical Sciences, College of Veterinary Medicine, University of Minnesota, St Paul, Minnesota; Masonic Cancer Center, University of Minnesota, Minneapolis, Minnesota; Center for Immunology

We evaluated the antitumor effects of remodeling the MC17 mouse sarcoma microenvironment (SME) by targeting urokinase-type plasminogen activator receptor (uPAR)- and epidermal growth factor receptor (EGFR)-expressing cells. Specifically, we used eBAT (a bispecific ligand-targeted toxin directed to EGFR and uPAR), and its mouse counterpart, meBAT, to ablate uPAR- and/or EGFR-expressing cells. We chose the MC17 model because the cells are resistant to eBAT, allowing us to exclusively evaluate the role of uPAR- and EGFR-expressing cells in the SME.

View Article and Find Full Text PDF

Lasering in on Uncommon EGFR Mutations.

J Thorac Oncol

September 2025

Department of Internal Medicine, Section of Medical Oncology and Hematology, Yale School of Medicine, New Haven, Connecticut; Yale Cancer Center, New Haven, Connecticut.

View Article and Find Full Text PDF

Background: Guidelines recommend leaving in situ rectosigmoid polyps diagnosed during colonoscopy that are 5 mm or smaller if the endoscopist optically predicts them to be non-neoplastic. However, no randomised controlled trial has been done to examine the efficacy and safety of this strategy.

Methods: This open-label, multicentre, non-inferiority, randomised controlled trial enrolled adults age 18 years or older undergoing colonoscopy for screening, surveillance, or clinical indications across four Italian centres.

View Article and Find Full Text PDF