Category Ranking
98%
Total Visits
921
Avg Visit Duration
2 minutes
Citations
20
Article Abstract
Background: Resident training programs in the US use the Orthopaedic In-Training Examination (OITE) developed by the American Academy of Orthopaedic Surgeons (AAOS) to assess the current knowledge of their residents and to identify the residents at risk of failing the Amerian Board of Orthopaedic Surgery (ABOS) examination. Optimal strategies for OITE preparation are constantly being explored. There may be a role for Large Language Models (LLMs) in orthopaedic resident education. ChatGPT, an LLM launched in late 2022 has demonstrated the ability to produce accurate, detailed answers, potentially enabling it to aid in medical education and clinical decision-making. The purpose of this study is to evaluate the performance of ChatGPT on Orthopaedic In-Training Examinations using Self-Assessment Exams from the AAOS database and approved literature as a proxy for the Orthopaedic Board Examination.
Methods: 301 SAE questions from the AAOS database and associated AAOS literature were input into ChatGPT's interface in a question and multiple-choice format and the answers were then analyzed to determine which answer choice was selected. A new chat was used for every question. All answers were recorded, categorized, and compared to the answer given by the OITE and SAE exams, noting whether the answer was right or wrong.
Results: Of the 301 questions asked, ChatGPT was able to correctly answer 183 (60.8%) of them. The subjects with the highest percentage of correct questions were basic science (81%), oncology (72.7%, shoulder and elbow (71.9%), and sports (71.4%). The questions were further subdivided into 3 groups: those about management, diagnosis, or knowledge recall. There were 86 management questions and 47 were correct (54.7%), 45 diagnosis questions with 32 correct (71.7%), and 168 knowledge recall questions with 102 correct (60.7%).
Conclusions: ChatGPT has the potential to provide orthopedic educators and trainees with accurate clinical conclusions for the majority of board-style questions, although its reasoning should be carefully analyzed for accuracy and clinical validity. As such, its usefulness in a clinical educational context is currently limited but rapidly evolving.
Clinical Relevance: ChatGPT can access a multitude of medical data and may help provide accurate answers to clinical questions.
Download full-text PDF |
Source |
|---|---|
| http://www.ncbi.nlm.nih.gov/pmc/articles/PMC10912220 | PMC |
| http://dx.doi.org/10.1016/j.jor.2023.10.026 | DOI Listing |
Publication Analysis
Top Keywords
Similar Publications
Developing an Interprofessional Pediatric Rehabilitation Model of Care in Northern Cree First Nation Communities: Protocol for a Needs Assessment and Codeveloped Intervention With a Qualitative and Participatory Action Approach.
JMIR Res Protoc
September 2025
School of Rehabilitation Science, University of Saskatchewan, Saskatoon, SK, Canada.
Background: In Canada, the Indigenous population is the youngest and fastest growing, yet ongoing health disparities for Indigenous peoples are widely recognized. There is a concerning lack of research on childhood disabilities and health conditions in Indigenous populations in Canada. For children with disabilities and chronic health conditions, ongoing access to rehabilitation services, such as occupational therapy, physical therapy, speech-language pathology, and audiology, is critical in promoting positive health and developmental outcomes.
View Article and Find Full Text PDFAll-Quadratic Mixed-Integer Problems: A Study on Evolution Strategies and Mathematical Programming.
Evol Comput
September 2025
Computer Science Department, Tel-Hai College, and The Galilee Research Institute - Migal, Upper Galilee, Israel
Mixed-integer (MI) quadratic models subject to quadratic constraints, known as All- Quadratic MI Programs, constitute a challenging class of NP-complete optimization problems. The particular scenario of unbounded integers defines a subclass that holds the distinction of being even undecidable. This complexity suggests a possible soft-spot for Mathematical Programming (MP) techniques, which otherwise constitute a good choice to treat MI problems.
View Article and Find Full Text PDFOne Thousand Ears in 7 years-A Single Surgeon's Experience of Performing Otoplasty and Cosmetic Ear Surgery in Adults.
J Craniofac Surg
September 2025
The Private Clinic of Harley Street, London, UK.
The majority of the literature contains outcomes of paediatric otoplasty with multiple surgeons' outcomes. However, to date, a single surgeon's case series numbering over 1000 adult cases in the same center has not been published. Cosmetic ear surgery in adults requires a completely different approach compared with children for the operating surgeon regarding assessment and technique.
View Article and Find Full Text PDFMulticriteria Assessment of Text Quality in Large Language Model-Generated Gynecomastia Materials: DeepSeek Versus OpenAI Versus Claude.
J Craniofac Surg
September 2025
Department of Breast Plastic Surgery, Plastic Surgery Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, Shijingshan, Beijing, China.
Background: With the development of artificial intelligence, obtaining patient-centered medical information through large language models (LLMs) is crucial for patient education. However, existing digital resources in online health care have heterogeneous quality, and the reliability and readability of content generated by various AI models need to be evaluated to meet the needs of patients with different levels of cultural literacy.
Objective: This study aims to compare the accuracy and readability of different LLMs in providing medical information related to gynecomastia, and explore the most promising science education tools in practical clinical applications.
A Retrospective Review of Craniosynostosis Reconstruction at a Community Children's Hospital Compared With Academic Centers.
J Craniofac Surg
September 2025
Department of Pediatric Plastic and Reconstructive Surgery, Children's Hospital Colorado.
Background: Craniosynostosis repair is traditionally performed at high-volume academic centers with multidisciplinary teams. Access barriers in rural or suburban regions raise the question of whether comparable outcomes can be achieved and if this surgery can be performed safely in community settings.
Objective: To evaluate the safety and perioperative outcomes of cranial vault reconstruction for craniosynostosis performed at a community-based children's hospital and compare these outcomes to those reported at academic institutions.