Assessing the appropriateness and completeness of ChatGPT-4's AI-generated responses for queries related to diabetic retinopathy.

Indian J Ophthalmol

Department of Ophthalmology, Shri Bhagwan Mahavir Vitreoretinal Services, SankaraNethralaya, Chennai, Tamil Nadu, India.

Published: July 2024


Category Ranking

98%

Total Visits

921

Avg Visit Duration

2 minutes

Citations

20

Article Abstract

Objective: To evaluate the appropriateness of responses generated by an online chat-based artificial intelligence (AI) model for diabetic retinopathy (DR) related questions.

Design: Cross-sectional study.

Methods: A set of 20 questions framed from the patient's perspective addressing DR-related queries, such as the definition of disease, symptoms, prevention methods, treatment options, diagnostic methods, visual impact, and complications, were formulated for input into ChatGPT-4. Peer-reviewed, literature-based answers were collected from popular search engines for the selected questions and three retinal experts reviewed the responses. An inter-human agreement was analyzed for consensus expert responses and also between experts. The answers generated by the AI model were compared with those provided by the experts. The experts rated the response generated by ChatGPT-4 on a scale of 0-5 for appropriateness and completeness.

Results: The answers provided by ChatGPT-4 were appropriate and complete for most of the DR-related questions. The response to questions on the adverse effects of laser photocoagulation therapy and compliance to treatment was not perfectly complete. The average rating given by the three retina expert evaluators was 4.84 for appropriateness and 4.38 for completeness of answers provided by the AI model. This corresponds to an overall 96.8% agreement among the experts for appropriateness and 87.6% for completeness regarding AI-generated answers.

Conclusion: ChatGPT-4 exhibits a high level of accuracy in generating appropriate responses for a range of questions in DR. However, there is a need to improvise the model to generate complete answers for certain DR-related topics.

Download full-text PDF

Source
http://www.ncbi.nlm.nih.gov/pmc/articles/PMC11338417PMC
http://dx.doi.org/10.4103/IJO.IJO_2510_23DOI Listing

Publication Analysis

Top Keywords

diabetic retinopathy
8
answers provided
8
responses
5
questions
5
answers
5
experts
5
assessing appropriateness
4
appropriateness completeness
4
completeness chatgpt-4's
4
chatgpt-4's ai-generated
4

Similar Publications

Diabetic retinopathy (DR) remains a leading cause of preventable blindness worldwide, with the affected population projected to reach 270 million by 2045. Our study analyzed 2 434 interventional trials registered between 2007 and 2024 in the Informa Pharma Intelligence database and found that anti-VEGF agents dominate the therapeutic landscape-bevacizumab represents 24.0 % of studies, ranibizumab 15.

View Article and Find Full Text PDF

Purpose: To evaluate macular vessel density using clinical parameters in patients with type 2 diabetes mellitus (DM) without retinopathy.

Patients And Methods: This cross-sectional study enrolled 32 participants (63 eyes) aged 40-60 years who met the inclusion criteria. Group 1 included 32 eyes of type 2 DM, whereas the rest had no DM.

View Article and Find Full Text PDF

Organoids: their emerging essential role in pathological mechanisms and drug discovery of diabetes and its complications.

Front Pharmacol

August 2025

State Key Laboratory for Quality Ensurance and Sustainable Use of Dao-di Herbs, Beijing, China.

Diabetes mellitus is a metabolic disease with a high global prevalence, which affects blood vessels throughout the entire body. As the disease progresses, it often leads to complications, including diabetic retinopathy and nephropathy. Currently, in addition to traditional cellular and animal models, more and more organoid models have been used in the study of diabetes and have broad application prospects in the field of pharmacological research.

View Article and Find Full Text PDF

Background: Artificial intelligence (AI) algorithms offer an effective solution to alleviate the burden of diabetic retinopathy (DR) screening in public health settings. However, there are challenges in translating diagnostic performance and its application when deployed in real-world conditions.

Objective: This study aimed to assess the technical feasibility of integration and diagnostic performance of validated DR screening (DRS) AI algorithms in real-world outpatient public health settings.

View Article and Find Full Text PDF

Dapagliflozin improves diabetic retinopathy in mice by inhibiting LAMA1 and regulating the PI3K/AKT signaling pathway.

Biochem Biophys Res Commun

September 2025

Department of Ophthalmology, Hebei Medical University, NO. 361 Zhongshan East Road, Changan District, Shijiazhuang City, Hebei Province, China; Department of Ophthalmology, Hebei General Hospital, NO. 348 Heping West Road, Xinhua District, Shijiazhuang City, Hebei Province, China. Electronic address

Diabetic retinopathy (DR) is among the most prevalent complications linked to advanced diabetes. Capillary Basement membrane (CBM) thickening is an early clinical manifestation in DR, and Laminin α 1 (LAMA1) is one of the main extracellular matrix components involved in CBM formation. Dapagliflozin (DAPA) has demonstrated efficacy in ameliorating DR.

View Article and Find Full Text PDF