Category Ranking
98%
Total Visits
921
Avg Visit Duration
2 minutes
Citations
20
Article Abstract
Artificial intelligence (AI) models for automatic generation of narrative radiology reports from images have the potential to enhance efficiency and reduce the workload of radiologists. However, evaluating the correctness of these reports requires metrics that can capture clinically pertinent differences. In this study, we investigate the alignment between automated metrics and radiologists' scoring of errors in report generation. We address the limitations of existing metrics by proposing new metrics, RadGraph F1 and RadCliQ, which demonstrate stronger correlation with radiologists' evaluations. In addition, we analyze the failure modes of the metrics to understand their limitations and provide guidance for metric selection and interpretation. This study establishes RadGraph F1 and RadCliQ as meaningful metrics for guiding future research in radiology report generation.
Download full-text PDF |
Source |
|---|---|
| http://www.ncbi.nlm.nih.gov/pmc/articles/PMC10499844 | PMC |
| http://dx.doi.org/10.1016/j.patter.2023.100802 | DOI Listing |
Publication Analysis
Top Keywords
Similar Publications
Optimizing Availability and Appropriate Use of Assisted Vaginal Birth: Protocol for Generic Formative Research of an Implementation Preparation.
JMIR Res Protoc
September 2025
Gender and Women's Health Unit, Nossal Institute for Global Health, School of Population and Global Health, The University of Melbourne, Carlton, Australia.
Background: Assisted vaginal birth is a lifesaving procedure where health workers use special devices to expedite birth vaginally when some complications emerge, such as due to prolonged labor. When the use of assisted vaginal birth is possible and appropriate, it provides benefits over cesarean section. These benefits include shorter recovery, reduced hospital stays, lower risks of complications, cost savings, and greater likelihood of vaginal birth in future pregnancies.
View Article and Find Full Text PDFFermented Food Consumption Across European Regions: Protocol for the Development and Validation of the Web-Based Fermented Foods Frequency Questionnaire (3FQ).
JMIR Res Protoc
September 2025
Department of Food Science and Technology, Kaunas University of Technology, Kaunas, Lithuania.
Background: Fermented foods vary significantly by food substrate and regional consumption patterns. Although they are consumed worldwide, their intake and potential health benefits remain understudied. Europe, in particular, lacks specific consumption recommendations for most fermented foods.
View Article and Find Full Text PDFIntraoperative Removal of a Live Cerebral Sparganosis.
JAMA Neurol
September 2025
Department of Neurosurgery, Shanghai General Hospital, School of Medicine, Shanghai Jiao Tong University, Shanghai, China.
Decentralized Clinical Trials in the Era of Real-World Evidence: A Critical Assessment of Recent Experiences.
Clin Transl Sci
September 2025
Food and Drug Administration, Silver Spring, Maryland, USA.
Since the first decentralized clinical trial (DCT) was conducted in 2011, there has been an increased usage of DCT due to its benefits of patient-centricity and generalizability of findings. This trend was further expedited by the global COVID-19 pandemic. We identified 23 case studies across various therapeutic areas and grouped them into different categories according to their purposes-by necessity, for operational benefits, to address unique research questions, to validate innovative digital endpoints, or to validate decentralization as a clinical research platform.
View Article and Find Full Text PDFCost-Effectiveness of In-Bed Cycling and Routine Physiotherapy for Patients Receiving Mechanical Ventilation.
JAMA Netw Open
September 2025
School of Rehabilitation Science, Faculty of Health Sciences, McMaster University, Hamilton, Ontario, Canada.
Importance: The cost-effectiveness of adding early in-bed cycling to usual physiotherapy among adults receiving mechanical ventilation in the intensive care unit (ICU) compared with usual physiotherapy alone is unknown.
Objective: To evaluate the cost-effectiveness of in-bed cycling plus usual physiotherapy compared with usual therapy alone in the Critical Care Cycling to Improve Lower Extremity Strength (CYCLE) randomized clinical trial.
Design, Setting, And Participants: This trial-based economic evaluation with a 90-day time horizon compared early cycling plus usual physiotherapy vs usual physiotherapy alone from a societal perspective.