Category Ranking
98%
Total Visits
921
Avg Visit Duration
2 minutes
Citations
20
Article Abstract
Background: External validation of predictive models in medical research is crucial to ensure their generalizability and applicability across diverse populations. However, validation often reveals discrepancies in model performance due to cohort differences, sample collection and storage, overfitting, and inconsistencies in data handling. This study investigates the challenges encountered during external validation of predictive models for early lung cancer detection using small RNA biomarkers, tying these challenges to specific validation outcomes and deriving recommendations.
Methods: Predictive models based on the XGBoost algorithm, developed from serum samples in the JanusRNA cohort, were externally validated in two independent Norwegian cohorts: HUNT and NOWAC. These cohorts differed in sample types, RNA abundance, library preparation protocols, and lung cancer histological classification. Strategies to harmonize data processing and address these discrepancies were employed to ensure a robust validation process.
Results: Validation revealed significant challenges due to cohort heterogeneity. Median AUC values ranged from 0.50 to 0.66 in validation cohorts, compared to 0.62-0.76 in the original models. Models performed worse in the female-only NOWAC cohort, where plasma was used, highlighting the impact of sample type and cohort characteristics on predictive accuracy.
Conclusions: Based on the challenges encountered during validation, we propose seven recommendations to guide robust external validation of omics-based predictive models including harmonizing data processing across cohorts, re-evaluating overfitting, and critically assessing model performance for clinical applications.
Impact: By highlighting practical issues in model validation and providing recommendations, this study supports more reliable and clinically applicable biomarker-based prediction models, ultimately aiding cancer screening and prevention efforts.
Download full-text PDF |
Source |
|---|---|
| http://dx.doi.org/10.1158/1055-9965.EPI-25-0787 | DOI Listing |
Publication Analysis
Top Keywords
Similar Publications
A novel multimodal framework combining habitat radiomics, deep learning, and conventional radiomics for predicting MGMT gene promoter methylation in Glioma: Superior performance of integrated models.
Eur J Radiol
September 2025
Department of Radiology, Affiliated Hospital of Hebei University, Baoding 071000, China. Electronic address:
Purpose: The present study aimed to develop a noninvasive predictive framework that integrates clinical data, conventional radiomics, habitat imaging, and deep learning for the preoperative stratification of MGMT gene promoter methylation in glioma.
Materials And Methods: This retrospective study included 410 patients from the University of California, San Francisco, USA, and 102 patients from our hospital. Seven models were constructed using preoperative contrast-enhanced T1-weighted MRI with gadobenate dimeglumine as the contrast agent.
Combined SHR and SIRI biomarkers predict increased coronary heart disease risk in type 2 diabetes.
Biomol Biomed
September 2025
Department of Cardiology, Renmin Hospital of Wuhan University, Wuhan, China.
Coronary heart disease (CHD) is a leading cause of morbidity and mortality; patients with type 2 diabetes mellitus (T2DM) are at particularly high risk, highlighting the need for reliable biomarkers for early detection and risk stratification. We investigated whether combining the stress hyperglycemia ratio (SHR) and systemic inflammation response index (SIRI) improves CHD detection in T2DM. In this retrospective cohort of 943 T2DM patients undergoing coronary angiography, associations of SHR and SIRI with CHD were evaluated using multivariable logistic regression and restricted cubic splines; robustness was examined with subgroup and sensitivity analyses.
View Article and Find Full Text PDFDesigning Buchwald-Hartwig Reaction Graph for Yield Prediction.
J Org Chem
September 2025
State Key Laboratory of Fine Chemicals, School of Chemical Engineering, Ocean and Life Sciences, Dalian University of Technology, Panjin 124221, P. R. China.
The Buchwald-Hartwig (B-H) reaction graph, a novel graph for deep learning models, is designed to simulate the interactions among multiple chemical components in the B-H reaction by representing each reactant as an individual node within a custom-designed reaction graph, thereby capturing both single-molecule and intermolecular relationship features. Trained on a high-throughput B-H reaction data set, B-H Reaction Graph Neural Network (BH-RGNN) achieves near-state-of-the-art performance with an score of 0.971 while maintaining low computational costs.
View Article and Find Full Text PDFHealth Care Professionals' Experiences Regarding Facilitators of and Barriers to Sustained Use of Social Robot Ivy for People With Intellectual Disabilities: Qualitative Interview Study.
J Med Internet Res
September 2025
School of Advertising, Marketing and Public Relations, Faculty of Business and Law, Queensland University of Technology, Brisbane, Australia.
Background: Labor shortages in health care pose significant challenges to sustaining high-quality care for people with intellectual disabilities. Social robots show promise in supporting both people with intellectual disabilities and their health care professionals; yet, few are fully developed and embedded in productive care environments. Implementation of such technologies is inherently complex, requiring careful examination of facilitators and barriers influencing sustained use.
View Article and Find Full Text PDFPredicting HOMO-LUMO Gaps Using Hartree-Fock Calculated Data and Machine Learning Models.
J Chem Inf Model
September 2025
Department of Chemistry, Delaware State University, Dover, Delaware 19901, United States.
The calculation of the highest occupied molecular orbital-lowest unoccupied molecular orbital (HOMO-LUMO) gap for chemical molecules is computationally intensive using quantum mechanics (QM) methods, while experimental determination is often costly and time-consuming. Machine Learning (ML) offers a cost-effective and rapid alternative, enabling efficient predictions of HOMO-LUMO gap values across large data sets without the need for extensive QM computations or experiments. ML models facilitate the screening of diverse molecules, providing valuable insights into complex chemical spaces and integrating seamlessly into high-throughput workflows to prioritize candidates for experimental validation.
View Article and Find Full Text PDF