Ensuring Reproducibility and Deploying Models with the Image2Radiomics Framework: An Evaluation of Image Processing on PanNET Model Performance.

Background/objectives: To evaluate the importance of image processing in a previously validated model for detecting pancreatic neuroendocrine tumors (PanNETs) and to introduce Image2Radiomics, a new framework that ensures reproducibility of the image processing pipeline and facilitates the deployment of radiomics models.

Methods: A previously validated model for identifying PanNETs from CT images served as the reference. Radiomics features were re-extracted using Image2Radiomics and compared to those from the original model using performance metrics. The impact of nine alterations to the image processing pipeline was evaluated. Prediction discrepancies were quantified using the mean ± SD of absolute differences in PanNET probability and the percentage of classification disagreement.

Results: The reference model was successfully replicated with Image2Radiomics, achieving a Cohen's kappa coefficient of 1. Alterations to the image processing pipeline led to reductions in model performance, with AUC dropping from 0.87 to 0.71 when image windowing was removed. Prediction disagreements were observed in up to 45% of patients. Even minor changes, such as switching the library used for spatial resampling, resulted in up to 21% disagreement.

Conclusions: Reproducing image processing pipelines remains challenging and limits the clinical deployment of radiomics models. While this study is limited to one model and imaging modality, the findings underscore a common risk in radiomics reproducibility. The Image2Radiomics framework addresses this issue by allowing researchers to define and share complete processing pipelines in a standardized way, improving reproducibility and facilitating model deployment in clinical and multicenter settings.