Med Image Anal
December 2025
Continual Learning (CL) enables neural networks to learn new tasks while retaining previous knowledge. However, most CL methods fail to address bias transfer, where spurious correlations propagate to future tasks or influence past knowledge. This bidirectional bias transfer negatively impacts model performance and fairness, especially in medical imaging, where it can lead to misdiagnoses and unequal treatment.
View Article and Find Full Text PDFArtificial intelligence (AI) is being explored for a growing range of applications in radiology, including image reconstruction, image segmentation, synthetic image generation, disease classification, worklist triage, and examination scheduling. However, training accurate AI models typically requires substantial amounts of expert-labeled data, which can be time-consuming and expensive to obtain. Active learning offers a potential strategy for mitigating the impacts of such labeling requirements.
View Article and Find Full Text PDFSuperResNET is an integrated machine learning-based analysis software for visualizing and quantifying 3D point cloud data acquired by single-molecule localization microscopy (SMLM). SuperResNET computational modules include correction for multiple blinking of single fluorophores, denoising, segmentation (clustering), feature extraction used for cluster group identification, modularity analysis, blob retrieval, and visualization in 2D and 3D. Here, a graphical user interface version of SuperResNET was applied to publicly available direct stochastic optical reconstruction microscopy (dSTORM) data of nucleoporin Nup96 and Nup107 labeled nuclear pores that present a highly organized octagon structure of eight corners.
View Article and Find Full Text PDFCellular function is defined by pathways that, in turn, are determined by distance-mediated interactions between and within subcellular organelles, protein complexes, and macromolecular structures. Multichannel super-resolution microscopy (SRM) is uniquely placed to quantify distance-mediated interactions at the nanometer scale with its ability to label individual biological targets with independent markers that fluoresce in different spectra. We review novel computational methods that quantify interaction from multichannel SRM data in both point-cloud and voxel form.
View Article and Find Full Text PDFContact (Thousand Oaks)
March 2025
Detection of mitochondria-ER contacts (MERCs) from diffraction limited confocal images commonly uses fluorescence colocalization analysis of mitochondria and endoplasmic reticulum (ER) as well as split fluorescent probes, such as the split-GFP-based contact site sensor (SPLICS). However, inter-organelle distances (∼10-60 nm) for MERCs are lower than the 200-250 nm diffraction limited resolution obtained by standard confocal microscopy. Super-resolution microscopy of 3D volume analysis provides a two-fold resolution improvement (∼120 nm XY; 250 nm Z), which remains unable to resolve MERCs.
View Article and Find Full Text PDFThe remarkable progress of deep learning in dermatological tasks has brought us closer to achieving diagnostic accuracies comparable to those of human experts. However, while large datasets play a crucial role in the development of reliable deep neural network models, the quality of data therein and their correct usage are of paramount importance. Several factors can impact data quality, such as the presence of duplicates, data leakage across train-test partitions, mislabeled images, and the absence of a well-defined test partition.
View Article and Find Full Text PDFSuperResNET is a network analysis pipeline for the analysis of point cloud data generated by single-molecule localization microscopy (SMLM). Here, we applied SuperResNET network analysis of SMLM direct stochastic optical reconstruction microscopy (dSTORM) data to determine how the clathrin endocytosis inhibitors pitstop 2, dynasore and latrunculin A (LatA) alter the morphology of clathrin-coated pits. SuperResNET analysis of HeLa and Cos7 cells identified three classes of clathrin structures: small oligomers (class I), pits and vesicles (class II), and larger clusters corresponding to fused pits or clathrin plaques (class III).
View Article and Find Full Text PDFNovel portable diffuse optical tomography (DOT) devices for breast cancer lesions hold great promise for non-invasive, non-ionizing breast cancer screening. Critical to this capability is not just the identification of lesions but rather the complex problem of discriminating between malignant and benign lesions. To accurately reconstruct the highly heterogeneous tissue of a cancer lesion in healthy breast tissue using DOT, multiple wavelengths can be leveraged to maximize signal penetration while minimizing sensitivity to noise.
View Article and Find Full Text PDFDeep learning models have achieved remarkable success in medical image classification. These models are typically trained once on the available annotated images and thus lack the ability of continually learning new tasks (i.e.
View Article and Find Full Text PDFMed Image Anal
July 2024
In recent years, deep learning (DL) has shown great potential in the field of dermatological image analysis. However, existing datasets in this domain have significant limitations, including a small number of image samples, limited disease conditions, insufficient annotations, and non-standardized image acquisitions. To address these shortcomings, we propose a novel framework called DermSynth3D.
View Article and Find Full Text PDFModern deep learning training procedures rely on model regularization techniques such as data augmentation methods, which generate training samples that increase the diversity of data and richness of label information. A popular recent method, , uses convex combinations of pairs of original samples to generate new samples. However, as we show in our experiments, can produce undesirable synthetic samples, where the data is sampled off the manifold and can contain incorrect labels.
View Article and Find Full Text PDFArtif Intell Med
February 2024
Clinical evaluation evidence and model explainability are key gatekeepers to ensure the safe, accountable, and effective use of artificial intelligence (AI) in clinical settings. We conducted a clinical user-centered evaluation with 35 neurosurgeons to assess the utility of AI assistance and its explanation on the glioma grading task. Each participant read 25 brain MRI scans of patients with gliomas, and gave their judgment on the glioma grading without and with the assistance of AI prediction and explanation.
View Article and Find Full Text PDFIn positron emission tomography (PET), attenuation and scatter corrections are necessary steps toward accurate quantitative reconstruction of the radiopharmaceutical distribution. Inspired by recent advances in deep learning, many algorithms based on convolutional neural networks have been proposed for automatic attenuation and scatter correction, enabling applications to CT-less or MR-less PET scanners to improve performance in the presence of CT-related artifacts. A known characteristic of PET imaging is to have varying tracer uptakes for various patients and/or anatomical regions.
View Article and Find Full Text PDFIdentification and morphological analysis of mitochondria-ER contacts (MERCs) by fluorescent microscopy is limited by subpixel resolution interorganelle distances. Here, the membrane contact site (MCS) detection algorithm, MCS-DETECT, reconstructs subpixel resolution MERCs from 3D super-resolution image volumes. MCS-DETECT shows that elongated ribosome-studded riboMERCs, present in HT-1080 but not COS-7 cells, are morphologically distinct from smaller smooth contacts and larger contacts induced by mitochondria-ER linker expression in COS-7 cells.
View Article and Find Full Text PDFLarge-scale processing of heterogeneous datasets in interdisciplinary research often requires time-consuming manual data curation. Ambiguity in the data layout and preprocessing conventions can easily compromise reproducibility and scientific discovery, and even when detected, it requires time and effort to be corrected by domain experts. Poor data curation can also interrupt processing jobs on large computing clusters, causing frustration and delays.
View Article and Find Full Text PDFMed Image Anal
August 2023
Skin cancer is a major public health problem that could benefit from computer-aided diagnosis to reduce the burden of this common disease. Skin lesion segmentation from images is an important step toward achieving this goal. However, the presence of natural and artificial artifacts (e.
View Article and Find Full Text PDFInt J Speech Technol
January 2023
Clearly articulated speech, relative to plain-style speech, has been shown to improve intelligibility. We examine if visible speech cues in video only can be systematically modified to enhance clear-speech visual features and improve intelligibility. We extract clear-speech visual features of English words varying in vowels produced by multiple male and female talkers.
View Article and Find Full Text PDFExplaining model decisions from medical image inputs is necessary for deploying deep neural network (DNN) based models as clinical decision assistants. The acquisition of multi-modal medical images is pervasive in practice for supporting the clinical decision-making process. Multi-modal images capture different aspects of the same underlying regions of interest.
View Article and Find Full Text PDFIdentification of small objects in fluorescence microscopy is a non-trivial task burdened by parameter-sensitive algorithms, for which there is a clear need for an approach that adapts dynamically to changing imaging conditions. Here, we introduce an adaptive object detection method that, given a microscopy image and an image level label, uses kurtosis-based matching of the distribution of the image differential to express operator intent in terms of recall or precision. We show how a theoretical upper bound of the statistical distance in feature space enables application of belief theory to obtain statistical support for each detected object, capturing those aspects of the image that support the label, and to what extent.
View Article and Find Full Text PDFMed Image Anal
February 2023
Explainable artificial intelligence (XAI) is essential for enabling clinical users to get informed decision support from AI and comply with evidence-based medical practice. Applying XAI in clinical settings requires proper evaluation criteria to ensure the explanation technique is both technically sound and clinically useful, but specific support is lacking to achieve this goal. To bridge the research gap, we propose the Clinical XAI Guidelines that consist of five criteria a clinical XAI needs to be optimized for.
View Article and Find Full Text PDFCell Mol Life Sci
October 2022
Mitochondria are major sources of cytotoxic reactive oxygen species (ROS), such as superoxide and hydrogen peroxide, that when uncontrolled contribute to cancer progression. Maintaining a finely tuned, healthy mitochondrial population is essential for cellular homeostasis and survival. Mitophagy, the selective elimination of mitochondria by autophagy, monitors and maintains mitochondrial health and integrity, eliminating damaged ROS-producing mitochondria.
View Article and Find Full Text PDFSupervised deep learning has become a standard approach to solving medical image segmentation tasks. However, serious difficulties in attaining pixel-level annotations for sufficiently large volumetric datasets in real-life applications have highlighted the critical need for alternative approaches, such as semi-supervised learning, where model training can leverage small expert-annotated datasets to enable learning from much larger datasets without laborious annotation. Most of the semi-supervised approaches combine expert annotations and machine-generated annotations with equal weights within deep model training, despite the latter annotations being relatively unreliable and likely to affect model optimization negatively.
View Article and Find Full Text PDFDrug repurposing can accelerate the identification of effective compounds for clinical use against SARS-CoV-2, with the advantage of pre-existing clinical safety data and an established supply chain. RNA viruses such as SARS-CoV-2 manipulate cellular pathways and induce reorganization of subcellular structures to support their life cycle. These morphological changes can be quantified using bioimaging techniques.
View Article and Find Full Text PDF