CASPIANET++: A multidimensional Channel-Spatial Asymmetric attention network with Noisy Student Curriculum Learning paradigm for brain tumor segmentation.

Comput Biol Med

Electrical and Computer Systems Engineering Discipline, School of Engineering, Monash University Malaysia, Bandar Sunway, 47500, Malaysia; School of Electrical and Computer Engineering, The University of Oklahoma, Norman, OK, 73019, USA. Electronic address:

Published: September 2021


Category Ranking

98%

Total Visits

921

Avg Visit Duration

2 minutes

Citations

20

Article Abstract

Convolutional neural networks (CNNs) have been used quite successfully for semantic segmentation of brain tumors. However, current CNNs and attention mechanisms are stochastic in nature and neglect the morphological indicators used by radiologists to manually annotate regions of interest. In this paper, we introduce a channel and spatial wise asymmetric attention (CASPIAN) by leveraging the inherent structure of tumors to detect regions of saliency. To demonstrate the efficacy of our proposed layer, we integrate this into a well-established convolutional neural network (CNN) architecture to achieve higher Dice scores, with less GPU resources. Also, we investigate the inclusion of auxiliary multiscale and multiplanar attention branches to increase the spatial context crucial in semantic segmentation tasks. The resulting architecture is the new CASPIANET++, which achieves Dice Scores of 91.19%, 87.6% and 81.03% for whole tumor, tumor core and enhancing tumor respectively. Furthermore, driven by the scarcity of brain tumor data, we investigate the Noisy Student method for segmentation tasks. Our new Noisy Student Curriculum Learning paradigm, which infuses noise incrementally to increase the complexity of the training images exposed to the network, further boosts the enhancing tumor region to 81.53%. Additional validation performed on the BraTS2020 data shows that the Noisy Student Curriculum Learning method works well without any additional training or finetuning.

Download full-text PDF

Source
http://dx.doi.org/10.1016/j.compbiomed.2021.104690DOI Listing

Publication Analysis

Top Keywords

noisy student
16
student curriculum
12
curriculum learning
12
asymmetric attention
8
learning paradigm
8
brain tumor
8
convolutional neural
8
semantic segmentation
8
dice scores
8
segmentation tasks
8

Similar Publications

Adolescents' risky sexual behaviour and increased teenage pregnancies have become a concern in sub-Saharan Africa, including KwaZulu-Natal province. This study explored school-going adolescents' perceptions of sexual reproductive health and rights in KwaZulu-Natal, South Africa. An exploratory, descriptive qualitative design was used to select 20 school-going adolescents in grades 10 to 12 using non-probability quota sampling.

View Article and Find Full Text PDF

Objective: To investigate sex-specific effects in self-reported auditory abilities using an adapted version of the Speech, Spatial and Qualities (SSQ) questionnaire.

Design And Study Sample: Three mixed-model analyses of variance were performed, one for each questionnaire section, using rationalised arcsine unit-transformed scores. Fifty-one females and 39 males with normal or near-normal hearing.

View Article and Find Full Text PDF

Semi-supervised medical image segmentation is essential for alleviating the cost of manual annotation in clinical applications. However, existing methods often suffer from unreliable pseudo-labels and confirmation bias in consistency-based training, which can lead to unstable optimization and degraded performance. To address these issues, a novel method named dual-Student adversarial framework with discriminator and consistency-driven learning for semi-supervised medical image segmentation is proposed.

View Article and Find Full Text PDF

Bayesian symmetric regression offers a principled framework for modeling data characterized by heavy-tailed errors and censoring, both of which are frequently encountered in medical research. Classical regression methods often yield unreliable results in the presence of outliers or incomplete observations, as commonly seen in clinical and survival data. To address these limitations, we develop a robust Bayesian regression model that incorporates symmetric error distributions such as the Student-t and Cauchy, providing improved resistance to extreme values.

View Article and Find Full Text PDF

This work introduces T-Loss, a novel and robust loss function for medical image segmentation. T-Loss is derived from the negative log-likelihood of the Student-t distribution and excels at handling noisy masks by dynamically controlling its sensitivity through a single parameter. This parameter is optimized during the backpropagation process, obviating the need for additional computations or prior knowledge about the extent and distribution of noisy labels.

View Article and Find Full Text PDF