Incomplete Multi-modal Disentanglement Learning with Application to Alzheimer's Disease Diagnosis.

Multi-modal neuroimaging data, including magnetic resonance imaging (MRI) and fluorodeoxyglucose positron emission tomography (PET), have greatly advanced the computer-aided diagnosis of Alzheimer's disease (AD) by providing shared and complementary information. However, the problem of incomplete multi-modal data remains inevitable and challenging. Conventional strategies that exclude subjects with missing data or synthesize missing scans either result in substantial sample reduction or introduce unwanted noise.

STF: A spherical transformer for versatile cortical surfaces applications.

Inspired by the remarkable success of attention mechanisms in various applications, there is a growing need to adapt the Transformer architecture from conventional Euclidean domains to non-Euclidean spaces commonly encountered in medical imaging. Structures such as brain cortical surfaces, represented by triangular meshes, exhibit spherical topology and present unique challenges. To address this, we propose the Spherical Transformer (STF), a versatile backbone that leverages self-attention for analyzing cortical surface data.

UNSUPERVISED CORTICAL SURFACE REGISTRATION NETWORK FOR ALIGNING GYRALNET.

The cortical 3-hinge gyrus (3HG) and its network (GyralNet) play key roles in understanding the regularity and variability of brain structure and function. However, existing cortical surface registration methods overlook these features, resulting in suboptimal alignment across subjects. Currently, no 3HG and GyralNet atlas exist for registration, and generation of the corresponding atlas requires extensive runtime using traditional methods.

Choroid plexus area and choroid plexus /lateral ventricle area index are potential imaging markers for freezing of gait in Parkinson's disease.

Background: The choroid plexus (CP), an important structure involved in cerebrospinal fluid (CSF) circulation, plays a key role in clearing harmful metabolites from the brain. However, the relationship between CP and the development of Parkinson's disease (PD) remains unclear, especially in those with freezing of gait (FOG). We aim to investigate the association between the CP area and CP/lateral ventricle area (CP/Ven) index with clinical symptoms of PD and the development of FOG.

Flexible Individualized Developmental Prediction of Infant Cortical Surface Maps via Intensive Triplet Autoencoder.

Computational methods for prediction of the dynamic and complex development of the infant cerebral cortex are critical and highly desired for a better understanding of early brain development in health and disease. Although a few methods have been proposed, they are limited to predicting cortical surface maps at predefined ages and require a large amount of strictly paired longitudinal data at these ages for model training. However, longitudinal infant images are typically acquired at highly irregular and nonuniform scanning ages, thus leading to limited training data for these methods and low flexibility and accuracy.

Longitudinally consistent registration and parcellation of cortical surfaces using semi-supervised learning.

Temporally consistent and accurate registration and parcellation of longitudinal cortical surfaces is of great importance in studying longitudinal morphological and functional changes of human brains. However, most existing methods are developed for registration or parcellation of a single cortical surface. When applying to longitudinal studies, these methods independently register/parcellate each surface from longitudinal scans, thus often generating longitudinally inconsistent and inaccurate results, especially in small or ambiguous cortical regions.

A joint brain extraction and image quality assessment framework for fetal brain MRI slices.

Brain extraction and image quality assessment are two fundamental steps in fetal brain magnetic resonance imaging (MRI) 3D reconstruction and quantification. However, the randomness of fetal position and orientation, the variability of fetal brain morphology, maternal organs around the fetus, and the scarcity of data samples, all add excessive noise and impose a great challenge to automated brain extraction and quality assessment of fetal MRI slices. Conventionally, brain extraction and quality assessment are typically performed independently.

PETS-Nets: Joint Pose Estimation and Tissue Segmentation of Fetal Brains Using Anatomy-Guided Networks.

Fetal Magnetic Resonance Imaging (MRI) is challenged by fetal movements and maternal breathing. Although fast MRI sequences allow artifact free acquisition of individual 2D slices, motion frequently occurs in the acquisition of spatially adjacent slices. Motion correction for each slice is thus critical for the reconstruction of 3D fetal brain MRI.

Weakly Supervised Cerebellar Cortical Surface Parcellation with Self-Visual Representation Learning.

The cerebellum (i.e., little brain) plays an important role in motion and balances control abilities, despite its much smaller size and deeper sulci compared to the cerebrum.

Fast Spherical Mapping of Cortical Surface Meshes Using Deep Unsupervised Learning.

Spherical mapping of cortical surface meshes provides a more convenient and accurate space for cortical surface registration and analysis and thus has been widely adopted in neuroimaging field. Conventional approaches typically first inflate and project the original cortical surface mesh onto a sphere to generate an initial spherical mesh which contains large distortions. Then they iteratively reshape the spherical mesh to minimize the metric (distance), area or angle distortions.

GEOMETRIC CONSTRAINED DEEP LEARNING FOR MOTION CORRECTION OF FETAL BRAIN MR IMAGES.

Robust motion correction of fetal brain MRI slices is crucial for 3D brain volume reconstruction. However, conventional methods can only handle a limited range of motion. Hence, a deep learning model based on geometric constraints is proposed in order to predict the arbitrary motion of fetal brain MRI slices in a standard anatomical space, which consists of a global motion estimation network and a relative motion estimation network.

Deformable Spherical Transformer for Cerebellar Surface Parcellation.

In neuroimaging analysis, accurate parcellation of the extremely folded cerebellar cortex is of immense importance for both structural and functional studies. To this end, we aim to develop a novel end-to-end deep learning-based method for automatic parcellation of the cerebellar cortical surface, which has an intrinsic spherical topology. Motivated by the success of Transformer, we employ Spherical Transformer to leverage its ability to model long-range dependency.

An attention-based context-informed deep framework for infant brain subcortical segmentation.

Precise segmentation of subcortical structures from infant brain magnetic resonance (MR) images plays an essential role in studying early subcortical structural and functional developmental patterns and diagnosis of related brain disorders. However, due to the dynamic appearance changes, low tissue contrast, and tiny subcortical size in infant brain MR images, infant subcortical segmentation is a challenging task. In this paper, we propose a context-guided, attention-based, coarse-to-fine deep framework to precisely segment the infant subcortical structures.

Learning 4D Infant Cortical Surface Atlas with Unsupervised Spherical Networks.

Spatiotemporal (4D) cortical surface atlas during infancy plays an important role for surface-based visualization, normalization and analysis of the dynamic early brain development. Conventional atlas construction methods typically rely on classical group-wise registration on sub-populations and ignore longitudinal constraints, thus having main issues: 1) constructing templates at discrete time points; 2) resulting in longitudinal inconsistency among different age's atlases; and 3) taking extremely long runtime. To address these issues, in this paper, we propose a fast incorporating to enforce the within-subject temporal correspondence in the atlas space.

Spherical Transformer on Cortical Surfaces.

Motivated by the recent great success of attention modeling in computer vision, it is highly desired to extend the Transformer architecture from the conventional Euclidean space to non-Euclidean spaces. Given the intrinsic spherical topology of brain cortical surfaces in neuroimaging, in this study, we propose a novel Spherical Transformer, an effective general-purpose backbone using the self-attention mechanism for analysis of cortical surface data represented by triangular meshes. By mapping the cortical surface onto a sphere and splitting it uniformly into overlapping spherical surface patches, we encode the long-range dependency within each patch by the self-attention operation and formulate the cross-patch feature transmission via overlapping regions.

A Deep Network for Joint Registration and Parcellation of Cortical Surfaces.

Cortical surface registration and parcellation are two essential steps in neuroimaging analysis. Conventionally, they are performed independently as two tasks, ignoring the inherent connections of these two closely-related tasks. Essentially, both tasks rely on meaningful cortical feature representations, so they can be jointly optimized by learning shared useful cortical features.

SPHERICAL TRANSFORMER FOR QUALITY ASSESSMENT OF PEDIATRIC CORTICAL SURFACES.

Brain cortical surfaces, which have an intrinsic spherical topology, are typically represented by triangular meshes and mapped onto a spherical manifold in neuroimaging analysis. Inspired by the strong capability of feature learning in Convolutional Neural Networks (CNNs), spherical CNNs have been developed accordingly and achieved many successes in cortical surface analysis. Motivated by the recent success of the transformer, in this paper, for the first of time, we extend the transformer into the spherical space and propose the spherical transformer, which can better learn contextual and structural features than spherical CNNs.

A 4D infant brain volumetric atlas based on the UNC/UMN baby connectome project (BCP) cohort.

Spatiotemporal (four-dimensional) infant-dedicated brain atlases are essential for neuroimaging analysis of early dynamic brain development. However, due to the substantial technical challenges in the acquisition and processing of infant brain MR images, 4D atlases densely covering the dynamic brain development during infancy are still scarce. Few existing ones generally have fuzzy tissue contrast and low spatiotemporal resolution, leading to degraded accuracy of atlas-based normalization and subsequent analyses.

Learning Spatiotemporal Probabilistic Atlas of Fetal Brains with Anatomically Constrained Registration Network.

Brain atlases are of fundamental importance for analyzing the dynamic neurodevelopment in fetal brain studies. Since the brain size, shape, and anatomical structures change rapidly during the prenatal period, it is essential to construct a spatiotemporal (4D) atlas equipped with tissue probability maps, which can preserve sharper early brain folding patterns for accurately characterizing dynamic changes in fetal brains and provide tissue prior informations for related tasks, e.g.

Construction of Longitudinally Consistent 4D Infant Cerebellum Atlases Based on Deep Learning.

Longitudinal infant dedicated cerebellum atlases play a fundamental role in characterizing and understanding the dynamic cerebellum development during infancy. However, due to the limited spatial resolution, low tissue contrast, tiny folding structures, and rapid growth of the cerebellum during this stage, it is challenging to build such atlases while preserving clear folding details. Furthermore, the existing atlas construction methods typically independently build discrete atlases based on samples for each age group without considering the within-subject temporal consistency, which is critical for large-scale longitudinal studies.

Longitudinal brain atlases of early developing cynomolgus macaques from birth to 48 months of age.

Longitudinal brain imaging atlases with densely sampled time-points and ancillary anatomical information are of fundamental importance in studying early developmental characteristics of human and non-human primate brains during infancy, which feature extremely dynamic imaging appearance, brain shape and size. However, for non-human primates, which are highly valuable animal models for understanding human brains, the existing brain atlases are mainly developed based on adults or adolescents, denoting a notable lack of temporally densely-sampled atlases covering the dynamic early brain development. To fill this critical gap, in this paper, we construct a comprehensive set of longitudinal brain atlases and associated tissue probability maps (gray matter, white matter, and cerebrospinal fluid) with totally 12 time-points from birth to 4 years of age (i.

S3Reg: Superfast Spherical Surface Registration Based on Deep Learning.

Cortical surface registration is an essential step and prerequisite for surface-based neuroimaging analysis. It aligns cortical surfaces across individuals and time points to establish cross-sectional and longitudinal cortical correspondences to facilitate neuroimaging studies. Though achieving good performance, available methods are either time consuming or not flexible to extend to multiple or high dimensional features.

Anatomy-Guided Convolutional Neural Network for Motion Correction in Fetal Brain MRI.

Fetal Magnetic Resonance Imaging (MRI) is challenged by the fetal movements and maternal breathing. Although fast MRI sequences allow artifact free acquisition of individual 2D slices, motion commonly occurs in between slices acquisitions. Motion correction for each slice is thus very important for reconstruction of 3D fetal brain MRI, but is highly operator-dependent and time-consuming.

Unsupervised Learning for Spherical Surface Registration.

Current spherical surface registration methods achieve good performance on alignment and spatial normalization of cortical surfaces across individuals in neuroimaging analysis. However, they are computationally intensive, since they have to optimize an objective function independently for each pair of surfaces. In this paper, we present a fast learning-based algorithm that makes use of the recent development in spherical Convolutional Neural Networks (CNNs) for spherical cortical surface registration.

Spherical Deformable U-Net: Application to Cortical Surface Parcellation and Development Prediction.

Convolutional Neural Networks (CNNs) have achieved overwhelming success in learning-related problems for 2D/3D images in the Euclidean space. However, unlike in the Euclidean space, the shapes of many structures in medical imaging have an inherent spherical topology in a manifold space, e.g.