Publications

2022

Karimi, Davood, and Ali Gholipour. (2022) 2022. “Diffusion tensor estimation with transformer neural networks”. Artif Intell Med 130: 102330. https://doi.org/10.1016/j.artmed.2022.102330.
Diffusion tensor imaging (DTI) is a widely used method for studying brain white matter development and degeneration. However, standard DTI estimation methods depend on a large number of high-quality measurements. This would require long scan times and can be particularly difficult to achieve with certain patient populations such as neonates. Here, we propose a method that can accurately estimate the diffusion tensor from only six diffusion-weighted measurements. Our method achieves this by learning to exploit the relationships between the diffusion signals and tensors in neighboring voxels. Our model is based on transformer networks, which represent the state of the art in modeling the relationship between signals in a sequence. In particular, our model consists of two such networks. The first network estimates the diffusion tensor based on the diffusion signals in a neighborhood of voxels. The second network provides more accurate tensor estimations by learning the relationships between the diffusion signals as well as the tensors estimated by the first network in neighboring voxels. Our experiments with three datasets show that our proposed method achieves highly accurate estimations of the diffusion tensor and is significantly superior to three competing methods. Estimations produced by our method with six diffusion-weighted measurements are comparable with those of standard estimation methods with 30-88 diffusion-weighted measurements. Hence, our method promises shorter scan times and more reliable assessment of brain white matter, particularly in non-cooperative patients such as neonates and infants.
Maffei, Chiara, Gabriel Girard, Kurt Schilling, Dogu Baran Aydogan, Nagesh Adluru, Andrey Zhylka, Ye Wu, et al. 2022. “Insights from the IronTract challenge: Optimal methods for mapping brain pathways from multi-shell diffusion MRI”. Neuroimage 257: 119327. https://doi.org/10.1016/j.neuroimage.2022.119327.
Limitations in the accuracy of brain pathways reconstructed by diffusion MRI (dMRI) tractography have received considerable attention. While the technical advances spearheaded by the Human Connectome Project (HCP) led to significant improvements in dMRI data quality, it remains unclear how these data should be analyzed to maximize tractography accuracy. Over a period of two years, we have engaged the dMRI community in the IronTract Challenge, which aims to answer this question by leveraging a unique dataset. Macaque brains that have received both tracer injections and ex vivo dMRI at high spatial and angular resolution allow a comprehensive, quantitative assessment of tractography accuracy on state-of-the-art dMRI acquisition schemes. We find that, when analysis methods are carefully optimized, the HCP scheme can achieve similar accuracy as a more time-consuming, Cartesian-grid scheme. Importantly, we show that simple pre- and post-processing strategies can improve the accuracy and robustness of many tractography methods. Finally, we find that fiber configurations that go beyond crossing (e.g., fanning, branching) are the most challenging for tractography. The IronTract Challenge remains open and we hope that it can serve as a valuable validation tool for both users and developers of dMRI analysis methods.
Bethlehem, Seidlitz, White, Vogel, Anderson, Adamson, Adler, et al. 2022. “Brain charts for the human lifespan”. Nature 604 (7906): 525-33. https://doi.org/10.1038/s41586-022-04554-y.
Over the past few decades, neuroimaging has become a ubiquitous tool in basic research and clinical studies of the human brain. However, no reference standards currently exist to quantify individual differences in neuroimaging metrics over time, in contrast to growth charts for anthropometric traits such as height and weight1. Here we assemble an interactive open resource to benchmark brain morphology derived from any current or future sample of MRI data ( http://www.brainchart.io/ ). With the goal of basing these reference charts on the largest and most inclusive dataset available, acknowledging limitations due to known biases of MRI studies relative to the diversity of the global population, we aggregated 123,984 MRI scans, across more than 100 primary studies, from 101,457 human participants between 115 days post-conception to 100 years of age. MRI metrics were quantified by centile scores, relative to non-linear trajectories2 of brain structural changes, and rates of change, over the lifespan. Brain charts identified previously unreported neurodevelopmental milestones3, showed high stability of individuals across longitudinal assessments, and demonstrated robustness to technical and methodological differences between primary studies. Centile scores showed increased heritability compared with non-centiled MRI phenotypes, and provided a standardized measure of atypical brain structure that revealed patterns of neuroanatomical variation across neurological and psychiatric disorders. In summary, brain charts are an essential step towards robust quantification of individual variation benchmarked to normative trajectories in multiple, commonly used neuroimaging phenotypes.
Vasung, Lana, Caitlin Rollins, Jennings Zhang, Clemente Velasco-Annis, Edward Yang, Ivy Lin, Jason Sutin, et al. 2022. “Abnormal development of transient fetal zones in mild isolated fetal ventriculomegaly”. Cereb Cortex. https://doi.org/10.1093/cercor/bhac125.
Mild isolated fetal ventriculomegaly (iFVM) is the most common abnormality of the fetal central nervous system. It is characterized by enlargement of one or both of the lateral ventricles (defined as ventricular width greater than 10 mm, but less than 12 mm). Despite its high prevalence, the pathophysiology of iFVM during fetal brain development and the neurobiological substrate beyond ventricular enlargement remain unexplored. In this work, we aimed to establish the relationships between the structural development of transient fetal brain zones/compartments and increased cerebrospinal fluid volume. For this purpose, we used in vivo structural T2-weighted magnetic resonance imaging of 89 fetuses (48 controls and 41 cases with iFVM). Our results indicate abnormal development of transient zones/compartments belonging to both hemispheres (i.e. on the side with and also on the contralateral side without a dilated ventricle) in fetuses with iFVM. Specifically, compared to controls, we observed enlargement of proliferative zones and overgrowth of the cortical plate in iFVM with associated reduction of volumes of central structures, subplate, and fetal white matter. These results indicate that enlarged lateral ventricles might be linked to the development of transient fetal zones and that global brain development should be taken into consideration when evaluating iFVM.
Karimi, Davood, Haoran Dou, and Ali Gholipour. (2022) 2022. “Medical Image Segmentation Using Transformer Networks”. IEEE Access 10: 29322-32. https://doi.org/10.1109/access.2022.3156894.
Deep learning models represent the state of the art in medical image segmentation. Most of these models are fully-convolutional networks (FCNs), namely each layer processes the output of the preceding layer with convolution operations. The convolution operation enjoys several important properties such as sparse interactions, parameter sharing, and translation equivariance. Because of these properties, FCNs possess a strong and useful inductive bias for image modeling and analysis. However, they also have certain important shortcomings, such as performing a fixed and pre-determined operation on a test image regardless of its content and difficulty in modeling long-range interactions. In this work we show that a different deep neural network architecture, based entirely on self-attention between neighboring image patches and without any convolution operations, can achieve more accurate segmentations than FCNs. Our proposed model is based directly on the transformer network architecture. Given a 3D image block, our network divides it into non-overlapping 3D patches and computes a 1D embedding for each patch. The network predicts the segmentation map for the block based on the self-attention between these patch embeddings. Furthermore, in order to address the common problem of scarcity of labeled medical images, we propose methods for pre-training this model on large corpora of unlabeled images. Our experiments show that the proposed model can achieve segmentation accuracies that are better than several state of the art FCN architectures on two datasets. Our proposed network can be trained using only tens of labeled images. Moreover, with the proposed pre-training strategies, our network outperforms FCNs when labeled training data is small.
Weijden, Chris Wj, Anouk Hoorn, Jan Hendrik Potze, Remco Renken, Ronald Jh Borra, Rudi Ajo Dierckx, Ingomar Gutmann, et al. 2022. “Diffusion-derived parameters in lesions, peri-lesion, and normal-appearing white matter in multiple sclerosis using tensor, kurtosis, and fixel-based analysis”. J Cereb Blood Flow Metab, 271678X221107953. https://doi.org/10.1177/0271678X221107953.
Neuronal damage is the primary cause of long-term disability of multiple sclerosis (MS) patients. Assessment of axonal integrity from diffusion MRI parameters might enable better disease characterisation. 16 diffusion derived measurements from diffusion tensor imaging (DTI), diffusion kurtosis imaging (DKI), and fixel-based analysis (FBA) in lesions, peri-lesion and normal appearing white matter were investigated. Diffusion MRI scans of 11 MS patients were processed to generate DTI, DKI, and FBA images. Fractional anisotropy (FA) and fibre density (FD) were used to assess axonal integrity across brain regions. Subsequently, 359 lesions were identified, and lesion and peri-lesion segmentation was performed using structural T1w, T2w, T2w-FLAIR, and T1w post-contrast MRI. The segmentations were then used to extract 16 diffusion MRI parameters from lesion, peri-lesion, and contralateral normal appearing white matter (NAWM). The measurements for axonal integrity, DTI-FA, DKI-FA, FBA-FD, produced similar results. All diffusion MRI parameters were affected in lesions as compared to NAWM (p < 0.001), confirming loss of axonal integrity in lesions. In peri-lesions, most parameters, except FBA-FD, were also significantly different from NAWM, although the effect size was smaller than in lesions. The reduction in axonal integrity in peri-lesions, despite unaffected fibre density estimates, suggests an effect of Wallerian degeneration.
Machado-Rivas, Fedel, Jasmine Gandhi, Jungwhan John Choi, Clemente Velasco-Annis, Onur Afacan, Simon Warfield, Ali Gholipour, and Camilo Jaimes. (2022) 2022. “Normal Growth, Sexual Dimorphism, and Lateral Asymmetries at Fetal Brain MRI”. Radiology 303 (1): 162-70. https://doi.org/10.1148/radiol.211222.
Background Tools in image reconstruction, motion correction, and segmentation have enabled the accurate volumetric characterization of fetal brain growth at MRI. Purpose To evaluate the volumetric growth of intracranial structures in healthy fetuses, accounting for gestational age (GA), sex, and laterality with use of a spatiotemporal MRI atlas of fetal brain development. Materials and Methods T2-weighted 3.0-T half-Fourier acquired single-shot turbo spin-echo sequence MRI was performed in healthy fetuses from prospectively recruited pregnant volunteers from March 2013 to May 2019. A previously validated section-to-volume reconstruction algorithm was used to generate intensity-normalized superresolution three-dimensional volumes that were registered to a fetal brain MRI atlas with 28 anatomic regions of interest. Atlas-based segmentation was performed and manually refined. Labels included the bilateral hippocampus, amygdala, caudate nucleus, lentiform nucleus, thalamus, lateral ventricle, cerebellum, cortical plate, hemispheric white matter, internal capsule, ganglionic eminence, ventricular zone, corpus callosum, brainstem, hippocampal commissure, and extra-axial cerebrospinal fluid. For fetuses younger than 31 weeks of GA, the subplate and intermediate zones were delineated. A linear regression analysis was used to determine weekly age-related change adjusted for sex and laterality. Results The final analytic sample consisted of 122 MRI scans in 98 fetuses (mean GA, 29 weeks ± 5 [range, 20-38 weeks]). All structures had significant volume growth with increasing GA (P < .001). Weekly age-related change for individual structures in the brain parenchyma ranged from 2.0% (95% CI: 0.9, 3.1; P < .001) in the hippocampal commissure to 19.4% (95% CI: 18.7, 20.1; P < .001) in the cerebellum. The largest sex-related differences were 22.1% higher volume in male fetuses for the lateral ventricles (95% CI: 10.9, 34.4; P < .001). There was rightward volumetric asymmetry of 15.6% for the hippocampus (95% CI: 14.2, 17.2; P < .001) and leftward volumetric asymmetry of 8.1% for the lateral ventricles (95% CI: 3.7, 12.2; P < .001). Conclusion With use of a spatiotemporal MRI atlas, volumetric growth of the fetal brain showed complex trajectories dependent on structure, gestational age, sex, and laterality. © RSNA, 2021 Online supplemental material is available for this article. See also the editorial by Rollins in this issue.
Balachandrasekaran, Arvind, Alexander Cohen, Onur Afacan, Simon Warfield, and Ali Gholipour. 2022. “Reducing the Effects of Motion Artifacts in fMRI: A Structured Matrix Completion Approach”. IEEE Trans Med Imaging 41 (1): 172-85. https://doi.org/10.1109/TMI.2021.3107829.
Functional MRI (fMRI) is widely used to study the functional organization of normal and pathological brains. However, the fMRI signal may be contaminated by subject motion artifacts that are only partially mitigated by motion correction strategies. These artifacts lead to distance-dependent biases in the inferred signal correlations. To mitigate these spurious effects, motion-corrupted volumes are censored from fMRI time series. Censoring can result in discontinuities in the fMRI signal, which may lead to substantial alterations in functional connectivity analysis. We propose a new approach to recover the missing entries from censoring based on structured low rank matrix completion. We formulated the artifact-reduction problem as the recovery of a super-resolved matrix from unprocessed fMRI measurements. We enforced a low rank prior on a large structured matrix, formed from the samples of the time series, to recover the missing entries. The recovered time series, in addition to being motion compensated, are also slice-time corrected at a fine temporal resolution. To achieve a fast and memory-efficient solution for our proposed optimization problem, we employed a variable splitting strategy. We validated the algorithm with simulations, data acquired under different motion conditions, and datasets from the ABCD study. Functional connectivity analysis showed that the proposed reconstruction resulted in connectivity matrices with lower errors in pair-wise correlation than non-censored and censored time series based on a standard processing pipeline. In addition, seed-based correlation analyses showed improved delineation of the default mode network. These demonstrate that the method can effectively reduce the adverse effects of motion in fMRI analysis.
Sadhwani, Anjali, David Wypij, Valerie Rofeberg, Ali Gholipour, Maggie Mittleman, Julia Rohde, Clemente Velasco-Annis, et al. 2022. “Fetal Brain Volume Predicts Neurodevelopment in Congenital Heart Disease”. Circulation. https://doi.org/10.1161/CIRCULATIONAHA.121.056305.
Background: Neurodevelopmental impairment is common in children with congenital heart disease (CHD), yet postnatal variables explain only 30% of the variance in outcomes. To explore whether the antecedents for neurodevelopmental disabilities might begin in utero, we analyzed whether fetal brain volume predicted subsequent neurodevelopmental outcome in children with CHD. Methods: Fetuses with isolated CHD and sociodemographically comparable healthy control fetuses underwent fetal brain MRI and 2-year neurodevelopmental evaluation with the Bayley Scales of Infant and Toddler Development (Bayley-III) and the Adaptive Behavior Assessment System (ABAS-3). Hierarchical regression evaluated potential predictors of Bayley-III and ABAS-3 outcomes in the CHD group, including fetal total brain volume adjusted for gestational age and sex, sociodemographic characteristics, birth parameters, and medical history. Results: The CHD group (n=52) had lower Bayley-III cognitive, language, and motor scores than the control group (n=26), but fetal brain volumes were similar. Within the CHD group, larger fetal total brain volume correlated with higher Bayley-III cognitive, language, and motor scores, and ABAS-3 adaptive functioning scores (r=0.32-0.47; all P<0.05), but not in the control group. Fetal brain volume predicted 10 21% of the variance in neurodevelopmental outcome measures in univariate analyses. Multivariable models that also included social class and postnatal factors explained 18-45% of the variance in outcome, depending on developmental domain. Moreover, in final multivariable models, fetal brain volume was the most consistent predictor of neurodevelopmental outcome across domains. Conclusions: Small fetal brain volume is a strong independent predictor of 2-year neurodevelopmental outcomes and may be an important imaging biomarker of future neurodevelopmental risk in CHD. Future studies are needed to support this hypothesis. Our findings support inclusion of fetal brain volume in risk stratification models and as a possible outcome in fetal neuroprotective intervention studies.
Sui, Yao, Onur Afacan, Camilo Jaimes, Ali Gholipour, and Simon Warfield. (2022) 2022. “Scan-Specific Generative Neural Network for MRI Super-Resolution Reconstruction”. IEEE Trans Med Imaging 41 (6): 1383-99. https://doi.org/10.1109/TMI.2022.3142610.
The interpretation and analysis of Magnetic resonance imaging (MRI) benefit from high spatial resolution. Unfortunately, direct acquisition of high spatial resolution MRI is time-consuming and costly, which increases the potential for motion artifact, and suffers from reduced signal-to-noise ratio (SNR). Super-resolution reconstruction (SRR) is one of the most widely used methods in MRI since it allows for the trade-off between high spatial resolution, high SNR, and reduced scan times. Deep learning has emerged for improved SRR as compared to conventional methods. However, current deep learning-based SRR methods require large-scale training datasets of high-resolution images, which are practically difficult to obtain at a suitable SNR. We sought to develop a methodology that allows for dataset-free deep learning-based SRR, through which to construct images with higher spatial resolution and of higher SNR than can be practically obtained by direct Fourier encoding. We developed a dataset-free learning method that leverages a generative neural network trained for each specific scan or set of scans, which in turn, allows for SRR tailored to the individual patient. With the SRR from three short duration scans, we achieved high quality brain MRI at an isotropic spatial resolution of 0.125 cubic mm with six minutes of imaging time for T2 contrast and an average increase of 7.2 dB (34.2%) in SNR to these short duration scans. Motion compensation was achieved by aligning the three short duration scans together. We assessed our technique on simulated MRI data and clinical data acquired from 15 subjects. Extensive experimental results demonstrate that our approach achieved superior results to state-of-the-art methods, while in parallel, performed at reduced cost as scans delivered with direct high-resolution acquisition.