Next Article in Journal
Ligand-Modulated Nuclearity and Geometry in Nickel(II) Hydrazone Complexes: From Mononuclear Complexes to Acetato- and/or Phenoxido-Bridged Clusters
Next Article in Special Issue
Functional Characterization of a Familial ALS-Associated Missense TBK1 (p-Arg573Gly) Mutation in Patient-Derived Lymphoblasts
Previous Article in Journal
Involvement of TRPM7 in Alcohol-Induced Damage of the Blood–Brain Barrier in the Presence of HIV Viral Proteins
Previous Article in Special Issue
SOMAscan Proteomics Identifies Novel Plasma Proteins in Amyotrophic Lateral Sclerosis Patients
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Review

Diffusion Tensor Imaging in Amyotrophic Lateral Sclerosis: Machine Learning for Biomarker Development

1
Department of Neurology, University of Ulm, Oberer Eselsberg 45, 89081 Ulm, Germany
2
German Center for Neurodegenerative Diseases (DZNE), 89081 Ulm, Germany
*
Author to whom correspondence should be addressed.
Int. J. Mol. Sci. 2023, 24(3), 1911; https://doi.org/10.3390/ijms24031911
Submission received: 30 December 2022 / Revised: 11 January 2023 / Accepted: 16 January 2023 / Published: 18 January 2023
(This article belongs to the Special Issue Amyotrophic Lateral Sclerosis as a Systemic Disease)

Abstract

:
Diffusion tensor imaging (DTI) allows the in vivo imaging of pathological white matter alterations, either with unbiased voxel-wise or hypothesis-guided tract-based analysis. Alterations of diffusion metrics are indicative of the cerebral status of patients with amyotrophic lateral sclerosis (ALS) at the individual level. Using machine learning (ML) models to analyze complex and high-dimensional neuroimaging data sets, new opportunities for DTI-based biomarkers in ALS arise. This review aims to summarize how different ML models based on DTI parameters can be used for supervised diagnostic classifications and to provide individualized patient stratification with unsupervised approaches in ALS. To capture the whole spectrum of neuropathological signatures, DTI might be combined with additional modalities, such as structural T1w 3-D MRI in ML models. To further improve the power of ML in ALS and enable the application of deep learning models, standardized DTI protocols and multi-center collaborations are needed to validate multimodal DTI biomarkers. The application of ML models to multiparametric MRI/multimodal DTI-based data sets will enable a detailed assessment of neuropathological signatures in patients with ALS and the development of novel neuroimaging biomarkers that could be used in the clinical workup.

1. Introduction

Neuroimaging is a standard tool in the clinical workup of neurodegenerative diseases. Parameterization of imaging data enables the development of objective and reliable biomarkers. A computational analysis of neuroimaging parameters has the potential to provide insights into complex disease mechanisms and might close important gaps in research [1]. As amyotrophic lateral sclerosis (ALS) is characterized by degeneration of the upper and lower motor neurons of the cerebral cortex, brainstem, and spinal cord [2], neuroimaging is a promising tool to assess neuropathology in vivo. The neuropathology of ALS is associated with a regional, four-stage distribution pattern of phosphorylated TDP-43 aggregates, as confirmed in postmortem studies [3,4]. Given that it is well-established that ALS is regarded as a multisystem disorder with extra-motor involvement [5], patients with ALS exhibit significant clinical heterogeneity, particularly in terms of site of onset, rate of progression, and cognitive impairment [6], which makes it difficult to effectively stratify patients for clinical trials in the development of novel therapies. Phenotypic heterogeneity hampers stratifying patients in early disease stages for clinical trials [7].
Magnetic resonance imaging (MRI) is part of the diagnostic procedures of ALS to exclude structural lesions and other etiologies of the clinical presentation. Objective and reliable in vivo neuroimaging biomarkers for early and accurate individualized prognosis and assessment of the cerebral status in ALS are still missing. Diffusion-weighted MRI (DWI) and diffusion tensor imaging (DTI) play a key role in this regard, as this MRI modality can reveal alterations in white matter (WM) by measuring the differences in constraints on the water diffusion in the brain [8]. The widely used scalar fractional anisotropy (FA) quantifies the degree of water diffusion anisotropy within voxels [9]. FA values range between 0 (highly isotropic diffusion) and 1 (highly anisotropic diffusion). Other metrics used to describe the constraints of water diffusion are the mean diffusivity (MD), i.e., the magnitude of the mobility of water molecules independent of directionality, the axial diffusivity (AD), i.e., the magnitude of diffusion parallel to axonal fiber tracts, and radial diffusivity (RD), i.e., diffusion in the direction perpendicular to the axonal fibers [9]. While FA is a summary measure of microstructural integrity and, thus, highly sensitive to microstructural changes, it is less specific to the type of change. MD is an inverse measure of the membrane density, AD tends to be variable in WM changes and axonal injury, and RD increases in WM with dysmyelination. Changes in the axonal diameters or density may also influence RD [10]. At the group level, WM alterations in neurodegenerative diseases can be assessed by unbiased whole-brain-based voxel-wise comparison of DTI metrics (e.g., [11]) or, after fiber tract reconstruction, by hypothesis-guided tract-wise analysis of DTI metrics (e.g., [11]).
In ALS, extensive regional alterations in diffusion metrics in the brain have been demonstrated [12,13]. Consistent findings are reductions in the FA along the corticospinal tract (CST) [14,15] and in the corpus callosum (CC) [16]. Longitudinally, the decrease in FA in the CST is associated with the disease severity [17]; recently, a prospective multicenter study demonstrated the feasibility of this regional diffusion metric as a progression marker [11].
The in vivo analysis of specific WM neuronal tracts allows for the neuropathological staging pattern to be translated to a DTI staging scheme for patients with ALS via a hypothesis-driven tract-of-interest-based approach [11]. During the progression of ALS, microstructural alterations indicated by decreased FA values occurring sequentially in the following tracts: the CST is affected first (stage 1), followed by the corticorubral and corticopontine tracts in stage 2 and the corticostriatal pathway in stage 3, while the involvement of the proximal part of the perforant pathway marks stage 4. The longitudinal applicability of this individualized staging system was confirmed [11].
In the evaluation of new therapeutic approaches in ALS, the current focus is on survival and loss of functionality as endpoints in clinical trials [18]. For example, fluid markers, such as neurofilaments (NF) [19], have proven successful in their use as biomarkers; here, DTI-based neuroimaging could be a valuable addition given that, ideally, a longitudinal biomarker should represent the (regional) progression of neuropathology. However, clinical scores are not fully able to capture cerebral alterations. In addition, functionality might temporarily not deteriorate under the influence of a drug without a change in the actual disease progression. Objective and reliable neuroimaging biomarkers that are sensitive to the progression of neuropathology in vivo might rectify this situation and potentially serve as endpoints in clinical trials.
This review summarizes the advantages and the potential of machine learning (ML)-based DTI methods for patient diagnosis and monitoring, and the future design of clinical DTI applications to ALS is conceptualized. As univariate neuroimaging methods have been successful at the group level but are of restricted usefulness at the individual level in providing definitive clinically useful biomarkers, ML approaches could also be employed for improving individual differential diagnosis.

2. Diagnostic Models

The clinical relevance of FA alterations along the CST is limited in the light of a meta-analysis of 30 studies which showed a pooled sensitivity of 65% for differentiating between patients with ALS and healthy persons [20]. Sensitivity varied little between studies, although regional FA quantification differed between region of interest (ROI)-based and tractography approaches and different field strengths. However, other regional ALS-associated FA alterations do not outperform the discrimination power of the CST [16,20,21]. Multivariate analysis approaches are promising to overcome the limitations of individually used DTI parameters for diagnostic predictions. Traditional statistical multivariate methods, such as z-score approaches, allow quantitative interpretation at the level of the individual subject in ALS [22], but capturing and accounting for the complex interactions between individual parameters remains difficult in these attempts. By analyzing high-dimensional data sets using ML models, novel opportunities are emerging for developing multivariate DTI biomarkers in ALS. As a branch of artificial intelligence (AI), ML algorithms and models automatically extract information from data to identify undiscovered patterns and relationships between different features and provide individualized predictions in healthcare settings [23]. Supervised ML is suitable for a wide range of binary classifications, such as predicting group membership in ‘patient vs. healthy controls’ scenarios, based on biomedical features in ALS research [24]. In clinical neuroimaging with sometimes limited sample sizes, standard supervised models, such as support vector machines (SVMs) and random forests (RFs), have been used in diagnostic settings and demonstrated their usefulness by retrieving robust results [1,25]. SVMs provide a robust classification algorithm by transforming data into a high-dimensional feature space, where a margin is maximized to separate classes [26]. Due to the transformation of the data, the underlying decision-making logic of the SVM cannot be interpreted directly. Decision trees provide better interpretability by classifying based on numerous binary decisions obtained from the data. An RF combines the results of an ensemble of decision trees, which increases the accuracy [27]. Overfitting (or underfitting) of ML algorithms is likely to occur with a limited number of samples per feature, i.e., parameter, in the model processing [24]. A minimum sample-to-feature ratio (SFR) of 10–15 is proposed as necessary based on historical statistical models, but modern algorithms may provide good fitting results with a lower SFR [28]. The implementation of standard ML models on DTI data is illustrated in Figure 1.
In addition to the prediction outcomes, most ML models also determine the importance of the features used, which enables data-driven feature selection. For such an unbiased approach to diagnostic classification in ALS, an SVM was used with all voxels of the FA maps as features (at a sample size of about 20 per group) [29]. Although an accuracy of 83% could be achieved after reducing the features to the 2400~3400 most discriminating ones in a second step, this result should be considered with caution due to the very low SFR and without validation on an independent test sample. Since ALS is a relatively rare disease, the sample size in (monocentric) clinical trials is often limited. Therefore, it might be useful to determine features a priori based on previous results in ALS from group studies and/or neuropathological considerations to address the SFR with the typically limited sample sizes [13]. The CST, therefore, is brought into focus as a predominant finding in group comparisons. Thus, RFs on all four diffusion metrics (FA, MD, RD, and AD) of the voxels assigned to the CST enabled inferences on the overall profile of the CST, leading to a diagnostic accuracy of 80% [30]. An addition of diffusion parameters of motor callosal tracts to CST diffusion metrics achieved a similar accuracy of 78% in predicting patients with SVM, based on the training data set [31]. An overview is presented in Table 1.
In addition to diagnostic classifications, there are a few other ML applications on DTI data (see Figure 2).
It could be shown by ML model applications to DWI that the WM network can be used as a biomarker to predict the progression rate in ALS patients at the single-subject level [34]. Additional computational algorithms may enable the modeling of sequential processes from cross-sectional data without prior theoretical assumptions about the progression of neuropathology. Thus, event-based modeling identified the CST and the CC as the WM structures first impacted in ALS [36]. This is consistent with the inclusion of the CST as the first stage in the DTI staging scheme [11] and its use in diagnostic ML models. By extending the feature selection for diagnostic predictions with diffusion metrics of the tracts associated with the neuropathological stages 2–4, the accuracy of an SVM could be slightly improved [32]. However, even extending the classification with features associated with advanced disease stages could not overcome the fact that unimodal brain imaging analyses cannot fully assess the complex neuropathology in patients with ALS [13,39]. Indications of restricted diagnostic accuracy of other MRI modalities are also evident in SVM classifications based solely on structural MRI parameters [31,32] or on resting-state functional MRI (fMRI) [40]. Based on multiparametric MRI assessments, feature sets combined from diffusion metrics and structural parameters, such as cortical thickness or texture properties, uniformly lead to an increase in the diagnostic accuracy of SVMs [31,32]. The superiority of such multiparametric MRI feature sets with WM and grey matter (GM) parameters over uniparametric approaches was also evident when a canonical discriminant function [41] or multilayer perceptrons [32,38], i.e., state-of-the-art artificial neural networks, were used for diagnostic classifications. The combination of DTI data with (resting state) fMRI is less studied. Nevertheless, the integration of patients’ FA maps together with their default-mode networks in RF models demonstrated a higher discriminative power for the classification of ALS than feature sets from the two individual MRI modalities [35]. An overview is presented in Table 2.
The neuroimaging signatures of patients with ALS might be confounded by disease duration or gender differences [47]. To address such sources of potential bias in classification models, one study selected anatomical domains as features that showed statistically significant differences in group comparisons between patients and healthy controls after adjustment for age, sex, and disease duration [42]. The multivariate binary logistic regression classifier then achieved a diagnostic accuracy of only 78% in an independent validation sample. Although feature selection based on statistical tests is apparently attractive, it has already been highlighted that high statistical significance does not automatically imply high discriminatory power in ML models [48].
Overall, the combination of DTI parameters with parameters from other MRI modalities significantly increases diagnostic sensitivity. Nevertheless, a perfect identification of all patients with ALS in a group mixed with healthy people seems to remain unachievable solely on DTI metrics.

3. Phenotypic Differentiation

Although diagnostic approaches are most important in the use of ML in clinical neuroimaging, the diagnosis of ALS is based on clinical criteria, such as the El Escorial diagnostic criteria [49] and the Gold Coast Criteria [50,51], is well-established for ALS. Still, there are diagnostic pitfalls (especially in patients with so-called mimic disorders [52])—the discussion of the clinical criteria is beyond the scope of this review. In diagnostic classification neuroimaging-based models, the issue of the differentiation of mimic disorders can be addressed by having the model decide not between ‘diseased’ and ‘healthy’ but between different patient categories. RF achieved an accuracy of 87% for ALS vs. clinical mimics based on diffusion features [31]. The revision of the El Escorial diagnostic criteria from 2015 included restricted phenotypes, i.e., primary lateral sclerosis (PLS), flail arm syndrome (FAS), progressive bulbar palsy (PBP), and progressive muscular atrophy (PMA)/lower motor neuron disease (LMND) [53]. However, this concept of the restricted phenotypes of ALS remains discussed [54,55]. With DTI, unbiased, quantitative statements about WM alterations in phenotypes are possible to contribute to these discussions. Fast-progressing LMND, PBP, PLS, and FAS show microstructural alterations whose patterns are identical to ‘classical’ ALS [56,57,58]. In a large-scale study with 575 patients with ALS including different phenotypes, texture properties of all five areas of the CC and diffusion metrics of the associated tracts were investigated and, subsequently, the discriminating value of those CC MRI metrics was evaluated by an SVM [59]. The model trained solely on patients with ‘classical’ ALS was also able to identify patients with different phenotypes with a sensitivity between 80% and 86% in independent test data sets. The results of this unbiased approach support the classification of clinical phenotypes as ALS variants and highlight the discriminating power of CC features which may contribute to further combined neuroimaging markers with high biomarker potential. Clustering algorithms as unsupervised ML models are appropriate to provide insights into similarities of neurodegeneration patterns between patients without prior hypotheses. In particular, clustering models with multimodal feature sets might be a valuable contribution to dissecting the heterogeneity of ALS. Thus, based on multiparametric MRI features obtained from structural MRI and DTI, a probabilistic network-based clustering algorithm reliably divided patients into three clusters with similar patterns of cerebral involvement [33]; these three clusters could be interpreted as patient subgroups. Across clusters, patients showed distinct clinical features and cognitive profiles. Therefore, each cluster might indicate a different neuroimaging phenotype of ALS which can be described as a pure motor, a frontotemporal, and a cingulate-parietal-temporal variant of ALS [45]. In the context of ALS phenotypes and variants, neuroimaging-based ML models might potentially be an effective tool to stratify patients aside from ‘classical’ ALS for clinical trials.
For individualized patient stratification in ALS, models predicting disease progression and survival are of specific interest. Similar to a diagnostic approach [42], a multivariate binary logistic regression approach with a combination of GM and WM features could be used to predict the survival of more or less than 18 months of patients with ALS [46]. This categorical model achieved an accuracy of 77% on the training data set. However, underperformance on the validation data set suggests overfitting of the model. A deep learning network reached an accuracy of 63% in the prediction of short-, medium-, and long-term survival of patients with ALS based on WM connectivity in terms of FA [43]. Systematic validation studies of such prognostic models on larger multi-site data sets are urgently needed.

Combinations with Non-Imaging Parameters

Instead of multiparametric MRI analysis, DTI parameters can also be extended by clinical measurements in the feature sets of classification tasks. In categorical survival predictions, such combinations of imaging features with clinical parameters may lead to improvement in the model accuracy compared to predictions solely based on diffusion metrics [43,46]. A study investigating the biomarker value of cortical thickness from structural MRI, functional scores, and neurophysiological parameters revealed different temporal dynamics of the modalities longitudinally which may lead to differences in the sensitivity to disease progression [44]. Differences between neuroimaging, functional rating, and neurophysiological measures in the sensitivity to cerebral progression might imply that by combining MRI, and specifically DTI, with non-imaging modalities, the disease status of patients might be characterized in detail and monitored longitudinally.
As clustering algorithms are frequently applied to the identification of patterns in unlabeled data sets, a multiparametric data set from WM, an oculomotor, and cognitive parameters associated with neuropathological stages of ALS could be analyzed in a data-driven manner without prior inclusion of the patient’s disease status [45]. In this study, hierarchical agglomerative clustering indicated a division of a heterogeneous group of patients with ALS into four clusters, each with similar multimodal parameters. Statistical analysis revealed differences in all parameters across clusters. Patients in one cluster showed the highest FA values and best performance in executive oculomotor tasks and cognitive tests, whereas patients in the most distant cluster showed the lowest FA values, lowest cognitive scores, and worst executive oculomotor performance across all clusters. Thus, the clustering approach showed high congruence of DTI, executive oculomotor function, and neuropsychological performance in patients with ALS. It seemed safe to conclude that the four clusters are in vivo correlates of neuropathological spreading stages. The development of an in vivo staging concept considering different brain function parameters could compensate for each modality’s limitations and lead to an in-depth characterization of patients with ALS. A multivariate DTI staging algorithm based on Bayesian statistics might provide the computational framework for such an approach. Such a classifier was superior to the classical threshold-based method in staging patients with ALS at the individual level [37]. The significant advantage of Bayesian statistics for multimodal issues is the ability to incorporate prior knowledge about the patient into the algorithm directly. With Bayesian statistics, the transition to statements expressing a degree of belief in how likely a specific event is has also proven useful for other research questions in ALS, such as hypothesis testing or complex networks [60,61].
Fluid markers from CSF or plasma are also conceivable combination parameters in comprehensive multimodal models. Neurofilament (NF) concentrations have previously been shown to have prognostic and predictive value [19] that might favor their inclusion together with DTI parameters in models for diagnostic classification or prediction of disease progression. MRI, which is able to regionally map the disease-related stages of ALS in vivo, has a differential part than fluid markers, such as the NF light chain, which correlates with disease progression rate and is negatively associated with survival and thus provides prognostic information [19].

4. Longitudinal Monitoring

4.1. Study Conceptualization

For longitudinal monitoring and clinical trials, reliable markers sensitive to cerebral progression are needed. Although alterations of the FA in the CST could be monitored longitudinally [11,17] and correlated with the loss of functionality [11,62], some studies reported negative results [63,64]. To obtain sensible and reproducible results in longitudinal DTI studies in ALS, it is essential to establish standards for study conceptualization. The main limitation of longitudinal DTI studies is insufficient sample size leading to insufficient statistical power. Under-powered studies hamper the investigation of the therapeutic effects of DTI [65]. Reports of sample sizes needed for 80% power with 25% treatment effect differ between 263 [17] and 567 subjects [66] per arm. In addition, 128 per arm for 50% treatment effect and 70% power were reported [11]. In all these studies, statistical power and sample size calculations were performed post hoc; therefore, the results might differ from the true power [67]. Monte Carlo simulations can be used in study conceptualization to calculate statistical power and sample size requirements under various study conditions. In addition to sample size, the power of a longitudinal DTI study is influenced by other factors such as the number of visits and time between them, data quality, between-subject variability, class probabilities, and the number of study drop-outs. For different decrease rates of FA in CST, Monte Carlo simulations showed that longitudinal group studies benefit from a second DTI scan at each visit [68]. Specifically, it was revealed that a second scan can reduce the required sample size or that sufficient statistical power could be achieved after shorter time intervals, respectively. The positive effect of repeated scans per visit was particularly pronounced with high measurement noise which is likely to occur with pronounced disease severity.
The scheduling of more than two visits is especially critical to the validity of imaging parameter trend analyses in longitudinal studies with an odd number of visits in total, e.g., one baseline and two follow-up visits [69]. With the simulation of outliers due to noise, it was shown that equidistant time intervals should be avoided to strengthen the trend analysis results in these specific scenarios. Although the study was based on the longitudinal striatum atrophy in T1w MRI data of patients with Huntington’s disease, the methodological limitations of longitudinal trend analysis are also valid for DTI studies in patients with other progressive neurodegenerative conditions, such as ALS.
A reliable assessment of (small) longitudinal WM alterations is essential in ALS for a timely determination of progression rate and enhances the stratification of patients for enrolment in clinical trials. Additionally, studies monitoring asymptomatic carriers of ALS-associated gene mutations for possible conversion to symptomatic disease might benefit from optimized study protocols to detect even subclinical cerebral alterations. For the conceptualization of clinical neuroimaging studies, considering sample numbers, measurement noise, and visit scheduling, simulations have proven to be useful [68,69]. In order to minimize the stress on patients and save time and money, meticulous planning of neuroimaging scans in advance may prevent the generation of incorrect findings.

4.2. Influences of Aging

In longitudinal studies, it is necessary to be aware that diffusion metrics are subject to physiological aging effects [70,71] and to what extent aging-associated alterations can be expected during the study period. To distinguish the proportion of physiological aging effects from neuropathological changes at the group level, it is recommended to longitudinally assess healthy control subjects according to the same study protocol as patients with ALS in prospective studies [72]. A tract-specific age correction, adjusted for the age of the study participants, could then be used to computationally eliminate the covariate age in the diffusion metrics, as in cross-sectional studies [73].
The modeling of the complex trajectories of healthy brain aging with ML approaches based on neuroimaging data has been established for clinical questions in recent years [74,75]. Such a brain age prediction is also possible when it is exclusively based on DTI data [76,77]. In principle, age correction of diffusion metrics in healthy study participants could be performed with an algorithmic inversion of brain age prediction based on an artificial neural network [77]. However, in addition to its role as a confounding covariate in a longitudinal setting, age is also a significant risk factor in sporadic ALS [78]. Brain age predictions have already been applied to ALS based on structural MRI, offering insights into a potential brain reserve against behavioral and/or cognitive decline and faster disease progression [79]. Based on these findings, multimodal MRI brain age models might offer promising approaches to investigate other risk factors regarding the personal environment since many lifestyle and biomedical parameters are associated with brain age [80,81,82].

5. Limitations

One major limitation of DTI-based ML approaches in ALS is the limited availability of data sets of patients. Longitudinal studies often experience high drop-out rates due to the rapid and often not predictable clinical disease progression. However, the number of data sets available often leads to a low SFR and is crucial in the choice of a classification model. While well-regularized standard ML models, such as SVMs or RFs, might be on the edge of overfitting given the typical sample size in ALS of around 20 to 200, i.e., an order of magnitude 101 to 102, deep learning models require several orders of magnitude in sample size more to perform optimally [1]. On the one hand, the risk of overfitting in standard ML models can be reduced with a priori feature selection based on neuroanatomical considerations. On the other hand, limiting features only to DTI and T1w metrics of specific neuroanatomical regions also appears to restrict the discriminating power of standard ML models, as different ML approaches with similar preselected multiparametric MRI features led to similar accuracies in diagnostic classifications.
In the context of the performance of DTI-based ML models, the physiological inter-subject variability of diffusion metrics should be discussed in addition to the limited sample sizes in ALS. Many lifestyle factors such as smoking [83], alcohol consumption [84], or sleep duration [85], have been reported to result in regional WM alterations. A more detailed description of healthy controls with respect to certain lifestyle circumstances might allow a better assessment of diffusion metrics and thus possibly a more accurate separation of patients and controls by adding confounding lifestyle parameters in ML models.

6. Further Perspectives

For the implementation of ML in ALS research, different perspectives arise, as shown in Figure 3. Most DTI-based ML publications in ALS focused on diagnostic classifications, i.e., patient vs. healthy control scenarios. Apart from the limited accuracy, the practical value of diagnostic classification models might be limited since the ground truth of the classifications is a diagnosis based on clinical criteria. The focus should, therefore, turn toward models representing the cerebral status or addressing the heterogeneity of ALS by phenotype classifications or individual disease trajectory predictions. Clustering as a method of unsupervised ML is suitable for the identification of unbiased subgroups in data. The required sample size to detect subgrouping with sufficient power is about 20 to 30 per expected cluster [86]; sample sizes that are realistically achievable in ALS research, even in monocenter settings.
To advance the power to discriminate patients from controls and thus contribute truly to faster diagnosis in ALS, normative deep learning models should find their way into ALS imaging. Deep learning models can encode meaningful representations of brain function in a data-driven manner and determine whether an unknown data set belongs to a group of healthy controls in normative modeling [87]. To advance the use of deep learning in ALS in the future, prospective multicenter neuroimaging studies and international repositories (such as those provided by the Neuroimaging Society in ALS (NiSALS) [15,88,89]) are needed. Thereby, the focus should also be put on longitudinal data collection with standardized protocols. DTI data sets from different centers and scanners should then be harmonized prior to model training, as differences in diffusion metrics may occur from different scanner and data acquisition factors [90]. It was shown that inter-scanner differences could be compensated with harmonization approaches, whereas biological inter-subject differences were preserved in healthy controls, as well as in patients with pathologically altered diffusion properties [15]. Due to inter-scanner differences, ML models need to be validated between centers and scanners for prospective clinical use. Novel techniques, such as deep and transfer learning [91] and few-shot learning [92], offer new possibilities and applications in the characterization and monitoring of ALS patients. Approaches with federated deep learning in multicenter design can be regarded as a perspective.
Diffusion kurtosis imaging (DKI) is a promising tool to be used as a biomarker in neurodegenerative diseases and, thus, also in ALS [93]. The DKI metrics alterations indicate decreased microstructural complexity in ALS, involving motor regions, extramotor regions, and callosal regions at early stage ALS [94,95]. Thus, DKI metrics can serve as potential biomarkers for assessing disease severity [96]. Multiparametric MRI assessments in patients with ALS are promising for enhanced individual phenotyping and may help with the stratification of therapeutic trials, provided that robust ML models will be used. Combining DTI with modalities beyond MRI, such as radioligand imaging with positron emission tomography or measures of neurophysiology [97,98], is a helpful technical approach to deep phenotyping of a given patient’s disease status. Because such approaches will continue to become more important for in vivo ALS staging systems in the future, patients with ALS should be evaluated in studies by use of a variety of clinical and cognitive parameters in addition to MRI [88,99].
An integration of DTI into clinical trials spans two different aspects: stratifying patients into prognostic groups and providing reliable markers sensitive to cerebral progression. DTI-based ML models that predict progression rate and assess phenotype might be appropriate for stratifying patients for clinical trial enrollment. For the establishment of longitudinal DTI biomarkers in clinical trials, the standardization and optimization of study protocols are essential to enhance longitudinal sensitivity and reliability. The use of DTI as a longitudinal monitoring tool could allow objective monitoring of cerebral progression and might be considered to be an endpoint in clinical trials.

7. Summary

The current state of research demonstrates the enormous academic and clinical potential of ML models in the development of DTI-based neuroimaging biomarkers in ALS. A more accurate assessment of cerebral changes seems possible with multiparametric MRI feature sets than with DTI metrics alone. To capture the full spectrum of pathological signatures in ALS, combining DTI with other modalities, e.g., neurophysiology, is promising to guide individualized ML-based patient characterizations. As multimodal integration of diffusion-weighted MRI techniques will be an essential element in the development of neuroimaging biomarkers in ALS, future research should focus on establishing standardized protocols for full patient characterization and multicenter transnational collaborations. Large, well-characterized cohorts enable a profound performance of ML algorithms and, therefore, gain new insights into the complex interplay between neuroimaging and other clinical measures to characterize patients with ALS and its phenotypes.

Author Contributions

Conceptualization, A.B., H.-P.M. and J.K.; literature search, A.B.; writing—original draft preparation, A.B.; writing—review and editing, H.-P.M., A.C.L. and J.K. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Data Availability Statement

Data sharing is not applicable.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Myszczynska, M.A.; Ojamies, P.N.; Lacoste, A.M.B.; Neil, D.; Saffari, A.; Mead, R.; Hautbergue, G.M.; Holbrook, J.D.; Ferraiuolo, L. Applications of Machine Learning to Diagnosis and Treatment of Neurodegenerative Diseases. Nat. Rev. Neurol. 2020, 16, 440–456. [Google Scholar] [CrossRef] [PubMed]
  2. Van Es, M.A.; Hardiman, O.; Chio, A.; Al-Chalabi, A.; Pasterkamp, R.J.; Veldink, J.H.; van den Berg, L.H. Amyotrophic Lateral Sclerosis. Lancet 2017, 390, 2084–2098. [Google Scholar] [CrossRef] [PubMed]
  3. Brettschneider, J.; Del Tredici, K.; Toledo, J.B.; Robinson, J.L.; Irwin, D.J.; Grossman, M.; Suh, E.; Van Deerlin, V.M.; Wood, E.M.; Baek, Y.; et al. Stages of PTDP-43 Pathology in Amyotrophic Lateral Sclerosis. Ann. Neurol. 2013, 74, 20–38. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  4. Braak, H.; Brettschneider, J.; Ludolph, A.C.; Lee, V.M.; Trojanowski, J.Q.; Tredici, K.D. Amyotrophic Lateral Sclerosis—A Model of Corticofugal Axonal Spread. Nat. Rev. Neurol. 2013, 9, 708–714. [Google Scholar] [CrossRef] [Green Version]
  5. Grossman, M. Amyotrophic Lateral Sclerosis—A Multisystem Neurodegenerative Disorder. Nat. Rev. Neurol. 2019, 15, 5–6. [Google Scholar] [CrossRef]
  6. Bendotti, C.; Bonetto, V.; Pupillo, E.; Logroscino, G.; Al-Chalabi, A.; Lunetta, C.; Riva, N.; Mora, G.; Lauria, G.; Weishaupt, J.H.; et al. Focus on the Heterogeneity of Amyotrophic Lateral Sclerosis. Amyotroph. Lateral Scler. Front. Degener. 2020, 21, 485–495. [Google Scholar] [CrossRef]
  7. Goyal, N.A.; Berry, J.D.; Windebank, A.; Staff, N.P.; Maragakis, N.J.; Berg, L.H.; Genge, A.; Miller, R.; Baloh, R.H.; Kern, R.; et al. Addressing Heterogeneity in Amyotrophic Lateral Sclerosis CLINICAL TRIALS. Muscle Nerve 2020, 62, 156–166. [Google Scholar] [CrossRef] [Green Version]
  8. Basser, P.J. Inferring Microstructural Features and the Physiological State of Tissues from Diffusion-Weighted Images. NMR Biomed. 1995, 8, 333–344. [Google Scholar] [CrossRef]
  9. Le Bihan, D.; Mangin, J.F.; Poupon, C.; Clark, C.A.; Pappata, S.; Molko, N.; Chabriat, H. Diffusion Tensor Imaging: Concepts and Applications. J. Magn. Reason. Imaging 2001, 13, 534–546. [Google Scholar] [CrossRef]
  10. Song, S.-K.; Sun, S.-W.; Ramsbottom, M.J.; Chang, C.; Russell, J.; Cross, A.H. Dysmyelination Revealed through MRI as Increased Radial (but Unchanged Axial) Diffusion of Water. Neuroimage 2002, 17, 1429–1436. [Google Scholar] [CrossRef]
  11. Kassubek, J.; Müller, H.-P.; Del Tredici, K.; Lulé, D.; Gorges, M.; Braak, H.; Ludolph, A.C. Imaging the Pathoanatomy of Amyotrophic Lateral Sclerosis in Vivo: Targeting a Propagation-Based Biological Marker. J. Neurol. Neurosurg. Psychiatry 2018, 89, 374–381. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  12. Menke, R.A.L.; Agosta, F.; Grosskreutz, J.; Filippi, M.; Turner, M.R. Neuroimaging Endpoints in Amyotrophic Lateral Sclerosis. Neurotherapeutics 2017, 14, 11–23. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  13. Kocar, T.D.; Müller, H.-P.; Ludolph, A.C.; Kassubek, J. Feature Selection from Magnetic Resonance Imaging Data in ALS: A Systematic Review. Ther. Adv. Chronic Dis. 2021, 12, 204062232110510. [Google Scholar] [CrossRef] [PubMed]
  14. Cardenas-Blanco, A.; Machts, J.; Acosta-Cabronero, J.; Kaufmann, J.; Abdulla, S.; Kollewe, K.; Petri, S.; Heinze, H.-J.; Dengler, R.; Vielhaber, S.; et al. Central White Matter Degeneration in Bulbar- and Limb-Onset Amyotrophic Lateral Sclerosis. J. Neurol. 2014, 261, 1961–1967. [Google Scholar] [CrossRef]
  15. Müller, H.-P.; Turner, M.R.; Grosskreutz, J.; Abrahams, S.; Bede, P.; Govind, V.; Prudlo, J.; Ludolph, A.C.; Filippi, M.; Kassubek, J.; et al. A Large-Scale Multicentre Cerebral Diffusion Tensor Imaging Study in Amyotrophic Lateral Sclerosis. J. Neurol. Neurosurg. Psychiatry 2016, 87, 570–579. [Google Scholar] [CrossRef] [Green Version]
  16. Filippini, N.; Douaud, G.; Mackay, C.E.; Knight, S.; Talbot, K.; Turner, M.R. Corpus Callosum Involvement Is a Consistent Feature of Amyotrophic Lateral Sclerosis. Neurology 2010, 75, 1645–1652. [Google Scholar] [CrossRef] [Green Version]
  17. Cardenas-Blanco, A.; Machts, J.; Acosta-Cabronero, J.; Kaufmann, J.; Abdulla, S.; Kollewe, K.; Petri, S.; Schreiber, S.; Heinze, H.-J.; Dengler, R.; et al. Structural and Diffusion Imaging versus Clinical Assessment to Monitor Amyotrophic Lateral Sclerosis. Neuroimage Clin. 2016, 11, 408–414. [Google Scholar] [CrossRef] [Green Version]
  18. Van Eijk, R.P.A.; Kliest, T.; van den Berg, L.H. Current Trends in the Clinical Trial Landscape for Amyotrophic Lateral Sclerosis. Curr. Opin. Neurol. 2020, 33, 655–661. [Google Scholar] [CrossRef]
  19. Steinacker, P.; Huss, A.; Mayer, B.; Grehl, T.; Grosskreutz, J.; Borck, G.; Kuhle, J.; Lulé, D.; Meyer, T.; Oeckl, P.; et al. Diagnostic and Prognostic Significance of Neurofilament Light Chain NF-L, but Not Progranulin and S100B, in the Course of Amyotrophic Lateral Sclerosis: Data from the German MND-Net. Amyotroph. Lateral Scler. Front. Degener. 2017, 18, 112–119. [Google Scholar] [CrossRef]
  20. Foerster, B.R.; Dwamena, B.A.; Petrou, M.; Carlos, R.C.; Callaghan, B.C.; Pomper, M.G. Diagnostic Accuracy Using Diffusion Tensor Imaging in the Diagnosis of ALS: A Meta-Analysis. Acad. Radiol. 2012, 19, 1075–1086. [Google Scholar] [CrossRef]
  21. De Marchi, F.; Stecco, A.; Falaschi, Z.; Filippone, F.; Pasché, A.; Bebeti, A.; Leigheb, M.; Cantello, R.; Mazzini, L. Detection of White Matter Ultrastructural Changes for Amyotrophic Lateral Sclerosis Characterization: A Diagnostic Study from Dti-Derived Data. Brain Sci. 2020, 10, 996. [Google Scholar] [CrossRef] [PubMed]
  22. Tahedl, M.; Murad, A.; Lope, J.; Hardiman, O.; Bede, P. Evaluation and Categorisation of Individual Patients Based on White Matter Profiles: Single-Patient Diffusion Data Interpretation in Neurodegeneration. J. Neurol. Sci. 2021, 428, 117584. [Google Scholar] [CrossRef] [PubMed]
  23. Yu, K.-H.; Beam, A.L.; Kohane, I.S. Artificial Intelligence in Healthcare. Nat. Biomed. Eng. 2018, 2, 719–731. [Google Scholar] [CrossRef] [PubMed]
  24. Grollemund, V.; Pradat, P.-F.; Querin, G.; Delbot, F.; Le Chat, G.; Pradat-Peyre, J.-F.; Bede, P. Machine Learning in Amyotrophic Lateral Sclerosis: Achievements, Pitfalls, and Future Directions. Front. Neurosci. 2019, 13, 135. [Google Scholar] [CrossRef] [Green Version]
  25. Davatzikos, C. Machine Learning in Neuroimaging: Progress and Challenges. Neuroimage 2019, 197, 652–656. [Google Scholar] [CrossRef] [PubMed]
  26. Orrù, G.; Pettersson-Yeo, W.; Marquand, A.F.; Sartori, G.; Mechelli, A. Using Support Vector Machine to Identify Imaging Biomarkers of Neurological and Psychiatric Disease: A Critical Review. Neurosci. Biobehav. Rev. 2012, 36, 1140–1152. [Google Scholar] [CrossRef] [PubMed]
  27. Sarica, A.; Cerasa, A.; Quattrone, A. Random Forest Algorithm for the Classification of Neuroimaging Data in Alzheimer’s Disease: A Systematic Review. Front. Aging Neurosci. 2017, 9, 329. [Google Scholar] [CrossRef] [Green Version]
  28. Raudys, Š. Statistical and Neural Classifiers; Advances in Pattern Recognition; Springer London: London, UK, 2001; ISBN 978-1-85233-297-6. [Google Scholar]
  29. Chen, Q.-F.; Zhang, X.-H.; Huang, N.-X.; Chen, H.-J. Identification of Amyotrophic Lateral Sclerosis Based on Diffusion Tensor Imaging and Support Vector Machine. Front. Neurol. 2020, 11, 275. [Google Scholar] [CrossRef]
  30. Sarica, A.; Cerasa, A.; Valentino, P.; Yeatman, J.; Trotta, M.; Barone, S.; Granata, A.; Nisticò, R.; Perrotta, P.; Pucci, F.; et al. The Corticospinal Tract Profile in Amyotrophic Lateral Sclerosis. Hum. Brain Mapp. 2017, 38, 727–739. [Google Scholar] [CrossRef]
  31. Ferraro, P.M.; Agosta, F.; Riva, N.; Copetti, M.; Spinelli, E.G.; Falzone, Y.; Sorarù, G.; Comi, G.; Chiò, A.; Filippi, M. Multimodal Structural MRI in the Diagnosis of Motor Neuron Diseases. Neuroimage Clin. 2017, 16, 240–247. [Google Scholar] [CrossRef]
  32. Kocar, T.D.; Behler, A.; Ludolph, A.C.; Müller, H.-P.; Kassubek, J. Multiparametric Microstructural MRI and Machine Learning Classification Yields High Diagnostic Accuracy in Amyotrophic Lateral Sclerosis: Proof of Concept. Front. Neurol. 2021, 12, 745475. [Google Scholar] [CrossRef] [PubMed]
  33. Tan, H.H.G.; Westeneng, H.; Nitert, A.D.; van Veenhuijzen, K.; Meier, J.M.; van der Burgh, H.K.; van Zandvoort, M.J.E.; van Es, M.A.; Veldink, J.H.; van den Berg, L.H. MRI Clustering Reveals Three ALS Subtypes With Unique Neurodegeneration Patterns. Ann. Neurol. 2022, 92, ana.26488. [Google Scholar] [CrossRef] [PubMed]
  34. Li, W.; Wei, Q.; Hou, Y.; Lei, D.; Yuan, A.; Yuan, A.; Ai, Y.; Qin, K.; Yang, J.; Yang, J.; et al. Disruption of the White Matter Structural Network and Its Correlation with Baseline Progression Rate in Patients with Sporadic Amyotrophic Lateral Sclerosis. Transl. Neurodegener. 2021, 10, 35. [Google Scholar] [CrossRef] [PubMed]
  35. Fratello, M.; Caiazzo, G.; Trojsi, F.; Russo, A.; Tedeschi, G.; Tagliaferri, R.; Esposito, F. Multi-View Ensemble Classification of Brain Connectivity Images for Neurodegeneration Type Discrimination. Neuroinform 2017, 15, 199–213. [Google Scholar] [CrossRef] [Green Version]
  36. Gabel, M.C.; Broad, R.J.; Young, A.L.; Abrahams, S.; Bastin, M.E.; Menke, R.A.L.; Al-Chalabi, A.; Goldstein, L.H.; Tsermentseli, S.; Alexander, D.C.; et al. Evolution of White Matter Damage in Amyotrophic Lateral Sclerosis. Ann. Clin. Transl. Neurol. 2020, 7, 722–732. [Google Scholar] [CrossRef] [PubMed]
  37. Behler, A.; Müller, H.-P.; Ludolph, A.C.; Lulé, D.; Kassubek, J. A Multivariate Bayesian Classification Algorithm for Cerebral Stage Prediction by Diffusion Tensor Imaging in Amyotrophic Lateral Sclerosis. Neuroimage Clin. 2022, 35, 103094. [Google Scholar] [CrossRef]
  38. Bede, P.; Murad, A.; Hardiman, O. Pathological Neural Networks and Artificial Neural Networks in ALS: Diagnostic Classification Based on Pathognomonic Neuroimaging Features. J. Neurol. 2022, 269, 2440–2452. [Google Scholar] [CrossRef]
  39. Del Tredici, K.; Braak, H. Neuropathology and Neuroanatomy of TDP-43 Amyotrophic Lateral Sclerosis. Curr. Opin. Neurol. 2022, 35, 660–671. [Google Scholar] [CrossRef]
  40. Welsh, R.C.; Jelsone-Swain, L.; Foerster, B.R. The Utility of Independent Component Analysis and Machine Learning in the Identification of the Amyotrophic Lateral Sclerosis Diseased Brain. Front. Hum. Neurosci. 2013, 7, 251. [Google Scholar] [CrossRef] [Green Version]
  41. Bede, P.; Iyer, P.M.; Finegan, E.; Omer, T.; Hardiman, O. Virtual Brain Biopsies in Amyotrophic Lateral Sclerosis: Diagnostic Classification Based on In Vivo Pathological Patterns. Neuroimage Clin. 2017, 15, 653–658. [Google Scholar] [CrossRef]
  42. Schuster, C.; Hardiman, O.; Bede, P. Development of an Automated MRI-Based Diagnostic Protocol for Amyotrophic Lateral Sclerosis Using Disease-Specific Pathognomonic Features: A Quantitative Disease-State Classification Study. PLoS ONE 2016, 11, e0167331. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  43. Van der Burgh, H.K.; Schmidt, R.; Westeneng, H.-J.; de Reus, M.A.; van den Berg, L.H.; van den Heuvel, M.P. Deep Learning Predictions of Survival Based on MRI in Amyotrophic Lateral Sclerosis. NeuroImage Clin. 2017, 13, 361–369. [Google Scholar] [CrossRef] [PubMed]
  44. Wirth, A.M.; Khomenko, A.; Baldaranov, D.; Kobor, I.; Hsam, O.; Grimm, T.; Johannesen, S.; Bruun, T.-H.; Schulte-Mattler, W.; Greenlee, M.W.; et al. Combinatory Biomarker Use of Cortical Thickness, MUNIX, and ALSFRS-R at Baseline and in Longitudinal Courses of Individual Patients With Amyotrophic Lateral Sclerosis. Front. Neurol. 2018, 9, 614. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  45. Behler, A.; Müller, H.; Del Tredici, K.; Braak, H.; Ludolph, A.C.; Lulé, D.; Kassubek, J. Multimodal in Vivo Staging in Amyotrophic Lateral Sclerosis Using Artificial Intelligence. Ann. Clin. Transl. Neurol. 2022, 9, 1069–1079. [Google Scholar] [CrossRef] [PubMed]
  46. Schuster, C.; Hardiman, O.; Bede, P. Survival Prediction in Amyotrophic Lateral Sclerosis Based on MRI Measures and Clinical Characteristics. BMC Neurol. 2017, 17, 73. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  47. Bede, P.; Elamin, M.; Byrne, S.; Hardiman, O. Sexual Dimorphism in ALS: Exploring Gender-Specific Neuroimaging Signatures. Amyotroph. Lateral Scler. Front. Degener. 2014, 15, 235–243. [Google Scholar] [CrossRef]
  48. Arbabshirani, M.R.; Plis, S.; Sui, J.; Calhoun, V.D. Single Subject Prediction of Brain Disorders in Neuroimaging: Promises and Pitfalls. NeuroImage 2017, 145, 137–165. [Google Scholar] [CrossRef] [Green Version]
  49. Brooks, B.R.; Miller, R.G.; Swash, M.; Munsat, T.L. El Escorial Revisited: Revised Criteria for the Diagnosis of Amyotrophic Lateral Sclerosis. Amyotroph. Lateral Scler. Other Mot. Neuron Disord. 2000, 1, 293–299. [Google Scholar] [CrossRef]
  50. Hannaford, A.; Pavey, N.; Bos, M.; Geevasinga, N.; Menon, P.; Shefner, J.M.; Kiernan, M.C.; Vucic, S. Diagnostic Utility of Gold Coast Criteria in Amyotrophic Lateral Sclerosis. Ann. Neurol. 2021, 89, 979–986. [Google Scholar] [CrossRef]
  51. De Jongh, A.D.; Braun, N.; Weber, M.; van Es, M.A.; Masrori, P.; Veldink, J.H.; van Damme, P.; van den Berg, L.H.; van Eijk, R.P.A. Characterising ALS Disease Progression According to El Escorial and Gold Coast Criteria. J Neurol Neurosurg Psychiatry 2022, 93, 865–870. [Google Scholar] [CrossRef]
  52. Traynor, B.J.; Codd, M.B.; Corr, B.; Forde, C.; Frost, E.; Hardiman, O. Amyotrophic Lateral Sclerosis Mimic Syndromes: A Population-Based Study. Arch. Neurol. 2000, 57, 109. [Google Scholar] [CrossRef] [Green Version]
  53. Ludolph, A.; Drory, V.; Hardiman, O.; Nakano, I.; Ravits, J.; Robberecht, W.; Shefner, J. For The WFN Research Group On ALS/MND A Revision of the El Escorial Criteria—2015. Amyotroph. Lateral Scler. Front. Degener. 2015, 16, 291–292. [Google Scholar] [CrossRef] [PubMed]
  54. De Vries, B.S.; Rustemeijer, L.M.M.; Bakker, L.A.; Schröder, C.D.; Veldink, J.H.; van den Berg, L.H.; Nijboer, T.C.W.; van Es, M.A. Cognitive and Behavioural Changes in PLS and PMA:Challenging the Concept of Restricted Phenotypes. J. Neurol. Neurosurg. Psychiatry 2019, 90, 141–147. [Google Scholar] [CrossRef] [Green Version]
  55. Finegan, E.; Chipika, R.H.; Shing, S.L.H.; Hardiman, O.; Bede, P. Primary Lateral Sclerosis: A Distinct Entity or Part of the ALS Spectrum? Amyotroph. Lateral Scler. Front. Degener. 2019, 20, 133–145. [Google Scholar] [CrossRef] [PubMed]
  56. Kassubek, J.; Müller, H.-P. Advanced Neuroimaging Approaches in Amyotrophic Lateral Sclerosis: Refining the Clinical Diagnosis. Expert Rev. Neurother. 2020, 20, 237–249. [Google Scholar] [CrossRef] [PubMed]
  57. Rosenbohm, A.; Del Tredici, K.; Braak, H.; Huppertz, H.-J.; Ludolph, A.C.; Müller, H.-P.; Kassubek, J. Involvement of Cortico-Efferent Tracts in Flail Arm Syndrome: A Tract-of-Interest-Based DTI Study. J. Neurol. 2022, 269, 2619–2626. [Google Scholar] [CrossRef] [PubMed]
  58. Sarica, A.; Valentino, P.; Nisticò, R.; Barone, S.; Pucci, F.; Quattrone, A.; Cerasa, A.; Quattrone, A. Assessment of the Corticospinal Tract Profile in Pure Lower Motor Neuron Disease: A Diffusion Tensor Imaging Study. Neurodegener Dis. 2019, 19, 128–138. [Google Scholar] [CrossRef]
  59. Münch, M.; Müller, H.-P.; Behler, A.; Ludolph, A.C.; Kassubek, J. Segmental Alterations of the Corpus Callosum in Motor Neuron Disease: A DTI and Texture Analysis in 575 Patients. Neuroimage Clin. 2022, 35, 103061. [Google Scholar] [CrossRef]
  60. Temp, A.G.M.; Naumann, M.; Hermann, A.; Glaß, H. Applied Bayesian Approaches for Research in Motor Neuron Disease. Front. Neurol. 2022, 13, 796777. [Google Scholar] [CrossRef]
  61. Gromicho, M.; Leão, T.; Oliveira Santos, M.; Pinto, S.; Carvalho, A.M.; Madeira, S.C.; De Carvalho, M. Dynamic Bayesian Networks for Stratification of Disease Progression in Amyotrophic Lateral Sclerosis. Eur. J. Neurol. 2022, 29, 2201–2210. [Google Scholar] [CrossRef]
  62. Baek, S.-H.; Park, J.; Kim, Y.H.; Seok, H.Y.; Oh, K.-W.; Kim, H.-J.; Kwon, Y.-J.; Sim, Y.; Tae, W.-S.; Kim, S.H.; et al. Usefulness of Diffusion Tensor Imaging Findings as Biomarkers for Amyotrophic Lateral Sclerosis. Sci. Rep. 2020, 10, 5199. [Google Scholar] [CrossRef] [Green Version]
  63. Alruwaili, A.R.; Pannek, K.; Henderson, R.D.; Gray, M.; Kurniawan, N.D.; McCombe, P.A. Tract Integrity in Amyotrophic Lateral Sclerosis: 6–Month Evaluation Using MR Diffusion Tensor Imaging. BMC Med. Imaging 2019, 19, 19. [Google Scholar] [CrossRef] [Green Version]
  64. Blain, C.R.V.; Williams, V.C.; Johnston, C.; Stanton, B.R.; Ganesalingam, J.; Jarosz, J.M.; Jones, D.K.; Barker, G.J.; Williams, S.C.R.; Leigh, N.P.; et al. A Longitudinal Study of Diffusion Tensor MRI in ALS. Amyotroph. Lateral. Scler. 2007, 8, 348–355. [Google Scholar] [CrossRef]
  65. Distaso, E.; Milella, G.; Mezzapesa, D.M.; Introna, A.; D’Errico, E.; Fraddosio, A.; Zoccolella, S.; Dicuonzo, F.; Simone, I.L. Magnetic Resonance Metrics to Evaluate the Effect of Therapy in Amyotrophic Lateral Sclerosis: The Experience with Edaravone. J. Neurol. 2021, 268, 3307–3315. [Google Scholar] [CrossRef] [PubMed]
  66. Zhang, Y.; Schuff, N.; Woolley, S.C.; Chiang, G.C.; Boreta, L.; Laxamana, J.; Katz, J.S.; Weiner, M.W. Progression of White Matter Degeneration in Amyotrophic Lateral Sclerosis: A Diffusion Tensor Imaging Study. Amyotroph. Lateral Scler. 2011, 12, 421–429. [Google Scholar] [CrossRef]
  67. Zhang, Y.; Hedo, R.; Rivera, A.; Rull, R.; Richardson, S.; Tu, X.M. Post Hoc Power Analysis: Is It an Informative and Meaningful Analysis? Gen. Psychiatry 2019, 32, e100069. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  68. Behler, A.; Lulé, D.; Ludolph, A.C.; Kassubek, J.; Müller, H.-P. Longitudinal Monitoring of Amyotrophic Lateral Sclerosis by Diffusion Tensor Imaging: Power Calculations for Group Studies. Front. Neurosci. 2022, 16, 929151. [Google Scholar] [CrossRef]
  69. Müller, H.-P.; Behler, A.; Landwehrmeyer, G.B.; Huppertz, H.-J.; Kassubek, J. How to Arrange Follow-Up Time-Intervals for Longitudinal Brain MRI Studies in Neurodegenerative Diseases. Front. Neurosci. 2021, 15, 682812. [Google Scholar] [CrossRef] [PubMed]
  70. Westlye, L.T.; Walhovd, K.B.; Dale, A.M.; Bjørnerud, A.; Due-Tønnessen, P.; Engvig, A.; Grydeland, H.; Tamnes, C.K.; Ostby, Y.; Fjell, A.M. Life-Span Changes of the Human Brain White Matter: Diffusion Tensor Imaging (DTI) and Volumetry. Cereb. Cortex 2010, 20, 2055–2068. [Google Scholar] [CrossRef] [Green Version]
  71. Cox, S.R.; Ritchie, S.J.; Tucker-Drob, E.M.; Liewald, D.C.; Hagenaars, S.P.; Davies, G.; Wardlaw, J.M.; Gale, C.R.; Bastin, M.E.; Deary, I.J. Ageing and Brain White Matter Structure in 3,513 UK Biobank Participants. Nat. Commun. 2016, 7, 13629. [Google Scholar] [CrossRef]
  72. Kalra, S.; Müller, H.-P.; Ishaque, A.; Zinman, L.; Korngut, L.; Genge, A.; Beaulieu, C.; Frayne, R.; Graham, S.J.; Kassubek, J. A Prospective Harmonized Multicenter DTI Study of Cerebral White Matter Degeneration in ALS. Neurology 2020, 95, e943–e952. [Google Scholar] [CrossRef]
  73. Behler, A.; Kassubek, J.; Müller, H.-P. Age-Related Alterations in DTI Metrics in the Human Brain—Consequences for Age Correction. Front. Aging Neurosci. 2021, 13, 682109. [Google Scholar] [CrossRef]
  74. Franke, K.; Gaser, C. Ten Years of BrainAGE as a Neuroimaging Biomarker of Brain Aging: What Insights Have We Gained? Front. Neurol. 2019, 10, 789. [Google Scholar] [CrossRef] [Green Version]
  75. Cole, J.H.; Franke, K. Predicting Age Using Neuroimaging: Innovative Brain Ageing Biomarkers. Trends Neurosci. 2017, 40, 681–690. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  76. Cole, J.H. Multimodality Neuroimaging Brain-Age in UK Biobank: Relationship to Biomedical, Lifestyle, and Cognitive Factors. Neurobiol. Aging 2020, 92, 34–42. [Google Scholar] [CrossRef] [PubMed]
  77. Kocar, T.D.; Behler, A.; Leinert, C.; Denkinger, M.; Ludolph, A.C.; Müller, H.-P.; Kassubek, J. Artificial Neural Networks for Non-Linear Age Correction of Diffusion Metrics in the Brain. Front. Aging Neurosci. 2022, 14, 999787. [Google Scholar] [CrossRef]
  78. Fang, F.; Ingre, C.; Roos, P.; Kamel, F.; Piehl, F. Risk Factors for Amyotrophic Lateral Sclerosis. CLEP 2015, 7, 181. [Google Scholar] [CrossRef] [Green Version]
  79. Hermann, A.; Tarakdjian, G.N.; Temp, A.G.M.; Kasper, E.; Machts, J.; Kaufmann, J.; Vielhaber, S.; Prudlo, J.; Cole, J.H.; Teipel, S.; et al. Cognitive and Behavioural but Not Motor Impairment Increases Brain Age in Amyotrophic Lateral Sclerosis. Brain Commun. 2022, 4, fcac239. [Google Scholar] [CrossRef] [PubMed]
  80. Franke, K.; Ristow, M.; Gaser, C. Gender-Specific Impact of Personal Health Parameters on Individual Brain Aging in Cognitively Unimpaired Elderly Subjects. Front. Aging Neurosci. 2014, 6, 94. [Google Scholar] [CrossRef] [Green Version]
  81. Beck, D.; de Lange, A.-M.G.; Alnæs, D.; Maximov, I.I.; Pedersen, M.L.; Leinhard, O.D.; Linge, J.; Simon, R.; Richard, G.; Ulrichsen, K.M.; et al. Adipose Tissue Distribution from Body MRI Is Associated with Cross-Sectional and Longitudinal Brain Age in Adults. NeuroImage Clin. 2022, 33, 102949. [Google Scholar] [CrossRef]
  82. McEvoy, L.K.; Fennema-Notestine, C.; Elman, J.A.; Eyler, L.T.; Franz, C.E.; Hagler, D.J.; Hatton, S.N.; Lyons, M.J.; Panizzon, M.S.; Dale, A.M.; et al. Alcohol Intake and Brain White Matter in Middle Aged Men: Microscopic and Macroscopic Differences. NeuroImage Clin. 2018, 18, 390–398. [Google Scholar] [CrossRef] [PubMed]
  83. Wang, C.; Xu, X.; Qian, W.; Shen, Z.; Zhang, M. Altered Human Brain Anatomy in Chronic Smokers: A Review of Magnetic Resonance Imaging Studies. Neurol. Sci. 2015, 36, 497–504. [Google Scholar] [CrossRef] [PubMed]
  84. Topiwala, A.; Allan, C.L.; Valkanova, V.; Zsoldos, E.; Filippini, N.; Sexton, C.; Mahmood, A.; Fooks, P.; Singh-Manoux, A.; Mackay, C.E.; et al. Moderate Alcohol Consumption as Risk Factor for Adverse Brain Outcomes and Cognitive Decline: Longitudinal Cohort Study. BMJ 2017, 357, j2353. [Google Scholar] [CrossRef] [Green Version]
  85. Grumbach, P.; Opel, N.; Martin, S.; Meinert, S.; Leehr, E.J.; Redlich, R.; Enneking, V.; Goltermann, J.; Baune, B.T.; Dannlowski, U.; et al. Sleep Duration Is Associated with White Matter Microstructure and Cognitive Performance in Healthy Adults. Hum. Brain Mapp. 2020, 41, 4397–4405. [Google Scholar] [CrossRef] [PubMed]
  86. Dalmaijer, E.S.; Nord, C.L.; Astle, D.E. Statistical Power for Cluster Analysis. BMC Bioinform. 2022, 23, 205. [Google Scholar] [CrossRef]
  87. Pinaya, W.H.L.; Scarpazza, C.; Garcia-Dias, R.; Vieira, S.; Baecker, L.; F da Costa, P.; Redolfi, A.; Frisoni, G.B.; Pievani, M.; Calhoun, V.D.; et al. Using Normative Modelling to Detect Disease Progression in Mild Cognitive Impairment and Alzheimer’s Disease in a Cross-Sectional Multi-Cohort Study. Sci. Rep. 2021, 11, 15746. [Google Scholar] [CrossRef]
  88. Filippi, M.; Agosta, F.; Grosskreutz, J.; Benatar, M.; Kassubek, J.; Verstraete, E.; Turner, M.R. Progress towards a Neuroimaging Biomarker for Amyotrophic Lateral Sclerosis. Lancet Neurol. 2015, 14, 786–788. [Google Scholar] [CrossRef]
  89. Steinbach, R.; Gaur, N.; Stubendorff, B.; Witte, O.W.; Grosskreutz, J. Developing a Neuroimaging Biomarker for Amyotrophic Lateral Sclerosis: Multi-Center Data Sharing and the Road to a “Global Cohort”. Front. Neurol. 2018, 9, 1055. [Google Scholar] [CrossRef] [Green Version]
  90. Pinto, M.S.; Paolella, R.; Billiet, T.; Van Dyck, P.; Guns, P.-J.; Jeurissen, B.; Ribbens, A.; den Dekker, A.J.; Sijbers, J. Harmonization of Brain Diffusion MRI: Concepts and Methods. Front. Neurosci. 2020, 14, 396. [Google Scholar] [CrossRef]
  91. Zaharchuk, G.; Gong, E.; Wintermark, M.; Rubin, D.; Langlotz, C.P. Deep Learning in Neuroradiology. Am. J. Neuroradiol. 2018, 39, 1776–1784. [Google Scholar] [CrossRef]
  92. Wang, S.; Tang, L.; Majety, A.; Rousseau, J.F.; Shih, G.; Ding, Y.; Peng, Y. Trustworthy Assertion Classification through Prompting. J. Biomed. Inform. 2022, 132, 104139. [Google Scholar] [CrossRef]
  93. Kamagata, K.; Andica, C.; Kato, A.; Saito, Y.; Uchida, W.; Hatano, T.; Lukies, M.; Ogawa, T.; Takeshige-Amano, H.; Akashi, T.; et al. Diffusion Magnetic Resonance Imaging-Based Biomarkers for Neurodegenerative Diseases. IJMS 2021, 22, 5216. [Google Scholar] [CrossRef] [PubMed]
  94. Chen, H.-J.; Zhan, C.; Cai, L.-M.; Lin, J.-H.; Zhou, M.-X.; Zou, Z.-Y.; Yao, X.-F.; Lin, Y.-J. White Matter Microstructural Impairments in Amyotrophic Lateral Sclerosis: A Mean Apparent Propagator MRI Study. NeuroImage Clin. 2021, 32, 102863. [Google Scholar] [CrossRef]
  95. Welton, T.; Maller, J.J.; Lebel, R.M.; Tan, E.T.; Rowe, D.B.; Grieve, S.M. Diffusion Kurtosis and Quantitative Susceptibility Mapping MRI Are Sensitive to Structural Abnormalities in Amyotrophic Lateral Sclerosis. NeuroImage Clin. 2019, 24, 101953. [Google Scholar] [CrossRef]
  96. Huang, N.; Zou, Z.; Xue, Y.; Chen, H. Abnormal Cerebral Microstructures Revealed by Diffusion Kurtosis Imaging in Amyotrophic Lateral Sclerosis. J. Magn. Reson. Imaging 2020, 51, 554–562. [Google Scholar] [CrossRef] [PubMed]
  97. Juengling, F.D.; Wuest, F.; Kalra, S.; Agosta, F.; Schirrmacher, R.; Thiel, A.; Thaiss, W.; Müller, H.-P.; Kassubek, J. Simultaneous PET/MRI: The Future Gold Standard for Characterizing Motor Neuron Disease—A Clinico-Radiological and Neuroscientific Perspective. Front. Neurol. 2022, 13, 890425. [Google Scholar] [CrossRef]
  98. Hübers, A.; Kassubek, J.; Müller, H.-P.; Broc, N.; Dreyhaupt, J.; Ludolph, A.C. The Ipsilateral Silent Period: An Early Diagnostic Marker of Callosal Disconnection in ALS. Ther. Adv. Chronic Dis. 2021, 12, 20406223211044070. [Google Scholar] [CrossRef] [PubMed]
  99. Kiernan, M.C.; Vucic, S.; Talbot, K.; McDermott, C.J.; Hardiman, O.; Shefner, J.M.; Al-Chalabi, A.; Huynh, W.; Cudkowicz, M.; Talman, P.; et al. Improving Clinical Trial Outcomes in Amyotrophic Lateral Sclerosis. Nat. Rev. Neurol. 2021, 17, 104–118. [Google Scholar] [CrossRef]
Figure 1. Schematic setup of a diffusion tensor imaging (DTI)-based supervised machine learning application in amyotrophic lateral sclerosis (ALS). Relevant features for classification are extracted from labeled data sets of patients and controls; for example, using tract-based analysis approaches. Standard machine learning models are trained on the labeled data and can subsequently also make diagnostic predictions for new data sets. An extension of the DTI features by parameter structural MRI is feasible.
Figure 1. Schematic setup of a diffusion tensor imaging (DTI)-based supervised machine learning application in amyotrophic lateral sclerosis (ALS). Relevant features for classification are extracted from labeled data sets of patients and controls; for example, using tract-based analysis approaches. Standard machine learning models are trained on the labeled data and can subsequently also make diagnostic predictions for new data sets. An extension of the DTI features by parameter structural MRI is feasible.
Ijms 24 01911 g001
Figure 2. Pie plot displaying the percentage of studies using diffusion tensor imaging (DTI)-based feature sets or combinations of DTI with other modalities in machine learning and deep learning models for different research tasks in amyotrophic lateral sclerosis.
Figure 2. Pie plot displaying the percentage of studies using diffusion tensor imaging (DTI)-based feature sets or combinations of DTI with other modalities in machine learning and deep learning models for different research tasks in amyotrophic lateral sclerosis.
Ijms 24 01911 g002
Figure 3. Strategies for the implementation of machine learning models on diffusion tensor imaging (DTI) data in amyotrophic lateral sclerosis. For several clinical questions, standard machine learning algorithms can provide reliable results even with limited sample sizes. Validating models with an independent test sample is essential for good modeling practice. Deep learning can be implemented with well-curated international data repositories. In addition to more complex algorithms, augmenting DTI features with other magnetic resonance imaging (MRI) parameters or neurophysiological measures can also add value in acquiring knowledge about the progression of the disease.
Figure 3. Strategies for the implementation of machine learning models on diffusion tensor imaging (DTI) data in amyotrophic lateral sclerosis. For several clinical questions, standard machine learning algorithms can provide reliable results even with limited sample sizes. Validating models with an independent test sample is essential for good modeling practice. Deep learning can be implemented with well-curated international data repositories. In addition to more complex algorithms, augmenting DTI features with other magnetic resonance imaging (MRI) parameters or neurophysiological measures can also add value in acquiring knowledge about the progression of the disease.
Ijms 24 01911 g003
Table 1. Diffusion tensor imaging (DTI)-based machine learning models in amyotrophic lateral sclerosis (ALS). AD—axial diffusivity, CC—corpus callosum, CST—corticospinal tract, FA—fractional anisotropy, FAS—flail arm syndrome, HC—healthy controls, LMND—lower motor neuron disease, MD—mean diffusivity, PBP—progressive bulbar palsy, PLS—primary lateral sclerosis, PUMN—pure upper motor neuron, RD—radial diffusivity, RF—random forest, SVM—support vector machine.
Table 1. Diffusion tensor imaging (DTI)-based machine learning models in amyotrophic lateral sclerosis (ALS). AD—axial diffusivity, CC—corpus callosum, CST—corticospinal tract, FA—fractional anisotropy, FAS—flail arm syndrome, HC—healthy controls, LMND—lower motor neuron disease, MD—mean diffusivity, PBP—progressive bulbar palsy, PLS—primary lateral sclerosis, PUMN—pure upper motor neuron, RD—radial diffusivity, RF—random forest, SVM—support vector machine.
StudyAlgorithmTaskFeaturesSample SizeModel ValidationAccuracy
Chen et al. [29]SVMDiagnostic predictionFA values of all white matter voxels22 patients with ALS;
26 HC
Leave-one-out cross-validation83%
Ferraro et al. [31]SVMDiagnostic predictionFA, MD, AD, and RD of CST and motor callosal tracts123 patients with ALS;
44 patients with PUMN;
20 ALS-mimics;
78 HC
Independent test sample78%
Kocar et al. [32]SVMDiagnostic predictionFA of CST, corticopontine tract, corticorubral tract, corticostriatal pathway, proximal perforant path, CC area II, and CC area III98 patients with ALS;
98 HC
Leave-one-out cross-validation66%
Münch et al. [33]SVMDiagnostic predictionFA of CC area I–III432 patients with ALS;
55 patients with PLS;
45 patients with FAS;
22 patients with PBP;
21 patients with LMND;
112 HC
Independent test sample65%
Li et al. [34]SVMPrediction of progressionWhite matter network matrices73 patients with ALSNested cross-validation85%
Sarica et al. [30]RFDiagnostic predictionFA, MD, AD, and RD of CST voxels24 patients with ALS;
24 HC
5-fold cross-validation80%
Fratello et al. [35]Multi-view models with RFDiagnostic predictionwhole-brain FA maps41 patients with ALS;
37 patients with Parkinson’s disease;
43 HC
n/a58%
Gabel et al. [36]Event-based modelingOrdering of events, i.e., regional involvementFA of CST (inferior/middle/superior), CC (genu/body/splenium), cingulum (dorsal section), superior longitudinal fasciculus, inferior longitudinal fasciculus, inferior fronto-occipital fasciculus, and uncinate fasciculus154 patients with ALS;
128 HC
Cross-validationn/a
Behler et al. [37]Multivariate Bayesian classificationCerebral stage predictionFA of CST, corticopontine tract, corticorubral tract, corticostriatal pathway, and proximal perforant path325 patients with ALS;
130 HC
Comparison to threshold-based DTI stagingn/a
Bede et al. [38]Multilayer perceptronDiagnostic predictionFA, MD, AD, and RD of 30 white matter regions214 patients with ALS;
37 patients with a non-ALS neurodegenerative diagnosis;
127 HC
Independent test sample79%
Table 2. Multimodal diffusion tensor imaging (DTI)-based machine learning models in amyotrophic lateral sclerosis. AD—axial diffusivity, CC—corpus callosum, CST—corticospinal tract, FA—fractional anisotropy, FAS—flail arm syndrome, HC—healthy controls, LMND—lower motor neuron disease, MD—mean diffusivity, PBP—progressive bulbar palsy, PLS—primary lateral sclerosis, PUMN—pure upper motor neuron, RD—radial diffusivity, RF—random forest, SVM—support vector machine.
Table 2. Multimodal diffusion tensor imaging (DTI)-based machine learning models in amyotrophic lateral sclerosis. AD—axial diffusivity, CC—corpus callosum, CST—corticospinal tract, FA—fractional anisotropy, FAS—flail arm syndrome, HC—healthy controls, LMND—lower motor neuron disease, MD—mean diffusivity, PBP—progressive bulbar palsy, PLS—primary lateral sclerosis, PUMN—pure upper motor neuron, RD—radial diffusivity, RF—random forest, SVM—support vector machine.
StudyAlgorithmTaskModalitiesSample SizeModel ValidationAccuracy
Ferraro et al. [31]SVMDiagnostic predictionDTI (tract-based diffusion metrics) + T1w MRI (cortical thickness) 123 patients with ALS, 44 patients with PUMN, 20 ALS mimics; 78 HCIndependent test sample91%
Kocar et al. [32]SVMDiagnostic predictionDTI (tract-based diffusion metrics) + T1w MRI (texture parameters) 98 patients with ALS; 98 HCLeave-one-out cross-validation80%
Münch et al. [33]SVMDiagnostic predictionDTI (tract-based diffusion metrics) + T1w MRI (texture parameters) 432 patients with ALS, 55 patients with PLS, 45 patients with FAS, 22 patients with PBP, 21 patients with LMND; 112 HCIndependent test sample84%
Bede et al. [41]Canonical discriminant functionDiagnostic predictionDTI (ROI-based diffusion metrics) + T1w MRI (ROI-based signal intensity + basal ganglia volumetrics)75 patients with ALS; 75 HCIndependent test sample90%
Fratello et al. [35]Multi-view models with RFDiagnostic predictionDTI (whole-brain FA maps) + fMRI (whole-brain default-mode networks)41 patients with ALS, 37 patients with Parkinson’s disease; 43 HC5-fold cross-validation67%
Schuster et al. [42]Binary logistic regressionDiagnostic predictionDTI (ROI-based diffusion metrics) + T1w MRI (regional grey matter densities)81 patients with ALS; 66 HCIndependent test sample78%
Schuster et al. [43]Binary logistic ridge regressionSurvival predictionDTI (regional diffusion metrics) + T1w MRI (regional cortical thickness)60 patients with ALS; 69 HC Independent test sample58%
Kocar et al. [32]Multilayer perceptronDiagnostic predictionDTI (tract-based diffusion metrics) + T1w MRI (texture parameters) 98 patients with ALS; 98 HCIndependent test sample72%
Bede et al. [38]Multilayer perceptron modelDiagnostic predictionDTI (ROI-based diffusion metrics) + T1w MRI (cerebral volumes + cortical thicknesses) 214 patients with ALS, 37 patients with a non-ALS neurodegenerative diagnosis; 127 HCIndependent test sample75%
Van der Burgh et al. [44]Deep learning networksSurvival predictionDTI (tract-based FA) + T1w MRI (cortical thicknesses + subcortical volumes) + clinical parameters135 patients with ALSIndependent test sample84%
Tan et al. [45]Probabilistic network-based clusteringDivide patients into subgroups of similar neurodegeneration patternsDTI (white matter connectome FA) + T1w MRI (whole-brain cortical thickness)488 patients with ALS; 338 HCLongitudinal subsample90% in the validation sample
Behler et al. [46]Hierarchical clusteringDivide patients into subgroups of similar neurodegeneration patternsDTI (tract-based FA) + video-oculography + cognitive scores 245 patients with ALSNon/a
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Behler, A.; Müller, H.-P.; Ludolph, A.C.; Kassubek, J. Diffusion Tensor Imaging in Amyotrophic Lateral Sclerosis: Machine Learning for Biomarker Development. Int. J. Mol. Sci. 2023, 24, 1911. https://doi.org/10.3390/ijms24031911

AMA Style

Behler A, Müller H-P, Ludolph AC, Kassubek J. Diffusion Tensor Imaging in Amyotrophic Lateral Sclerosis: Machine Learning for Biomarker Development. International Journal of Molecular Sciences. 2023; 24(3):1911. https://doi.org/10.3390/ijms24031911

Chicago/Turabian Style

Behler, Anna, Hans-Peter Müller, Albert C. Ludolph, and Jan Kassubek. 2023. "Diffusion Tensor Imaging in Amyotrophic Lateral Sclerosis: Machine Learning for Biomarker Development" International Journal of Molecular Sciences 24, no. 3: 1911. https://doi.org/10.3390/ijms24031911

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop