Improving classification rate of schizophrenia using a multimodal multi-layer perceptron model with structural and functional MRI

Alvaro E. Ulloa, Sergey Plis, Vince D. Calhoun

Research output: Contribution to journalArticlepeer-review

Abstract

The wide variety of brain imaging technologies allows us to exploit information inherent to different data modalities. The richness of multimodal datasets may increase predictive power and reveal latent variables that otherwise would have not been found. However, the analysis of multimodal data is often conducted by assuming linear interactions which impact the accuracy of the results. We propose the use of a multimodal multi-layer perceptron model to enhance the predictive power of structural and functional magnetic resonance imaging (sMRI and fMRI) combined. We also use a synthetic data generator to pre-train each modality input layers, alleviating the effects of the small sample size that is often the case for brain imaging modalities. The proposed model improved the average and uncertainty of the area under the ROC curve to 0.850±0.051 compared to the best results on individual modalities (0.741±0.075 for sMRI, and 0.833±0.050 for fMRI).

Original languageEnglish (US)
JournalUnknown Journal
StatePublished - Apr 4 2018
Externally publishedYes

ASJC Scopus subject areas

  • General

Fingerprint Dive into the research topics of 'Improving classification rate of schizophrenia using a multimodal multi-layer perceptron model with structural and functional MRI'. Together they form a unique fingerprint.

Cite this