Decision processes in 3D structural MRI schizophrenia classification evaluated with saliency maps
Summary
This study evaluates seven deep learning (DL) architectures for classifying schizophrenia from 3D structural MRI data, focusing on the transparency of their decision processes using gradient-weighted class activation mapping (Grad-CAM). Researchers trained models on 192 adult brains (101 schizophrenia patients, 91 healthy controls) from the MCIC collection. While all models achieved over 70% classification accuracy and AUC scores above 0.75, only BrainID and ResNet18 demonstrated plausible decision-making based on structural brain information, as assessed by saliency maps. The study also developed a method to translate Grad-CAM saliency maps into universally interpretable anatomical markers, identifying candidate regions, primarily frontal and right-sided, consistent with known schizophrenia markers.
Key takeaway
For AI Scientists developing clinical decision support systems, you must integrate explainable AI (XAI) methods like Grad-CAM to validate model decisions, not just performance. Your models might achieve high accuracy but rely on implausible features, indicating overfitting or spurious correlations. Systematically evaluating saliency maps and deriving consistent anatomical markers will build trust and accelerate the clinical translation of deep learning applications, ensuring your diagnostic tools are both accurate and interpretable.
Key insights
Explainable AI methods are crucial for validating deep learning models in medical diagnostics, revealing decision plausibility beyond performance metrics.
Principles
- High classification accuracy does not guarantee plausible decision-making.
- Saliency maps can reveal overfitting or inconsistent feature learning.
- Aggregating local explanations yields global biomarker candidates.
Method
A three-stage approach: (1) train DL classifiers, (2) evaluate individual saliency map plausibility using Grad-CAM, mass accuracy, and center of mass, (3) derive global anatomical biomarkers by statistically comparing and intersecting consistent saliency regions across plausible architectures.
In practice
- Apply Grad-CAM to assess DL model decision plausibility in medical imaging.
- Quantify saliency map quality using mass accuracy and CoM deviation.
- Intersect saliency maps from multiple models for robust biomarker discovery.
Topics
- Deep Learning
- Schizophrenia Classification
- Explainable AI
- Grad-CAM
- Structural MRI
- Neuroimaging Biomarkers
Best for: AI Scientist, Research Scientist, Machine Learning Engineer
Related on AIssential
Editorial summary, takeaway, and curation by AIssential. Original article published by Machine learning : nature.com subject feeds.