Forecasting Medium-Horizon Alzheimer's Disease Progression: Residual Gap-Aware Transformers for 24-Month CDR-SB Change from ADNI Clinical and Biomarker Histories

· Source: stat.ML updates on arXiv.org · Field: Health & Wellbeing — Health & Medical Research, Medical Devices & Health Technology, Artificial Intelligence & Machine Learning · Depth: Expert, extended

Summary

A new model, the residual gap-aware transformer, has been developed to forecast medium-horizon Alzheimer's disease progression, specifically the 24-month Clinical Dementia Rating Sum of Boxes (CDR-SB) change. This model leverages harmonized longitudinal data from the Alzheimer's Disease Neuroimaging Initiative (ADNI), comprising 2,600 labeled anchors from 858 participants and 7,276 longitudinal rows. It combines a mixed-effects statistical reference with a transformer-based residual learning approach, incorporating participant-level random intercepts, observation-level triplet tokenization for irregular histories, and a learned nonnegative time-gap penalty in self-attention. The model was compared against a linear mixed-effects baseline, GRU-D, and STraTS across five participant-level random seeds. It achieved the best mean test performance across all reported metrics, reducing Mean Squared Error (MSE) by 13.1% and increasing prediction-observation correlation by 26.4% relative to the mixed-effects baseline, also outperforming GRU-D and STraTS.

Key takeaway

For AI Scientists and Machine Learning Engineers developing Alzheimer's disease progression models, consider adopting a hybrid statistical-neural approach. Your models should integrate a mixed-effects statistical reference to capture baseline disease burden and within-subject dependence, with a transformer-based residual learner that accounts for irregular longitudinal clinical and biomarker histories, including time-gap penalties in attention. This strategy can significantly improve prediction accuracy and correlation for medium-horizon outcomes like 24-month CDR-SB change, offering a more robust and clinically interpretable framework.

Key insights

Combining statistical anchoring with gap-aware residual learning improves medium-horizon Alzheimer's disease progression prediction.

Principles

Method

The proposed method uses a mixed-effects model for baseline prediction, then a gap-aware transformer learns residuals from irregular longitudinal clinical and biomarker histories, employing observation-level triplet tokenization and a time-gap penalty in self-attention.

In practice

Topics

Best for: AI Scientist, Research Scientist, Machine Learning Engineer

Related on AIssential

Open in AIssential →

Editorial summary, takeaway, and curation by AIssential. Original article published by stat.ML updates on arXiv.org.