Tabular Foundation Models for Clinical Survival Analysis via Survival-Aware Adaptation
Summary
A new lightweight adaptation approach applies tabular foundation models (TFMs) to clinical survival analysis, a critical task for predicting time-to-event outcomes like mortality. This method addresses the challenge of applying TFMs, typically restricted to discrete classification, to censored time-to-event prediction. The approach involves training a survival-aware head, specifically a multi-task logistic regression (MTLR) head, on top of pretrained TFM representations from architectures like TabPFN, TabDPT, and TabICL. Evaluated on public survival benchmarks and large-scale ICU cohorts MIMIC-IV and eICU, this transfer learning strategy demonstrates competitive or superior performance. For instance, TabDPT-FT-MTLR achieved a C-index of 0.856 on MIMIC-IV, a +1.4% improvement over DeepSurv (0.844) and +6.7% over the best zero-shot model (0.802). On eICU, TabICL-FT-MTLR reached 0.797, outperforming DeepSurv (0.784) by +1.7% and the best zero-shot model (0.749) by +6.4%. These results underscore the effectiveness of combining pretrained tabular representations with survival-aware objectives for clinical survival prediction.
Key takeaway
For AI Scientists and Research Scientists developing clinical prediction models, you should consider integrating tabular foundation models into your survival analysis workflows. This approach offers superior performance over traditional baselines, especially when dealing with censored time-to-event data. By adapting pretrained models like TabDPT or TabICL with a multi-task logistic regression head, you can achieve higher C-index scores on critical datasets such as MIMIC-IV and eICU. This strategy provides a practical and effective alternative, potentially reducing the need for extensive task-specific training data.
Key insights
Adapting tabular foundation models with a survival-aware head significantly improves clinical time-to-event prediction.
Principles
- Pretrained tabular representations enhance survival analysis.
- Survival-aware objectives are crucial for time-to-event tasks.
- Transfer learning reduces data dependency for clinical models.
Method
Apply a multi-task logistic regression (MTLR) head directly atop pretrained tabular foundation model representations to model right-censored time-to-event outcomes.
In practice
- Use TabDPT-FT-MTLR for improved mortality prediction in ICU settings.
- Explore TabICL-FT-MTLR for similar gains in diverse clinical cohorts.
- Adapt existing TFMs with MTLR for new survival analysis tasks.
Topics
- Tabular Foundation Models
- Clinical Survival Analysis
- Time-to-Event Prediction
- Multi-Task Logistic Regression
- Transfer Learning
- MIMIC-IV
- eICU
Best for: AI Scientist, Research Scientist
Related on AIssential
Editorial summary, takeaway, and curation by AIssential. Original article published by Artificial Intelligence.