Tabular Foundation Models for Clinical Survival Analysis via Survival-Aware Adaptation

· Source: Artificial Intelligence · Field: Technology & Digital — Artificial Intelligence & Machine Learning, Data Science & Analytics, Health & Medical Research · Depth: Expert, quick

Summary

A new lightweight adaptation approach applies tabular foundation models (TFMs) to clinical survival analysis, a critical task for predicting time-to-event outcomes like mortality. This method addresses the challenge of applying TFMs, typically restricted to discrete classification, to censored time-to-event prediction. The approach involves training a survival-aware head, specifically a multi-task logistic regression (MTLR) head, on top of pretrained TFM representations from architectures like TabPFN, TabDPT, and TabICL. Evaluated on public survival benchmarks and large-scale ICU cohorts MIMIC-IV and eICU, this transfer learning strategy demonstrates competitive or superior performance. For instance, TabDPT-FT-MTLR achieved a C-index of 0.856 on MIMIC-IV, a +1.4% improvement over DeepSurv (0.844) and +6.7% over the best zero-shot model (0.802). On eICU, TabICL-FT-MTLR reached 0.797, outperforming DeepSurv (0.784) by +1.7% and the best zero-shot model (0.749) by +6.4%. These results underscore the effectiveness of combining pretrained tabular representations with survival-aware objectives for clinical survival prediction.

Key takeaway

For AI Scientists and Research Scientists developing clinical prediction models, you should consider integrating tabular foundation models into your survival analysis workflows. This approach offers superior performance over traditional baselines, especially when dealing with censored time-to-event data. By adapting pretrained models like TabDPT or TabICL with a multi-task logistic regression head, you can achieve higher C-index scores on critical datasets such as MIMIC-IV and eICU. This strategy provides a practical and effective alternative, potentially reducing the need for extensive task-specific training data.

Key insights

Adapting tabular foundation models with a survival-aware head significantly improves clinical time-to-event prediction.

Principles

Method

Apply a multi-task logistic regression (MTLR) head directly atop pretrained tabular foundation model representations to model right-censored time-to-event outcomes.

In practice

Topics

Best for: AI Scientist, Research Scientist

Related on AIssential

Open in AIssential →

Editorial summary, takeaway, and curation by AIssential. Original article published by Artificial Intelligence.