Comparison of Loss Functions for Robust Deep Learning-based Echocardiography Segmentation when Learning with Partially Labelled Data from Multiple Domains
Summary
A comprehensive study evaluates three loss functions—adaptive categorical cross entropy (aCCE) loss, marginal loss, and adaptive binary cross entropy (aBCE) loss—for robust deep learning-based echocardiography segmentation. The research addresses challenges in training automated cardiac structure segmentation models using partially-labelled data from multiple domains. Experiments compared these loss functions across intra-domain and inter-domain tasks, considering scenarios with single or multiple partial-labels and varying proportions of fully-labelled data. All three loss functions demonstrated strong performance in intra-domain segmentation. For inter-domain tasks with one missing label, aBCE and marginal losses showed superior results. In more complex scenarios involving multiple missing labels, marginal loss significantly outperformed the other methods, highlighting its robustness. This investigation is the first to compare loss-based solutions for multi-domain, partially-labelled echocardiography segmentation.
Key takeaway
For Machine Learning Engineers developing echocardiography segmentation models with multi-domain, partially-labelled datasets, your choice of loss function significantly impacts performance. If you encounter scenarios with multiple missing labels, prioritize marginal loss for its proven robustness. For single missing labels, aBCE or marginal loss are strong contenders. This selection optimizes model accuracy and reduces the need for extensive full data annotation.
Key insights
The marginal loss function offers superior robustness for multi-domain echocardiography segmentation with multiple missing labels.
Principles
- Loss function choice is critical for multi-domain partial-label learning.
- Different loss functions excel in specific partial-label scenarios.
Method
The study compared aCCE, marginal, and aBCE losses across intra-domain and inter-domain echocardiography segmentation tasks, varying partial-label counts and fully-labelled data proportions.
In practice
- Prioritize marginal loss for multi-label missing scenarios.
- Consider aBCE or marginal for single missing labels.
- All three losses are effective for intra-domain tasks.
Topics
- Echocardiography Segmentation
- Deep Learning
- Loss Functions
- Partially-Labelled Data
- Multi-Domain Learning
- Cardiac Imaging
Best for: Computer Vision Engineer, AI Scientist, Machine Learning Engineer, Research Scientist
Related on AIssential
Editorial summary, takeaway, and curation by AIssential. Original article published by Takara TLDR - Daily AI Papers.