Label-Decoupled Style Augmentation for Domain Generalization in Multi-Label Remote Sensing Scene Classification
Summary
A novel Label-Decoupled Style Augmentation framework is proposed to enhance domain generalization in multi-label remote sensing scene classification, addressing the issue where global feature-statistics augmentation contaminates classes. This framework confines style perturbation to label-specific regions by using per-label attention, derived from a learnable module or gradient class-activation maps. Per-label feature statistics are then mixed with cross-domain samples sharing present labels, using independent per-label coefficients, and features are recomposed via attention-weighted normalization. Evaluated on a leave-one-domain-out benchmark across multi-label UCM, AID, and DFC15 datasets with six shared labels, the best variant achieved 71.5% mean average precision. This result surpasses empirical risk minimization by 5.0 points and the strongest global-statistics baseline by 1.3 points, with gains up to 7.7 points on the hardest transfers. The framework adds at most 0.35% parameters and leaves inference unchanged.
Key takeaway
For Machine Learning Engineers developing robust multi-label remote sensing classification models, you should consider integrating label-decoupled style augmentation. This approach significantly boosts domain generalization, particularly for challenging transfers, achieving up to 7.7 points gain on hard transfers. It offers an inexpensive upgrade path, adding at most 0.35% parameters and leaving inference unchanged, making it a practical solution for improving model resilience to distribution shifts.
Key insights
Label-decoupled style augmentation improves multi-label domain generalization by localizing style perturbations to specific class regions.
Principles
- Global style augmentation can lead to class contamination.
- Confining style perturbation to label-specific regions is effective.
- Spatial attention is key for localized feature mixing.
Method
The framework uses per-label attention to obtain label-specific feature statistics, mixes these with cross-domain samples sharing labels under independent coefficients, and recomposes features via attention-weighted normalization.
In practice
- Implement per-label attention for fine-grained style mixing.
- Integrate this framework for multi-label remote sensing tasks.
- Utilize gradient class-activation maps for per-label attention.
Topics
- Label-Decoupled Augmentation
- Domain Generalization
- Multi-Label Classification
- Remote Sensing
- Feature Augmentation
- Attention Mechanisms
- Mean Average Precision
Code references
Best for: Research Scientist, AI Scientist, Machine Learning Engineer, Computer Vision Engineer
Related on AIssential
See Counsel's argued verdicts on the open AI decisions leaders are weighing →
Editorial summary, takeaway, and curation by AIssential. Original article published by Computer Vision and Pattern Recognition.