Label-Decoupled Style Augmentation for Domain Generalization in Multi-Label Remote Sensing Scene Classification

· Source: Computer Vision and Pattern Recognition · Field: Technology & Digital — Artificial Intelligence & Machine Learning, Remote Sensing · Depth: Expert, quick

Summary

A novel Label-Decoupled Style Augmentation framework is proposed to enhance domain generalization in multi-label remote sensing scene classification, addressing the issue where global feature-statistics augmentation contaminates classes. This framework confines style perturbation to label-specific regions by using per-label attention, derived from a learnable module or gradient class-activation maps. Per-label feature statistics are then mixed with cross-domain samples sharing present labels, using independent per-label coefficients, and features are recomposed via attention-weighted normalization. Evaluated on a leave-one-domain-out benchmark across multi-label UCM, AID, and DFC15 datasets with six shared labels, the best variant achieved 71.5% mean average precision. This result surpasses empirical risk minimization by 5.0 points and the strongest global-statistics baseline by 1.3 points, with gains up to 7.7 points on the hardest transfers. The framework adds at most 0.35% parameters and leaves inference unchanged.

Key takeaway

For Machine Learning Engineers developing robust multi-label remote sensing classification models, you should consider integrating label-decoupled style augmentation. This approach significantly boosts domain generalization, particularly for challenging transfers, achieving up to 7.7 points gain on hard transfers. It offers an inexpensive upgrade path, adding at most 0.35% parameters and leaving inference unchanged, making it a practical solution for improving model resilience to distribution shifts.

Key insights

Label-decoupled style augmentation improves multi-label domain generalization by localizing style perturbations to specific class regions.

Principles

Method

The framework uses per-label attention to obtain label-specific feature statistics, mixes these with cross-domain samples sharing labels under independent coefficients, and recomposes features via attention-weighted normalization.

In practice

Topics

Code references

Best for: Research Scientist, AI Scientist, Machine Learning Engineer, Computer Vision Engineer

Related on AIssential

Open in AIssential →

Editorial summary, takeaway, and curation by AIssential. Original article published by Computer Vision and Pattern Recognition.