SAMBA: A Scatter-Guided Masked Bidirectional Mamba Foundation Model for SAR Target Recognition

· Source: cs.CV updates on arXiv.org · Field: Technology & Digital — Artificial Intelligence & Machine Learning, Robotics & Autonomous Systems, Emerging Technologies & Innovation · Depth: Expert, extended

Summary

SAMBA, a novel Scatter-Guided Masked Bidirectional Mamba foundation model, is proposed for Synthetic Aperture Radar Automatic Target Recognition (SAR ATR). This model addresses the high computational complexity of Transformer-based architectures and the inadequacy of generic masking strategies for SAR imagery. SAMBA integrates a linear-complexity Mamba encoder with a mid-sequence class token, a three-level hierarchical Scattering-Guided Masked Autoencoder (SG-MAE) masking strategy, and a lightweight SpatialMix feature interaction module. Utilizing a two-stage cross-domain pre-training pipeline, SAMBA demonstrates superior performance across all pre-training configurations. It features only 27M parameters, significantly fewer than ConvNeXt-V2 (89M) and HiViT (66M), while achieving state-of-the-art results on seven downstream SAR classification and detection datasets, including MSTAR, SSDD, and SARDet-100K. The SG-MAE strategy alone boosted 5-shot classification accuracy from 71.5% to 80.6%.

Key takeaway

For Machine Learning Engineers developing SAR Automatic Target Recognition systems, you should consider Mamba-based architectures like SAMBA. Its linear complexity and scattering-guided masking offer superior performance and efficiency over traditional Transformer models, especially for high-resolution SAR imagery. Implement a two-stage cross-domain pre-training approach to maximize transfer capability and achieve state-of-the-art results on classification and detection tasks.

Key insights

SAR ATR foundation models benefit from Mamba architectures and scattering-guided masking for efficiency and accuracy.

Principles

Method

SAMBA employs an overlapped patch embedding, a mid-positioned CLS token in a bidirectional Mamba encoder, and a three-level hierarchical SG-MAE masking strategy, complemented by a SpatialMix decoder.

In practice

Topics

Code references

Best for: Computer Vision Engineer, AI Scientist, Machine Learning Engineer, Research Scientist

Related on AIssential

Open in AIssential →

Editorial summary, takeaway, and curation by AIssential. Original article published by cs.CV updates on arXiv.org.