ASFR-Net: Adversarial Alignment and Spatio-Frequency Refinement Network for Heterogeneous Remote Sensing Image Change Detection

· Source: Computer Vision and Pattern Recognition · Field: Technology & Digital — Artificial Intelligence & Machine Learning, Remote Sensing · Depth: Expert, quick

Summary

ASFR-Net, an Adversarial Alignment and Spatio-Frequency Refinement Network, addresses the challenge of heterogeneous change detection in remote sensing imagery by effectively decoupling genuine land-cover changes from significant modal disparities. This end-to-end network employs a Modality-Invariant Representation Learner (MIR-Learner) to extract features that bridge the primary domain gap between different imaging mechanisms. It then utilizes an innovative Spatio-Frequency Synergistic Enhancement Module (SFEM) to suppress sensor-specific noise and artifacts, leveraging frequency-domain processing for elements difficult to discern spatially. Multi-level difference features are processed by a decoder with cascaded Hierarchical Guided Fusion Module (HGFM) blocks to generate precise change maps. To combat data scarcity, the authors also released the VisNIR-HCD dataset, a high-resolution benchmark for building changes. ASFR-Net achieves state-of-the-art performance on both VisNIR-HCD and public datasets, with its source code and dataset publicly available.

Key takeaway

For Research Scientists developing heterogeneous change detection models, ASFR-Net provides a robust framework to mitigate modal disparities and pseudo-changes. You should consider integrating its modality-invariant representation learning and spatio-frequency refinement techniques to enhance detection accuracy. Furthermore, utilize the publicly available VisNIR-HCD dataset to benchmark your models, especially for building change detection tasks, as it offers unique challenges for generalization.

Key insights

ASFR-Net uses adversarial alignment and spatio-frequency refinement to improve heterogeneous remote sensing change detection.

Principles

Method

ASFR-Net uses an MIR-Learner for invariant features, then an SFEM for spatio-frequency noise suppression. A decoder with HGFM blocks generates change maps from refined multi-level differences.

In practice

Topics

Code references

Best for: Computer Vision Engineer, AI Scientist, Machine Learning Engineer, Research Scientist

Related on AIssential

Open in AIssential →

Editorial summary, takeaway, and curation by AIssential. Original article published by Computer Vision and Pattern Recognition.