LC-SLab -- An object-based deep learning framework for large-scale land cover classification from satellite imagery and sparse in-situ labels

· Source: cs.CV updates on arXiv.org · Field: Technology & Digital — Artificial Intelligence & Machine Learning, Geospatial AI & Remote Sensing · Depth: Expert, extended

Summary

LC-SLab is a novel deep learning framework designed for large-scale land cover classification using satellite imagery and sparse in-situ labels. It addresses the issue of fragmented and noisy predictions from traditional pixel-wise methods by employing object-based classification, which assigns labels to semantically coherent image regions and enforces a minimum mapping unit (MMU) to control fragmentation. The framework supports both input-level aggregation via graph neural networks and output-level aggregation through postprocessing semantic segmentation models. Additionally, it integrates features from a pre-trained network to enhance performance on smaller datasets. Evaluations using annual Sentinel-2 composites and sparse LUCAS labels demonstrate that LC-SLab's object-based methods achieve comparable or superior accuracy to pixel-wise models while generating significantly more coherent land cover maps. Input-level aggregation proves more robust with limited data, whereas output-level aggregation excels with larger datasets. Notably, several LC-SLab configurations surpass the accuracy of established third-party products like ESA WorldCover and ESRI Land Cover.

Key takeaway

For Machine Learning Engineers developing large-scale land cover maps with sparse in-situ labels, you should adopt object-based deep learning frameworks like LC-SLab. This approach significantly reduces map fragmentation and can match or exceed pixel-wise accuracy. Evaluate input-level aggregation for smaller datasets and output-level for larger ones, and integrate pre-trained features to enhance label efficiency and model performance, especially with limited data.

Key insights

Object-based deep learning improves land cover map coherence and accuracy, especially with sparse labels, by enforcing a minimum mapping unit.

Principles

Method

LC-SLab defines objects via unsupervised oversegmentation, optionally extracts features from a pre-trained model, then classifies using either input-level aggregation (GNNs on object graphs) or output-level aggregation (postprocessing pixel-wise semantic segmentation logits). Optimization uses partial cross-entropy loss.

In practice

Topics

Best for: Computer Vision Engineer, AI Scientist, Research Scientist, Machine Learning Engineer

Related on AIssential

Open in AIssential →

Editorial summary, takeaway, and curation by AIssential. Original article published by cs.CV updates on arXiv.org.