MambaLIE: Scene Light Intensity-Boosted Low-Light Image Enhancement with State Space Model

· Source: cs.AI updates on arXiv.org · Field: Technology & Digital — Artificial Intelligence & Machine Learning, Computer Vision, Emerging Technologies & Innovation · Depth: Expert, extended

Summary

MambaLIE is a novel low-light image enhancement (LIE) method based on a State Space Model (SSM) that addresses the limitations of Convolutional Neural Networks (CNNs) and Transformers. It introduces a scene light intensity prior to improve the structural distribution of illumination and proposes a Locally Enhanced State Space Model (LESSM) for efficient light enhancement. LESSM combines an SSM branch for modeling long-range dependencies with linear time complexity and a local enhanced branch for local feature representations. MambaLIE outperforms existing CNN-based and Transformer-based LIE methods on four widely used synthetic benchmarks (LOLv1, LOLv2-real, LOLv2-syn, MIT-Adobe FiveK) and five publicly available real-world benchmarks (LIME, MEF, NPE, DICM, VV) in terms of accuracy, speed, and model size. The model is trained on 128x128 image patches with a batch size of 12, using a 4-level encoder-decoder architecture with {1,2,4,8} GLEMs, and optimized with Adam for 1000-4000 epochs on an NVIDIA RTX 4090 GPU.

Key takeaway

For Machine Learning Engineers developing low-light image processing solutions for consumer electronics, MambaLIE offers a superior balance of performance and efficiency. You should consider integrating its State Space Model-based architecture to achieve high-quality enhancement with linear computational complexity, making it suitable for deployment on resource-constrained devices like mobile phones and digital cameras. This approach can significantly improve downstream vision tasks such as object detection.

Key insights

MambaLIE uses a State Space Model and scene light intensity prior for efficient, high-quality low-light image enhancement.

Principles

Method

MambaLIE computes a scene light intensity prior via a mean filter, gates it with the low-light input, then processes it through a U-shaped encoder-decoder framework using Locally Enhanced State Space Models (LESSM), channel attention, and a Dual Gated Feed-Forward Network.

In practice

Topics

Code references

Best for: Research Scientist, AI Scientist, Machine Learning Engineer, Computer Vision Engineer

Related on AIssential

Open in AIssential →

Editorial summary, takeaway, and curation by AIssential. Original article published by cs.AI updates on arXiv.org.