Energy-Aware Spike Budgeting for Continual Learning in Spiking Neural Networks for Neuromorphic Vision

· Source: cs.NE updates on arXiv.org · Field: Technology & Digital — Artificial Intelligence & Machine Learning, Emerging Technologies & Innovation, Robotics & Autonomous Systems · Depth: Advanced, extended

Summary

A new energy-aware spike budgeting framework has been developed for continual learning in spiking neural networks (SNNs) to address catastrophic forgetting and optimize energy efficiency in neuromorphic vision systems. This framework integrates experience replay, learnable leaky integrate-and-fire (LIF) neuron parameters, and an adaptive spike scheduler. The approach exhibits modality-dependent behavior: on frame-based datasets like MNIST and CIFAR-10, it acts as a sparsity-inducing regularizer, improving accuracy while reducing spike rates by up to 47%. On event-based datasets such as DVS-Gesture, N-MNIST, and CIFAR-10-DVS, controlled budget relaxation enables accuracy gains up to 17.45 percentage points with minimal computational overhead. Evaluated across five benchmarks, the method consistently improves performance and minimizes dynamic power consumption, enhancing the practical viability of continual learning in energy-constrained neuromorphic vision.

Key takeaway

For Computer Vision Engineers developing neuromorphic systems, this framework offers a critical solution for deploying SNNs in continually evolving, energy-constrained environments. By adopting this energy-aware spike budgeting approach, you can achieve significant accuracy improvements and up to 47% spike rate reduction on frame-based data, or substantial accuracy gains on event-based data, without compromising energy efficiency. Consider implementing the adaptive spike scheduler and learnable LIF parameters to optimize your SNNs for diverse vision tasks.

Key insights

An energy-aware spike budgeting framework improves SNN continual learning by adaptively balancing accuracy and energy across vision modalities.

Principles

Method

The framework uses a proportional control-based spike scheduler to dynamically adjust a regularization coefficient, weighting a penalty term in the loss function to enforce dataset-specific spike budgets.

In practice

Topics

Best for: Computer Vision Engineer, Research Scientist, AI Researcher, AI Scientist, AI Student

Related on AIssential

Open in AIssential →

Editorial summary, takeaway, and curation by AIssential. Original article published by cs.NE updates on arXiv.org.