Asynchronous AI cuts computing energy by orders of magnitude while learning continuously

· Source: News on Artificial Intelligence and Machine Learning · Field: Technology & Digital — Artificial Intelligence & Machine Learning, Robotics & Autonomous Systems · Depth: Advanced, short

Summary

A research team at the University of Massachusetts Amherst, led by Provost Professor Hava Siegelmann, has developed a novel AI architecture called Asynchronous Neural Turing networks (ANT). Published in Nature Communications, ANT aims to dramatically reduce the energy consumption of AI systems by orders of magnitude while enabling continuous, real-time learning. Unlike current deep neural networks such as ChatGPT, which rely on energy-intensive synchronized computations across billions of artificial neurons, ANT operates asynchronously, similar to the human brain. It updates only the neurons required at each computational step, eliminating the need for a global clock while preserving the differentiable neural properties crucial for training. This approach addresses the escalating energy demands of large AI models and is particularly valuable for energy-constrained autonomous systems like robots, edge-computing devices, and autonomous vehicles.

Key takeaway

For Machine Learning Engineers developing AI for energy-constrained environments, you should investigate asynchronous neural network architectures like ANT. This approach offers orders of magnitude energy reduction compared to globally synchronized deep networks, making it ideal for robotics, autonomous vehicles, and edge computing. Consider how adopting asynchronous designs could enable more sustainable and adaptive AI deployments in your projects.

Key insights

Asynchronous Neural Turing networks (ANT) significantly cut AI energy by mimicking brain's selective neuron updates.

Principles

Method

ANT removes the global synchronization clock while retaining differentiable neural properties for training, updating only necessary neurons at each step.

In practice

Topics

Best for: Research Scientist, AI Scientist, Machine Learning Engineer, Robotics Engineer

Related on AIssential

Open in AIssential →

Editorial summary, takeaway, and curation by AIssential. Original article published by News on Artificial Intelligence and Machine Learning.