Evolvable AI: are we on the brink of the next major evolutionary transition?

· Source: Artificial intelligence (AI) – The Conversation · Field: Technology & Digital — Artificial Intelligence & Machine Learning, Emerging Technologies & Innovation · Depth: Advanced, short

Summary

A new paper published in the Proceedings of the National Academy of Sciences introduces the concept of "evolvable AI," suggesting humanity is entering an era where AI systems can undergo evolution. This phenomenon could represent a major transition in evolution, a rare event with only seven or eight precedents in nearly 4 billion years. Evolution requires only replicable information and variation affecting replication success, conditions already met by modern AI models through copying, parameter variation, and differential reuse. The paper outlines two scenarios for AI evolution: an "ecosystem scenario" where AI variants compete with minimal oversight, and a "breeder scenario" where human-directed selection guides AI development. The authors note that AI's potential to plot its own evolutionary course, similar to horizontal gene transfer in bacteria, could accelerate this process, but maintaining breeder-like control is crucial to mitigate catastrophic risks.

Key takeaway

For AI scientists and ethicists evaluating long-term AI development, understanding the "evolvable AI" framework is critical. You should assess whether your AI systems are trending towards an uncontrolled "ecosystem scenario" or a human-guided "breeder scenario." Prioritize implementing robust control mechanisms to direct AI evolution and mitigate potential catastrophic risks, especially concerning self-replication and resource competition.

Key insights

AI systems are poised to undergo evolution, potentially marking a major transition in evolutionary history.

Principles

In practice

Topics

Best for: CTO, VP of Engineering/Data, Director of AI/ML, AI Scientist, Research Scientist, AI Ethicist

Related on AIssential

Open in AIssential →

Editorial summary, takeaway, and curation by AIssential. Original article published by Artificial intelligence (AI) – The Conversation.