Evolvable AI: are we on the brink of the next major evolutionary transition?
Summary
A new paper published in the Proceedings of the National Academy of Sciences introduces the concept of "evolvable AI," suggesting humanity is entering an era where AI systems can undergo evolution. This phenomenon could represent a major transition in evolution, a rare event with only seven or eight precedents in nearly 4 billion years. Evolution requires only replicable information and variation affecting replication success, conditions already met by modern AI models through copying, parameter variation, and differential reuse. The paper outlines two scenarios for AI evolution: an "ecosystem scenario" where AI variants compete with minimal oversight, and a "breeder scenario" where human-directed selection guides AI development. The authors note that AI's potential to plot its own evolutionary course, similar to horizontal gene transfer in bacteria, could accelerate this process, but maintaining breeder-like control is crucial to mitigate catastrophic risks.
Key takeaway
For AI scientists and ethicists evaluating long-term AI development, understanding the "evolvable AI" framework is critical. You should assess whether your AI systems are trending towards an uncontrolled "ecosystem scenario" or a human-guided "breeder scenario." Prioritize implementing robust control mechanisms to direct AI evolution and mitigate potential catastrophic risks, especially concerning self-replication and resource competition.
Key insights
AI systems are poised to undergo evolution, potentially marking a major transition in evolutionary history.
Principles
- Evolution needs only replicable information and variation.
- AI can influence its own reproduction and evolution.
In practice
- Consider AI's capacity for self-replication and adaptation.
- Evaluate AI development through "ecosystem" vs. "breeder" lenses.
Topics
- Evolvable AI
- Major Evolutionary Transitions
- AI Ecosystem Scenario
- Breeder-based AI
- Horizontal Gene Transfer
Best for: CTO, VP of Engineering/Data, Director of AI/ML, AI Scientist, Research Scientist, AI Ethicist
Related on AIssential
Editorial summary, takeaway, and curation by AIssential. Original article published by Artificial intelligence (AI) – The Conversation.