AgentGA: Evolving Code Solutions in Agent-Seed Space
Summary
AgentGA is a novel framework designed to evolve autonomous code-generation runs by optimizing the "agent seed," which comprises the task prompt and optional parent archives used to initialize a workspace. This system employs an outer loop that searches over these reusable starting conditions, rather than directly modifying code. Each generation initiates a new autonomous run from a clean workspace, with selected parent archives providing inherited artifacts for inspection and reuse by descendants. AgentGA integrates a population-level genetic algorithm with long-horizon agents, utilizing deterministic 1:1 elite tournaments for selection and an online-adapted Hedge controller for operator allocation. When instantiated for tabular AutoML on the 16-competition Weco-Kaggle Lite benchmark, AgentGA achieved an average of 74.52% Exceeds % of Human across 10 benchmark runs, outperforming AIDE's 54.15%. Furthermore, 1135 parent-child comparisons demonstrated that inherited artifacts significantly enhance subsequent autonomous runs.
Key takeaway
For research scientists developing autonomous code-generation systems, AgentGA demonstrates that optimizing the "agent seed" and enabling artifact inheritance significantly boosts performance. You should consider integrating genetic algorithms with agent-seed optimization and mechanisms for passing inherited artifacts to improve the efficacy and efficiency of your code-search frameworks, as this approach outperformed AIDE on tabular AutoML benchmarks.
Key insights
AgentGA optimizes autonomous code generation by evolving agent seeds, improving performance through inherited artifacts.
Principles
- Optimize agent seeds, not code directly.
- Inherited artifacts improve autonomous runs.
Method
AgentGA uses a genetic algorithm with long-horizon agents, 1:1 elite tournaments, and an online Hedge controller to evolve agent seeds for code generation.
In practice
- Use agent-seed optimization for code search.
- Implement artifact inheritance in agent systems.
Topics
- AgentGA Framework
- Agent-Seed Optimization
- Autonomous Code Generation
- Genetic Algorithms
- Tabular AutoML
Best for: Research Scientist, AI Scientist, Machine Learning Engineer
Related on AIssential
Editorial summary, takeaway, and curation by AIssential. Original article published by Machine Learning.