LLM-Evolved Domain-Independent Heuristics for Symbolic AI Planning

· Source: Artificial Intelligence · Field: Technology & Digital — Artificial Intelligence & Machine Learning, Robotics & Autonomous Systems · Depth: Expert, quick

Summary

Researchers have developed LLM-Evolved Domain-Independent Heuristics for symbolic AI planning, which surpass hand-engineered state-of-the-art solutions. This approach uses evolutionary search, where a large language model mutates parent heuristics written in C++. Candidate heuristics are stored in a MAP-Elites archive, keyed on informedness and speed, with fitness scores calculated by blending coverage and solving time. On unseen testing domains, the best evolved heuristic solves more tasks than even the strongest baseline, with the full heuristic suite spanning the Pareto frontier of the informedness-speed tradeoff. The study also found that seeding evolution from the trivial blind heuristic outperforms seeding from the strong FF heuristic, and LLM reasoning effort significantly affects compilation success rates. These evolved programs are plain C++, allowing them to function as drop-in replacements in existing planners while retaining underlying search guarantees.

Key takeaway

For AI Scientists developing symbolic AI planning systems, you should investigate integrating LLM-evolved domain-independent heuristics. This research demonstrates that such heuristics can exceed hand-engineered state-of-the-art performance, solving more tasks on unseen domains. Your teams can utilize these C++-based drop-in replacements to enhance planner capabilities, inheriting existing soundness and completeness guarantees. Consider exploring evolutionary search with LLMs, potentially starting with simple heuristic seeds, to discover novel and highly effective planning solutions.

Key insights

LLMs can evolve domain-independent heuristics for symbolic AI planning that outperform human-designed ones.

Principles

Method

LLMs mutate C++ heuristics; evolutionary search optimizes via a MAP-Elites archive, blending coverage and solving time for fitness.

In practice

Topics

Best for: Research Scientist, AI Scientist

Related on AIssential

Open in AIssential →

Editorial summary, takeaway, and curation by AIssential. Original article published by Artificial Intelligence.