SKILL-DISCO: Distilling and Compiling Agent Traces into Reusable Procedural Skills
Summary
SKILL-DISCO is a novel distillation-and-compilation framework designed to extract reusable procedural skills from successful agent execution traces. It tackles the inefficiency of agents repeatedly solving similar task instances, which leads to increased reasoning costs and extended execution times. The framework conceptualizes successful traces within FSM-defined scenarios as paths in an unknown transition graph, defining procedural skills as parameterized control-flow subgraphs that can be reused. SKILL-DISCO distills these reusable PFSM subgraphs and compiles them into callable, executable, and verifiable procedural skills. Evaluations on ALFWorld and WebArena benchmarks demonstrate that SKILL-DISCO significantly enhances success rates and reduces the number of agent turns across different model scales, highlighting the value of representing shared experience as reusable execution structures.
Key takeaway
For AI Scientists and Machine Learning Engineers developing autonomous agents, if you are struggling with high reasoning costs and long execution traces in repetitive tasks, you should explore frameworks like SKILL-DISCO. This approach allows your agents to distill and compile reusable procedural skills from successful past experiences, significantly improving success rates and reducing agent turns. Implementing structured skill representations can make your agent systems more efficient and robust.
Key insights
Distilling reusable procedural skills from agent traces significantly reduces redundant reasoning and execution costs.
Principles
- Procedural skills are reusable parameterized control-flow subgraphs.
- FSM-defined scenarios are key for extracting procedural skills.
- Shared experience as execution structures boosts agent efficiency.
Method
SKILL-DISCO distills reusable PFSM subgraphs from successful traces and compiles them into callable, executable, and verifiable procedural skills.
In practice
- Apply to FSM-defined task scenarios for skill extraction.
- Improve agent success rates on ALFWorld and WebArena.
- Reduce agent turns in complex, repetitive tasks.
Topics
- Agent Systems
- Procedural Skills
- Skill Distillation
- Control-Flow Graphs
- ALFWorld
- WebArena
Best for: Research Scientist, AI Engineer, AI Scientist, Machine Learning Engineer
Related on AIssential
Editorial summary, takeaway, and curation by AIssential. Original article published by Takara TLDR - Daily AI Papers.