AI agents win at Slay the Spire 2 after researchers replace growing chat logs with structured memory

· Source: The Decoder · Field: Technology & Digital — Artificial Intelligence & Machine Learning, Robotics & Autonomous Systems · Depth: Advanced, medium

Summary

The AgenticSTS project, developed by Alaya Lab and Shanghai Jiao Tong University, introduces a novel memory architecture for AI agents, enabling them to succeed in the digital card game Slay the Spire 2 where frontier models previously failed. Instead of appending to an ever-growing chat log, AgenticSTS rebuilds each decision from five organized memory layers: fixed protocol instructions (L1), state schemas (L2), retrieved game rules (L3), summaries of previous runs (L4), and strategy skills (L5). This approach significantly improved performance; activating the L5 skill library doubled the win rate from 3 out of 10 to 6 out of 10 games at A0 difficulty. Furthermore, AgenticSTS demonstrated superior efficiency against public agents STS2MCP and CharTyr, winning 6 of 10 games compared to their 0 of 5, while using 66 to 90 times fewer tokens per point. Its prompt size remained constant at approximately 5,000 tokens, contrasting with competitors' prompts that grew to 527,000 tokens.

Key takeaway

For Machine Learning Engineers designing AI agents for complex, multi-step environments, you should prioritize structured, fixed-size memory architectures over traditional growing chat logs. This approach dramatically improves agent performance and reduces token costs by preventing "context rot." Implement distinct memory layers for protocols, state, rules, run summaries, and skills to enhance decision-making and efficiency. Your agent's accumulated knowledge might be model-specific, so test transferability carefully.

Key insights

Structured, fixed-size memory layers significantly enhance AI agent performance and efficiency over growing conversational logs.

Principles

Method

Rebuild each agent decision prompt from five distinct memory layers: fixed protocol instructions (L1), state schemas (L2), retrieved game rules (L3), summaries of previous runs (L4), and situation-specific strategy skills (L5).

In practice

Topics

Code references

Best for: Research Scientist, AI Engineer, NLP Engineer, AI Scientist, Machine Learning Engineer, AI Architect

Related on AIssential

Open in AIssential →

Editorial summary, takeaway, and curation by AIssential. Original article published by The Decoder.