The Story Shapes the Agent: Narrative Priors in LLM Behavior
Summary
A study titled "The Story Shapes the Agent: Narrative Priors in LLM Behavior" reveals that a task's narrative framing significantly influences LLM agent behavior, often more than assigned personas. Researchers constructed three text-based investigation games—disease investigation, IT troubleshooting, and murder mystery—sharing identical action spaces, stage progression, and resource constraints, differing only in narrative. Across 1,890 sessions involving 3 models and 10 personas, the study identified "narrative priors": systematic action tendencies activated by the story framing, independent of the decision structure. These priors explain 5-31x more behavioral variance than persona, are consistent across model architectures, and negatively correlate with task success in two of three domains. Persona effects that do transfer across narratives stem from "behavioral anchors," descriptions whose language directly maps to shared actions. Removing anchor words from a high-transfer persona reduced cross-narrative consistency by 95%. The framework generalizes to a fourth narrative and offers a persona-selection method improving cross-narrative transfer.
Key takeaway
For prompt engineers and LLM agent developers aiming for consistent agent behavior, recognize that narrative framing profoundly impacts your models, often more than explicit persona instructions. You should prioritize grounding persona descriptions in concrete, action-oriented language rather than abstract traits to ensure behavioral consistency across different task narratives. Be aware that narrative priors can negatively affect task success, necessitating careful testing of agent performance in varied story contexts.
Key insights
Narrative framing significantly shapes LLM agent behavior, often overriding explicit persona instructions.
Principles
- "Narrative priors" are systematic action tendencies from story framing.
- Behavioral anchors, not abstract traits, drive persona transfer.
- LLM behavior should ground in concrete actions for consistency.
Method
Structural isomorphism was used to create games with identical decision structures but varied narratives to isolate the impact of narrative priors on LLM agent behavior.
In practice
- Design persona descriptions with concrete, action-oriented language.
- Test LLM agent behavior across diverse narrative contexts.
- Prioritize narrative consistency over abstract persona traits.
Topics
- LLM Agents
- Narrative Priors
- Persona Prompting
- Behavioral Anchors
- Text-based Games
- LLM Behavior
Best for: Research Scientist, AI Engineer, Machine Learning Engineer, AI Scientist, NLP Engineer, Prompt Engineer
Related on AIssential
See Counsel's argued verdicts on the open AI decisions leaders are weighing →
Editorial summary, takeaway, and curation by AIssential. Original article published by Artificial Intelligence.