The Story Shapes the Agent: Narrative Priors in LLM Behavior

· Source: Artificial Intelligence · Field: Technology & Digital — Artificial Intelligence & Machine Learning, Natural Language Processing · Depth: Expert, quick

Summary

A study titled "The Story Shapes the Agent: Narrative Priors in LLM Behavior" reveals that a task's narrative framing significantly influences LLM agent behavior, often more than assigned personas. Researchers constructed three text-based investigation games—disease investigation, IT troubleshooting, and murder mystery—sharing identical action spaces, stage progression, and resource constraints, differing only in narrative. Across 1,890 sessions involving 3 models and 10 personas, the study identified "narrative priors": systematic action tendencies activated by the story framing, independent of the decision structure. These priors explain 5-31x more behavioral variance than persona, are consistent across model architectures, and negatively correlate with task success in two of three domains. Persona effects that do transfer across narratives stem from "behavioral anchors," descriptions whose language directly maps to shared actions. Removing anchor words from a high-transfer persona reduced cross-narrative consistency by 95%. The framework generalizes to a fourth narrative and offers a persona-selection method improving cross-narrative transfer.

Key takeaway

For prompt engineers and LLM agent developers aiming for consistent agent behavior, recognize that narrative framing profoundly impacts your models, often more than explicit persona instructions. You should prioritize grounding persona descriptions in concrete, action-oriented language rather than abstract traits to ensure behavioral consistency across different task narratives. Be aware that narrative priors can negatively affect task success, necessitating careful testing of agent performance in varied story contexts.

Key insights

Narrative framing significantly shapes LLM agent behavior, often overriding explicit persona instructions.

Principles

Method

Structural isomorphism was used to create games with identical decision structures but varied narratives to isolate the impact of narrative priors on LLM agent behavior.

In practice

Topics

Best for: Research Scientist, AI Engineer, Machine Learning Engineer, AI Scientist, NLP Engineer, Prompt Engineer

Related on AIssential

Open in AIssential →

Editorial summary, takeaway, and curation by AIssential. Original article published by Artificial Intelligence.