Belief Engine: Configurable and Inspectable Stance Dynamics in Multi-Agent LLM Deliberation
Summary
The Belief Engine (BE) is an auditable belief-update layer designed for multi-agent Large Language Model (LLM) deliberation simulations, addressing the lack of transparency in why an agent's stance changes. BE operationalizes "belief" as an evidential state over a proposition, exposing it as a scalar stance $S \in [-1,1]$. It extracts arguments into structured memory and updates stance using a log-odds rule, controlled by two interpretable parameters: evidence uptake $u$ and prior anchoring $a$. Parameter sweeps across base LLMs like GPT-4o-mini, Qwen 3.5 9B, and Gemma 4 E4B demonstrate that these controls reliably shape stance dynamics while maintaining an evidence-level audit trail. When replayed on the DEBATE human deliberation dataset, BE effectively reconstructs participants whose final stance aligns with extracted evidence, while stable or evidence-opposed cases highlight the influence of anchoring or factors beyond the extracted evidence stream. This framework provides configurable infrastructure for studying evidence-grounded deliberation, making openness, commitment, convergence, and disagreement attributable to explicit update assumptions rather than hidden prompt effects.
Key takeaway
For research scientists developing multi-agent LLM systems, integrating the Belief Engine offers critical transparency into agent deliberation. You can explicitly control how agents process evidence and maintain commitments, moving beyond opaque prompt effects. This allows for auditable simulations where stance changes are traceable to specific update assumptions, enabling more rigorous study of cooperation, conflict resolution, and preference formation in synthetic communities.
Key insights
The Belief Engine provides auditable, parameter-controlled stance dynamics for LLM agents in deliberative simulations.
Principles
- Separate belief state from generation.
- Log-odds rule for evidence accumulation.
- Explicit controls for uptake and anchoring.
Method
The Belief Engine processes messages through argument extraction, evidence judgment, structured memory updates, log-odds belief state computation, and response composition, using parameters $u$ and $a$ to control stance dynamics.
In practice
- Use BE to simulate agent deliberation.
- Adjust $u$ for evidence responsiveness.
- Adjust $a$ for initial commitment persistence.
Topics
- Belief Engine
- Multi-Agent LLM Deliberation
- Stance Dynamics
- Log-Odds Belief Updating
- Evidence Uptake
Best for: Research Scientist, AI Scientist, Machine Learning Engineer, AI Engineer
Related on AIssential
Editorial summary, takeaway, and curation by AIssential. Original article published by cs.AI updates on arXiv.org.