Belief Engine: Configurable and Inspectable Stance Dynamics in Multi-Agent LLM Deliberation

· Source: cs.AI updates on arXiv.org · Field: Technology & Digital — Artificial Intelligence & Machine Learning, Robotics & Autonomous Systems · Depth: Expert, extended

Summary

The Belief Engine (BE) is an auditable belief-update layer designed for multi-agent Large Language Model (LLM) deliberation simulations, addressing the lack of transparency in why an agent's stance changes. BE operationalizes "belief" as an evidential state over a proposition, exposing it as a scalar stance $S \in [-1,1]$. It extracts arguments into structured memory and updates stance using a log-odds rule, controlled by two interpretable parameters: evidence uptake $u$ and prior anchoring $a$. Parameter sweeps across base LLMs like GPT-4o-mini, Qwen 3.5 9B, and Gemma 4 E4B demonstrate that these controls reliably shape stance dynamics while maintaining an evidence-level audit trail. When replayed on the DEBATE human deliberation dataset, BE effectively reconstructs participants whose final stance aligns with extracted evidence, while stable or evidence-opposed cases highlight the influence of anchoring or factors beyond the extracted evidence stream. This framework provides configurable infrastructure for studying evidence-grounded deliberation, making openness, commitment, convergence, and disagreement attributable to explicit update assumptions rather than hidden prompt effects.

Key takeaway

For research scientists developing multi-agent LLM systems, integrating the Belief Engine offers critical transparency into agent deliberation. You can explicitly control how agents process evidence and maintain commitments, moving beyond opaque prompt effects. This allows for auditable simulations where stance changes are traceable to specific update assumptions, enabling more rigorous study of cooperation, conflict resolution, and preference formation in synthetic communities.

Key insights

The Belief Engine provides auditable, parameter-controlled stance dynamics for LLM agents in deliberative simulations.

Principles

Method

The Belief Engine processes messages through argument extraction, evidence judgment, structured memory updates, log-odds belief state computation, and response composition, using parameters $u$ and $a$ to control stance dynamics.

In practice

Topics

Best for: Research Scientist, AI Scientist, Machine Learning Engineer, AI Engineer

Related on AIssential

Open in AIssential →

Editorial summary, takeaway, and curation by AIssential. Original article published by cs.AI updates on arXiv.org.