让大模型辩论时的立场变化可解释、可调控,看清是证据驱动还是固执己见。
Belief Engine: Configurable and Inspectable Stance Dynamics in Multi-Agent LLM Deliberation

- 用对数几率规则更新信念,控制证据吸收和先验锚定
- 在辩论数据集上成功还原多数人的证据驱动型立场转变
- 适合研究真实辩论中观点演化机制的研究者
基于大模型的智能体被广泛用于模拟谈判、冲突解决和多轮观点交流等思辨互动。然而生成的对话记录往往无法揭示立场变化的原因:可能是证据吸收、锚定效应、角色漂移、盲目附和,或提示词与检索上下文的变化。我们提出信念引擎(Belief Engine, BE),一个可审计的信念更新层,将“信念”视为命题上的证据状态,并以标量立场形式显式表达。BE将论证提取至结构化记忆,使用受证据吸收率u和先验锚定强度a控制的对数几率规则更新立场。在多个基础大模型上进行参数扫描表明,这些控制能可靠塑造立场动态,同时保留证据级更新轨迹。在包含前后观点的DEBATE人类辩论数据集上,BE最准确重建了最终立场由提取证据决定的参与者;而立场稳定或与证据相悖的情况,则指向锚定效应或其他未被提取的因素。BE为研究以证据为基础的思辨提供了可配置的基础设施,使开放性、承诺度、共识与分歧等现象可关联到明确的更新假设,而非隐藏的提示影响。
原文摘要 · Abstract (English)
LLM-based agents are increasingly used to simulate deliberative interactions such as negotiation, conflict resolution, and multi-turn opinion exchange. Yet generated transcripts often do not reveal why an agent's stance changes: movement may reflect evidence uptake, anchoring, role drift, echoing, or changed prompt and retrieval context. We introduce the Belief Engine (BE), an auditable belief-update layer that treats "belief" as an evidential state over a proposition and exposes it as scalar stance. BE extracts arguments into structured memory and updates stance with a log-odds rule controlled by evidence uptake u and prior anchoring a. Across multiple base LLMs, parameter sweeps show that these controls reliably shape stance dynamics while preserving an evidence-level update trail. On DEBATE, a human deliberation dataset with pre/post opinions, BE best reconstructs participants whose final stance follows extracted evidence; stable and evidence-opposed cases instead point to anchoring or factors outside the extracted evidence stream. BE provides configurable infrastructure for studying evidence-grounded deliberation, where openness, commitment, convergence, and disagreement can be tied to explicit update assumptions rather than hidden prompt effects.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。