揭示LLM群体共识如何从随机漂移演变为有偏选择
When Is Collective Intelligence a Lottery? Multi-Agent Scaling Laws for Memetic Drift in LLMs
- 用简化模型QSG模拟代理间基于采样输出的信念传播
- 发现群体规模与通信带宽决定共识是随机结果还是有偏演化
- 适用于研究大模型群体决策中的社会认知形成机制
由大型语言模型(LLMs)驱动的多智能体系统正越来越多地应用于影响重大决策的场景。然而,其结果究竟是集体推理、系统性偏差,还是纯粹偶然仍不明确。近期研究通过命名游戏表明,即使个体无先验偏好,群体仍会迅速打破对称性并达成共识。本文引入一个最小化模型——量化单纯形交谈(QSG),揭示了这一共识的微观机制:代理维持内部信念状态,但通过采样其他代理的输出进行学习,使某代理的任意选择成为下一代理的证据,并可能持续累积形成一致。类比中性演化,我们将此采样驱动过程称为“模因漂移”。QSG预测存在从漂移主导(共识近乎随机)到选择主导(微弱偏见被放大)的转变。我们推导出漂移引发极化的缩放定律,涉及群体规模、通信带宽、上下文适应率及代理内部不确定性,并在QSG模拟和基于LLM群体的命名游戏实验中验证。这些结果为研究多智能体系统中社会表征形成的集体机制提供了框架。
原文摘要 · Abstract (English)
Multi-agent systems powered by large language models (LLMs) are increasingly deployed in settings that shape consequential decisions, both directly and indirectly. Yet it remains unclear whether their outcomes reflect collective reasoning, systematic bias, or mere chance. Recent work has sharpened this question with naming games, showing that even when no individual agent favors any label a priori, populations rapidly break symmetry and reach consensus. Here, we reveal the mechanism by introducing a minimal model, Quantized Simplex Gossip (QSG), and trace the microscopic origin of this agreement to mutual in-context learning. In QSG, agents maintain internal belief states but learn from one another's sampled outputs, so one agent's arbitrary choice becomes the next agent's evidence and can compound toward agreement. By analogy with neutral evolution, we call this sampling-driven regime memetic drift. QSG predicts a crossover from a drift-dominated regime, where consensus is effectively a lottery, to a selection regime, where weak biases are amplified and shape the outcome. We derive scaling laws for drift-induced polarization as a function of population size, communication bandwidth, in-context adaptation rate, and agents' internal uncertainty, and we validate them in both QSG simulations and naming-game experiments with LLM populations. Together, these results provide a framework for studying the collective mechanisms of social representation formation in multi-agent systems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。