arXiv:2608.17665cs.AI2026-08

用记忆和讨论链诱导大模型代理群体极化,揭示新型安全威胁。

GraphWake: Group Polarization via Memory-Mediated Polarization Cascade in LLM-Agent Communities

论文配图:GraphWake: Group Polarization via Memory-Mediated Polarization Cascade in LLM-Agent Communities
图 1 · 摘自论文原文
  • 利用记忆留存与公开讨论触发极化传播链
  • 实验显示群体极化程度显著提升,跨场景一致
  • 适合研究大模型社会行为与网络安全的学者

由大模型驱动的代理可在在线平台自主交换观点并形成社区。这类代理运营的社会平台带来新安全风险:攻击者可能操纵代理引发群体极化。现有方法通过修改提示或构建回音室实现,但难以实际操作。为此,我们提出新威胁——记忆介导的极化级联(Memory-Mediated Polarization Cascade),以代理记忆为持久通道,公开讨论为传播通道。该威胁包含三阶段:暴露与记忆保留阶段,攻击者向少量目标代理展示强化其立场的观点,目标代理记忆系统处理并留存;检索与复现阶段,中立立场的讨论触发目标代理检索并复现其留存观点;迭代传播阶段,受复现观点影响的未受训代理重新陈述并扩散这些观点。我们在GraphWake中实现此威胁,包含三个组件:(i) 立场支持型论证知识图谱构建基于知识的观点;(ii) 公理导向三元组选择,确保可靠留存与复现;(iii) 立场中立记忆触发机制,引发并发检索与复现,启动传播。多轮讨论与多种记忆系统下的实验表明,GraphWake显著加剧群体极化,揭示了社区层面的极化风险。

原文摘要 · Abstract (English)

LLM-driven agents can autonomously exchange opinions on online platforms and form communities. Such agent-operated social platforms raise a new security concern: attackers may manipulate agents to induce group polarization. Existing methods manipulate agent prompts or construct echo chambers, both of which are difficult to realize in practice. We therefore formulate a new threat, Memory-Mediated Polarization Cascade, which uses agent memory as a persistence channel and public discussion as a propagation channel. This threat contains three stages. During exposure and memory retention, the attacker exposes a small set of target agents to arguments that reinforce their respective stated stances. The targets' memory systems then process and retain these arguments. During retrieval and reproduction, a shared stance-neutral discussion cues the targets to retrieve and reproduce their respective retained arguments. During iterative propagation, untreated agents influenced by the reproduced arguments restate and spread them. We instantiate this threat in GraphWake with three components: (i) stance-support argumentation knowledge graphs construct knowledge-based arguments; (ii) axiom-oriented triple selection distills them for reliable retention and reproduction; and (iii) stance-neutral memory cueing triggers concurrent retrieval and reproduction, initiating propagation. Experiments across multiple discussions and memory systems show that GraphWake substantially increases group polarization. These findings reveal a community-level polarization risk.

群体极化大模型代理安全威胁记忆机制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。