用几何曲率提前预警大模型多智能体系统的连锁风险
Auditing Cascading Risks in Multi-Agent Systems via Semantic-Geometric Co-evolution
- 将智能体交互建模为动态图,用曲率度量信息冗余与瓶颈
- 曲率异常比语义违规早数轮出现,可提前预警风险
- 定位故障源头精准,适合高可靠性系统审计
基于大语言模型的多智能体系统易发生连锁风险:早期交互在语义上流畅且合规,但底层互动动态已开始扭曲,放大潜在不稳定性或对齐偏差。传统基于逐条消息语义的审计方法被动滞后,无法捕捉这些早期结构前兆。本文提出一种基于语义-几何协同演化的风险审计框架,将多智能体交互建模为动态图,引入离散几何度量Ollivier-Ricci曲率(ORC),刻画通信拓扑中的信息冗余与瓶颈形成。通过耦合语义流信号与图几何,框架学习可信协作的正常协同演化模式,将偏离该耦合流形视为早期预警信号。在多个符合风险类别的场景实验中,曲率异常系统性地早于显式语义违规数个交互回合出现,支持主动干预。此外,曲率的局部性提供了原则性可解释性,可精确定位引发可信协作崩溃的具体智能体或连接。
原文摘要 · Abstract (English)
Large Language model (LLM)-based Multi-Agent Systems (MAS) are prone to cascading risks, where early-stage interactions remain semantically fluent and policy-compliant, yet the underlying interaction dynamics begin to distort in ways that amplify latent instability or misalignment. Traditional auditing methods that focus on per-message semantic content are inherently reactive and lagging, failing to capture these early structural precursors. In this paper, we propose a principled framework for cascading-risk detection grounded in semantic--geometric co-evolution. We model MAS interactions as dynamic graphs and introduce Ollivier--Ricci Curvature (ORC) -- a discrete geometric measure -- to characterize information redundancy and bottleneck formation in communication topologies. By coupling semantic flow signals with graph geometry, the framework learns the normal co-evolutionary dynamics of trusted collaboration and treats deviations from this coupled manifold as early-warning signals. Experiments on a suite of cascading-risk scenarios aligned with the risk category demonstrate that curvature anomalies systematically precede explicit semantic violations by several interaction turns, enabling proactive intervention. Furthermore, the local nature of Ricci curvature provides principled interpretability for root-cause attribution, identifying specific agents or links that precipitate the collapse of trustworthy collaboration.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。