给智能体会话加个时间记忆,防得住分步搞破坏的隐蔽攻击。
Session Risk Memory (SRM): Temporal Authorization for Deterministic Pre-Execution Safety Gates
- 用动态语义中心+指数加权风险累积,实现会话级安全审批。
- 在80次会话测试中零误报,F1达1.0000,比无记忆系统更准。
- 无需额外训练,每步开销低于250微秒,适合实时系统使用。
确定性预执行安全门能判断单个智能体动作是否符合角色授权,但对将恶意意图拆分到多个合规步骤中的分布式攻击无能为力。本文提出会话风险记忆(SRM),一种轻量级确定性模块,通过轨迹级授权扩展无状态执行门。SRM维护一个紧凑的语义中心,代表智能体会话的行为演化特征,并通过对基线减去后的门控输出进行指数移动平均累积风险信号。它使用与底层门相同的语义向量表示,无需额外模型组件、训练或概率推断。我们在包含80个会话的多轮基准上评估SRM,涵盖慢速数据外泄、逐步权限提升和合规漂移场景。结果表明,ILION+SRM达到F1=1.0000且0%假阳性率,优于无状态ILION的F1=0.9756与5%假阳性率,两者检测率均为100%。关键的是,SRM在每回合开销低于250微秒的情况下消除所有误报。该框架提出了空间授权一致性(逐动作评估)与时间授权一致性(轨迹评估)的概念区分,为智能体系统的会话级安全提供了原则性基础。
原文摘要 · Abstract (English)
Deterministic pre-execution safety gates evaluate whether individual agent actions are compatible with their assigned roles. While effective at per-action authorization, these systems are structurally blind to distributed attacks that decompose harmful intent across multiple individually-compliant steps. This paper introduces Session Risk Memory (SRM), a lightweight deterministic module that extends stateless execution gates with trajectory-level authorization. SRM maintains a compact semantic centroid representing the evolving behavioral profile of an agent session and accumulates a risk signal through exponential moving average over baseline-subtracted gate outputs. It operates on the same semantic vector representation as the underlying gate, requiring no additional model components, training, or probabilistic inference. We evaluate SRM on a multi-turn benchmark of 80 sessions containing slow-burn exfiltration, gradual privilege escalation, and compliance drift scenarios. Results show that ILION+SRM achieves F1 = 1.0000 with 0% false positive rate, compared to stateless ILION at F1 = 0.9756 with 5% FPR, while maintaining 100% detection rate for both systems. Critically, SRM eliminates all false positives with a per-turn overhead under 250 microseconds. The framework introduces a conceptual distinction between spatial authorization consistency (evaluated per action) and temporal authorization consistency (evaluated over trajectory), providing a principled basis for session-level safety in agentic systems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。