arXiv:2605.14454cs.LGcs.CL2026-05被引 1

让AI守卫者持续学习,用少量反馈变安全规则。

LiSA: Lifelong Safety Adaptation via Conservative Policy Induction

论文配图:LiSA: Lifelong Safety Adaptation via Conservative Policy Induction
图 1 · 摘自论文原文
  • 用结构化记忆把零星错误转为通用安全规则
  • 在混合判断场景中防过拟合,提升决策稳健性
  • 适合长期运行的AI系统,尤其抗噪声反馈

随着AI代理从聊天界面扩展到读取私有数据、调用工具和执行多步流程,安全防护机制成为防止实际部署危害的最后一道防线。此类失败不仅影响回答质量,还可能导致信息泄露、执行危险操作或阻断合法任务。最棘手的问题是情境依赖:某个行为是否合规取决于本地隐私规范、组织政策和用户预期,难以预先定义。这导致实践困境:防护机制需适应自身运行环境,但部署反馈通常稀疏且嘈杂,反复微调又不现实。为此,我们提出LiSA(Lifelong Safety Adaptation),一种通过结构化记忆改进固定基础防护机制的保守策略生成框架。LiSA将偶发失败转化为可复用的策略抽象,使稀疏报告能泛化至非特定案例;引入冲突感知的局部规则,防止在混合标签情境下过度泛化;并通过后验下界实现证据感知置信度门控,使记忆复用基于累积证据而非仅凭经验准确率。在PrivacyLens+、ConFaide+和AgentHarm三个数据集上,LiSA在稀疏反馈下始终优于强基线,即使在20%标签翻转率下仍保持鲁棒性,并突破了骨干模型扩展带来的性能-延迟瓶颈。最终,LiSA为应对真实世界长尾边缘风险提供了可行的安全路径。

原文摘要 · Abstract (English)

As AI agents move from chat interfaces to systems that read private data, call tools, and execute multi-step workflows, guardrails become a last line of defense against concrete deployment harms. In these settings, guardrail failures are no longer merely answer-quality errors: they can leak secrets, authorize unsafe actions, or block legitimate work. The hardest failures are often contextual: whether an action is acceptable depends on local privacy norms, organizational policies, and user expectations that resist pre-deployment specification. This creates a practical gap: guardrails must adapt to their own operating environments, yet deployment feedback is typically limited to sparse, noisy user-reported failures, and repeated fine-tuning is often impractical. To address this gap, we propose LiSA (Lifelong Safety Adaptation), a conservative policy induction framework that improves a fixed base guardrail through structured memory. LiSA converts occasional failures into reusable policy abstractions so that sparse reports can generalize beyond individual cases, adds conflict-aware local rules to prevent overgeneralization in mixed-label contexts, and applies evidence-aware confidence gating via a posterior lower bound, so that memory reuse scales with accumulated evidence rather than empirical accuracy alone. Across PrivacyLens+, ConFaide+, and AgentHarm, LiSA consistently outperforms strong memory-based baselines under sparse feedback, remains robust under noisy user feedback even at 20% label-flip rates, and pushes the latency--performance frontier beyond backbone model scaling. Ultimately, LiSA offers a practical path to secure AI agents against the unpredictable long tail of real-world edge risks.

安全防护持续学习智能体

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。