arXiv:2604.24020cs.CRcs.AI2026-04

让AI自主学习识别攻击,提升自身安全判断力。

Poster: ClawdGo: Endogenous Security Awareness Training for Autonomous AI Agents

  • 通过自演自训机制,让AI在推理时内生地识别威胁
  • 训练后平均得分从80.9升至96.9,覆盖11个威胁维度
  • 适合部署在开放平台的AI代理,增强主动防御能力

部署在OpenClaw等平台的自主AI代理面临提示注入、记忆污染、供应链攻击和社交工程等威胁,但现有防护仅关注平台边界,未训练代理自身的威胁判断能力。本文提出ClawdGo框架,实现内生式安全意识训练:在不修改模型的前提下,让代理在推理时自主识别与推理威胁。四大贡献包括:TLDT(三层领域分类)将12个可训练维度划分为自我防御、主人保护与企业安全层;ASAT(自主安全意识训练)采用自对弈循环,代理在最弱优先的课程调度下轮流扮演攻击者、防御者与评估者;CSMA(跨会话记忆累积)通过四层持久化记忆架构与公理结晶促进机制,实现技能持续积累;SACP(安全意识校准问题)形式化了内生训练带来的精确率-召回率权衡。实时实验显示,最弱优先的ASAT使平均TLDT得分从80.9提升至96.9,较均匀随机调度高6.5分,覆盖11/12维度。CSMA确保全周期收益保留;冷启动消融仅恢复2.4分,留下13.6分差距。E模式生成32个符合TLDT的场景,涵盖全部12维度。当高度训练的代理将合法能力评估误判为提示注入时(30/160),观察到SACP现象。

原文摘要 · Abstract (English)

Autonomous AI agents deployed on platforms such as OpenClaw face prompt injection, memory poisoning, supply-chain attacks, and social engineering, yet existing defences address only the platform perimeter, leaving the agent's own threat judgement entirely untrained. We present ClawdGo, a framework for endogenous security awareness training: we teach the agent to recognise and reason about threats from the inside, at inference time, with no model modification. Four contributions are introduced: TLDT (Three-Layer Domain Taxonomy) organises 12 trainable dimensions across Self-Defence, Owner-Protection, and Enterprise-Security layers; ASAT (Autonomous Security Awareness Training) is a self-play loop where the agent alternates attacker, defender, and evaluator roles under weakest-first curriculum scheduling; CSMA (Cross-Session Memory Accumulation) compounds skill gains via a four-layer persistent memory architecture and Axiom Crystallisation Promotion (ACP); and SACP (Security Awareness Calibration Problem) formalises the precision-recall tradeoff introduced by endogenous training. Live experiments show weakest-first ASAT raises average TLDT score from 80.9 to 96.9 over 16 sessions, outperforming uniform-random scheduling by 6.5 points and covering 11 of 12 dimensions. CSMA retains the full gain across sessions; cold-start ablation recovers only 2.4 points, leaving a 13.6-point gap. E-mode generates 32 TLDT-conformant scenarios covering all 12 dimensions. SACP is observed when a heavily trained agent classifies a legitimate capability assessment as prompt injection (30/160).

AI安全自主代理内生训练

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。