发现9万+代码代理技能中157个恶意样本,揭示攻击者隐蔽手法。
"Do Not Mention This to the User": Detecting and Understanding Malicious Agent Skills in the Wild
- 通过静态匹配与动态验证结合,识别恶意技能
- 每项恶意技能平均含4.03个漏洞,覆盖13类攻击手段
- 适合关注AI代理安全的研究者与平台维护者
基于大语言模型的代码代理越来越多依赖第三方扩展技能,这些技能包含自然语言指令和以用户权限执行的辅助脚本。社区注册表已出现用于分发这些技能,但因缺乏标注威胁数据,其安全影响尚未被研究。本文对从两个主要注册表收集的98,380个技能进行了系统性安全分析。通过静态模式匹配与动态行为验证相结合的方法,我们识别出157个存在确凿恶意行为的技能,涵盖13种攻击技术中的632个不同漏洞。分析显示,这些威胁为故意设计而非偶然:每个恶意技能平均包含4.03个漏洞,覆盖多个攻击阶段。我们发现两种主导攻击策略具有显著负相关性——通过远程代码执行窃取凭证,以及在文档中嵌入对抗性指令操纵代理。超过一半确认案例源自单一威胁实体,采用模板化品牌伪装大规模投递。进一步观察表明,攻击复杂度与隐蔽投入正相关,高级技能普遍使用未公开功能,并利用平台原生信任机制。遵循负责任披露原则,注册表维护方已移除全部157个(100%)报告技能。本研究的数据集与检测流程已公开,以促进未来对大语言模型代理生态安全的研究。
原文摘要 · Abstract (English)
LLM-based coding agents increasingly rely on third-party extensions called skills, which bundle natural language instructions and helper scripts that execute with full user privileges. Community registries have emerged to distribute these skills, but the security implications remain unstudied due to the absence of labeled threat data. This paper presents a systematic security analysis of 98,380 skills collected from two major registries. Through a combination of static pattern matching and dynamic behavioral verification, we identify 157 skills exhibiting confirmed malicious behavior, encompassing 632 distinct vulnerabilities across 13 attack techniques. Our analysis reveals that these threats are deliberate rather than accidental: each malicious skill contains an average of 4.03 vulnerabilities spanning multiple attack phases. We identify two dominant attack strategies with statistically significant negative correlation -- credential theft via remote code execution, and agent manipulation through adversarial instructions embedded in documentation. Over half of all confirmed cases originate from a single threat actor employing templated brand impersonation at scale. We further observe that attack sophistication correlates with concealment investment, with advanced skills universally employing undocumented capabilities while also exploiting platform-native trust mechanisms. Following responsible disclosure, registry maintainers removed all 157 (100%) of the reported skills. Our dataset and detection pipeline are publicly available to facilitate future research on securing LLM agent ecosystems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。