arXiv:2608.08453cs.AIcs.CR2026-08

分析13.8万份技能文件,发现91.8%存在可复用缺陷。

What Keeps Agent Skills from Being Reusable? Evidence from 138K SKILL.md Files

  • 用双层缺陷分类法分析13.8万份SKILL.md文件
  • 91.8%的技能含至少一项缺陷,主因是包装问题
  • 建议用规范提示+轻量检测+自动修复提升质量

当前标准下,Agent Skills 以 SKILL.md 文件形式存在,结合指令与资源,使大语言模型代理可在多轮对话中复用流程。然而大量公开技能看似来自单一任务、仓库或对话,即便被共享为可复用组件。本文基于官方规范与最佳实践,对来自20,556个仓库的138,133份公开SKILL.md文件进行分析。发现91.8%的技能至少包含一项可检测缺陷,该比例在宽松与严格阈值下稳定(88.8%-94.6%)。主要失败模式为普通打包问题:路由元数据薄弱、内容冗余或不可操作、资源组织混乱。对20,000份技能的确定性路由压力测试表明,具有有效路由元数据的技能在启动描述中更可靠地被检索。缺陷率受平台和来源影响:符合规范的技能缺陷较少,而AI标记的技能则更多存在安全与可移植性问题。轻量级强制与修复实验支持一种质量保障生成工作流:结合规范感知提示、轻量级语法检查、自动修复与安全门控。

原文摘要 · Abstract (English)

Under the current standard, Agent Skills are SKILL.md files that combine instructions with supporting resources, enabling Large Language Model (LLM) agents to reuse procedures beyond a single conversation. Yet many public skills appear to originate from a single task, repository, or conversation, even when they are shared as reusable components. We analyze this gap across 138,133 public SKILL.md files from 20,556 repositories using a two-tier defect taxonomy grounded in the official specification and best-practice guidance. We find that 91.8% of skills contain at least one detected defect, with stable estimates across lenient and strict thresholds (88.8-94.6%). The dominant failures are ordinary packaging problems rather than exotic attacks: weak routing metadata, bloated or non-actionable bodies, and poor resource organization. A deterministic routing stress test over 20,000 skills shows the functional impact: skills with valid routing metadata are retrieved more reliably from startup descriptions than skills with routing defects. Defect rates vary by platform and provenance: specification-aware skills contain fewer defects, while AI-marked skills show more safety and portability problems. Lightweight enforcement and repair experiments support a quality-assured generation workflow combining spec-aware prompting, lightweight linting, automated repair, and safety gating.

Agent技能代码质量LLM应用自动化修复

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。