提出SSL结构化表示,让智能体技能更易被机器理解和使用。
From Skill Text to Skill Structure: The Scheduling-Structural-Logical Representation for Agent Skills
- 将技能拆解为调度、结构、逻辑三类信号,分离语义与执行信息
- 在技能发现任务中MRR@50提升至0.729,风险评估宏F1达0.509
- 适合需要可解释、可复用技能的智能体系统开发者
大型语言模型代理日益依赖可复用的技能——集指令、控制流、约束和工具调用于一体的能力建包。然而当前代理系统中的技能仍以文本为主,如SKILL.md格式文档,其机器可用信息主要嵌于自然语言描述中。这导致技能中心型系统面临表征难题:管理技能集合与执行时使用技能均需推理调用接口、执行结构与具体副作用,但这些信号常混杂于单一文本表面。显式表达技能知识或可帮助机器更高效获取与利用。基于记忆组织包、脚本理论及施兰克与阿贝尔森的经典认知语言学框架,本文首次提出面向代理技能的结构化表示——调度-结构-逻辑(Scheduling-Structural-Logical, SSL)表示,分离技能级调度信号、场景级执行结构与逻辑级动作/资源使用证据。我们以大模型为基础构建归一化器,并在技能发现与风险评估两个任务上验证其效果。实验表明,相比纯文本基线,SSL显著提升性能:在技能发现任务中,MRR@50从0.649提升至0.729;在风险评估中,宏平均F1从0.409提升至0.509。结果表明,显式的、源自源头的结构可使技能更易搜索与审查,推动智能体技能向更具可检查性、可复用性与操作可行性的方向演进,而非终极标准或端到端技能管理机制。
原文摘要 · Abstract (English)
Large language model (LLM) agents increasingly rely on reusable skills: capability packages that combine instructions, control flow, constraints, and tool calls. In current agent systems, however, skills are still represented by text-heavy artifacts, mainly SKILL{.}md-style documents whose machine-usable evidence remains embedded largely in natural-language descriptions. As a result, skill-centered agent systems face a representation problem: both managing skill collections and using skills during agent execution require reasoning over invocation interfaces, execution structure, and concrete side effects, but these signals are often entangled in a single textual surface. An explicit representation of skill knowledge may therefore help make these artifacts easier for machines to acquire and leverage. Drawing on Memory Organization Packets, Script Theory, and Conceptual Dependency from Schank and Abelson's classical work on cognitive linguistic representation, we introduce what is, to our knowledge, the first structured representation for agent skill artifacts that disentangles skill-level scheduling signals, scene-level execution structure, and logic-level action/resource-use evidence: the Scheduling-Structural-Logical (SSL) representation. We instantiate SSL with an LLM-based normalizer and evaluate SSL-derived representations in two tasks, Skill Discovery and Risk Assessment. The experiment shows that SSL significantly outperforms the text-only baselines: in Skill Discovery, MRR@50 improves from 0.649 to 0.729; in Risk Assessment, macro F1 improves from 0.409 to 0.509. These findings suggest that an explicit, source-grounded structure can make agent skills easier to search and review, positioning SSL as a practical step toward more inspectable, reusable, and operationally actionable skill representations, rather than a finished standard or end-to-end skill-management mechanism.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。