为小模型设计的智能技能推荐系统,兼顾性能与安全约束。
SkillSelect-Serve: QoS-Aware Budgeted Skill Service Recommendation for LLM Agents

- 将技能封装为可度量的服务,按任务需求动态排序
- 在4000令牌预算下实现100%可执行性,仅损失1.14点命中率
- 适合资源受限的智能体,能降低工具违规率和风险暴露
可复用的代理技能正成为大语言模型(LLM)代理的服务化能力层。不同于普通检索项,技能包含功能能力、输入输出假设、工具依赖、上下文成本和风险元数据。小规模LLM代理因上下文、工具可用性和风险容忍度受限,难以选择合适技能。现有固定Top-k方法仅基于文本相关性排序,忽略需求满足、可交付性和运行约束。我们提出SkillSelect-Serve,一个面向服务质量(QoS)、预算受限的技能服务推荐框架。原始技能被结构化为技能服务,任务转化为结构化需求对象,候选从大规模注册表中发现,通过校准的任务条件适用性评估器排序,并由约束投影打包,强制执行令牌预算、聚合风险和工具可用性约束,仅使用部署可观测特征。在包含35,353个技能的注册表上,经两名独立评估者验证的多正例相关性判断显示,无约束的前5名推荐仅在9.1%的任务中适配4000令牌上下文;约束投影恢复100%可交付性,命中率仅下降1.14点,优于检索-重排、预算截断和多样性选择。相同三服务预算下,命中率从0.8864提升至0.9091,风险暴露减半,工具违规率从44%-81%降至零。结果表明,应将可复用技能视为可发现、可比较、约束感知的服务单元。
原文摘要 · Abstract (English)
Reusable agent skills are emerging as a service-oriented capability layer for Large Language Model (LLM) agents. Unlike plain retrieval items, a skill exposes functional capabilities, input-output assumptions, tool dependencies, context cost, and risk metadata. Selecting skills is particularly challenging for small LLM agents, which can load only a few capability units under restricted context, tool availability, and risk tolerance. Existing fixed Top-k methods rank skills by textual relevance and overlook requirement satisfaction, deliverability, and operational constraints. We present SkillSelect-Serve, a QoS-aware, budget-constrained Skill Service recommendation framework. Raw skills are profiled as structured Skill Services, the task is converted into a structured requirement object, and candidates discovered from a large-scale registry are ranked by a calibrated task-conditioned suitability estimator and packed by a constrained projection enforcing token-budget, aggregated-risk, and tool-availability constraints, using only deployment-observable features. On a registry of 35,353 skills with pooled multi-positive relevance judgments verified by two independent assessors, the unconstrained top-5 recommendation fits a realistic 4,000-token context for only 9.1% of tasks; the constrained projection restores 100% deliverability at a cost of only 1.14 points of hit rate, outperforming retrieve-and-rerank, budget truncation, and diversity-based selection under identical budgets. The same mechanism halves delivered risk exposure and eliminates the 44-81% tool-violation rates of tool-agnostic recommendation. At an identical three-service budget, hit rate improves from 0.8864 to 0.9091 over fixed Top-3 retrieval. The results support managing reusable agent skills as discoverable, comparable, and constraint-aware service units instead of plain retrievable documents.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。