arXiv:2608.28241cs.AI2026-08

让AI更懂用户:根据用户画像精准匹配合适技能

Beyond Task-Only Matching: Personalized Skill Routing with Counterfactual Evaluation

论文配图:Beyond Task-Only Matching: Personalized Skill Routing with Counterfactual Evaluation
图 1 · 摘自论文原文
  • 将技能路由建模为任务与用户画像联合相关的检索问题
  • 在固定任务下,用户画像变化导致最优技能改变,验证了个性化必要性
  • 提出技能筛选新框架SkillFeed,提升准确率23.1点,适配个性化需求场景

可复用技能库的快速发展使技能路由成为大语言模型智能体的关键能力。现有方法仅依赖任务语义匹配,但在用户约束不同时,相同请求可能匹配到语义相关但不适用的技能。为此,本文将个性化技能路由定义为受用户画像条件制约的检索问题。提出一个基于反事实的基准测试,固定任务而改变用户画像以诱导参考技能变化。构建成对反事实监督信号,提出SkillFeed框架,通过渐进式检索与重排序,先建立任务-技能对齐,再学习画像相关的判别能力。该框架利用实体级证据,重排语义相似但画像冲突的候选技能,识别同时满足任务需求和用户约束的方案。在SkillFeed-Bench上,技能匹配准确率达75.1%,比预训练基线提升23.1点;当用户画像改变参考技能时,引入画像条件带来35.1点增益,证明画像在决定技能适用性中起关键作用。

原文摘要 · Abstract (English)

The rapid expansion of reusable skill repositories makes skill routing a critical capability for large language model (LLM) agents. Existing methods treat routing as task-only semantic matching. However, when users with incompatible constraints issue an identical request, this assumption conflates task relevance with skill suitability: a task-only router can select a semantically plausible skill that is unsuitable for the requesting user. To expose this failure mode, we formulate \textit{personalized skill routing} as profile-conditioned retrieval, in which relevance depends jointly on the task and the user profile. We first introduce a profile-counterfactual benchmark, in which the task is held fixed while changes in the user profile induce changes in the reference skill. We further construct paired counterfactual supervision and propose SkillFeed, a progressive retrieve-and-rerank framework that first establishes task--skill alignment and then learns profile-conditioned discrimination. By retrieving body-level evidence and reranking semantically similar but profile-conflicting candidates, SkillFeed identifies skills that satisfy both task requirements and user constraints. On SkillFeed-Bench, SkillFeed attains 75.1\% top-1 retrieval accuracy, a 23.1-point improvement over the corresponding pretrained routing baseline. Adding profile conditioning yields a 35.1-point gain on queries where user profile changes the reference skill. This contrast shows that user profiles are most consequential precisely when they change skill suitability. Our website is publicly available at http://www.aiskillfeed.com .

智能体技能路由个性化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。