将开源代码库提炼为可复用的智能研究技能,提升AI自主科研效率。
Repo-To-Skill: Distilling GitHub Repositories Into AI4AI Skills

- 通过任务无关与任务导向双路径,从1000个热门代码库中提炼出5000+可验证技能
- 在固定模型和执行预算下,多项评测指标最高提升134.3%,显著超越无技能版本
- 适合构建高效自主科研代理的研究者与开发者,尤其关注工程化落地
自主智能体正逐步实现机器学习研究的全流程自动化。这类智能体虽具备规划、执行、记忆与验证能力,但仍缺乏领域特有的操作性知识——即从知晓方法到实际可行之间的关键经验。这些知识存在于代码库与论文中,但以人类可读形式存在且体量过大,难以直接加载使用。本文提出DisCo,一种以技能为核心的科研智能体,能生成并运用操作技能。其知识提炼分为两种互补方式:任务无关型,将广泛使用的开源代码库转化为通用技能;任务导向型,针对具体任务生成专属技能。前者覆盖整个开放生态,形成包含5000+已验证技能的AREX-Skill库,涵盖20个领域与178个能力类别。在固定GPT-5.5主干、研究框架及下游执行预算的前提下,启用技能的智能体在MLE-bench上表现提升134.3%,PaperBench提升34.4%,FrontierCS提升9.2%,PassNet提升14.0%。这些性能提升源于引入了经过提炼的操作上下文。
原文摘要 · Abstract (English)
Autonomous agents are beginning to carry out machine-learning (ML) research end to end. These agents combine a model backbone with a harness for planning, execution, memory, and verification, but this architecture still leaves domain-specific know-how outside the agent. We call this missing layer operational knowledge, the know-how that separates knowing a method from making it work. That knowledge is not absent from the field. It appears in repositories and papers, but in forms written for human readers and too large to load during a task. Once distilled into compact, verified skills, this knowledge can be reused across tasks rather than rediscovered during each run. We present DisCo, a skill-powered research agent that creates skills and uses them during research. Its distillation runs in two complementary forms: task-agnostic, condensing the field's widely used repositories into reusable skills, and task-oriented, producing the skills a concrete task calls for. The former, applied across the open ecosystem, yields the AREX-Skill Library, with 5,000+ verified skills distilled from 1,000 widely used ML repositories and organized into 20 areas and 178 capability families. With the GPT-5.5 backbone, research harness, and downstream execution budget held fixed, the skill-equipped research agent scores 134.3% higher on MLE-bench, 34.4% higher on PaperBench, 9.2% higher on FrontierCS, and 14.0% higher on PassNet than the same agent without skills. These gains come from adding distilled operating context under that fixed setup.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。