arXiv:2603.01712cs.AIcs.LG2026-03被引 3

用智能体自动微调大模型,13个垂直领域任务全搞定

FT-Dojo: Towards Autonomous LLM Fine-Tuning with Language Agents

  • 构建交互式环境,让智能体自主规划、验证与迭代微调
  • 在13项任务中10项表现最优,显著优于基线和主流代理
  • 适合研究自动化机器学习与智能体系统的人参考

将大语言模型微调应用于垂直领域仍需大量人工投入,包括数据整理、训练配置及行为诊断。尽管自主机器学习和语言智能体备受关注,但端到端大模型微调作为交互式智能体任务尚未被系统研究。本文提出FT-Dojo,一个面向自主大模型微调的交互式基准环境,涵盖5个领域共13项任务。它不依赖静态数据集,而是标准化了任务接口、共享原始数据仓库、沙盒执行环境、结构化反馈协议和预留评估流程。同时开发了针对微调优化的FT-Agent框架,采用结构化迭代规划、快速失败验证和多层级反馈分析,持续优化数据与训练策略。实验表明,FT-Agent在13项任务中有10项达到最佳性能,且通过与前沿智能体、开源规划模块及多轮运行统计的对比,验证了其有效性。案例研究显示,智能体可通过累积学习恢复失败,但在因果诊断和长程规划方面仍存局限。代码已开源:https://github.com/microsoft/rd-agent。

原文摘要 · Abstract (English)

Fine-tuning large language models for vertical domains remains labor-intensive, requiring practitioners to curate data, configure training, and iteratively diagnose model behavior. Despite growing interest in autonomous machine learning and language agents, end-to-end LLM fine-tuning has not been systematically studied as an interactive agent task. We introduce FT-Dojo, an interactive benchmark environment for autonomous LLM fine-tuning, comprising 13 tasks across 5 domains. Rather than a new collection of static datasets, FT-Dojo standardizes a task interface, shared raw-data repository, sandboxed execution environment, structured feedback protocol, and held-out evaluation procedure. We further develop FT-Agent, a fine-tuning-oriented autonomous framework that uses structured iteration planning, fail-fast validation, and multi-level feedback analysis to refine data and training strategies. Experiments show that FT-Agent provides a strong initial baseline, achieving the best performance on 10 out of 13 tasks, with additional controlled comparisons against frontier agents, open-source planning backbones, and multi-run statistics supporting the main findings. Case studies show that agents can recover from failures through cumulative learning, while still exposing limitations in causal diagnosis and long-horizon planning. The implementation is available at https://github.com/microsoft/rd-agent.

智能体微调自动化大模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。