arXiv:2605.30407cs.CLcs.AI2026-05中稿 · EMNLP被引 2

让大模型自己设计数据,显著提升专精模型性能

Exploring Autonomous Agentic Data Engineering for Model Specialization

论文配图:Exploring Autonomous Agentic Data Engineering for Model Specialization
图 1 · 摘自论文原文
  • 用大模型自主规划、生成并迭代优化训练数据
  • 在多个领域中使学生模型性能提升57.29%
  • 适合想实现自动化模型定制的研究者与开发者

大型语言模型(LLMs)在通用任务上表现优异,但在缺乏高质量领域数据时难以适应专业场景。现有基于LLM的数据整理方法多依赖人工设计流程,未检验LLM是否能自主完成端到端的数据工程以实现模型专精。本文提出自主代理数据工程新任务,将数据视为可优化组件,研究代理在多个领域中通过计划、生成和迭代优化训练数据,以提升微调后性能为目标。实验表明,自主的LLM数据工程师带来显著收益:GPT-5.2构建的训练课程使学生模型性能提升57.29%,全程由代理驱动数据迭代。研究揭示了潜力与瓶颈,确立自主数据工程为可测量能力,并指明代理驱动模型专精的发展路径(代码将在https://github.com/zjunlp/DataAgent发布)。

原文摘要 · Abstract (English)

Large Language Models (LLMs) have demonstrated strong performance on general tasks, while often struggling to adapt to specialized domains without high-quality domain-specific data. Existing LLM-based data curation methods primarily rely on human-designed workflows, leaving it unexamined whether LLMs can autonomously execute an end-to-end data engineering pipeline for model specialization. We formalize Autonomous Agentic Data Engineering, a novel task designed to evaluate LLMs as autonomous data engineers that drive model specialization through end-to-end data curation. We frame data as an optimizable component and study agents that plan, generate, and iteratively optimize training data across multiple domains, guided by post-training performance improvement. Experiments show that autonomous LLM data engineers yield substantial gains, as GPT-5.2 constructs a training curriculum that improves a student model by 57.29%, entirely through iterative, agent-driven data adaptation. By illuminating both potential and bottlenecks, our study establishes autonomous data engineering as a measurable capability and charts a path toward agent-driven model specialization (Code will be released at https://github.com/zjunlp/DataAgent).

自主数据工程模型专精大模型应用智能代理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。