让AI自主优化数据,不改模型也能提升性能。
DataMaster: Data-Centric Autonomous AI Research

- 用树状搜索+共享数据池+全局记忆,自动找、选、处理数据。
- 在两个基准上分别提升32.27%和0.67个百分点的准确率。
- 适合想提升模型效果又不想改算法的研究者或工程师。
随着模型架构、训练方法和算力预算日趋标准化,机器学习系统的进一步提升越来越依赖数据质量。然而数据工程仍主要依赖人工且缺乏系统性:从业者反复寻找外部数据集,适配现有流程,通过下游训练验证候选数据,并总结以往经验。本文研究任务驱动的自主数据工程,即由自主代理仅通过优化数据侧(包括外部数据发现、选择与组合、清洗与转换)来增强固定学习算法,目标是在不改变学习算法的前提下获得更强的下游性能。为应对开放搜索空间、分支依赖优化及延迟验证等挑战,我们提出DataMaster——一个集成树状结构搜索、共享数据池和累积记忆的数据智能体框架。该框架包含三个核心组件:组织不同数据工程路径的DataTree、存储可复用外部数据源的Data Pool,以及记录节点结果、中间产物和可复用发现的Global Memory。三者协同使代理能够发现候选数据、构建可执行训练输入、通过下游反馈评估并跨分支传递有效证据。我们在MLE-Bench Lite和PostTrainBench两类基准上评估DataMaster:在MLE-Bench Lite上,其奖牌率相比初始得分提升32.27%;在PostTrainBench上,其在GPQA上的表现超过指令模型(31.02% vs 30.35%)。
原文摘要 · Abstract (English)
As model families, training recipes, and compute budgets become increasingly standardized, further gains in machine learning systems depend increasingly on data. Yet data engineering remains largely manual and ad hoc: practitioners repeatedly search for external datasets, adapt them to existing pipelines, validate candidate data through downstream training, and carry forward lessons from prior attempts. We study task-conditioned autonomous data engineering, where an autonomous agent improves a fixed learning algorithm by optimizing only the data side, including external data discovery, data selection and composition, cleaning and transformation. The goal is to obtain a stronger downstream solution while leaving the learning algorithm unchanged. To address the open-ended search space, branch-dependent refinement, and delayed validation inherent in autonomous data engineering, we propose DataMaster, a data-agent framework that integrates tree-structured search, shared candidate data, and cumulative memory. DataMaster consists of three key components: a DataTree that organizes alternative data-engineering branches, a shared Data Pool that stores discovered external data sources for reuse, and a Global Memory that records node outcomes, artifacts, and reusable findings. Together, these components allow the agent to discover candidate data, construct executable training inputs, evaluate them through downstream feedback, and carry useful evidence across branches. We evaluate DataMaster on two types of benchmarks, MLE-Bench Lite and PostTrainBench. On MLE-Bench Lite, it improves medal rate by 32.27% over the initial score; on PostTrainBench, it surpasses the instruct model on GPQA (31.02% vs 30.35%).
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。