arXiv:2608.29966cs.CL2026-08

让数据生成器自我进化,提前优化数据质量。

DataFoundry: Evolving Data Preparators via Recursive Self-Improvement

论文配图:DataFoundry: Evolving Data Preparators via Recursive Self-Improvement
图 1 · 摘自论文原文
  • 用模块化技能和控制器实现数据生成器的递归自改进
  • 在数学、金融等四领域测试,生成数据下游效果优于基线
  • 适合需要高质量训练数据的研究者和工业界应用

大语言模型的领域适配越来越依赖高质量训练数据,但现有数据准备流程通常仅在生成后通过事后过滤来处理质量,造成根本性错位:质量问题源自构建过程,却只对输出进行控制。我们提出 extsc{DataFoundry},一个在大规模数据生产前通过递归自改进演化数据准备器的框架。 extsc{DataFoundry} 将数据准备器表示为可演化的运行时规范,采用 extsc{Skills-as-Modules} 架构,由中心 extsc{Controller} 协调模块化技能,编译可执行运行时,利用领域相关标准在小规模试点集上诊断缺陷,并将反馈转化为适配器,修订单个准备组件同时保持稳定接口。我们在 DataPrep-Bench 上评估了数学、金融、法律和医学四个领域,发现递归演化后的准备器生成的数据具有更高的下游实用性。不同骨干模型的实验表明该提升不依赖特定模型,分析与案例研究进一步揭示了框架的优化动态及实际演化过程。

原文摘要 · Abstract (English)

Domain adaptation of large language models increasingly depends on constructing high-quality training data, yet existing data-preparation pipelines typically address quality only after generation through post-hoc filtering. This creates a fundamental mismatch: data-quality issues often originate from the construction process itself, while quality control is applied only to its outputs. We introduce \textsc{DataFoundry}, a framework for \textbf{evolving data preparators through recursive self-improvement} before large-scale data production. \textsc{DataFoundry} represents a data preparator as an evolvable runtime specification and instantiates its evolution with a \textsc{Skills-as-Modules} architecture, in which a central \textsc{Controller} orchestrates modular skills to compile executable runtimes, diagnose deficiencies on small pilot sets using domain-appropriate criteria, and translate diagnostic feedback into adapters that revise individual preparation components while preserving stable interfaces. We evaluate \textsc{DataFoundry} on DataPrep-Bench across mathematics, finance, law, and medicine, and find that recursively evolved preparators produce training data with higher downstream utility than baselines. Experiments across different backbones further demonstrate that these improvements are not tied to a particular model, while analyses and case studies further reveal the framework's optimization dynamics and illustrate how its evolution unfolds in practice.

数据构建自进化领域适配

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。