构建通用数据分析师,让开源模型也能处理复杂多样的真实数据分析任务。
Scaling Generalist Data-Analytic Agents
- 用细粒度任务分类和递进难度生成法合成多样化高难度数据查询。
- 训练后在多个基准上达71.16%准确率,超越闭源模型DeepSeek-V3.1和GPT-5。
- 适合想训练高效数据代理的科研人员与开发者,提供完整数据集与模型。
数据分析师代理正成为自动化科学发现与创新型AI的关键驱动力。当前方法高度依赖专有模型的提示工程,而开源模型难以应对真实世界中格式多样、规模庞大、需要长程多步推理的数据分析需求。本文提出DataMind,一套可扩展的数据合成与代理训练方案,用于构建通用数据分析师。DataMind解决三大挑战:数据资源不足、训练策略不当、代码驱动的多轮推理不稳定。具体包括:1)采用细粒度任务分类与递进式难易组合机制,提升合成查询的多样性与难度;2)结合知识增强轨迹采样与模型/规则双重过滤;3)动态调整的联合监督微调与强化学习损失目标;4)内存高效且稳定的代码多轮推理框架。基于DataMind,我们构建了DataMind-12K,一个覆盖多元领域、任务类别与文件格式的高质量轨迹数据集。在该数据集上训练的DataMind-14B在多个分析基准上达到71.16%平均分,优于最强闭源模型DeepSeek-V3.1与GPT-5;DataMind-7B在所有开源模型中表现最佳,得分为68.10%。我们还总结了探索性实验中的实证见解,为社区提供可落地的智能体训练参考。相关数据集与模型将开源共享。
原文摘要 · Abstract (English)
Data-analytic agents are emerging as a key catalyst for automated scientific discovery and for the vision of Innovating AI. Current approaches, however, rely heavily on prompt engineering over proprietary models, while open-source models struggle to face diverse-format, large-scale data files and long-horizon, multi-step reasoning that real-world analytics demands. This paper introduces DataMind, a scalable data synthesis and agent training recipe designed to build generalist data-analytic agents. DataMind tackles three key challenges in building open-source data-analytic agents, including insufficient data resources, improper training strategy, and unstable code-based multi-turn rollout. Concretely, DataMind applies 1) a fine-grained task taxonomy and a recursive easy-to-hard task composition mechanism to increase the diversity and difficulty of synthesized queries; 2) a knowledge-augmented trajectory sampling strategy followed by model-based and rule-based filtering; 3) a dynamically adjustable training objective combining both SFT and RL losses; 4) a memory-frugal and stable code-based multi-turn rollout framework. Built on DataMind, we curate DataMind-12K, a high-quality trajectory set spanning diverse domains, task categories, and data file formats for data-analytic tasks. Trained on DataMind-12K, our DataMind-14B achieves state-of-the-art with an average score of 71.16% on multiple data analysis benchmarks, outperforming the strongest proprietary baselines DeepSeek-V3.1 and GPT-5. Our DataMind-7B also performs best among all open-source models with a score of 68.10%. We also incorporate some empirical insights gained from our exploratory trials into the analysis experiments, aiming to provide actionable insights about agentic training for the community. We will release DataMind-12K and DataMind-7B,14B for the community's future research.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。