让大模型在真实机器学习任务中反复试错,提升自主解决问题能力。
MLE-Dojo: Interactive Environments for Empowering LLM Agents in Machine Learning Engineering
- 构建交互式环境,支持大模型迭代实验与调试。
- 基于200多个真实Kaggle挑战,覆盖数据处理到调参全流程。
- 适合研究大模型自动化工程能力或开发智能编程助手的人。
我们提出MLE-Dojo,一个类Gym的框架,用于系统性地强化学习、评估和改进大语言模型(LLM)在迭代式机器学习工程(MLE)工作流中的表现。不同于依赖静态数据集或单次评估的现有基准,MLE-Dojo提供可交互环境,使代理通过结构化反馈循环持续实验、调试并优化解决方案。该框架基于200多个真实世界Kaggle挑战构建,涵盖数据处理、架构搜索、超参数调优和代码调试等多样化开放式任务,反映真实工程场景。其全可执行环境支持监督微调与强化学习相结合的训练方式,实现迭代实验、真实数据采样和实时结果验证。对8个前沿大模型的广泛评估显示,当前模型虽能实现有意义的迭代优化,但在生成长周期解决方案和高效解决复杂错误方面仍存在显著局限。此外,MLE-Dojo灵活可扩展的架构可无缝集成多种数据源、工具和评估协议,支持基于模型的代理调优,促进互操作性、可扩展性和可复现性。我们已开源该框架与基准,推动下一代机器学习代理的社区共建。
原文摘要 · Abstract (English)
We introduce MLE-Dojo, a Gym-style framework for systematically reinforcement learning, evaluating, and improving autonomous large language model (LLM) agents in iterative machine learning engineering (MLE) workflows. Unlike existing benchmarks that primarily rely on static datasets or single-attempt evaluations, MLE-Dojo provides an interactive environment enabling agents to iteratively experiment, debug, and refine solutions through structured feedback loops. Built upon 200+ real-world Kaggle challenges, MLE-Dojo covers diverse, open-ended MLE tasks carefully curated to reflect realistic engineering scenarios such as data processing, architecture search, hyperparameter tuning, and code debugging. Its fully executable environment supports comprehensive agent training via both supervised fine-tuning and reinforcement learning, facilitating iterative experimentation, realistic data sampling, and real-time outcome verification. Extensive evaluations of eight frontier LLMs reveal that while current models achieve meaningful iterative improvements, they still exhibit significant limitations in autonomously generating long-horizon solutions and efficiently resolving complex errors. Furthermore, MLE-Dojo's flexible and extensible architecture seamlessly integrates diverse data sources, tools, and evaluation protocols, uniquely enabling model-based agent tuning and promoting interoperability, scalability, and reproducibility. We open-source our framework and benchmarks to foster community-driven innovation towards next-generation MLE agents.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。