arXiv:2601.10820cs.LGcs.AI2026-01被引 1

用智能规划器让AI团队协作生成可靠特征代码,效率提升百倍。

Towards Reliable ML Feature Engineering via Planning in Constrained-Topology of LLM Agents

  • 设计受限拓扑的多智能体框架,用规划器协调代码生成流程。
  • 在真实推荐系统中将特征开发周期从三周缩短至一天,效率提升150%。
  • 支持团队个性化工具集成,关键步骤可请求人工干预,适合工程落地。

代码生成模型的进步为自动化特征工程带来了前所未有的机遇,但其在真实机器学习团队中的应用仍受限于三大挑战:(i) 缺乏捕捉生产级特征工程迭代复杂过程的数据集;(ii) 常用编码助手(如 CoPilot、Devin)与团队特定工具、代码库、工作流和实践的整合与个性化能力有限;(iii) 由于反馈时机不当或不足,导致人机协作效果不佳。为此,我们提出一种由规划器引导的、受限拓扑的多智能体框架,以多步方式为代码仓库生成代码。该基于大语言模型的规划器利用团队环境图来协调智能体调用、生成上下文感知提示,并利用下游失败结果回溯修正上游产出。它可在关键步骤请求人工介入,确保生成代码的可靠性、可维护性及与团队预期的一致性。在自建的内部数据集上,该方法相比手动编写和无规划流程,在评估指标上分别提升38%和150%。实际应用中,为服务超过1.2亿用户的推荐模型构建特征时,该方法将特征工程周期从三周缩短至一天,实现显著落地价值。

原文摘要 · Abstract (English)

Recent advances in code generation models have unlocked unprecedented opportunities for automating feature engineering, yet their adoption in real-world ML teams remains constrained by critical challenges: (i) the scarcity of datasets capturing the iterative and complex coding processes of production-level feature engineering, (ii) limited integration and personalization of widely used coding agents, such as CoPilot and Devin, with a team's unique tools, codebases, workflows, and practices, and (iii) suboptimal human-AI collaboration due to poorly timed or insufficient feedback. We address these challenges with a planner-guided, constrained-topology multi-agent framework that generates code for repositories in a multi-step fashion. The LLM-powered planner leverages a team's environment, represented as a graph, to orchestrate calls to available agents, generate context-aware prompts, and use downstream failures to retroactively correct upstream artifacts. It can request human intervention at critical steps, ensuring generated code is reliable, maintainable, and aligned with team expectations. On a novel in-house dataset, our approach achieves 38% and 150% improvement in the evaluation metric over manually crafted and unplanned workflows respectively. In practice, when building features for recommendation models serving over 120 million users, our approach has delivered real-world impact by reducing feature engineering cycles from three weeks to a single day.

特征工程多智能体规划器

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。