AI自动生成工业AI系统演进方向,效果超人类专家。
Astar: Learning to Propose Evolution Directions for Self-Evolving Industrial AI Systems

- 用历史迭代数据训练专用模型,自动提出演进方向。
- 单次提议成功率67.86%,远超人类专家的32.29%。
- 已实现全自动连续迭代,提升广告收益4.86%。
现代AI系统通过持续迭代推进:提出演进方向、编码实现、训练与评估。后三阶段日益自动化,但起点——提出有效演进方向——仍依赖资深专家,成瓶颈。本文探索让AI接管此任务。发现通用大模型(如GPT-5.5)仅能给出泛化且不匹配的建议,因所需知识源于经验而非显式编码。为此提出Astar,基于工业系统海量迭代历史训练专用演进引导模型。面临四个挑战:监督信号稀疏、数据噪声、方向空间巨大、验证成本高。从数据侧设计流水线,通过成对样本扩展与噪声过滤构建大规模清洁演化语料;从模型侧采用中段训练、SFT与强化学习,以分层提示引导生成,并用奖励模型作为快速替代评估器。Astar已部署于阿里巴巴Lazada广告系统。Astar-8B在真实执行评估中单次提议成功率0.6786,显著高于人类专家(0.3229)和最强通用模型(0.3071)。更重要的是,其完成闭环,实现全自动迭代:连续指导20轮迭代,离线Hitrate@200提升23.6%;线上A/B测试显示GMV相对增长4.86%,广告收入提升1.82%。
原文摘要 · Abstract (English)
Modern AI systems advance through continuous iteration: a loop of proposing evolution directions, implementing code, training, and evaluation. While the latter three stages are increasingly automated, the starting point --- proposing effective evolution directions --- remains a critical bottleneck that still relies heavily on senior experts. In this work, we explore whether AI can take over this role. We find that general-purpose LLMs, even the advanced GPT-5.5, offer only generic and misaligned suggestions: the required expertise is accumulated through experience rather than explicitly codified, and thus hard to inject directly. To this end, we propose Astar, a training-based approach that learns a specialized evolution-guiding model from the abundant iteration histories of industrial systems. Realizing this idea, however, raises four challenges: sparse supervision, noisy data, a vast direction space, and prohibitively expensive verification. We address them along two fronts. On the data side, we design a pipeline that turns noisy historical commits into a large, clean evolutionary corpus via pairwise sample expansion and noise filtering. On the model side, we train the model through mid-training, SFT, and RL, guiding evolution direction generation with hierarchical hints and using the reward model in RL as a fast surrogate evaluator. Astar has been deployed in Alibaba's Lazada advertising system for evolution direction proposal. Astar-8B achieves a single-proposal success rate of 0.6786 in real-execution evaluation, far exceeding human experts (0.3229) and the strongest general-purpose LLM (0.3071). More importantly, Astar closes the loop and enables fully automatic iteration: it guided 20 consecutive iterations over two weeks, improving offline Hitrate@200 by 23.6%, while an online A/B test yielded relative lifts of 4.86% in GMV and 1.82% in advertising revenue.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。