AutoLR自动化推荐系统从研究到上线的全流程,提升工业级推荐迭代效率。
AutoLR: Automating the Path from Research to Launch Review in Industrial Recommender Systems

- 构建多专家委员会与确定性探索-利用选择器,协同LLM与规则引擎
- 在DASHEN上实现92%候选方案通过离线验证,平均节省5.3天实验周期
- 适合工业界推荐系统研发团队,尤其关注自动化评估与上线流程
在网易游戏社区应用DASHEN中,改进工业推荐系统是一个迭代的研究与工程过程,而非直接从想法到部署。算法工程师通常从论文、技术报告和历史实验中发现有前景的方向,复现或调整方法,在生产代码中实现,并通过训练和离线实验评估模型。表现优异的候选方案进入在线A/B测试,最终通过发布评审(Launch Review)才能全流量上线。大语言模型可辅助各环节,但缺乏能协调长期、多日实验周期的统一框架。本文提出AutoLR,最初为自动发布评审(Auto Launch Review),后扩展为端到端自主研究-上线协作系统。它包含三个机制:多专家委员会进行辩论与对抗式评审;确定性加权探索-利用选择器,在有限试验预算内分配资源并结合委员会重排序;分层知识系统融合外部研究、生产系统知识及DASHEN特定领域知识(如游戏社区、玩家特征、内容交互模式),并结合配置、补丁、日志、失败记录和离线结果的后验证据。LLM代理负责语义推理与代码生成,而确定性控制器保留对执行、指标提取、安全约束和持久状态转换的控制权。
原文摘要 · Abstract (English)
Improving an industrial recommender is an iterative research-and-engineering process rather than a direct path from idea to deployment. In \textbf{DASHEN, NetEase's gaming-community app}, algorithm engineers typically identify promising directions from research papers, technical reports, and prior production experiments; reproduce or adapt the underlying methods; implement them in the production codebase; and evaluate the resulting models through training and offline experiments. Promising candidates are then advanced to online A/B tests, and those demonstrating robust gains are submitted to Launch Review---the internal gate for full-traffic rollout. Large language models (LLMs) can assist with individual stages of this workflow, but the overall process remains human-dependent without a harness that can reliably coordinate them across long-running, often multi-day experimental cycles. We present \textbf{AutoLR}, initially built as \textbf{Auto Launch Review} and later extended upstream into an autonomous research-to-launch harness. AutoLR combines three system mechanisms: a \textbf{multi-expert council} that debates and adversarially reviews proposals; a \textbf{deterministic evidence-weighted exploration--exploitation selector} that allocates a limited trial budget across candidate directions and uses Council reranking; and a layered knowledge system that combines external research, production-system knowledge, and DASHEN-specific domain knowledge---such as game communities, player characteristics, and content-interaction patterns---with posterior evidence from configurations, patches, logs, failures, and offline outcomes. LLM agents perform semantic reasoning and code generation, while deterministic controllers retain authority over execution, metric extraction, guardrails, and persistent state transitions.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。