arXiv:2607.29241cs.IRcs.AI2026-07

用强化学习路由自动优化推荐系统,提升稳定性和效率

RecHarness: A Bandit-Routed Agentic Harness for Self-Evolving Recommender Systems

论文配图:RecHarness: A Bandit-Routed Agentic Harness for Self-Evolving Recommender Systems
图 1 · 摘自论文原文
  • 分两步优化:先用博弈算法选方向,再让大模型生成具体修改代码
  • 在7天线上测试中,广告收益提升0.534%,曝光增0.559%
  • 支持长期探索,遇瓶颈时自动触发结构跳跃机制

现代推荐系统优化仍依赖工程师手动调整架构、目标函数和训练策略。尽管基于大模型的智能体可自动化这一试错过程,但若让大模型同时决定修改方向并生成具体假设,常因实验预算有限导致搜索不稳定。为此,我们提出 RecHarness——一种基于博弈路由的智能体优化框架,用于自动化推荐模型优化。RecHarness 将优化流程分为两步:首先由博弈路由器根据历史验证反馈选择下一步修改方向;随后大模型在选定方向内生成具体的优化假设与可执行代码修改。为支持长周期探索,RecHarness 引入跳谷机制,当局部修改陷入停滞时自动激活结构跃迁分支。在多个推荐任务、数据集和模型主干上,RecHarness 在有限试验预算下实现更稳定的性能提升,优于单纯依赖大模型推理的搜索方法。在大规模短视频广告平台的7天在线A/B测试中,优选方案使ADVV提升2.084%,收入增加0.534%,曝光量提高0.559%。代码已开源:https://github.com/6lyc/RecHarness。

原文摘要 · Abstract (English)

Optimizing modern recommender models still depends heavily on engineers manually iterating over architectural, objective, and training-strategy changes. While LLM-based agents can automate this trial-and-error process, allowing the LLM to both select modification directions and generate concrete hypotheses often leads to unstable search under limited experiment budgets. Inspired by the above challenge, we propose RecHarness, a Bandit-Routed Agentic Harness for automated recommender model optimization. RecHarness separates the optimization process into two steps: a bandit router selects the next modification direction according to historical validation feedback, while the LLM generates a concrete optimization hypothesis and executable code edit within the selected direction. To sustain long-horizon exploration, RecHarness uses a jump-basin mechanism to activate a structural-jump arm when local edits stagnate. Across multiple recommendation tasks, datasets, and model backbones, RecHarness achieves more stable performance improvements and uses limited trial budgets more effectively than LLM-reasoning search. During a 7-day online A/B test on a large-scale short-video advertising platform, the selected candidate improves ADVV by 2.084%, Revenue by 0.534%, and Exposure by 0.559%. Code is available at https://github.com/6lyc/RecHarness.

推荐系统智能体自动化优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。