arXiv:2609.02730cs.CL2026-09

用AI代理自动优化推荐系统,提升效果且不增加成本。

CORAL: An LLM-Native Harness for Production Recommender Systems

  • 构建闭环AI代理,根据实时数据动态调整推荐策略。
  • 在两个大型社交平台测试中,提升用户参与度或降低服务成本。
  • 无需人工干预,适合需要持续优化的生产级推荐系统。

生产级推荐系统影响数十亿用户的可见内容,其性能需持续优化:随着内容、用户行为和上游模型的变化,检索、排序与服务策略必须重新评估。传统上依赖工程师进行线上实验,过程缓慢且受限于人力,导致系统部分长期未更新。尽管大语言模型已应用于排序、用户建模和离线开发,但极少有系统将智能体置于持续闭环中,基于决策效果学习并主动调整实时推荐系统。本文提出CORAL(Constraint-Optimized Recommender via an Agentic Loop),一个原生支持大模型的推荐系统框架。每个循环中,智能体观察运行信号,结合历史决策与结果记忆,调用工具(包括数值优化器以控制预算)重构推荐策略,测量结果反馈至下一周期。该问题被建模为部分可观测、非平稳、受约束的优化问题,策略通过上下文迭代改进,无需参数更新。在两个大规模社交平台的A/B实验中,同一框架在一处实现用户参与度提升而无额外服务成本,在另一处降低服务成本且不影响参与度,覆盖了效果-效率权衡边界。性能随循环迭代持续提升,表明单个智能体闭环可自动化传统由人工算法工程师完成的持续优化工作,且在明确约束下运行。

原文摘要 · Abstract (English)

Production recommender systems shape what billions of people see, and sustaining their performance requires continual optimization: as content, user behavior, and upstream models shift, the choices governing retrieval, ranking, and serving must be revisited. Traditionally, human engineers test such changes through online experiments--a slow, reactive process limited by engineering effort, leaving parts of the system unrevised as conditions change. Although large language models have been applied to ranking, user modeling, and offline model development, few systems place an agent in a continual closed loop that acts on a live recommender and learns from the measured effects of its decisions. We present CORAL (Constraint-Optimized Recommender via an Agentic Loop), an LLM-native harness that closes this loop: each cycle, the agent observes operating signals, reasons over a memory of past decisions and outcomes, and invokes tools--including a numerical optimizer that keeps changes within a fixed operating budget--to reconfigure the recommender, with measured outcomes informing the next cycle. We formulate this as a partially observed, non-stationary, constrained optimization problem in which the policy improves in context, without parameter updates, from its prior actions. Across two large-scale social platforms, evaluated with A/B experiments, the same harness improves engagement at no additional serving cost on one and reduces serving cost without degrading engagement on the other, spanning the engagement-efficiency frontier. Performance improves as the loop iterates, suggesting that a single agentic loop can automate continual optimization work traditionally performed by human algorithm engineers under explicit guardrails.

推荐系统智能体大模型应用闭环优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。