arXiv:2608.09440cs.IR2026-08

用可执行策略生成推荐排序,提升效果且不增加延迟。

MetaStrategy: Generative Ranking with Executable LLM Strategies

论文配图:MetaStrategy: Generative Ranking with Executable LLM Strategies
图 1 · 摘自论文原文
  • 生成结构化可执行策略,动态调节推荐目标权重与规则
  • 线上测试点击页浏览量提升2.11%,成交额增2.83%
  • 适配工业级推荐系统,兼容现有模型与业务约束

工业级推荐系统需在用户、商业、体验等多重目标耦合下对异构内容进行排序。现有生成式排序方法直接构造物品序列,难以融入成熟的预测模型、运营规则和场级护栏。本文提出MetaStrategy框架,不直接生成序列,而是生成可执行的结构化排序策略。基于请求上下文,大语言模型(LLM)策略生成带类型的JSON包,控制目标权重、内容与品类偏好、体验约束及位置策略。一个确定性验证器与编译器实例化出独立的生成器,在生成器-评估器(GE)架构下与现有方案原子竞争。策略在生产路径回放环境中训练,通过重执行日志请求而不暴露用户。采用选择、相对排序和基线提升奖励,自竞争课程机制将频繁策略反馈为对手,并通过评估器路由的奖励增强在线策略蒸馏,将40亿参数教师模型压缩至0.8亿参数学生模型。该方法部署于淘宝首页猜你喜欢模块,通过差异触发近线生成;LLM推理位于同步排序之外,响应时间无明显增加。七天用户随机在线A/B测试中,MetaStrategy在27.93%的处理请求中胜过原有方案,显著提升点击页浏览量(+2.11%)、详情页浏览量(+3.12%)和交易金额(+2.83%)。

原文摘要 · Abstract (English)

Industrial recommender systems rank heterogeneous content under coupled user, business, commercial, and experience objectives. Existing generative ranking methods typically construct item sequences directly, making them difficult to integrate with mature predictive models, operational rules, and field-level guardrails. We present MetaStrategy, a framework that instead generates a structured, executable ranking strategy. Conditioned on request context, a large language model (LLM) policy emits a typed JSON bundle controlling objective weights, content and category preferences, experience constraints, and position policies. A deterministic validator and compiler instantiate an isolated Generator that competes atomically with incumbents under the list-level Evaluator of the Generator-Evaluator (GE) architecture. We train the policy in a production-path replay environment that re-executes logged requests through the current re-ranking stack without user exposure. The method combines selection, relative-rank, and baseline-lift rewards, a self-competitive curriculum that feeds frequent strategies back as competitors, and Evaluator-routed reward-augmented on-policy distillation that transfers complementary 4B-parameter Teachers into a compact 0.8B-parameter Student. We deploy MetaStrategy in Taobao Homepage Guess You Like through diff-triggered nearline generation; LLM inference remains outside synchronous ranking, with no observable increase in response time (RT). In a seven-day user-randomized online A/B test, MetaStrategy wins 27.93% of treatment-side GE calls and significantly improves click page views (click PV) by 2.11%, item-detail page views (IPV) by 3.12%, and transaction amount by 2.83%.

推荐系统生成式排序LLM应用策略生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。