arXiv:2607.27789cs.IR2026-07

用反馈驱动策略发现,让推荐模型从理解用户意图到做出有效推荐

From Understanding to Action: Feedback-Grounded Policy Discovery for Generative Recommendation

论文配图:From Understanding to Action: Feedback-Grounded Policy Discovery for Generative Recommendation
图 1 · 摘自论文原文
  • 基于反馈优化推荐策略,区分意图与决策规则
  • 线上测试提升4.5%收入和4.6%广告价值
  • 将LLM知识蒸馏为轻量生成器,支持快速推理

基于语义ID的生成式推荐模型虽能高效生成下一个物品,但其监督信号主要反映行为共现与局部转移。大语言模型(LLMs)可通过对异构交互历史推理来理解用户当前需求,但其缺乏推荐结果反馈的训练,语言上合理的推理未必带来有效推荐。我们称此为“理解-行动差距”。为此,我们区分意图知识(用户当前需求)与策略知识(在该需求下的推荐方向与拒绝边界)。提出一种反馈驱动的智能体框架:先推断任务导向的意图,再根据增量效用发现推荐策略,并以结果反馈而非语言合理性进行评估与优化。进一步通过双空间关系蒸馏,将意图与策略知识迁移到轻量级语义ID生成器的两个隐向量中,实现无需LLM的在线推理。公开基准测试显示持续优于基线,大规模线上A/B测试中收入提升4.506%,ADVV提升4.621%。

原文摘要 · Abstract (English)

Semantic-ID-based generative recommenders enable efficient next-item generation, but their item-level supervision mainly captures behavioral co-occurrence and local transitions. Large language models (LLMs) can complement these models by reasoning over heterogeneous interaction histories to understand the user's current demand. However, LLMs are not inherently trained with recommendation-specific outcome feedback, and linguistically plausible reasoning therefore does not necessarily lead to effective recommendation decisions. We term this mismatch the Understanding-Action Gap. Accordingly, we distinguish intent knowledge, which captures the user's current demand, from policy knowledge, which specifies the recommendation direction and rejection boundary under that demand. To bridge this gap, we propose a feedback-driven agent framework that first induces task-oriented intent and then discovers recommendation policies according to their incremental utility over an intent-only baseline. Candidate policies are evaluated and refined using outcome-derived feedback rather than linguistic plausibility. We further transfer the resulting intent and policy knowledge into two latent tokens of a lightweight Semantic-ID generator through dual-space relational distillation, enabling LLM-free online inference. Experiments on public benchmarks show consistent improvements over baselines, while large-scale online A/B tests achieve gains of 4.506% in Revenue and 4.621% in ADVV.

生成推荐大模型策略发现反馈学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。