arXiv:2510.16804cs.IR2025-10被引 2

提出非交错布局的生成推荐方法,兼顾精度与效率

The Layout Is the Model: On Action-Item Coupling in Generative Recommendation

  • 采用延迟动作条件机制,非交错排列项目与行为
  • 在多个数据集上达到领先性能,计算量降低显著
  • 适合追求高效部署的推荐系统开发者

生成式推荐(GR)模型将用户交互历史视为需自回归预测的序列。当同时建模项目和行为(如观看时长、购买、评论)时,标记的排布方式——即项目/行为标记的顺序与可见性——决定了模型可利用的信息及其泛化能力。本文基于三大基本原则开展统一研究:(P1) 在输入输出空间最大化项目/行为信号;(P2) 保持“行为给定项目”的条件关系;(P3) 避免信息泄露。虽然交错布局(项目与行为分占独立标记)自然满足这些原则,但会导致序列长度增加,训练与推理成本上升。针对非交错布局,我们设计了一种新颖有效的方法——滞后动作条件(LAC),表面看似反直觉,但符合设计原则,表现优异。在公开数据集和大规模生产日志上的全面实验验证了不同布局方案的有效性,并实证支持了设计原则。所提出的非交错方法LAC在显著更低的浮点运算量(FLOPs)下达到竞争力或更优的推荐质量。研究结果为构建高精度且高效的生成式推荐系统提供了可操作的指导。

原文摘要 · Abstract (English)

Generative Recommendation (GR) models treat a user's interaction history as a sequence to be autoregressively predicted. When both items and actions (e.g., watch time, purchase, comment) are modeled, the layout-the ordering and visibility of item/action tokens-critically determines what information the model can use and how it generalizes. We present a unified study of token layouts for GR grounded in first principles: (P1) maximize item/action signal in both input/output space, (P2) preserve the conditioning relationship "action given item" and (P3) no information leakage. While interleaved layout (where item and action occupy separate tokens) naturally satisfies these principles, it also bloats sequence length with larger training/inference cost. On the non-interleaved front, we design a novel and effective approach, Lagged Action Conditioning (LAC), which appears strange on the surface but aligns well with the design principles to yield strong accuracy. Comprehensive experiments on public datasets and large-scale production logs evaluate different layout options and empirically verifies the design principles. Our proposed non-interleaved method, LAC, achieves competitive or superior quality at substantially lower FLOPs than interleaving. Our findings offer actionable guidance for assembling GR systems that are both accurate and efficient.

生成推荐序列建模效率优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。