arXiv:2602.13581cs.IR2026-02KDD被引 1

解决生成式推荐的短视问题,实现高效指令跟随推荐。

Climber-Pilot: A Non-Myopic Generative Recommendation Model Towards Better Instruction-Following

  • 用时间感知掩码训练,让模型预判长期多物品行为。
  • 引入稀疏注意力机制,直接在生成中融入业务约束。
  • 在网易云音乐上线测试,核心指标提升4.24%。

生成式检索已成为推荐系统中的有前景范式,相比传统双塔架构具备更优的序列建模能力。然而,在大规模工业场景中,此类模型常存在固有短视问题:受限于单步推理与严格延迟要求,往往将多样用户意图压缩为局部最优预测,难以捕捉长期多物品消费模式。此外,真实检索系统需遵循显式检索指令,如类别控制和策略约束。现有条件化或事后过滤方法在引入指令跟随时,常以牺牲相关性或效率为代价。本文提出Climber-Pilot,一个统一的生成式检索框架以解决上述双重挑战。首先,提出时间感知多物品预测(TAMIP),通过时间感知掩码将长期多物品前瞻知识蒸馏至模型参数,缓解局部最优预测,同时保持单步高效推理。其次,提出条件引导稀疏注意力(CGSA),通过稀疏注意力直接在生成过程中嵌入业务约束,无需增加推理步骤。在网易云音乐——中国最大音乐流媒体平台之一——的离线实验与在线A/B测试表明,Climber-Pilot显著优于现有先进基线,核心业务指标提升4.24%。

原文摘要 · Abstract (English)

Generative retrieval has emerged as a promising paradigm in recommender systems, offering superior sequence modeling capabilities over traditional dual-tower architectures. However, in large-scale industrial scenarios, such models often suffer from inherent myopia: due to single-step inference and strict latency constraints, they tend to collapse diverse user intents into locally optimal predictions, failing to capture long-horizon and multi-item consumption patterns. Moreover, real-world retrieval systems must follow explicit retrieval instructions, such as category-level control and policy constraints. Incorporating such instruction-following behavior into generative retrieval remains challenging, as existing conditioning or post-hoc filtering approaches often compromise relevance or efficiency. In this work, we present Climber-Pilot, a unified generative retrieval framework to address both limitations. First, we introduce Time-Aware Multi-Item Prediction (TAMIP), a novel training paradigm designed to mitigate inherent myopia in generative retrieval. By distilling long-horizon, multi-item foresight into model parameters through time-aware masking, TAMIP alleviates locally optimal predictions while preserving efficient single-step inference. Second, to support flexible instruction-following retrieval, we propose Condition-Guided Sparse Attention (CGSA), which incorporates business constraints directly into the generative process via sparse attention, without introducing additional inference steps. Extensive offline experiments and online A/B testing at NetEase Cloud Music, one of the largest music streaming platforms, demonstrate that Climber-Pilot significantly outperforms state-of-the-art baselines, achieving a 4.24\% lift of the core business metric.

生成式推荐长序列建模指令跟随音乐推荐

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。