通过多时序偏好对齐,让生成式推荐更懂用户长期兴趣。
EchoRec: Multi-Item Prediction-Empowered Generative Recommendation via Cycle-Consistent Preference Alignment

- 用多时序循环一致对齐,捕捉用户偏好的演化轨迹。
- 在三个数据集上显著提升推荐效果,天然支持多物品生成。
- 模型结构可卸载,推理时无额外开销,适合实际部署。
生成式推荐通过自回归生成目标物品的语义标识符,在共享标记空间中统一了偏好建模与索引检索。近期研究引入了多标记预测(MTP),但主要继承其效率优势,未充分挖掘其作为密集监督信号的潜力。我们分析发现,未来行为相较于随机配对具有显著的语义回声,但随时间推移在意图转换下逐渐衰减,因此是信息丰富且顺序依赖的信号。受此启发,我们提出 EchoRec,通过跨多时序的循环一致整体偏好对齐,增强 MTP 在生成式推荐中的表现。该方法包含两个协同模块:时序感知偏好生成(HPG)通过轻量级辅助分支链式建模,逐层体现偏好演化;可验证的整体偏好对齐(VHA)将各时序偏好整合为整体偏好,并通过循环一致投影回传,抑制虚假对齐,理论上保证在可逆传输下排除秩塌陷形式的伪对齐,使整体偏好保留在解码表示中。所有辅助组件在推理时可丢弃,引入可忽略的在线服务开销。在三个数据集上的大量实验表明,EchoRec 显著优于现有方法,同时具备自然的多物品生成能力。代码与数据集将在论文接收后公开。
原文摘要 · Abstract (English)
Generative recommendation autoregressively generates the semantic IDs of the target item, unifying preference modeling and index retrieval within the shared token space. Recent attempts have introduced Multi-Token Prediction (MTP) into this field, yet they primarily inherit its efficiency merit, leaving its potential as dense supervision unexplored. Unlocking this potential hinges on whether future behaviors qualify as informative supervision. Our analysis reveals that future behaviors carry a semantic echo of the current one far above that of random pairs, which nevertheless decays along horizons under intent transitions, making them informative yet order-dependent signals. Motivated by this, we propose EchoRec, which empowers MTP with cycle-consistent holistic preference alignment across multi-horizon for generative recommendation. It comprises two synergistic modules. Horizon-aware Preference Generation (HPG) sequentially chains lightweight auxiliary branches upon the base recommender, where each branch conditions on its predecessor to respect preference evolution. Verifiable Holistic-Preference Alignment (VHA) further consolidates them into the holistic preference and echoes it back through cycle-consistent projectors to suppress spurious alignment, with theoretical guarantees that exclude the rank-collapse form of spurious alignment under an invertible transport, enabling the holistic preference to be retained in the decoding representation. All auxiliary components serve as disposable scaffolding discarded at inference, introducing negligible online serving overhead. Extensive experiments on three datasets demonstrate the superiority of our EchoRec, together with its naturally acquired multi-item generation ability. Our code and datasets will be available upon acceptance.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。