arXiv:2506.23643cs.IR2025-06被引 10

提出新生成推荐范式,让模型先‘思考’再‘行动’,提升推荐效果。

Act-With-Think: Chunk Auto-Regressive Modeling for Generative Recommendation

  • 采用分块自回归机制,将语义与行为统一建模,模拟用户决策过程。
  • 在多个数据集上召回率提升7.93%至22.30%,显著优于传统方法。
  • 首次实现语义与行为联合建模,适合研究可解释推荐系统者参考。

生成式推荐(GR)通常将物品的行为或语义信息编码为离散标记,利用标准自回归(AR)生成范式进行预测。然而,现有方法往往忽略其内在关联,即语义常为行为提供合理解释(‘为何’),而行为是具体动作(‘做什么’),这可能限制了GR的潜力。为此,我们提出分块自回归建模(CAR),一种遵循用户先思考语义(如品牌)、再采取行动(如购买)的决策模式的新生成范式。CAR首次通过分块级自回归,从‘行动中思考’的双重视角,将语义标识符(SIDs)与用户标识符(UID)整合进单一自回归Transformer。具体地,CAR将SIDs与UID打包为概念性分块,用于物品统一表示,使每个解码步骤可做出整体预测。实验表明,相比传统AR方法,CAR显著提升性能,召回率@5提高7.93%至22.30%。此外,我们验证了模型性能与SIDs位数间的缩放效应,表明CAR初步模拟了类似大语言模型(LLMs)的慢思考机制。

原文摘要 · Abstract (English)

Generative recommendation (GR) typically encodes behavioral or semantic aspects of item information into discrete tokens, leveraging the standard autoregressive (AR) generation paradigm to make predictions. However, existing methods tend to overlook their intrinsic relationship, that is, the semantic usually provides some reasonable explainability "$\textbf{why}$" for the behavior "$\textbf{what}$", which may constrain the full potential of GR. To this end, we present Chunk AutoRegressive Modeling (CAR), a new generation paradigm following the decision pattern that users usually think semantic aspects of items (e.g. brand) and then take actions on target items (e.g. purchase). Our CAR, for the $\textit{first time}$, incorporates semantics (SIDs) and behavior (UID) into a single autoregressive transformer from an ``act-with-think'' dual perspective via chunk-level autoregression. Specifically, CAR packs SIDs and UID into a conceptual chunk for item unified representation, allowing each decoding step to make a holistic prediction. Experiments show that our CAR significantly outperforms existing methods based on traditional AR, improving Recall@5 by 7.93% to 22.30%. Furthermore, we verify the scaling effect between model performance and SIDs bit number, demonstrating that CAR preliminary emulates a kind of slow-thinking style mechanism akin to the reasoning processes observed in large language models (LLMs).

生成推荐自回归可解释性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。