arXiv:2507.20327cs.IR2025-07被引 1

用时序优势增强推荐生成模型,提升轨迹质量和计算效率。

TADT-CSA: Temporal Advantage Decision Transformer with Contrastive State Abstraction for Generative Recommendation

  • 引入时序优势信号,优化长期收益与趋势捕捉。
  • 对比状态抽象模块使状态表示更高效,降低计算开销。
  • 适合需要高精度与低延迟的实时推荐场景。

随着基于Transformer的大语言模型(LLMs)快速发展,生成式推荐在提升推荐系统准确性和语义理解方面展现出巨大潜力。相比LLMs,决策变换器(DT)作为轻量级生成模型,适用于序列推荐任务,但面临轨迹拼接不佳、状态空间高维带来的计算成本高等问题。为此,本文提出一种新型时间优势决策变换器与对比状态抽象模型(TADT-CSA)。该模型融合传统返利目标(RTG)信号与新提出的时序优势(TA)信号,以同时捕捉长期回报及其序列趋势。同时,在DT框架中引入对比状态抽象模块,设计了基于TA条件的状态向量量化(TAC-SVQ)策略,使状态码本结合上下文信息。此外,通过奖励预测网络和对比转移预测(CTP)网络,确保码本保留当前状态的奖励信息及相邻状态间的转移特征。在公开数据集与线上推荐系统上的实验表明,TADT-CSA显著优于基线方法。

原文摘要 · Abstract (English)

With the rapid advancement of Transformer-based Large Language Models (LLMs), generative recommendation has shown great potential in enhancing both the accuracy and semantic understanding of modern recommender systems. Compared to LLMs, the Decision Transformer (DT) is a lightweight generative model applied to sequential recommendation tasks. However, DT faces challenges in trajectory stitching, often producing suboptimal trajectories. Moreover, due to the high dimensionality of user states and the vast state space inherent in recommendation scenarios, DT can incur significant computational costs and struggle to learn effective state representations. To overcome these issues, we propose a novel Temporal Advantage Decision Transformer with Contrastive State Abstraction (TADT-CSA) model. Specifically, we combine the conventional Return-To-Go (RTG) signal with a novel temporal advantage (TA) signal that encourages the model to capture both long-term returns and their sequential trend. Furthermore, we integrate a contrastive state abstraction module into the DT framework to learn more effective and expressive state representations. Within this module, we introduce a TA-conditioned State Vector Quantization (TAC-SVQ) strategy, where the TA score guides the state codebooks to incorporate contextual token information. Additionally, a reward prediction network and a contrastive transition prediction (CTP) network are employed to ensure the state codebook preserves both the reward information of the current state and the transition information between adjacent states. Empirical results on both public datasets and an online recommendation system demonstrate the effectiveness of the TADT-CSA model and its superiority over baseline methods.

生成推荐决策变换器状态抽象时序优势

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。