分离时间动态与顺序信息,提升推荐模型对用户行为时序规律的捕捉能力。
Decoupled Temporal Encoding for Generative Recommendation
- 将时间动态与顺序编码解耦,分别建模宏观时间模式和局部交互密度。
- 在真实外卖场景中,相比基线模型,点击率提升2.3%,转化率提升1.8%。
- 轻量级设计,适合直接部署到现有推荐系统中。
位置编码是基于Transformer的生成式推荐模型的核心组件,用户历史被建模为自回归物品序列。现有方法多沿用自然语言处理中的位置编码,主要表征离散物品顺序,但推荐序列不仅包含顺序,还受时间戳和时间效应影响。本工作基于真实外卖与即时零售推荐系统,发现用户行为存在多层次时间规律,包括近期效应、用餐高峰、工作日/周末转换以及促销驱动的流量激增。现有方法通过时间特征、间隔嵌入、衰减函数或注意力偏置部分解决此问题,但通常以统一表示或单一路径注入异构时间信号,难以区分宏观时间动态与局部顺序线索。为此,我们提出解耦时间编码(Decoupled Temporal Encoding, DTE),一种轻量级生成式推荐框架。DTE通过两个互补模块分离时间动态与顺序信息:个性化宏观时间模块将紧凑的时间原型注入物品嵌入,时间门控微观序列模块仅在交互密集时引入相对顺序偏置。DTE参数高效且部署友好,可无缝集成至现有系统。
原文摘要 · Abstract (English)
Positional encoding is a fundamental component of Transformer-based generative recommendation models, where user histories are modeled as autoregressive item sequences. Most positional encoding methods are inherited from natural language processing and mainly represent discrete item order. However, recommendation sequences go beyond ordered lists, as timestamps and temporal effects also shape item relations. Our work is motivated by a real-world food delivery and instant retail recommendation system, where user behavior exhibits multi-level temporal regularities, including recency effects, meal-time peaks, weekday-weekend shifts, and promotion-driven traffic bursts. Existing methods partially address this issue through timestamp features, interval embeddings, decay functions, or attention biases, but they usually inject heterogeneous temporal signals through a unified representation or a single modeling pathway, making it difficult to distinguish broad temporal dynamics from local order cues. To address this limitation, we propose Decoupled Temporal Encoding, a lightweight framework for generative recommendation. DTE separates temporal dynamics from order information through two complementary modules: a personalized macro-temporal module that injects compact temporal primitives into item embeddings, and a time-gated micro-sequential module that introduces relative-order bias only when interactions are temporally dense. DTE is also parameter-efficient and deployment-friendly, allowing easy integration into existing systems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。