SPARC让推荐系统更懂上下文,动态压缩用户行为信息
SPARC: Sequence-aware Progressive Attribute Routing and Compression Framework for Generative Recommendation

- 按行为字段分步建模,生成上下文感知的特征表示
- 多路路由保留关键信息,压缩后仍保持高精度推荐效果
- 适合需要高效处理长序列行为数据的工业级推荐场景
生成式推荐将物品编码为离散语义ID(SIDs),基于用户历史SID序列自回归生成目标物品。现有SIDs虽融合多模态与结构化信息,但通常静态分配且不随交互上下文变化。工业场景中,每条行为包含类别、品牌、价格、行为类型、时间戳等异构属性,全量展开会显著增加输入长度,直接压缩则可能过早丢弃上下文相关细节。本文提出SPARC框架:首先建模各字段类型的序列依赖,获得上下文感知表示;随后将原始、上下文及身份表示路由至多个槽位,在固定容量下保留互补信息;最后通过轻量级跨物品交互整合中间标记,并将每个历史物品压缩为单一标记。遵循‘先上下文化,再压缩’原则,SPARC在不增加生成模型输入长度的前提下增强用户历史表示。在工业级淘宝和公开亚马逊数据集上的实验表明,SPARC优于强基线。与静态压缩变体对比显示,其性能提升源于上下文感知的信息保留,而非压缩模块表达力增强。
原文摘要 · Abstract (English)
Generative recommendation tokenizes items as discrete Semantic IDs (SIDs) and autoregressively generates target items from users' historical SID sequences. Although existing SIDs incorporate multimodal and structured information, they are typically statically assigned and independent of the current interaction context. In industrial scenarios, each behavior also contains heterogeneous attributes, such as category, brand, price, behavior type, and timestamp. Fully expanding these features greatly increases the input length, while directly compressing them into a single representation may prematurely discard context-relevant information. We propose \textbf{SPARC}, \uline{\textbf{S}}equence-aware \uline{\textbf{P}}rogressive \uline{\textbf{A}}ttribute \uline{\textbf{R}}outing and \uline{\textbf{C}}ompression Framework for Generative recommendation. SPARC first models the sequential dependencies of each field type to obtain context-aware field representations. It then routes the original, contextual, and identity representations of different fields into multiple slots to preserve complementary information under a fixed capacity. Finally, lightweight cross-item interaction integrates the intermediate tokens and compresses each historical item into a single token. Following the principle of contextualizing before compression, SPARC enriches user-history representations without increasing the input length of the generative backbone. Experiments on industrial Taobao and public Amazon datasets demonstrate that SPARC outperforms strong conventional and generative baselines. Further comparisons with static compression variants show that the improvement of SPARC comes from context-conditioned information retention rather than merely increasing the expressiveness of the compression module.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。