让推荐模型更轻更快,同时处理超长用户行为序列。
SlimPer: Make Personalization Model Slim and Smart

- 用固定大小知识库迭代优化,替代传统长序列处理
- 支持10,000+用户行为建模,推理内存不随历史增长
- 适合大规模工业推荐系统,尤其关注效率与可解释性
Transformer架构在工业推荐系统中日益普及,但其依赖逐标记自回归生成的设计与推荐任务本质不符:推荐只需为每个<用户, 商品>对输出单一相关性评分,无需标记级监督。基于此,我们提出SlimPer,将个性化排序重构为对紧凑统一的<用户, 商品>知识库的迭代精炼。每层中,模型有选择地查询原始多模态用户侧标记,计算显式相关性匹配分数,并更新知识库,所有操作每层仅需O(N)复杂度,中间表示大小固定。因此,模型深度与用户历史长度解耦,实现更深理解而无需成比例增加计算或内存;仅请求优化进一步通过共享单个用户标记副本降低内存开销。SlimPer在单一主干网络中统一融合稀疏、稠密与序列特征,并通过注意力机制提供内在可解释性。已在Instagram Reels和Feed上线,显著提升用户参与度,同时简化系统架构,支持有效建模超过10,000条细粒度用户历史事件。
原文摘要 · Abstract (English)
Transformer-style architectures are increasingly adopted for industrial recommendation systems, yet they inherit a design premise misaligned with the task: generative models rely on per-token autoregressive prediction, which justifies maintaining large intermediate tensors that scale with sequence length. In contrast, recommendation systems produce a single set of relevance scores for each <user, item> pair without token-level supervision. Leveraging this observation, we propose SlimPer, which reformulates personalized ranking as iterative refinement of a compact, unified <user, item> knowledge base. At each layer, the model selectively queries raw multi-modal user-side tokens, computes explicit relevance matching scores, and refines the knowledge base, all in O(N) per-layer cost with a fixed-size intermediate representation. As a result, model depth is decoupled from user history length, enabling deeper relevance understanding without proportional growth in compute or memory; request-only optimization further trims memory by sharing a single copy of user-side tokens across all candidate items. SlimPer unifies sparse, dense, and sequence features within a single backbone and provides inherent interpretability through its attention mechanism. Deployed on Instagram Reels and Feed, SlimPer yields measurable improvements in user engagement while streamlining the overall system and enabling effective modeling of 10k+ fine-grained user history events.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。