用双对齐语义ID提升工业推荐系统精度与效率
DAS: Dual-Aligned Semantic IDs Empowered Industrial Recommender System
- 一阶段联合优化量化与对齐,避免信息损失
- 多视角对比对齐使语义ID与用户行为更匹配
- 已落地快手广告系统,日均服务4亿用户
语义ID是通过量化多模态大模型嵌入生成的离散标识符,可实现推荐系统中多模态内容的高效融合。然而,其缺乏协同信号,导致与下游判别性与生成性推荐目标存在偏差。现有研究虽引入多种对齐机制,但两阶段框架仍存在两大局限:(1) 对齐过程不可避免的信息损失;(2) 自适应对齐策略应用不灵活,限制互信息最大化。为此,本文提出新型的一阶段双对齐语义ID(DAS)方法,同步优化量化与对齐,保留语义完整性与对齐质量,避免两阶段方法的信息损耗。DAS通过两种创新有效策略实现更高效的语义ID与协同信号对齐:(1) 多视角对比对齐:引入基于ID的协同过滤去偏模块,并设计三种对比对齐方法——双用户到物品(u2i)、双物品到物品/用户到用户(i2i/u2u)、双共现物品到物品/用户到用户(i2i/u2u);(2) 双学习:通过对齐用户与广告的双重量化,使构建的语义ID实现更强关联。我们通过大量离线实验与在线A/B测试验证DAS有效性,现已成功部署于快手App多个广告场景,日均服务超4亿用户。
原文摘要 · Abstract (English)
Semantic IDs are discrete identifiers generated by quantizing the Multi-modal Large Language Models (MLLMs) embeddings, enabling efficient multi-modal content integration in recommendation systems. However, their lack of collaborative signals results in a misalignment with downstream discriminative and generative recommendation objectives. Recent studies have introduced various alignment mechanisms to address this problem, but their two-stage framework design still leads to two main limitations: (1) inevitable information loss during alignment, and (2) inflexibility in applying adaptive alignment strategies, consequently constraining the mutual information maximization during the alignment process. To address these limitations, we propose a novel and flexible one-stage Dual-Aligned Semantic IDs (DAS) method that simultaneously optimizes quantization and alignment, preserving semantic integrity and alignment quality while avoiding the information loss typically associated with two-stage methods. Meanwhile, DAS achieves more efficient alignment between the semantic IDs and collaborative signals, with the following two innovative and effective approaches: (1) Multi-view Constrative Alignment: To maximize mutual information between semantic IDs and collaborative signals, we first incorporate an ID-based CF debias module, and then design three effective contrastive alignment methods: dual user-to-item (u2i), dual item-to-item/user-to-user (i2i/u2u), and dual co-occurrence item-to-item/user-to-user (i2i/u2u). (2) Dual Learning: By aligning the dual quantizations of users and ads, the constructed semantic IDs for users and ads achieve stronger alignment. Finally, we conduct extensive offline experiments and online A/B tests to evaluate DAS's effectiveness, which is now successfully deployed across various advertising scenarios at Kuaishou App, serving over 400 million users daily.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。