arXiv:2605.23310cs.IR2026-05被引 2

用生成式语义ID实现头尾商品知识单向迁移,提升长尾推荐效果。

From Head to Tail: Asymmetric Knowledge Transfer in Long-tail Recommendation with Generative Semantic IDs

论文配图:From Head to Tail: Asymmetric Knowledge Transfer in Long-tail Recommendation with Generative Semantic IDs
图 1 · 摘自论文原文
  • 通过LLM生成语义ID,将内容与协同信号对齐,构建统一表征。
  • 头到尾单向知识迁移,提升头端商品表示质量,头端AUC提升0.35%。
  • 适合电商推荐系统优化,尤其在数据不均衡场景下表现优异。

真实电商场景中的长尾推荐因数据严重不均衡而面临挑战。现有方法难以融合内容多模态特征与协同信号,且忽略头尾商品间知识迁移的不对称性:尾部商品的噪声信号会损害头部商品的表示学习。本文提出AKT-Rec框架,利用大语言模型生成语义ID,通过监督微调的多模态大模型(MLLM)对齐物品与用户的内容与协同信息,生成语义表征。再通过残差量化变分自编码器(RQ-VAE)将表征离散化为语义ID,形成相似实体的语义聚类。AKT-Rec包含两个核心模块:(1) 聚类引导的自适应嵌入,将每个ID表示分解为聚类级嵌入(共享语义)与个体嵌入,并通过非对称对比目标与活跃度感知门控机制,实现从头到尾的知识迁移;(2) 分层特征聚合,构建并行特征视图,自适应融合以优化不同活跃度样本的预测。在大规模工业数据集上的实验及阿里巴巴天猫平台的在线A/B测试表明,该方法显著有效:离线指标上AUC提升0.35%,GAUC提升1.53%;在线测试中点击率(CTR)提升2.76%,商品交易总额(GMV)提升3.47%,验证了其在真实生产环境中的实用性。

原文摘要 · Abstract (English)

Long-tail recommendation in real-world e-commerce platforms remains challenging due to severe data imbalance. Existing methods often struggle to combine content-based multimodal features with collaborative signals. Many of these methods also ignore an important asymmetry in knowledge transfer between head and tail IDs: noisy signals from tail IDs can hurt representation learning for head IDs. This paper presents AKT-Rec, a framework for Asymmetric Knowledge Transfer in long-tail Recommendation that uses LLM-generated semantic IDs. AKT-Rec uses Multimodal LLMs (MLLMs) with supervised fine-tuning to align content representations with collaborative information for both items and users, producing semantic representations. It then discretizes these representations into semantic IDs with a Residual-Quantized VAE (RQ-VAE), which yields semantic clusters of similar entities. AKT-Rec has two main components: (1) Cluster-Guided Adaptive Embedding, which decomposes each ID representation into a cluster-level embedding that captures shared semantics and an individual embedding. Through an asymmetric contrastive objective and an activity-aware gating mechanism, this module directs knowledge transfer from head to tail IDs. (2) Hierarchical Feature Aggregation, which builds parallel feature views and adaptively fuses them to optimize predictions for samples with varying activity levels. Extensive experiments on a large-scale industrial dataset and online A/B testing on the Alibaba Tmall platform demonstrate the effectiveness of AKT-Rec. AKT-Rec improves offline performance by 0.35% in AUC and 1.53% in GAUC, outperforming several competitive baselines. In online A/B testing, AKT-Rec achieves a 2.76% increase in CTR and a 3.47% increase in GMV, validating its utility in real-world production environments.

长尾推荐语义嵌入知识迁移多模态

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。