统一物品编码框架,让大模型跨领域推荐更高效准确。
Tokenize Once, Recommend Anywhere: Unified Item Tokenization for Multi-domain LLM-based Recommendation
- 用混合专家架构和多代码本实现跨域统一编码。
- 相比基线最高提升51.89%,且无需为每个领域重新训练。
- 适合需要跨领域推荐的工业系统,尤其关注可扩展性。
基于大语言模型的推荐系统通过物品编码弥合了物品空间与语言空间的差异。然而,现有方法通常需为每个物品领域单独训练模型,限制了泛化能力。不同领域的分布与语义差异也使得构建能保留领域特性的统一编码方案极具挑战。为此,我们提出UniTok统一物品编码框架,结合自研的混合专家(MoE)架构与多个代码本,将物品映射为离散令牌,实现可扩展的跨域编码并保留语义信息。具体而言,各领域物品首先通过共享编码器投影至统一潜在空间,再由领域专属专家捕捉独特语义,同时始终激活的共享专家编码跨领域通用知识。此外,为缓解领域间语义失衡,我们引入互信息校准机制,引导模型均衡保留各领域的语义信息。在广泛真实数据集上的实验表明,所提UniTok框架(a)效果显著:相较强基线最高提升51.89%;(b)理论合理:验证了架构设计与优化的分析有效性;(c)高度泛化:无需领域特定重训练即可在多样领域中保持稳健性能,这是现有基线无法支持的能力。
原文摘要 · Abstract (English)
Large language model (LLM)-based recommender systems have achieved high-quality performance by bridging the discrepancy between the item space and the language space through item tokenization. However, existing item tokenization methods typically require training separate models for each item domain, limiting generalization. Moreover, the diverse distributions and semantics across item domains make it difficult to construct a unified tokenization that preserves domain-specific information. To address these challenges, we propose UniTok, a Unified item Tokenization framework that integrates our own mixture-of-experts (MoE) architecture with a series of codebooks to convert items into discrete tokens, enabling scalable tokenization while preserving semantic information across multiple item domains. Specifically, items from different domains are first projected into a unified latent space through a shared encoder. They are then routed to domain-specific experts to capture the unique semantics, while a shared expert, which is always active, encodes common knowledge transferable across domains. Additionally, to mitigate semantic imbalance across domains, we present a mutual information calibration mechanism, which guides the model towards retaining similar levels of semantic information for each domain. Comprehensive experiments on wide-ranging real-world datasets demonstrate that the proposed UniTok framework is (a) highly effective: achieving up to 51.89% improvements over strong benchmarks, (b) theoretically sound: showing the analytical validity of our architectural design and optimization; and (c) highly generalizable: demonstrating robust performance across diverse domains without requiring per-domain retraining, a capability not supported by existing baselines.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。