arXiv:2410.19276cs.IR2024-10中稿 · KDD被引 1

用共享令牌替代物品ID,提升多模态推荐效果与冷启动能力

MOTOR: Learning ID-free Item Representation with Token Crossing for Embedding-based Multimodal Recommendation

  • 用产品量化将多模态特征转为紧凑令牌,实现跨物品语义共享
  • 在9个主流模型上均显著提升性能,冷启动场景下推荐能力增强
  • 无需复杂损失函数,模型参数量大幅减少,适合大规模推荐系统

尽管多模态推荐模型有效融合了视觉与文本信息,但依赖唯一物品ID嵌入构成了根本性性能瓶颈。具体表现为:(1) 信息隔离——唯一ID阻碍相关物品间语义交互;(2) 冷启动脆弱性——稀疏交互下难以优化ID嵌入;(3) 存储低效——参数量随物品数量线性增长。为此,我们提出MOTOR,一种新型的无ID多模态令牌表示方案。MOTOR以可学习的共享多模态令牌取代显式物品ID,从根本上实现无ID推荐框架。方法上,首先通过产品量化将原始多模态特征离散化为紧凑令牌ID,这些令牌作为隐式物品特征,再经由新颖的令牌交叉网络(TCN)合成,捕捉高阶交互模式。该‘离散化-交互’机制实现了跨物品语义共享,并显著压缩模型规模,且无需引入复杂辅助损失。在九个主流模型上的大量实验表明,MOTOR带来显著性能提升,进一步增强了模型在冷启动场景下的推荐能力。

原文摘要 · Abstract (English)

While multimodal recommendation models have effectively integrated visual and textual information, their reliance on unique ID embeddings constitutes a fundamental performance bottleneck. Specifically, ID-based paradigms suffer from three limitations: (1) \textbf{Information Isolation}, where unique IDs prevent semantic information exchange among related items; (2) \textbf{Cold-Start Vulnerability}, as ID embeddings are difficult to optimize with sparse interactions; and (3) \textbf{Storage Inefficiency}, where parameter costs scale linearly with item quantity. To overcome these challenges, we propose \textbf{MOTOR}, a novel \textbf{ID-free MultimOdal TOken Representation} scheme. MOTOR replaces explicit item IDs with learnable, shared multimodal tokens, fundamentally transforming the recommender into an ID-free framework. Methodologically, we first employ product quantization to discretize raw multimodal features into compact token IDs. These tokens serve as implicit item features, which are then synthesized via a novel \textbf{Token Cross Network (TCN)} to capture high-order interaction patterns. This "discretize-and-interact" mechanism enables semantic sharing across items and significantly compresses the model size without introducing complex auxiliary losses. Extensive experiments across nine mainstream models demonstrate the significant performance improvement achieved by MOTOR. Further, MOTOR improves the capability of these models to recommend items in cold-start scenarios.

多模态推荐无ID建模冷启动令牌表示

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。