用单个令牌表示商品,提升多模态大模型推荐效率
An item is worth one token in Multimodal Large Language Models-based Sequential Recommendation
- 将商品信息压缩为单一令牌,减少冗余
- 训练速度提升至2.5倍,推理时间降至25%
- 适合需要高效长序列推荐的场景
序列推荐(SR)基于用户历史行为预测未来交互。大语言模型(LLMs)带来强大的生成与推理能力,显著提升SR性能;多模态大语言模型(MLLMs)进一步引入图像和交互关系等数据。但存在三大问题:(a) 长且冗余的描述导致商品表征不佳,影响训练与推理效率;(b) 由于预训练主要依赖文本,模型对非文本模态存在认知偏差;(c) 长交互序列中注意力机制难以捕捉早期行为,削弱长程依赖建模。为此,我们提出Speeder,一种高效的MLLM-based SR范式,包含三项创新:1)多模态表征压缩(MRC),将商品属性浓缩为简洁、信息丰富的令牌,降低冗余与计算开销;2)模态感知渐进优化(MPO),实现多模态表征的逐步学习;3)序列位置感知增强(SPAE),提升模型对相对与绝对序列依赖的捕捉能力。在真实数据集上的大量实验表明,Speeder在亚马逊数据集上训练速度达原方法的250%,推理时间降至25%。
原文摘要 · Abstract (English)
Sequential recommendations (SR) predict users' future interactions based on their historical behavior. The rise of Large Language Models (LLMs) has brought powerful generative and reasoning capabilities, significantly enhancing SR performance, while Multimodal LLMs (MLLMs) further extend this by introducing data like images and interactive relationships. However, critical issues remain, i.e., (a) Suboptimal item representations caused by lengthy and redundant descriptions, leading to inefficiencies in both training and inference; (b) Modality-related cognitive bias, as LLMs are predominantly pretrained on textual data, limiting their ability to effectively integrate and utilize non-textual modalities; (c) Weakening sequential perception in long interaction sequences, where attention mechanisms struggle to capture earlier interactions, hindering the modeling of long-range dependencies. To address these issues, we propose Speeder, an efficient MLLM-based paradigm for SR featuring three key innovations: 1) Multimodal Representation Compression (MRC), which condenses item attributes into concise yet informative tokens, reducing redundancy and computational cost; 2) Modality-aware Progressive Optimization (MPO), enabling gradual learning of multimodal representations; 3) Sequential Position Awareness Enhancement (SPAE), improving the LLM's capability to capture both relative and absolute sequential dependencies in long interaction sequences. Extensive experiments on real-world datasets demonstrate the effectiveness and efficiency of Speeder. Speeder increases training speed to 250% of the original while reducing inference time to 25% on the Amazon dataset.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。