arXiv:2607.27002cs.IR2026-07

让大模型多层特征为推荐服务,自适应融合更精准

IMFuse: Instance-Aware Multi-Layer Fusion for LLM-Enhanced Sequential Recommendation

论文配图:IMFuse: Instance-Aware Multi-Layer Fusion for LLM-Enhanced Sequential Recommendation
图 1 · 摘自论文原文
  • 用多层特征替代单层输出,动态融合不同语义层级信息
  • 在四个数据集上平均提升6.72%,显著优于现有方法
  • 适合需要高精度推荐的电商、内容平台等场景

大语言模型(LLM)通过编码物品文本信息提升了序列推荐效果,但现有方法通常仅使用最终层隐藏状态,忽略了中间层蕴含的互补语义。实证分析发现,最终层存在维度坍缩问题,而中间层保留了由粗到精的语义知识。同时,不同物品的层间表示演化差异显著,统一选层效果不佳。为此,我们提出IMFuse,一种实例感知的多层融合策略:通过学习全局维度级层偏好,捕获通用语义贡献;并引入实例感知专家调制机制,动态调整偏好,生成个性化物品语义表征。在四个真实数据集上的实验表明,IMFuse持续优于当前最优基线,平均相对提升达6.72%,且参数与计算开销极小。

原文摘要 · Abstract (English)

Recent advancements in Large Language Models (LLMs) have significantly enhanced sequential recommendation by encoding rich item textual information into semantic representations. However, existing methods typically rely on the final-layer hidden states of LLMs, overlooking potentially useful semantic signals encoded in other layers. Through empirical analysis, we reveal the limitations of this practice: final-layer representations often suffer from dimensional collapse, whereas intermediate layers preserve complementary, coarse-to-fine semantic knowledge. Furthermore, we observe that different items exhibit heterogeneous layer-wise representation evolution, making a uniform layer selection sub-optimal. To bridge this gap, we propose IMFuse, an instance-aware multi-layer fusion strategy designed for LLM-enhanced recommendation. Instead of relying on a single layer, IMFuse adaptively aggregates multi-layer semantic information by learning global dimension-wise layer preferences to capture general semantic contributions. To address item-level heterogeneity, IMFuse introduces an instance-aware expert modulation mechanism that dynamically adjusts these global preferences, generating personalized, item-specific semantic representations. Extensive experiments across four real-world datasets demonstrate the effectiveness of IMFuse. It consistently outperforms state-of-the-art baselines with an average relative improvement of 6.72%, while introducing limited parameter and computational overhead.

序列推荐大模型多层融合

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。