arXiv:2508.10312cs.CL2025-08KDD被引 1

提出新方法保留大模型推荐中的协同信号,避免语义过强导致信息丢失。

Beyond Semantic Understanding: Preserving Collaborative Frequency Components in LLM-based Recommendation

  • 从频域角度设计滤波机制,分步净化并保留用户行为中的协同特征。
  • 在4个数据集上提升最多8.00%的NDCG@10,显著缓解协同信号衰减。
  • 适合关注大模型推荐中协同信息保留的研究者与工业应用开发者。

将大型语言模型(LLM)用于推荐系统虽能生成语义丰富的推荐,但其倾向于过度强调用户行为历史中的语义关联,导致内在协同信号随层传播而逐渐弱化。相比之下,传统Transformer模型通常能保持甚至增强协同信号。为解决此问题,本文提出FreLLM4Rec,从谱视角平衡语义与协同信息。首先利用全局图低通滤波器(G-LPF)对融合语义与协同的信息嵌入进行初步去噪;随后通过时间频率调制(TFM)逐层主动保留协同信号。理论证明,该方法在计算效率与性能间取得平衡,其频率域滤波器可逼近理想但难以实现的局部图傅里叶滤波器。在四个基准数据集上的实验表明,该方法有效缓解了协同信号衰减,在NDCG@10指标上相较最优基线最高提升8.00%。研究揭示了LLM处理协同信息的机制,并为改进基于大模型的推荐系统提供了可解释的框架。

原文摘要 · Abstract (English)

Recommender systems in concert with Large Language Models (LLMs) present promising avenues for generating semantically-informed recommendations. However, LLM-based recommenders exhibit a tendency to overemphasize semantic correlations within users' interaction history. When taking pretrained collaborative ID embeddings as input, LLM-based recommenders progressively weaken the inherent collaborative signals as the embeddings propagate through LLM backbones layer by layer, as opposed to traditional Transformer-based sequential models in which collaborative signals are typically preserved or even enhanced for state-of-the-art performance. To address this limitation, we introduce FreLLM4Rec, an approach designed to balance semantic and collaborative information from a spectral perspective. Item embeddings that incorporate both semantic and collaborative information are first purified using a Global Graph Low-Pass Filter (G-LPF) to preliminarily remove irrelevant high-frequency noise. Temporal Frequency Modulation (TFM) then actively preserves collaborative signal layer by layer. Note that the collaborative preservation capability of TFM is theoretically guaranteed by establishing a connection between the optimal but hard-to-implement local graph fourier filters and the suboptimal yet computationally efficient frequency-domain filters. Extensive experiments on four benchmark datasets demonstrate that FreLLM4Rec successfully mitigates collaborative signal attenuation and achieves competitive performance, with improvements of up to 8.00\% in NDCG@10 over the best baseline. Our findings provide insights into how LLMs process collaborative information and offer a principled approach for improving LLM-based recommendation systems.

推荐系统大模型协同过滤频域建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。