arXiv:2606.07526cs.CLcs.AI2026-06ACL

让大模型推荐系统学会理解用户-物品关系图谱,提升推荐精准度。

GraphLoRA: Structure-Aware Low-Rank Adaptation for Large Language Model Recommendation

论文配图:GraphLoRA: Structure-Aware Low-Rank Adaptation for Large Language Model Recommendation
图 1 · 摘自论文原文
  • 在低秩微调中嵌入可训练的图消息传递网络,让结构信息动态影响参数更新。
  • 在多个数据集上超越现有方法,准确率最高提升6.2%,且计算开销可控。
  • 适合做个性化推荐、融合图结构与文本理解的场景,尤其适合大模型应用。

大型语言模型(LLM)凭借强大的推理与泛化能力,在推荐系统中展现出巨大潜力。然而,如何有效对齐语言模型所建模的文本语义与协同信号仍是关键挑战。现有方法或把协同信息转为文本提示,或注入预训练嵌入,均将结构信息视为静态输入,无法捕捉高阶依赖关系。为此,我们提出GraphLoRA,一种从独立到结构感知传播的低秩适配新框架。GraphLoRA在低秩适配路径中嵌入可训练的图消息传递网络,使结构信号能通过参数空间传播,让协同拓扑显式引导参数更新,实现图结构与文本语义的深度融合。大量实验表明,GraphLoRA不仅优于当前最先进的基于LLM的推荐方法,还具备更强泛化能力,同时保持良好计算效率。代码已公开于https://github.com/wgj15965/GraphLoRA。

原文摘要 · Abstract (English)

Large Language Models (LLMs) have shown strong potential for recommendation (LLMRec) due to their powerful reasoning and generalization abilities. However, effectively aligning the textual semantics modeled by LLMs with the collaborative signals remains a key challenge. Existing methods either translate collaborative information into textual prompts or inject pre-trained embeddings into the LLM, both of which treat structural information as static input and fail to capture high-order relational dependencies. To bridge this gap, we propose GraphLoRA, a novel framework that generalizes low-rank adaptation from independent to structure-aware propagation. GraphLoRA embeds a trainable graph message-passing network within the low-rank adaptation pathway, enabling structural signals to propagate through the parameter space. This design allows collaborative topology to explicitly guide parameter updates, fostering deep integration between graph-structured and textual semantic information. Extensive experiments on multiple benchmarks demonstrate that GraphLoRA not only outperforms state-of-the-art LLM-based recommendation methods but also achieves superior generalization, effectively balancing structural reasoning capability with computational efficiency. Code is available at \href{https://github.com/wgj15965/GraphLoRA}{https://github.com/wgj15965/GraphLoRA}.

推荐系统图神经网络大模型适配低秩微调

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。