arXiv:2504.11658cs.IRcs.AI2025-04被引 3

用可解释的嵌入优化推荐系统,提升性能与透明度。

Improving LLM Interpretability and Performance via Guided Embedding Refinement for Sequential Recommendation

  • 用LLM生成可解释的引导嵌入,融合基础模型提升语义表达。
  • 在多个任务上实现MRR、Recall、NDCG提升10%至50%。
  • 适合关注推荐系统可解释性与性能优化的研究者与工程师。

大型语言模型(LLMs)的快速发展为序列推荐系统带来了新机遇。然而,将LLM集成到现有推荐系统中时,模型可解释性、透明度与安全性问题仍受关注。为此,我们提出引导嵌入优化方法,通过可解释的方式利用LLM增强基础推荐系统的嵌入表示。不直接以LLM作为推荐主干,而是将其作为辅助工具,模拟推荐业务逻辑,生成捕捉领域相关语义信息的引导嵌入。基于该引导嵌入与降维后的基础嵌入,构建精细化嵌入并融入推荐模块进行训练与推理。大量实验表明,该方法适配多种基础嵌入模型,跨任务泛化能力强。数值结果表明,精炼嵌入在MRR、Recall率和NDCG上实现约10%至50%的提升,同时通过案例研究验证了其可解释性优势。

原文摘要 · Abstract (English)

The fast development of Large Language Models (LLMs) offers growing opportunities to further improve sequential recommendation systems. Yet for some practitioners, integrating LLMs to their existing base recommendation systems raises questions about model interpretability, transparency and related safety. To partly alleviate challenges from these questions, we propose guided embedding refinement, a method that carries out a guided and interpretable usage of LLM to enhance the embeddings associated with the base recommendation system. Instead of directly using LLMs as the backbone of sequential recommendation systems, we utilize them as auxiliary tools to emulate the sales logic of recommendation and generate guided embeddings that capture domain-relevant semantic information on interpretable attributes. Benefiting from the strong generalization capabilities of the guided embedding, we construct refined embedding by using the guided embedding and reduced-dimension version of the base embedding. We then integrate the refined embedding into the recommendation module for training and inference. A range of numerical experiments demonstrate that guided embedding is adaptable to various given existing base embedding models, and generalizes well across different recommendation tasks. The numerical results show that the refined embedding not only improves recommendation performance, achieving approximately $10\%$ to $50\%$ gains in Mean Reciprocal Rank (MRR), Recall rate, and Normalized Discounted Cumulative Gain (NDCG), but also enhances interpretability, as evidenced by case studies.

推荐系统LLM应用可解释性嵌入优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。