arXiv:2508.09653cs.IRcs.AI2025-08被引 1

让大模型推荐更聪明:自动识别无用信息并智能优化

On Negative-aware Preference Optimization for Recommendation

  • 用批内共享负样本,不加内存也能扩大训练数据
  • 根据负样本可信度动态调整学习强度,提升准确率
  • 适合想改进大模型推荐系统、降低热门内容偏见的研究者

推荐系统利用用户交互数据推荐相关项目,同时过滤无关(负向)内容。大型语言模型(LLMs)在推荐任务中展现出潜力,但现有优化方法难以有效利用负样本。单纯引入大量负样本虽能提高排序准确率并缓解流行度偏差,但会增加计算开销和内存成本。此外,现有方法未考虑负样本的差异性信息量,导致优化效果不佳。为此,我们提出NAPO(Negative-aware Preference Optimization),一种增强型的基于大模型推荐的偏好优化框架。NAPO引入两项关键创新:(1) 批内负样本共享,可在不增加内存开销的情况下扩大负样本池;(2) 动态奖励边际调整,根据负样本置信度自适应调节模型更新。在三个公开数据集上的大量实验表明,NAPO在推荐准确率和流行度偏差降低方面均优于现有方法。

原文摘要 · Abstract (English)

Recommendation systems leverage user interaction data to suggest relevant items while filtering out irrelevant (negative) ones. The rise of large language models (LLMs) has garnered increasing attention for their potential in recommendation tasks. However, existing methods for optimizing LLM-based recommenders face challenges in effectively utilizing negative samples. Simply integrating large numbers of negative samples can improve ranking accuracy and mitigate popularity bias but often leads to increased computational overhead and memory costs. Additionally, current approaches fail to account for the varying informativeness of negative samples, leading to suboptimal optimization performance. To address these issues, we propose NAPO (\textbf{N}egative-\textbf{A}ware \textbf{P}reference \textbf{O}ptimization), an enhanced framework for preference optimization in LLM-based recommendation. NAPO introduces two key innovations: (1) in-batch negative sharing, which expands the pool of negative samples without additional memory overhead, and (2) dynamic reward margin adjustment, which adapts model updates based on the confidence of negative samples. Extensive experiments on three public datasets demonstrate that NAPO outperforms existing methods in both recommendation accuracy and popularity bias reduction.

推荐系统大模型负样本

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。