用大模型精准捕捉用户不喜欢什么,提升推荐系统理解力。
CoNRec: Context-Discerning Negative Recommendation with LLMs
- 设计上下文感知模块,用语义ID替代文本描述,增强对负向反馈的理解。
- 提出渐进式GRPO训练,动态平衡正负行为上下文,缓解数据稀疏问题。
- 新奖励函数基于多日未来负反馈,更贴近真实用户偏好,适合优化负向推荐。
理解用户喜欢什么相对简单,但理解用户不喜欢什么仍具挑战且研究不足。现代推荐系统中,用户负向偏好研究日益重要。诸多平台引入显式负反馈机制,并利用此类信号优化推荐模型。除传统业务指标外,负反馈率等以用户体验为导向的指标已成为评估系统性能的关键。然而,现有方法多将负反馈作为辅助信号用于增强正向推荐,极少直接建模负向兴趣,而后者在离线场景中极具价值。此外,负反馈数据固有的稀疏性导致模型易受正向反馈主导的上下文偏差影响。为此,我们提出首个基于大语言模型的负反馈建模框架,包含特制的上下文辨识模块。采用语义ID表示替代文本项描述,并引入项级对齐任务以增强大模型对负反馈背后语义上下文的理解。同时,设计渐进式GRPO训练范式,使模型能动态平衡正负行为上下文的使用。进一步研究发现,传统‘预测下一个负向项目’目标与用户真实负向偏好存在根本性错位,该错位受推荐顺序显著影响。为缓解此问题,我们提出基于多日未来负反馈及其协同信号的新奖励函数与评估指标。
原文摘要 · Abstract (English)
Understanding what users like is relatively straightforward; understanding what users dislike, however, remains a challenging and underexplored problem. Research into users' negative preferences has gained increasing importance in modern recommendation systems. Numerous platforms have introduced explicit negative feedback mechanisms and leverage such signals to refine their recommendation models. Beyond traditional business metrics, user experience-driven metrics, such as negative feedback rates, have become critical indicators for evaluating system performance. However, most existing approaches primarily use negative feedback as an auxiliary signal to enhance positive recommendations, paying little attention to directly modeling negative interests, which can be highly valuable in offline applications. Moreover, due to the inherent sparsity of negative feedback data, models often suffer from context understanding biases induced by positive feedback dominance. To address these challenges, we propose the first large language model framework for negative feedback modeling with special designed context-discerning modules. We use semantic ID Representation to replace text-based item descriptions and introduce an item-level alignment task that enhances the LLM's understanding of the semantic context behind negative feedback. Furthermore, we design a Progressive GRPO training paradigm that enables the model to dynamically balance the positive and negative behavioral context utilization. Besides, our investigation further reveals a fundamental misalignment between the conventional next-negative-item prediction objective and users' true negative preferences, which is heavily influenced by the system's recommendation order. To mitigate this, we propose a novel reward function and evaluation metric grounded in multi-day future negative feedback and their collaborative signals.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。