让推荐模型学会表达不确定,提升稳定性和可靠性
Uncertainty-aware Generative Recommendation
- 用不确定性加权奖励,惩罚自信错误
- 动态调整学习难度,防止过早收敛
- 显式对齐置信度,适合风险敏感场景
生成式推荐将推荐任务重构为端到端的自回归序列生成。现有偏好优化方法多依赖二元正确性判断,存在‘不确定性盲视’问题:忽略模型生成信心、样本学习难度差异及置信度表达缺失,导致训练不稳定与决策风险不可量化。本文提出不确定性感知生成推荐(UGR),通过三重机制协同优化:(1) 不确定性加权奖励,惩罚高置信错误;(2) 难度感知优化动态,避免过早收敛;(3) 显式置信度对齐,赋予模型表达信心能力。大量实验表明,UGR不仅显著提升推荐性能,还从根本上稳定训练过程,缓解标准方法中常见的性能退化现象。此外,学习到的置信度可支持可靠的下游风险感知应用。
原文摘要 · Abstract (English)
Generative Recommendation has emerged as a transformative paradigm, reformulating recommendation as an end-to-end autoregressive sequence generation task. Despite its promise, existing preference optimization methods typically rely on binary outcome correctness, suffering from a systemic limitation we term uncertainty blindness. This issue manifests in the neglect of the model's intrinsic generation confidence, the variation in sample learning difficulty, and the lack of explicit confidence expression, directly leading to unstable training dynamics and unquantifiable decision risks. In this paper, we propose Uncertainty-aware Generative Recommendation (UGR), a unified framework that leverages uncertainty as a critical signal for adaptive optimization. UGR synergizes three mechanisms: (1) an uncertainty-weighted reward to penalize confident errors; (2) difficulty-aware optimization dynamics to prevent premature convergence; and (3) explicit confidence alignment to empower the model with confidence expression capabilities. Extensive experiments demonstrate that UGR not only yields superior recommendation performance but also fundamentally stabilizes training, preventing the performance degradation often observed in standard methods. Furthermore, the learned confidence enables reliable downstream risk-aware applications. Our project repository is available at: https://github.com/cxfann/UGR.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。