arXiv:2602.07206cs.LGcs.AI2026-02

提出DSL模型,让推荐系统自动调节软标签损失的锐度以应对负样本竞争差异。

DSL: Understanding and Improving Softmax Recommender Systems with Competition-Aware Scaling

  • 根据负样本难易度和相似性重加权,动态调整每条训练数据的负样本权重。
  • 基于构建的竞争者名单自适应调整每个样本的温度参数,提升训练稳定性。
  • 在多种数据集上比标准软标签损失平均提升6.22%,尤其在分布外场景表现更优。

Softmax Loss(SL)在推荐系统中日益流行,因其表现出更优性能、鲁棒性和公平性。然而,在隐式反馈场景下,单一全局温度及对均匀采样负样本的同等处理可能导致训练脆弱,因为采样集中的相关或信息性竞争者程度不一。特定负样本组合下的最优损失锐度,可能对另一组负样本而言过强或失稳。本文提出双尺度软标签损失(DSL),通过采样竞争本身推断有效锐度。DSL在对数求和指数主干基础上增加两个互补分支:一是利用难度与物品间相似性重加权每个训练实例内的负样本;二是基于构造的竞争者名单上的竞争强度,自适应调整每个样本的温度。二者共同在保持SL几何结构的同时,重塑负样本及样本间的竞争分布。在多个代表性基准和主干模型上,DSL显著优于强基线,在部分设置中超越SL超过10%,跨数据集、指标和主干平均提升6.22%。在分布外(OOD)流行度偏移场景下,平均改进达9.31%。进一步提供理论分析,采用分布鲁棒优化(DRO)框架,揭示了DSL如何重塑模糊样本的鲁棒收益与KL偏差,解释了其在准确率与鲁棒性上的实证提升。

原文摘要 · Abstract (English)

Softmax Loss (SL) is being increasingly adopted for recommender systems (RS) as it has demonstrated better performance, robustness and fairness. Yet in implicit-feedback, a single global temperature and equal treatment of uniformly sampled negatives can lead to brittle training, because sampled sets may contain varying degrees of relevant or informative competitors. The optimal loss sharpness for a user-item pair with a particular set of negatives, can be suboptimal or destabilising for another with different negatives. We introduce Dual-scale Softmax Loss (DSL), which infers effective sharpness from the sampled competition itself. DSL adds two complementary branches to the log-sum-exp backbone. Firstly it reweights negatives within each training instance using hardness and item--item similarity, secondly it adapts a per-example temperature from the competition intensity over a constructed competitor slate. Together, these components preserve the geometry of SL while reshaping the competition distribution across negatives and across examples. Over several representative benchmarks and backbones, DSL yields substantial gains over strong baselines, with improvements over SL exceeding $10%$ in several settings and averaging $6.22%$ across datasets, metrics, and backbones. Under out-of-distribution (OOD) popularity shift, the gains are larger, with an average of $9.31%$ improvement over SL. We further provide a theoretical, distributionally robust optimisation (DRO) analysis, which demonstrates how DSL reshapes the robust payoff and the KL deviation for ambiguous instances. This helps explain the empirically observed improvements in accuracy and robustness.

推荐系统软标签鲁棒性优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。