arXiv:2510.04375cs.LGcs.AI2025-10被引 2

动态调整损失权重,让冷门兴趣在推荐中不被淹没。

Adaptive Weighted Loss for Sequential Recommendations on Sparse Domains

  • 根据数据稀疏度自适应调节每类领域的损失权重
  • 在四个数据集上显著提升稀疏领域召回率与NDCG,提升超15%
  • 理论严谨且计算开销极小,适合实际部署

单模型序列推荐架构在稀疏或小众领域中对高活跃用户的效果常受限。此前的PinnerFormerLite虽采用固定加权损失优先处理特定领域,但单一权重难以应对极端稀疏领域——其训练信号易被大量通用数据稀释。本文提出一种数据驱动的动态加权损失函数,依据各领域训练数据的稀疏程度自适应调整权重:稀疏领域权重更高,密集领域权重更低,确保罕见兴趣仍能贡献有效梯度,避免被掩盖。我们提供了严格的理论分析,包括收敛性证明、复杂度分析与边界分析,验证方法的稳定性和高效性。在MovieLens、Amazon Electronics、Yelp Business、LastFM Music四个数据集上,对比SIGMA、CALRec、SparseEnNet等前沿基线,该动态加权机制显著优于所有方法,尤其在稀疏领域表现突出,Recall@10和NDCG@10均有显著提升,同时保持密集领域性能,并引入极小计算开销。

原文摘要 · Abstract (English)

The effectiveness of single-model sequential recommendation architectures, while scalable, is often limited when catering to "power users" in sparse or niche domains. Our previous research, PinnerFormerLite, addressed this by using a fixed weighted loss to prioritize specific domains. However, this approach can be sub-optimal, as a single, uniform weight may not be sufficient for domains with very few interactions, where the training signal is easily diluted by the vast, generic dataset. This paper proposes a novel, data-driven approach: a Dynamic Weighted Loss function with comprehensive theoretical foundations and extensive empirical validation. We introduce an adaptive algorithm that adjusts the loss weight for each domain based on its sparsity in the training data, assigning a higher weight to sparser domains and a lower weight to denser ones. This ensures that even rare user interests contribute a meaningful gradient signal, preventing them from being overshadowed. We provide rigorous theoretical analysis including convergence proofs, complexity analysis, and bounds analysis to establish the stability and efficiency of our approach. Our comprehensive empirical validation across four diverse datasets (MovieLens, Amazon Electronics, Yelp Business, LastFM Music) with state-of-the-art baselines (SIGMA, CALRec, SparseEnNet) demonstrates that this dynamic weighting system significantly outperforms all comparison methods, particularly for sparse domains, achieving substantial lifts in key metrics like Recall at 10 and NDCG at 10 while maintaining performance on denser domains and introducing minimal computational overhead.

序列推荐稀疏数据动态损失权重优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。