arXiv:2601.10067cs.LGcs.IR2026-01被引 1

用噪声感知方法选小样本,1%数据达到95%训练效果

Efficient Content-based Recommendation Model Training via Noise-aware Coreset Selection

  • 基于梯度的子模优化选核心数据集,同时修正标签噪声
  • 仅用1%数据即恢复93-95%全量训练性能
  • 适合大规模推荐系统高效训练,尤其对抗数据噪声

基于内容的推荐系统(CRS)利用内容特征预测用户-项目交互,是帮助用户在信息密集的网络服务中导航的关键工具。然而,保证CRS有效性需要大规模甚至持续的模型训练以适应多样化用户偏好,带来显著的计算成本和资源消耗。一种有前景的解决方案是核心集选择(coreset selection),通过选取少量但具代表性的数据样本,在降低训练开销的同时保持模型质量。然而,所选核心集对用户-项目交互中的普遍噪声尤为敏感,尤其在规模极小时。为此,我们提出噪声感知核心集选择(NaCS)框架。NaCS通过基于训练梯度的子模优化构建核心集,并同时利用渐进式训练模型修正噪声标签。此外,通过不确定性量化过滤低置信度样本,避免使用不可靠的交互数据进行训练。大量实验表明,与现有方法相比,NaCS能生成更高质量的核心集并实现更高效率。值得注意的是,NaCS仅用1%的训练数据即可恢复93-95%的全数据集训练性能。源代码已公开于 https://github.com/chenxing1999/nacs。

原文摘要 · Abstract (English)

Content-based recommendation systems (CRSs) utilize content features to predict user-item interactions, serving as essential tools for helping users navigate information-rich web services. However, ensuring the effectiveness of CRSs requires large-scale and even continuous model training to accommodate diverse user preferences, resulting in significant computational costs and resource demands. A promising approach to this challenge is coreset selection, which identifies a small but representative subset of data samples that preserves model quality while reducing training overhead. Yet, the selected coreset is vulnerable to the pervasive noise in user-item interactions, particularly when it is minimally sized. To this end, we propose Noise-aware Coreset Selection (NaCS), a specialized framework for CRSs. NaCS constructs coresets through submodular optimization based on training gradients, while simultaneously correcting noisy labels using a progressively trained model. Meanwhile, we refine the selected coreset by filtering out low-confidence samples through uncertainty quantification, thereby avoid training with unreliable interactions. Through extensive experiments, we show that NaCS produces higher-quality coresets for CRSs while achieving better efficiency than existing coreset selection techniques. Notably, NaCS recovers 93-95\% of full-dataset training performance using merely 1\% of the training data. The source code is available at \href{https://github.com/chenxing1999/nacs}{https://github.com/chenxing1999/nacs}.

推荐系统核心集选择噪声鲁棒高效训练

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。