让样本竞争进化,提升模型对难样本和噪声样本的适应能力
Evolution-Inspired Sample Competition for Deep Neural Network Optimization

- 通过构建样本组并计算竞争得分,动态调整损失权重
- 在12个公开数据集上显著改善分类性能,尤其在难样本上表现更优
- 无需特定任务假设,适配多种网络结构,通用性强
传统深度网络训练通常采用统一的学习范式优化所有样本,未显式建模样本间的异质性竞争。这种简化处理易引发类别不平衡下的偏差、难样本学习不足及噪声样本被错误强化等问题。本文提出一种受进化启发的优化方法——自然选择(Natural Selection, NS),将竞争机制引入深度网络训练。NS首先将多个样本组合成复合图像并恢复至原始输入尺寸进行模型推理,基于预测结果计算每个样本的相对竞争变化得分,进而动态重加权样本损失,实现竞争驱动的优化。该方法无需依赖预设规则或静态标准,提供了一种简单而有效的非均匀样本处理方式。在四个图像分类任务的12个公开数据集上的大量实验表明,该方法有效提升模型性能,且兼容多种网络架构,不依赖任务特异性假设,具备强通用性与实用潜力。代码将公开。
原文摘要 · Abstract (English)
Conventional deep network training generally optimizes all samples under a largely uniform learning paradigm, without explicitly modeling the heterogeneous competition among them. Such an oversimplified treatment can lead to several well-known issues, including bias under class imbalance, insufficient learning of hard samples, and the erroneous reinforcement of noisy samples. In this work, we present \textit{Natural Selection} (NS), a novel evolution-inspired optimization method that explicitly incorporates competitive interactions into deep network training. Unlike conventional sample reweighting strategies that rely mainly on predefined heuristics or static criteria, NS estimates the competitive status of each sample in a group-wise context and uses it to adaptively regulate its training contribution. Specifically, NS first assembles multiple samples into a composite image and rescales it to the original input size for model inference. Based on the resulting predictions, a natural selection score is computed for each sample to characterize its relative competitive variation within the constructed group. These scores are then used to dynamically reweight the sample-wise loss, thereby introducing an explicit competition-driven mechanism into the optimization process. In this way, NS provides a simple yet effective means of moving beyond uniform sample treatment and enables more adaptive and balanced model optimization. Extensive experiments on 12 public datasets across four image classification tasks demonstrate the effectiveness of the proposed method. Moreover, NS is compatible with diverse network architectures and does not depend on task-specific assumptions, indicating its strong generality and practical potential. The code will be made publicly available.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。