arXiv:2507.10904cs.LGcs.AI2025-07ICCV被引 3

针对难易样本按类别聚集的场景,提出比例化核心数据集选择方法。

Class-Proportional Coreset Selection for Difficulty-Separable Data

  • 按类别难度差异设计比例采样策略,避免忽略稀有但关键样本。
  • 在99%数据裁剪下,准确率仅降2.58%,优于传统方法4倍以上。
  • 特别适合医疗、网络安全等对误判敏感的高风险领域。

高质量训练数据对构建可靠高效的机器学习系统至关重要。单次核心数据集选择通过精简数据集同时保持甚至提升模型性能,常依赖基于训练动态的数据难度评分。然而,现有方法隐含假设各类数据难度一致,忽略了类别间难度差异。本文揭示在网络安全和医学影像等领域,数据难度常按类别聚集,提出类难度可分离性概念及量化指标CDSC。高CDSC值与无类别感知核心数据集方法性能下降相关,后者过度代表简单多数类而忽略稀有但信息丰富的少数类。为此,我们引入多种采样策略的类比例变体,在五个跨安全与医疗领域的数据集上持续取得最优表现。例如在CTU-13数据集上,极端99%裁剪率下,覆盖率导向核心数据集的比例版本(CCS-CP)仅导致准确率下降2.58%、精确率0.49%、召回率0.19%;相比之下,无类别感知的基线方法准确率下降7.59%、精确率4.57%、召回率4.11%。此外,激进裁剪在噪声大、不平衡、大规模数据中增强了泛化能力。结果表明,显式建模类难度可分离性能带来更有效、鲁棒且泛化的数据精简,尤其适用于高风险场景。

原文摘要 · Abstract (English)

High-quality training data is essential for building reliable and efficient machine learning systems. One-shot coreset selection addresses this by pruning the dataset while maintaining or even improving model performance, often relying on training-dynamics-based data difficulty scores. However, most existing methods implicitly assume class-wise homogeneity in data difficulty, overlooking variation in data difficulty across different classes. In this work, we challenge this assumption by showing that, in domains such as network intrusion detection and medical imaging, data difficulty often clusters by class. We formalize this as class-difficulty separability and introduce the Class Difficulty Separability Coefficient (CDSC) as a quantitative measure. We demonstrate that high CDSC values correlate with performance degradation in class-agnostic coreset methods, which tend to overrepresent easy majority classes while neglecting rare but informative ones. To address this, we introduce class-proportional variants of multiple sampling strategies. Evaluated on five diverse datasets spanning security and medical domains, our methods consistently achieve state-of-the-art performance. For instance, on CTU-13, at an extreme 99% pruning rate, a class-proportional variant of Coverage-centric Coreset Selection (CCS-CP) shows remarkable stability, with accuracy dropping only 2.58%, precision 0.49%, and recall 0.19%. In contrast, the class-agnostic CCS baseline, the next best method, suffers sharper declines of 7.59% in accuracy, 4.57% in precision, and 4.11% in recall. We further show that aggressive pruning enhances generalization in noisy, imbalanced, and large-scale datasets. Our results underscore that explicitly modeling class-difficulty separability leads to more effective, robust, and generalizable data pruning, particularly in high-stakes scenarios.

数据精简类别平衡核心集医疗图像

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。