区分数据边界与核心,智能增删样本提升模型性能
Oversampling and Downsampling with Core-Boundary Awareness: A Data Quality-Driven Approach
- 按数据重要性分层:识别边界关键样本与核心冗余样本
- 边界增广使F1提升最高10%,核心压缩可减90%数据量
- 适用于大模型训练等高效学习场景,显著节省计算资源
机器学习模型在处理类别不平衡问题时,常因无法区分决策边界附近的敏感样本与数据分布核心的冗余样本而表现受限。本文提出一种系统化方法,用于识别并区分这两类数据。在多个基准数据集上的大量实验表明,边界样本增广可使F1分数在96%的数据集上提升最高10%;而核心感知的降采样方法可将数据集压缩高达90%的同时保持准确率,效率是原始数据集的10倍。该方法不仅适用于不平衡分类,还对计算成本高的任务(如大型语言模型训练)具有广泛意义。通过优先选择高质量、决策相关数据,本方法可推广至文本、多模态及自监督学习场景,实现更快收敛、更好泛化和显著计算节约。本研究为数据高效学习开辟新路径,以智能采样取代盲目扩充,推动下一代AI发展。代码已发布于PyPI:https://pypi.org/project/adaptive-resampling/
原文摘要 · Abstract (English)
The effectiveness of machine learning models, particularly in unbalanced classification tasks, is often hindered by the failure to differentiate between critical instances near the decision boundary and redundant samples concentrated in the core of the data distribution. In this paper, we propose a method to systematically identify and differentiate between these two types of data. Through extensive experiments on multiple benchmark datasets, we show that the boundary data oversampling method improves the F1 score by up to 10\% on 96\% of the datasets, whereas our core-aware reduction method compresses datasets up to 90\% while preserving their accuracy, making it 10 times more powerful than the original dataset. Beyond imbalanced classification, our method has broader implications for efficient model training, particularly in computationally expensive domains such as Large Language Model (LLM) training. By prioritizing high-quality, decision-relevant data, our approach can be extended to text, multimodal, and self-supervised learning scenarios, offering a pathway to faster convergence, improved generalization, and significant computational savings. This work paves the way for future research in data-efficient learning, where intelligent sampling replaces brute-force expansion, driving the next generation of AI advancements. Our code is available as a Python package at https://pypi.org/project/adaptive-resampling/ .
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。