通过分析训练日志优化数据筛选,显著降低重识别任务的训练成本
Data Pruning Can Do More: A Comprehensive Data Pruning Approach for Object Re-identification
- 利用训练过程中的置信度历史评估样本重要性,更精准判断数据价值
- 在多个重识别数据集上删减30%以上样本或训练时间,精度损失低于0.1%
- 支持即插即用,可自动识别错误标签和异常样本,适合大规模重识别项目
以往研究证明训练数据中并非每个样本都同等重要。数据剪枝旨在移除低价值样本,同时保持与完整数据训练相当的性能,从而降低存储和训练开销。然而,现有剪枝方法多集中于图像分类任务。本文首次系统探索剪枝方法在目标重识别(ReID)任务中的可行性,并提出更全面的数据剪枝框架。通过充分挖掘训练过程中的logit历史,该方法不仅提供更准确的样本重要性度量,还能修正误标样本并识别异常值。此外,该方法效率极高,重要性评分计算成本较现有方法降低10倍。作为即插即用、架构无关的框架,可在VeRi、MSMT17和Market1501数据集上分别剔除35%、30%和5%的样本或训练时间,精度损失小于0.1%。相关重要样本、误标样本及异常样本列表已公开于https://github.com/Zi-Y/data-pruning-reid。
原文摘要 · Abstract (English)
Previous studies have demonstrated that not each sample in a dataset is of equal importance during training. Data pruning aims to remove less important or informative samples while still achieving comparable results as training on the original (untruncated) dataset, thereby reducing storage and training costs. However, the majority of data pruning methods are applied to image classification tasks. To our knowledge, this work is the first to explore the feasibility of these pruning methods applied to object re-identification (ReID) tasks, while also presenting a more comprehensive data pruning approach. By fully leveraging the logit history during training, our approach offers a more accurate and comprehensive metric for quantifying sample importance, as well as correcting mislabeled samples and recognizing outliers. Furthermore, our approach is highly efficient, reducing the cost of importance score estimation by 10 times compared to existing methods. Our approach is a plug-and-play, architecture-agnostic framework that can eliminate/reduce 35%, 30%, and 5% of samples/training time on the VeRi, MSMT17 and Market1501 datasets, respectively, with negligible loss in accuracy (< 0.1%). The lists of important, mislabeled, and outlier samples from these ReID datasets are available at https://github.com/Zi-Y/data-pruning-reid.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。