系统评估图像数据质量对模型性能的影响,提出自动优化的数据清洗流程。
A Data-Centric Perspective on the Influence of Image Data Quality in Machine Learning Models
- 构建整合CleanVision与Fastdup的自动化数据清洗流水线,支持自动阈值选择。
- 发现模糊和严重降采样最影响模型表现,而卷积网络对部分失真较鲁棒。
- 在单/双扰动下F1提升至0.9468/0.8557,去重效果从0.4576升至0.7928。
机器学习研究长期聚焦于模型设计,对训练数据关注不足。随着模型架构趋于成熟,数据质量成为关键瓶颈。本文以公开且相对干净的CIFAKE数据集为基础,系统识别图像常见质量问题并量化其对训练的影响。在此基础上,整合社区工具CleanVision与Fastdup,分析其机制并提出改进:引入自动阈值选择,实现无需人工调参的问题图像检测。实验表明,不同质量缺陷影响各异——尽管卷积神经网络对部分失真具有鲁棒性,但对模糊、严重降采样等遮蔽关键视觉特征的退化极为敏感。将低质量图像检测建模为二分类任务,以F1分数评估。所提自动阈值法在单扰动下F1从0.6794升至0.9468,双扰动下从0.7447升至0.8557;去重策略使F1由0.4576提升至0.7928。结果验证了该工作流的有效性,为图像机器学习中的数据质量评估提供可扩展方案。
原文摘要 · Abstract (English)
In machine learning, research has traditionally focused on model development, with relatively less attention paid to training data. As model architectures have matured and marginal gains from further refinements diminish, data quality has emerged as a critical factor. However, systematic studies on evaluating and ensuring dataset quality in the image domain remain limited. This study investigates methods for systematically assessing image dataset quality and examines how various image quality factors influence model performance. Using the publicly available and relatively clean CIFAKE dataset, we identify common quality issues and quantify their impact on training. Building on these findings, we develop a pipeline that integrates two community-developed tools, CleanVision and Fastdup. We analyze their underlying mechanisms and introduce several enhancements, including automatic threshold selection to detect problematic images without manual tuning. Experimental results demonstrate that not all quality issues exert the same level of impact. While convolutional neural networks show resilience to certain distortions, they are particularly vulnerable to degradations that obscure critical visual features, such as blurring and severe downscaling. To assess the performance of existing tools and the effectiveness of our proposed enhancements, we formulate the detection of low-quality images as a binary classification task and use the F1 score as the evaluation metric. Our automatic thresholding method improves the F1 score from 0.6794 to 0.9468 under single perturbations and from 0.7447 to 0.8557 under dual perturbations. For near-duplicate detection, our deduplication strategy increases the F1 score from 0.4576 to 0.7928. These results underscore the effectiveness of our workflow and provide a foundation for advancing data quality assessment in image-based machine learning.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。