arXiv:2503.22375cs.CVeess.IV2025-03被引 6

研究图像质量对自动驾驶模型性能的影响,发现感知精度与图像失真高度相关。

Data Quality Matters: Quantifying Image Quality Impact on Machine Learning Performance

  • 构建配对图像数据集,系统量化压缩与虚拟化导致的图像偏差。
  • 发现图像失真越大,目标检测的框定位准确率越低,可靠性下降。
  • 提出用LPIPS度量图像质量,其与模型性能相关性最强,适合评估数据可信度。

高自动化驾驶系统依赖机器学习完成目标检测与分割等感知任务,而传感器数据压缩与硬件在环虚拟化常导致数据失真,影响模型表现。本文提出四步框架:首先构建含修改图像的配对数据集,确保一一对应;其次通过对比原始摄像头数据,量化压缩与虚拟化引起的图像偏差;第三分析先进目标检测模型性能,评估输入数据变化对边界框精度与可靠性的影响;最后进行相关性分析,发现所有任务中LPIPS指标与机器学习性能的相关性最高,表明其能有效反映图像质量对模型的影响。

原文摘要 · Abstract (English)

Precise perception of the environment is essential in highly automated driving systems, which rely on machine learning tasks such as object detection and segmentation. Compression of sensor data is commonly used for data handling, while virtualization is used for hardware-in-the-loop validation. Both methods can alter sensor data and degrade model performance. This necessitates a systematic approach to quantifying image validity. This paper presents a four-step framework to evaluate the impact of image modifications on machine learning tasks. First, a dataset with modified images is prepared to ensure one-to-one matching image pairs, enabling measurement of deviations resulting from compression and virtualization. Second, image deviations are quantified by comparing the effects of compression and virtualization against original camera-based sensor data. Third, the performance of state-of-the-art object detection models is analyzed to determine how altered input data affects perception tasks, including bounding box accuracy and reliability. Finally, a correlation analysis is performed to identify relationships between image quality and model performance. As a result, the LPIPS metric achieves the highest correlation between image deviation and machine learning performance across all evaluated machine learning tasks.

自动驾驶图像质量模型性能数据评估

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。