提出两个真实光学模糊数据集,评估模型在真实模糊下的鲁棒性。
Examining the Impact of Optical Aberrations to Image Classification and Object Detection Models
- 基于泽尼克多项式构建两类真实模糊数据集
- 不同模型在新数据集上表现差异显著,最高下降超20%
- 适合研究视觉模型对真实光学畸变的鲁棒性
深度神经网络在计算机视觉中广泛应用,甚至用于安全关键场景。因此,视觉模型需对噪声、模糊等干扰具备鲁棒性。现有基准多以简化方式模拟模糊,忽略光学系统产生的多样模糊核形状。本文提出两个模糊数据集:OpticsBench针对彗差、散焦、像散等初级像差(由泽尼克多项式单参数控制);LensCorruptions通过泽尼克多项式线性组合生成100种真实镜头的模糊模式。在ImageNet和MSCOCO上对多种预训练模型进行评估,结果表明模型在新数据集上的性能波动显著,部分任务准确率下降超过20%,说明必须引入真实图像退化来评估模型对模糊的鲁棒性。
原文摘要 · Abstract (English)
Deep neural networks (DNNs) have proven to be successful in various computer vision applications such that models even infer in safety-critical situations. Therefore, vision models have to behave in a robust way to disturbances such as noise or blur. While seminal benchmarks exist to evaluate model robustness to diverse corruptions, blur is often approximated in an overly simplistic way to model defocus, while ignoring the different blur kernel shapes that result from optical systems. To study model robustness against realistic optical blur effects, this paper proposes two datasets of blur corruptions, which we denote OpticsBench and LensCorruptions. OpticsBench examines primary aberrations such as coma, defocus, and astigmatism, i.e. aberrations that can be represented by varying a single parameter of Zernike polynomials. To go beyond the principled but synthetic setting of primary aberrations, LensCorruptions samples linear combinations in the vector space spanned by Zernike polynomials, corresponding to 100 real lenses. Evaluations for image classification and object detection on ImageNet and MSCOCO show that for a variety of different pre-trained models, the performance on OpticsBench and LensCorruptions varies significantly, indicating the need to consider realistic image corruptions to evaluate a model's robustness against blur.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。