MVTec AD 2 新数据集挑战工业异常检测,推动领域突破性能瓶颈。
The MVTec AD 2 Dataset: Advanced Scenarios for Unsupervised Anomaly Detection
- 构建8个高难度工业检测场景,含透明/重叠物体、微小缺陷等新挑战
- 顶尖模型平均分割AU-PRO仍低于60%,反映真实检测难题
- 支持光照变化测试,适合评估模型在真实分布偏移下的鲁棒性
近年来,MVTec AD和VisA等现有异常检测基准的分割AU-PRO性能已趋于饱和,顶尖模型间差异不足1个百分点,难以有效区分模型优劣,阻碍领域进展,尤其受机器学习结果固有随机性影响。我们提出MVTec AD 2,包含8个异常检测场景,超过8000张高分辨率图像,涵盖以往数据集中未涉及的复杂工业检测用例,如透明与重叠物体、暗场与背光照明、正常样本高变异性及极小缺陷。我们对前沿方法进行全面评估,结果显示其平均AU-PRO仍低于60%。此外,数据集提供光照条件变化的测试场景,用于评估模型在真实世界分布偏移下的鲁棒性。评测服务器公开像素级真值(https://benchmark.mvtec.com/),全部图像数据可访问(https://www.mvtec.com/company/research/datasets/mvtec-ad-2)。
原文摘要 · Abstract (English)
In recent years, performance on existing anomaly detection benchmarks like MVTec AD and VisA has started to saturate in terms of segmentation AU-PRO, with state-of-the-art models often competing in the range of less than one percentage point. This lack of discriminatory power prevents a meaningful comparison of models and thus hinders progress of the field, especially when considering the inherent stochastic nature of machine learning results. We present MVTec AD 2, a collection of eight anomaly detection scenarios with more than 8000 high-resolution images. It comprises challenging and highly relevant industrial inspection use cases that have not been considered in previous datasets, including transparent and overlapping objects, dark-field and back light illumination, objects with high variance in the normal data, and extremely small defects. We provide comprehensive evaluations of state-of-the-art methods and show that their performance remains below 60% average AU-PRO. Additionally, our dataset provides test scenarios with lighting condition changes to assess the robustness of methods under real-world distribution shifts. We host a publicly accessible evaluation server that holds the pixel-precise ground truth of the test set (https://benchmark.mvtec.com/). All image data is available at https://www.mvtec.com/company/research/datasets/mvtec-ad-2.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。