arXiv:2410.00713cs.CV2024-10被引 9

机器人拍摄的真实场景异常检测数据集,挑战现有方法在复杂条件下的泛化能力。

RAD: A Dataset and Benchmark for Real-Life Anomaly Detection with Robotic Observations

  • 用机械臂多视角拍摄5848张真实光照下物体图像,覆盖13类日常物品。
  • 2D特征方法在图像级检测中表现最好,3D重建对像素级定位更优但受反光和对称性影响。
  • 适合研究机器人视觉、工业质检及多视角异常检测的学者使用。

异常检测对机器人感知与工业质检至关重要,但现有基准大多在固定视角和稳定光照下采集,无法反映真实部署环境。本文提出RAD(Realistic Anomaly Detection),一个由机器人采集的多视角异常检测基准。RAD包含13类日常物体共5,848张RGB图像,每类物体从68个不同视角拍摄,使用Franka机械臂与RGB-D相机,在非受控光照条件下获取。数据涵盖划痕、缺失、污渍、挤压四种真实缺陷类型,并提供像素级标注用于定位。我们在测试视角未知的真实场景下,评估了代表性2D特征方法、3D重建流程及视觉语言模型。结果表明,传统2D特征嵌入方法在图像级检测中仍最可靠;3D方法在像素级定位上更具优势,但对反光材料、几何对称性和稀疏视角覆盖仍敏感;视觉语言模型在分类与定位任务中表现均不佳。RAD为鲁棒机器人质检提供了严苛评测平台,揭示了外观、几何与视角不确定性联合建模的开放问题。项目主页与代码已公开。

原文摘要 · Abstract (English)

Anomaly detection is essential for robotic perception and industrial inspection, yet most benchmarks are collected under controlled conditions with fixed viewpoints and stable illumination. These settings do not reflect robotic deployment, where camera pose, lighting, and surface reflectance vary continuously. We present RAD (Realistic Anomaly Detection), a robot-captured multi-view benchmark for pose-agnostic anomaly detection. RAD contains 5,848 RGB images from 13 everyday object categories, captured from 68 viewpoints per object with a Franka robotic arm and an RGB-D camera under uncontrolled lighting. The dataset covers four realistic defect types: scratched, missing, stained, and squeezed, with pixel-level annotations for localization. We benchmark representative 2D feature-based methods, 3D reconstruction pipelines, and vision-language models under a realistic setting in which test poses are unknown. Results show a clear gap between performance on conventional benchmarks and performance on RAD. Strong 2D feature-embedding methods remain the most reliable at image-level detection, whereas 3D approaches are more competitive for pixel-level localization but remain vulnerable to reflective materials, geometric symmetry, and sparse viewpoint coverage. Vision-language models perform poorly in both classification and localization. RAD provides a challenging testbed for robust robotic inspection and highlights open problems in jointly modeling appearance, geometry, and viewpoint uncertainty. Our website and code are available at https://chang-xinhai.github.io/rad-website/.

异常检测机器人视觉工业质检多视角

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。