通过几何对齐提升多视角异常检测准确率,减少误报。
Unsupervised Multi-View Visual Anomaly Detection via Progressive Homography-Guided Alignment
- 用单应性矩阵对齐多视角特征,建模视角不变表示。
- 在扩散模型中分阶段对齐,实现从粗到细的表面理解。
- 适合处理大视角变化和复杂纹理的工业缺陷检测。
无监督多视角视觉异常检测面临的核心挑战是区分真实缺陷与由视角变化引起的正常外观差异。现有方法多针对单视角设计,将多视角视为孤立图像,导致特征表示不一致且误报率高。为此,我们提出ViewSense-AD(VSAD)框架,通过显式建模多视角间的几何一致性,学习视角不变表示。核心是多视角对齐模块(MVAM),利用单应性将相邻视图的对应特征区域投影并对齐。我们将MVAM集成到视图对齐潜空间扩散模型(VALDM)中,在去噪过程中实现渐进式多阶段对齐,从而从粗到细构建物体表面的连贯整体理解。此外,轻量级融合精修模块(FRM)增强对齐特征的全局一致性,抑制噪声并提升判别力。异常检测通过对比扩散模型的多层级特征与正常原型的记忆库完成。在具有挑战性的RealIAD和MANTA数据集上的大量实验表明,VSAD达到新最优性能,显著优于现有方法,在像素、视图和样本级别均表现优异,证明其对大视角偏移和复杂纹理的鲁棒性。
原文摘要 · Abstract (English)
Unsupervised visual anomaly detection from multi-view images presents a significant challenge: distinguishing genuine defects from benign appearance variations caused by viewpoint changes. Existing methods, often designed for single-view inputs, treat multiple views as a disconnected set of images, leading to inconsistent feature representations and a high false-positive rate. To address this, we introduce ViewSense-AD (VSAD), a novel framework that learns viewpoint-invariant representations by explicitly modeling geometric consistency across views. At its core is our Multi-View Alignment Module (MVAM), which leverages homography to project and align corresponding feature regions between neighboring views. We integrate MVAM into a View-Align Latent Diffusion Model (VALDM), enabling progressive and multi-stage alignment during the denoising process. This allows the model to build a coherent and holistic understanding of the object's surface from coarse to fine scales. Furthermore, a lightweight Fusion Refiner Module (FRM) enhances the global consistency of the aligned features, suppressing noise and improving discriminative power. Anomaly detection is performed by comparing multi-level features from the diffusion model against a learned memory bank of normal prototypes. Extensive experiments on the challenging RealIAD and MANTA datasets demonstrate that VSAD sets a new state-of-the-art, significantly outperforming existing methods in pixel, view, and sample-level visual anomaly proving its robustness to large viewpoint shifts and complex textures.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。