arXiv:2604.05632cs.CV2026-04

通过语义与几何对齐,提升多视角多模态缺陷检测精度。

SGANet: Semantic and Geometric Alignment for Multimodal Multi-view Anomaly Detection

  • 设计跨视角特征精炼与语义结构对齐模块,融合多源信息。
  • 在SiM3D和Eyecandies数据集上实现领先检测与定位性能。
  • 适合工业质检中复杂物体表面缺陷的自动化识别场景。

多视角异常检测旨在通过多角度观测识别复杂物体表面缺陷。现有无监督方法常因视角差异和模态不一致导致特征不统一。为此,本文提出语义与几何对齐网络(SGANet),一个统一的多模态多视角异常检测框架,通过联合建模语义对齐、结构一致性与全局几何对应,学习物理上一致的特征表示。SGANet包含三个核心模块:选择性跨视角特征精炼模块(SCFRM)有选择地聚合相邻视图中的有效块特征,增强跨视角交互;语义-结构块对齐(SSPA)在模态间强制语义对齐,同时保持视角变换下的结构一致性;多视角几何对齐(MVGA)进一步对齐跨视角的几何对应块。大量实验表明,该方法在SiM3D和Eyecandies数据集上均达到最优检测与定位效果,验证了其在真实工业场景中的有效性。

原文摘要 · Abstract (English)

Multi-view anomaly detection aims to identify surface defects on complex objects using observations captured from multiple viewpoints. However, existing unsupervised methods often suffer from feature inconsistency arising from viewpoint variations and modality discrepancies. To address these challenges, we propose a Semantic and Geometric Alignment Network (SGANet), a unified framework for multimodal multi-view anomaly detection that effectively combines semantic and geometric alignment to learn physically coherent feature representations across viewpoints and modalities. SGANet consists of three key components. The Selective Cross-view Feature Refinement Module (SCFRM) selectively aggregates informative patch features from adjacent views to enhance cross-view feature interaction. The Semantic-Structural Patch Alignment (SSPA) enforces semantic alignment across modalities while maintaining structural consistency under viewpoint transformations. The Multi-View Geometric Alignment (MVGA) further aligns geometrically corresponding patches across viewpoints. By jointly modeling feature interaction, semantic and structural consistency, and global geometric correspondence, SGANet effectively enhances anomaly detection performance in multimodal multi-view settings. Extensive experiments on the SiM3D and Eyecandies datasets demonstrate that SGANet achieves state-of-the-art performance in both anomaly detection and localization, validating its effectiveness in realistic industrial scenarios.

异常检测多视角多模态工业质检

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。