arXiv:2608.04210cs.CV2026-08中稿 · ECCV

无需3D重建,用视觉变压器实现任意视角下的异常检测

PADFormer: Pose-agnostic Anomaly Detection from Sparse View Images

论文配图:PADFormer: Pose-agnostic Anomaly Detection from Sparse View Images
图 1 · 摘自论文原文
  • 直接在图像空间利用ViT重构正常图像,保持姿态信息
  • 仅用正常数据训练,通过动态选块与空间对齐应对稀疏视角
  • 多掩码推理生成多版本重建图,适合工业质检等场景

姿态无关异常检测(PAD)面临挑战,因异常可能出现在任意视角下,需处理显著的姿态变化。现有方法依赖复杂的3D重建,计算开销大且需大量多视角数据。本文提出PADFormer,一种新颖的图像空间方法,利用视觉变换器(ViT)直接重构查询图像的无异常版本,同时保留姿态信息。核心思想是仅用正常数据训练,通过跨视图掩码重建、动态补丁选择和空间对齐机制,在显著姿态变化下从稀疏参考视图有效学习。推理时,采用不同掩码模式多次前向传播,生成一组无异常重建结果,实现对查询图像的全面覆盖。异常通过比较重建结果与原图判定。PADFormer在PAD基准上达到当前最优性能,且在经典少样本异常检测(FSAD)任务上表现相当,展现出卓越效率与泛化能力,无需3D重建。

原文摘要 · Abstract (English)

Pose-agnostic Anomaly Detection (PAD) remains challenging as anomalies can appear under arbitrary viewpoints, requiring methods to handle significant pose variations. Existing approaches rely on complex 3D reconstruction, which are computationally expensive and require extensive multi-view data. We propose PADFormer, a novel image-space approach that leverages Vision Transformer (ViT) to directly reconstruct anomaly-free versions of query images while preserving pose information. Our key insight is to adapt cross-view masked reconstruction for anomaly detection through training exclusively on normal data, combined with dynamic patch selection and spatial alignment mechanisms that enable effective learning from sparse reference views under significant pose variations. During inference, we perform multiple forward passes with different masking patterns to generate an ensemble of anomaly-free reconstructions, ensuring comprehensive coverage of the query image. Anomalies are detected by comparing these reconstructions with the query image. PADFormer achieves state-of-the-art results on the PAD benchmark while maintaining comparable performance on classic few-shot anomaly detection (FSAD) tasks, demonstrating superior efficiency and generalization without requiring 3D reconstruction.

异常检测视觉变压器姿态不变少样本

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。