用超图建模图像关系,让模型理解整体是否正常。
Hypergraph Normal World Models for Logical Visual Anomaly Detection

- 用超图捕捉图像中局部块的复杂关系,构建正常世界模型。
- 在早餐盒数据集上逻辑异常检测AUROC达0.9279,优于基线0.8434。
- 适合关注整体结构异常的工业质检场景,尤其小样本下仍有效。
视觉异常检测通常仅使用正常图像训练。主流单类检测器将测试图像块映射到正常分布,适用于局部结构缺陷。但逻辑异常不同:各部分看似正常,整体却违反正常数量、共现或空间关系。本文研究仅凭正常图像能否学习此类特定正常世界。提出超图正常世界模型,将冻结的DINOv2图像块特征提炼为块、关系和超图统计量,构建块组间的空间超边。通过信息商评分,分离局部、关系、超边及超边-关系证据。在MVTec LOCO早餐盒验证数据集上,完整超图模型将逻辑异常检测的AUROC从DINOv2 patch-kNN的0.8434提升至0.9279,优于非超图变体(0.9013→0.9279)。少样本实验显示模型在极少量正常图像下仍有效。t-SNE显示逻辑异常在学习的能量空间中可分离;关系反事实使信息商平均上升83.13;随机超图降低逻辑异常AUROC,且超边归因在逻辑异常上显著更高。定性示例表明高分由关系项驱动。结果表明,逻辑视觉异常检测应建模正常关系,而不仅是正常局部块。
原文摘要 · Abstract (English)
Visual anomaly detection is often deployed with only normal training images. Most one-class detectors map test patches or features to a normal reference distribution. This works well for local structural defects. Logical anomalies are different. Each visible part may look normal, while the whole image violates a normal count, co-occurrence, or spatial relation. This paper studies whether a model can learn such a category-specific normal world from nominal images alone. We propose the Hypergraph Normal World Model, a normal-only detector that distills frozen DINOv2 patch tokens into patch, relation, and hypergraph statistics. It builds spatial hyperedges over token groups. It then scores each test image with an information quotient that separates local, relational, hyperedge, and hyperedge-relation evidence. On the available MVTec LOCO breakfast-box validation data, the full hypergraph model improves logical anomaly AUROC from 0.8434 for DINOv2 patch-kNN to 0.9279. It also improves over the non-hypergraph variant, from 0.9013 to 0.9279. Few-shot experiments show that the model remains effective with very limited normal images. We also test whether the score reflects normal-world knowledge rather than a shallow mapping. t-SNE separates logical anomalies in the learned energy space. Relation counterfactuals increase the information quotient by 83.13 on average. Random hypergraphs reduce logical AUROC, and hyperedge attribution is much larger on logical anomalies. Qualitative examples show that high scores are driven by relation-bearing terms. These results suggest that logical visual anomaly detection should model normal relations, not only normal local patches.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。