让图像每块自动匹配专用专家,提升零样本异常检测能力
MoECLIP: Patch-Specialized Experts for Zero-shot Anomaly Detection
- 按图像块特征动态分配专用低秩专家进行适应
- 14个工业与医疗数据集上均超越现有最佳方法
- 适合需要高精度零样本异常检测的工业质检场景
CLIP模型强大的泛化能力推动了零样本异常检测(ZSAD)的发展,使其能够检测未见类别中的异常。ZSAD的核心挑战是在保持CLIP强大泛化能力的同时,使模型专用于异常检测任务。现有方法普遍采用不区分图像块的统一处理方式,缺乏对各块独特特性的建模。为此,我们提出MoECLIP,一种面向ZSAD任务的混合专家(MoE)架构,通过动态路由机制将每个图像块根据其特征分配给特定的低秩适配(LoRA)专家,实现像素级适应。为避免专家间功能冗余,我们引入(1)冻结正交特征分离(FOFS),在输入特征空间中强制专家关注不同信息;(2)单纯形等角紧框架(ETF)损失,约束专家输出形成最大等角表示。在涵盖工业与医疗领域的14个基准数据集上的实验表明,MoECLIP显著优于现有最先进方法。代码已公开于https://github.com/CoCoRessa/MoECLIP。
原文摘要 · Abstract (English)
The CLIP model's outstanding generalization has driven recent success in Zero-Shot Anomaly Detection (ZSAD) for detecting anomalies in unseen categories. The core challenge in ZSAD is to specialize the model for anomaly detection tasks while preserving CLIP's powerful generalization capability. Existing approaches attempting to solve this challenge share the fundamental limitation of a patch-agnostic design that processes all patches monolithically without regard for their unique characteristics. To address this limitation, we propose MoECLIP, a Mixture-of-Experts (MoE) architecture for the ZSAD task, which achieves patch-level adaptation by dynamically routing each image patch to a specialized Low-Rank Adaptation (LoRA) expert based on its unique characteristics. Furthermore, to prevent functional redundancy among the LoRA experts, we introduce (1) Frozen Orthogonal Feature Separation (FOFS), which orthogonally separates the input feature space to force experts to focus on distinct information, and (2) a simplex equiangular tight frame (ETF) loss to regulate the expert outputs to form maximally equiangular representations. Comprehensive experimental results across 14 benchmark datasets spanning industrial and medical domains demonstrate that MoECLIP outperforms existing state-of-the-art methods. The code is available at https://github.com/CoCoRessa/MoECLIP.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。