统一多模态多类别异常检测,用专家混合机制实现自适应重建。
UniMMAD: Unified Multi-Modal and Multi-Class Anomaly Detection via MoE-Driven Feature Decompression
- 采用MoE驱动的特征解压,按模态和类别动态选择专家路径。
- 在9个数据集上达到顶尖性能,66类异常检测准确率领先。
- 参数量减少75%,推理快且避免误报,适合跨领域部署。
现有异常检测方法通常将模态与类别视为独立因素,导致解决方案碎片化且内存开销大。基于重建的多类别方法普遍依赖共享解码路径,难以应对跨域巨大差异,造成正常边界扭曲、域间干扰和高误报率。为此,本文提出UniMMAD——一种统一的多模态多类别异常检测框架。核心是基于混合专家(MoE)的特征解压机制,实现针对特定域的自适应、解耦重建,遵循“从通用到具体”范式。编码阶段,多种模态组合输入被压缩为紧凑通用特征,通过特征压缩模块抑制潜在异常、促进跨模态交互并防止捷径学习。解码阶段,通用特征经稀疏门控交叉MoE分解为模态/类别特异性形式,动态选择专家路径。为进一步提升效率,设计分组动态过滤机制与MoE-in-MoE结构,参数量减少75%,保持稀疏激活与快速推理。UniMMAD在涵盖3个领域、12种模态、66类的9个异常检测数据集上取得当前最优性能。源代码将发布于https://github.com/yuanzhao-CVLAB/UniMMAD。
原文摘要 · Abstract (English)
Existing anomaly detection (AD) methods often treat the modality and class as independent factors. Although this paradigm has enriched the development of AD research branches and produced many specialized models, it has also led to fragmented solutions and excessive memory overhead. Moreover, reconstruction-based multi-class approaches typically rely on shared decoding paths, which struggle to handle large variations across domains, resulting in distorted normality boundaries, domain interference, and high false alarm rates. To address these limitations, we propose UniMMAD, a unified framework for multi-modal and multi-class anomaly detection. At the core of UniMMAD is a Mixture-of-Experts (MoE)-driven feature decompression mechanism, which enables adaptive and disentangled reconstruction tailored to specific domains. This process is guided by a ``general to specific'' paradigm. In the encoding stage, multi-modal inputs of varying combinations are compressed into compact, general-purpose features. The encoder incorporates a feature compression module to suppress latent anomalies, encourage cross-modal interaction, and avoid shortcut learning. In the decoding stage, the general features are decompressed into modality-specific and class-specific forms via a sparsely-gated cross MoE, which dynamically selects expert pathways based on input modality and class. To further improve efficiency, we design a grouped dynamic filtering mechanism and a MoE-in-MoE structure, reducing parameter usage by 75\% while maintaining sparse activation and fast inference. UniMMAD achieves state-of-the-art performance on 9 anomaly detection datasets, spanning 3 fields, 12 modalities, and 66 classes. The source code will be available at https://github.com/yuanzhao-CVLAB/UniMMAD.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。