arXiv:2603.02629cs.CV2026-03被引 4

解决多模态异常检测中新增类别时遗忘旧知识的问题

Towards an Incremental Unified Multimodal Anomaly Detection: Augmenting Multimodal Denoising From an Information Bottleneck Perspective

  • 用信息瓶颈机制过滤冗余特征,减少误判干扰
  • 结合Mamba解码器分离物体间特征耦合,防止误关联
  • 在3D-AD和Eyecandies数据集上表现优于传统方法

实现增量式统一多模态异常检测的关键在于让单一模型具备跨类别系统性检测能力,并支持增量学习以适应新出现的物体或类别。核心挑战是克服灾难性遗忘——在获取新知识的同时保留已有知识。尽管已有研究尝试解决此问题,但普遍忽视了虚假与冗余特征对遗忘的负面影响。本文深入分析此类特征在增量统一框架中的负面作用,发现仅通过简单聚合单模态架构构建的多模态框架更易发生遗忘。为此,提出新型去噪框架IB-IUMAD,融合Mamba解码器与信息瓶颈融合模块:前者用于解耦对象间特征关联,避免不同物体间的虚假特征干扰;后者则从融合特征中剔除冗余信息,显式保留判别性特征。在MVTec 3D-AD与Eyecandies数据集上的理论分析与实验表明,IB-IUMAD具有优异的有效性与竞争力。

原文摘要 · Abstract (English)

The quest for incremental unified multimodal anomaly detection seeks to empower a single model with the ability to systematically detect anomalies across all categories and support incremental learning to accommodate emerging objects/categories. Central to this pursuit is resolving the catastrophic forgetting dilemma, which involves acquiring new knowledge while preserving prior learned knowledge. Despite some efforts to address this dilemma, a key oversight persists: ignoring the potential impact of spurious and redundant features on catastrophic forgetting. In this paper, we delve into the negative effect of spurious and redundant features on this dilemma in incremental unified frameworks, and reveal that under similar conditions, the multimodal framework developed by naive aggregation of unimodal architectures is more prone to forgetting. To address this issue, we introduce a novel denoising framework called IB-IUMAD, which exploits the complementary benefits of the Mamba decoder and information bottleneck fusion module: the former dedicated to disentangle inter-object feature coupling, preventing spurious feature interference between objects; the latter serves to filter out redundant features from the fused features, thus explicitly preserving discriminative information. A series of theoretical analyses and experiments on MVTec 3D-AD and Eyecandies datasets demonstrates the effectiveness and competitive performance of IB-IUMAD.

异常检测多模态增量学习信息瓶颈

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。