arXiv:2409.05611cs.CVcs.AI2024-09被引 6

用动态路由和测试时自适应,提升异常检测对同类样本分布差异的鲁棒性。

Adapted-MoE: Mixture of Experts with Test-Time Adaption for Anomaly Detection

  • 通过路由网络将同类别样本分到不同子空间,实现多分布建模
  • 在纹理异常检测数据集上,I-AUROC提升2.18%-7.20%,P-AUROC提升1.57%-16.30%
  • 适合处理真实场景中正常样本分布多样、测试数据存在偏移的异常检测任务

基于正常样本表示的无监督异常检测方法近年取得显著进展。然而,现有方法仅学习单一决策边界,忽略了同一类别样本在真实世界中特征分布的多样性,也未考虑测试集与训练集间仍存在的分布偏移。为此,本文提出 Adapted-MoE,包含路由网络和一系列专家模型,通过分而治之的方式处理同类别样本的多重分布。具体地,设计基于表示学习的路由网络,将同类别样本分配至子类特征空间;随后,多个专家模型分别学习各类正常样本表示,构建多个独立决策边界。引入测试时自适应机制,消除未见测试样本表示与专家模型所学特征分布间的偏差。实验在提供三个类别多个子类别的纹理异常检测基准数据集上进行。结果表明,Adapted-MoE 显著提升基线模型性能,在 I-AUROC 上提升 2.18%-7.20%,在 P-AUROC 上提升 1.57%-16.30%,优于当前最先进方法。代码已开源。

原文摘要 · Abstract (English)

Most unsupervised anomaly detection methods based on representations of normal samples to distinguish anomalies have recently made remarkable progress. However, existing methods only learn a single decision boundary for distinguishing the samples within the training dataset, neglecting the variation in feature distribution for normal samples even in the same category in the real world. Furthermore, it was not considered that a distribution bias still exists between the test set and the train set. Therefore, we propose an Adapted-MoE which contains a routing network and a series of expert models to handle multiple distributions of same-category samples by divide and conquer. Specifically, we propose a routing network based on representation learning to route same-category samples into the subclasses feature space. Then, a series of expert models are utilized to learn the representation of various normal samples and construct several independent decision boundaries. We propose the test-time adaption to eliminate the bias between the unseen test sample representation and the feature distribution learned by the expert model. Our experiments are conducted on a dataset that provides multiple subclasses from three categories, namely Texture AD benchmark. The Adapted-MoE significantly improves the performance of the baseline model, achieving 2.18%-7.20% and 1.57%-16.30% increase in I-AUROC and P-AUROC, which outperforms the current state-of-the-art methods. Our code is available at https://github.com/.

异常检测MoE测试时自适应

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。