通过双流解耦提升少样本异常检测,融合3D几何与2D图像信息。
CMDS-AD: Cross-Modal Dual-Stream Decoupling for Few-Shot Anomaly Detection

- 设计双流架构:真实流与低频估计流分离高/低频特征。
- 1-shot下在MVTec 3D-AD上提升5.7% I-AUROC和2.0% AUPRO。
- 适合研究少样本异常检测、多模态融合的开发者和工程师。
少样本异常检测因训练数据稀缺而面临挑战。多模态异常检测(MAD)利用3D几何信息增强2D RGB表征,缓解数据不足问题。然而现有方法采用空间均匀特征处理,混淆了稳定的宏观结构与高频局部缺陷信号,加剧跨模态错位并提高误报率。为此,我们提出CMDS-AD框架:基于LoRA引导的扩散模型生成多样化的RGB样本以缓解极端数据稀缺;对于3D正常样本增强,使用预训练扩散模型作为正常估计器,其天然具备非线性低通滤波特性,可直接从RGB输入中提取低频正常表征,构建纯低频辅助流,锚定稳健结构模板,协助含高低频耦合成分的真实流精准分离微缺陷。同时,坐标感知分层特征映射器自适应对齐跨模态语义,乘法评分机制过滤模态特异性噪声。在极端1-shot设置下,CMDS-AD在MVTec 3D-AD上实现5.7%(I-AUROC)和2.0%(AUPRO)的绝对性能提升,于EyeCandies数据集上分别提升7.7%与5.6%,达到新基准。代码已开源。
原文摘要 · Abstract (English)
Few-shot anomaly detection remains challenging due to limited training data. Multi-modal anomaly detection (MAD) offers a viable solution, leveraging 3D geometric cues to enrich 2D RGB representations and compensate for this scarcity. However, existing MAD methods apply spatially uniform feature processing, conflating stable macroscopic structures with high-frequency localized defect signals, exacerbating cross-modal misalignment and inflating false-positive rates. To overcome this, we present CMDS-AD, a Cross-Modal Dual-Stream Anomaly Detection framework. A LoRA-guided diffusion model generates diverse RGB samples to mitigate extreme data scarcity. For 3D normal augmentation, we employ a pre-trained diffusion model as a normal estimator. Crucially, this estimator inherently acts as a non-linear low-pass filter, directly extracting low-frequency normal representations from RGB inputs. This establishes an auxiliary estimated stream of purely low-frequency information, anchoring robust structural templates and assisting the uncompressed real stream, containing coupled high- and low-frequency components, to precisely isolate micro-defects. A Coordinate-Aware Hierarchical Feature Mapper adaptively aligns cross-modal semantics, while a multiplicative scoring mechanism filters modality-specific noise. Under the extreme 1-shot setting, CMDS-AD achieves absolute performance gains of 5.7% (I-AUROC) and 2.0% (AUPRO) on MVTec 3D-AD, alongside 7.7% and 5.6% improvements on EyeCandies, establishing a new state-of-the-art. Code is available at https://github.com/Junhaocai27/CMDS-AD
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。