自动为多模态数据选最适合的异常检测模型。
M3OOD: Automatic Selection of Multimodal OOD Detectors
- 用元学习分析历史表现,自动选最优检测器。
- 12种场景下均超越10个基线方法,开销极小。
- 适合部署在视频、音频等多模态系统中。
分布外(OOD)鲁棒性是现代机器学习系统的关键挑战,尤其在涉及视频、音频和传感器数据等多模态场景中愈发突出。现有众多OOD检测方法针对不同分布偏移设计,单一检测器难以适应所有情况。由于OOD检测任务本质无监督,难以预测模型性能,也难以系统性地在新数据上评估。为此,我们提出M3OOD——一种基于元学习的多模态OOD检测器选择框架。该框架结合多模态嵌入与人工设计的元特征,捕捉数据分布和跨模态特性,通过历史在多样化多模态基准上的表现,推荐适用于新分布偏移的检测器。实验表明,M3OOD在12个测试场景中持续优于10个竞争基线,计算开销极低。
原文摘要 · Abstract (English)
Out-of-distribution (OOD) robustness is a critical challenge for modern machine learning systems, particularly as they increasingly operate in multimodal settings involving inputs like video, audio, and sensor data. Currently, many OOD detection methods have been proposed, each with different designs targeting various distribution shifts. A single OOD detector may not prevail across all the scenarios; therefore, how can we automatically select an ideal OOD detection model for different distribution shifts? Due to the inherent unsupervised nature of the OOD detection task, it is difficult to predict model performance and find a universally Best model. Also, systematically comparing models on the new unseen data is costly or even impractical. To address this challenge, we introduce M3OOD, a meta-learning-based framework for OOD detector selection in multimodal settings. Meta learning offers a solution by learning from historical model behaviors, enabling rapid adaptation to new data distribution shifts with minimal supervision. Our approach combines multimodal embeddings with handcrafted meta-features that capture distributional and cross-modal characteristics to represent datasets. By leveraging historical performance across diverse multimodal benchmarks, M3OOD can recommend suitable detectors for a new data distribution shift. Experimental evaluation demonstrates that M3OOD consistently outperforms 10 competitive baselines across 12 test scenarios with minimal computational overhead.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。