arXiv:2604.13252cs.LGcs.AI2026-04

多模态异常检测需基于上下文推理,避免误判正常变化为异常。

Out of Context: Reliability in Multimodal Anomaly Detection Requires Contextual Inference

论文配图:Out of Context: Reliability in Multimodal Anomaly Detection Requires Contextual Inference
图 1 · 摘自论文原文
  • 将多模态数据分为上下文与观测,区分环境变化与真实异常
  • 固定参考模型会因忽略上下文导致误报率上升
  • 适合部署于动态环境的工业监测系统

异常检测旨在识别偏离预期行为的观测。由于异常事件本身稀疏,多数框架仅用正常数据训练,学习单一无条件的正常参考模型。这隐含假设正常行为可由单一分布表征。然而现实中,异常常依赖上下文:同一观测在不同运行条件下可能正常或异常。随着机器学习系统在动态异构环境中部署,固定上下文假设引入结构性模糊——难以区分上下文变化与真实异常,导致性能不稳定、判断不可靠。尽管现代传感系统常采集多模态数据,反映系统行为与运行状态的互补信息,现有方法却等同处理所有数据流,未区分上下文信息与异常相关信号。结果是异常评估未显式依赖运行条件。我们主张将多模态异常检测重构为跨模态上下文推理问题,使模态角色不对称,分离上下文与观测,实现条件化异常定义而非全局参考。这一视角对模型设计、评估协议与基准构建均有影响,并指出了迈向鲁棒、上下文感知的多模态异常检测的开放挑战。

原文摘要 · Abstract (English)

Anomaly detection aims to identify observations that deviate from expected behavior. Because anomalous events are inherently sparse, most frameworks are trained exclusively on normal data to learn a single reference model of normality. This implicitly assumes that normal behavior can be captured by a single, unconditional reference distribution. In practice, however, anomalies are often context-dependent: A specific observation may be normal under one operating condition, yet anomalous under another. As machine learning systems are deployed in dynamic and heterogeneous environments, these fixed-context assumptions introduce structural ambiguity, i.e., the inability to distinguish contextual variation from genuine abnormality under marginal modeling, leading to unstable performance and unreliable anomaly assessments. While modern sensing systems frequently collect multimodal data capturing complementary aspects of both system behavior and operating conditions, existing methods treat all data streams equally, without distinguishing contextual information from anomaly-relevant signals. As a result, abnormality is often evaluated without explicitly conditioning on operating conditions. We argue that multimodal anomaly detection should be reframed as a cross-modal contextual inference problem, in which modalities play asymmetric roles, separating context from observation, to define abnormality conditionally rather than relative to a single global reference. This perspective has implications for model design, evaluation protocols, and benchmark construction, and outline open research challenges toward robust, context-aware multimodal anomaly detection.

异常检测多模态上下文推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。