让表格型基础模型输出可解释的异常诊断信号,提升安全决策可信度。
FoMo X: Modular Explainability Signals for Outlier Detection Foundation Models
- 在预训练模型嵌入上加轻量诊断头,离线训练实现快速解释
- 能准确还原真实风险等级与置信度,推理开销几乎为零
- 适合需要实时可解释性的工业级异常检测场景
表格基础模型,特别是先验数据拟合网络(PFNs),通过无监督零样本适配新数据集而彻底改变了异常检测(OD)领域。然而,这些模型通常作为黑箱运行,仅输出标量异常分数,缺乏安全关键决策所需的上下文信息。现有事后解释方法往往计算成本过高,难以实时部署,或无法捕捉零样本推理中的认知不确定性。本文提出FoMo-X,一个模块化框架,赋予OD基础模型内生的轻量诊断能力。我们利用预训练PFN主干的冻结嵌入已编码丰富的上下文相关关系信息这一洞察,附加辅助诊断头,并使用与主干相同的生成模拟器先验进行离线训练。这使得我们可以将蒙特卡洛丢弃等计算昂贵的认知不确定性特性,提炼为确定性的单次前向传播。我们实例化了两个新头:严重性头将偏差离散化为可解释的风险等级,不确定度头提供校准后的置信度度量。在合成与真实世界基准(ADBench)上的大量评估表明,FoMo-X以高保真度恢复了真实诊断信号,且推理开销可忽略不计。通过弥合基础模型性能与操作可解释性之间的差距,FoMo-X为可信的零样本异常检测提供了可扩展路径。
原文摘要 · Abstract (English)
Tabular foundation models, specifically Prior-Data Fitted Networks (PFNs), have revolutionized outlier detection (OD) by enabling unsupervised zero-shot adaptation to new datasets without training. However, despite their predictive power, these models typically function as opaque black boxes, outputting scalar outlier scores that lack the operational context required for safety-critical decision-making. Existing post-hoc explanation methods are often computationally prohibitive for real-time deployment or fail to capture the epistemic uncertainty inherent in zero-shot inference. In this work, we introduce FoMo-X, a modular framework that equips OD foundation models with intrinsic, lightweight diagnostic capabilities. We leverage the insight that the frozen embeddings of a pretrained PFN backbone already encode rich, context-conditioned relational information. FoMo-X attaches auxiliary diagnostic heads to these embeddings, trained offline using the same generative simulator prior as the backbone. This allows us to distill computationally expensive properties, such as Monte Carlo dropout based epistemic uncertainty, into a deterministic, single-pass inference. We instantiate FoMo-X with two novel heads: a Severity Head that discretizes deviations into interpretable risk tiers, and an Uncertainty Head that provides calibrated confidence measures. Extensive evaluation on synthetic and real-world benchmarks (ADBench) demonstrates that FoMo-X recovers ground-truth diagnostic signals with high fidelity and negligible inference overhead. By bridging the gap between foundation model performance and operational explainability, FoMo-X offers a scalable path toward trustworthy, zero-shot outlier detection.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。