用上下文学习做表格异常检测,速度快且无需调参。
TACTIC for Navigating the Unknown: Tabular Anomaly deteCTion via In-Context inference
- 用合成异常数据预训练,让模型直接判断异常
- 单次前向传播即可输出明确结果,无须后处理
- 适合真实场景中噪声多、异常率不一的情况
表格数据异常检测是长期存在的无监督学习难题,现有深度学习模型仍面临挑战。尽管上下文学习(in-context learning)在监督任务中表现优异,但其基于分类的先验难以直接用于异常检测。本文研究了此类模型在异常检测中的应用,发现典型扩展方法在噪声或污染上下文中表现不稳定,且计算成本高。为此提出TACTIC,一种基于异常中心合成先验预训练的上下文异常检测方法,实现快速、依赖数据的异常推理,避免特定数据集调优。与传统基于得分的方法不同,TACTIC作为判别预测器训练,支持单次前向传播完成明确判断,无需阈值选择等后处理。在真实数据集上的实验表明,TACTIC在干净和噪声上下文中对不同异常率和类型均有良好表现,且先验选择影响检测质量。结果证明,专门设计的异常中心上下文模型如TACTIC,在性能上可媲美甚至超越其他任务特定方法。
原文摘要 · Abstract (English)
Anomaly detection for tabular data has been a long-standing unsupervised learning problem that remains a major challenge for current deep learning models. Recently, in-context learning has emerged as a new paradigm that has shifted efforts from task-specific optimization to large-scale pretraining aimed at creating foundation models that generalize across diverse datasets. Although in-context models, such as TabPFN, perform well in supervised problems, their learned classification-based priors may not readily extend to anomaly detection. In this paper, we study in-context models for anomaly detection and show that the unsupervised extensions to TabPFN exhibit unstable behavior, particularly in noisy or contaminated contexts, in addition to the high computational cost. We address these challenges and introduce TACTIC, an in-context anomaly detection approach based on pretraining with anomaly-centric synthetic priors, which provides fast and data-dependent reasoning about anomalies while avoiding dataset-specific tuning. In contrast to typical score-based approaches, which produce uncalibrated anomaly scores that require post-processing (e.g. threshold selection or ranking heuristics), the proposed model is trained as a discriminative predictor, enabling unambiguous anomaly decisions in a single forward pass. Through experiments on real-world datasets, we examine the performance of TACTIC in clean and noisy contexts with varying anomaly rates and different anomaly types, as well as the impact of prior choices on detection quality. Our experiments clearly show that specialized anomaly-centric in-context models such as TACTIC are highly competitive compared to other task-specific methods.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。