无需调参和标注,直接检测表格数据异常点。
FoMo-0D: A Foundation Model for Zero-shot Tabular Outlier Detection
- 基于合成数据预训练的通用模型,零样本直接预测
- 57个数据集上表现优于多数基线,接近最优方法
- 单样本推理仅需7.7毫秒,速度提升超7倍
异常检测(OD)在实际应用中需求广泛,但因其为无监督任务,模型选择成为关键瓶颈。尽管已有大量可调参的OD算法,但缺乏系统性的无监督算法与超参数选择方法,限制了其实际应用。本文提出FoMo-0D,一种面向表格数据的零样本异常检测基础模型,通过在合成数据上预训练,可直接预测测试样本的异常/正常标签,无需微调、无需标注数据,也无需额外训练或调参。在57个真实世界数据集上对26个基线进行对比实验显示,FoMo-0D表现极具竞争力,显著优于多数方法,且与第二名无统计显著差异。此外,其推理效率极高,平均每个样本仅需7.7毫秒,相比以往方法至少提速7倍。为促进后续研究,我们已公开数据生成、预训练实现及模型权重,详见https://github.com/A-Chicharito-S/FoMo-0D。
原文摘要 · Abstract (English)
Outlier detection (OD) has a vast literature as it finds numerous real-world applications. Being an unsupervised task, model selection is a key bottleneck for OD without label supervision. Despite a long list of available OD algorithms with tunable hyperparameters, the lack of systematic approaches for unsupervised algorithm and hyperparameter selection limits their effective use in practice. In this paper, we present FoMo-0D, a pre-trained Foundation Model for zero/0-shot OD on tabular data, which bypasses the hurdle of model selection altogether. Having been pre-trained on synthetic data, FoMo-0D can directly predict the (outlier/inlier) label of test samples without parameter fine-tuning -- requiring no labeled data, and no additional training or hyperparameter tuning when given a new task. Extensive experiments on 57 real-world datasets against 26 baselines show that FoMo-0D is highly competitive; outperforming the majority of the baselines with no statistically significant difference from the 2nd best method. Further, FoMo-0D is efficient in inference time requiring only 7.7 ms per sample on average, with at least 7x speed-up compared to previous methods. To facilitate future research, our implementations for data synthesis and pre-training as well as model checkpoints are openly available at https://github.com/A-Chicharito-S/FoMo-0D.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。