提出可零样本/少样本检测图异常的通用模型,突破传统模型泛化瓶颈。
AnomalyGFM: Graph Foundation Model for Zero/Few-shot Anomaly Detection
- 通过残差特征对齐构建跨图通用的正常与异常原型
- 在11个真实数据集上零样本和少样本效果均领先现有方法
- 适合新图数据或标注稀缺场景下的异常检测任务
图异常检测(GAD)旨在识别与多数节点不同的异常节点,近年来受到广泛关注。现有通用图模型虽在各类图任务中表现优异,却难以泛化至GAD任务,主要因难以学习捕捉跨领域图中罕见、不规则且异构的异常模式的通用知识。为此,我们提出AnomalyGFM,一种面向GAD的图基础模型,支持在多样图数据集上的零样本推理与少样本提示微调。关键思想是:需具备图无关的正常与异常类别表示,以实现跨图的有效零/少样本检测。受此启发,AnomalyGFM通过预训练,将节点表示残差(即节点与其邻居的表示偏差)与可学习的正常和异常类原型对齐。残差特征将节点信息投影至统一特征空间,从而一致地衡量不同图中节点的异常程度。该机制驱动了图无关、判别性原型的学习,使模型可在新图(包括超大规模图)上实现零样本异常检测。若新图中有少量标注正常节点,模型还可通过提示微调进一步适配。在11个广泛使用的含真实异常的GAD数据集上的综合实验表明,AnomalyGFM在零样本和少样本设置下显著优于当前最优方法。
原文摘要 · Abstract (English)
Graph anomaly detection (GAD) aims to identify abnormal nodes that differ from the majority of the nodes in a graph, which has been attracting significant attention in recent years. Existing generalist graph models have achieved remarkable success in different graph tasks but struggle to generalize to the GAD task. This limitation arises from their difficulty in learning generalized knowledge for capturing the inherently infrequent, irregular and heterogeneous abnormality patterns in graphs from different domains. To address this challenge, we propose AnomalyGFM, a GAD-oriented graph foundation model that supports zero-shot inference and few-shot prompt tuning for GAD in diverse graph datasets. One key insight is that graph-agnostic representations for normal and abnormal classes are required to support effective zero/few-shot GAD across different graphs. Motivated by this, AnomalyGFM is pre-trained to align data-independent, learnable normal and abnormal class prototypes with node representation residuals (i.e., representation deviation of a node from its neighbors). The residual features essentially project the node information into a unified feature space where we can effectively measure the abnormality of nodes from different graphs in a consistent way. This provides a driving force for the learning of graph-agnostic, discriminative prototypes for the normal and abnormal classes, which can be used to enable zero-shot GAD on new graphs, including very large-scale graphs. If there are few-shot labeled normal nodes available in the new graphs, AnomalyGFM can further support prompt tuning to leverage these nodes for better adaptation. Comprehensive experiments on 11 widely-used GAD datasets with real anomalies, demonstrate that AnomalyGFM significantly outperforms state-of-the-art competing methods under both zero- and few-shot GAD settings.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。