通过多尺度跨模态学习,让文本与图结构联合训练,提升异常检测效果。
Text-Attributed Graph Anomaly Detection via Multi-Scale Cross- and Uni-Modal Contrastive Learning
- 设计跨模态与单模态多尺度一致性损失,联合训练文本与图编码器。
- 在8个新发布的数据集上,平均准确率(AP)提升11.13%。
- 适合处理含文本描述的图数据异常检测,如社交网络、金融交易等场景。
图数据在诸多高风险场景中广泛应用,推动了图异常检测(GAD)的发展。现实中的图常包含以原始文本序列形式存在的节点描述,称为文本属性图(TAGs)。现有方法通常采用浅层嵌入技术将文本编码为特征,再依赖图域内的复杂自监督任务进行异常检测。然而,文本编码过程与图域异常检测目标分离,导致提取的文本特征难以聚焦于与异常相关的信息,严重限制检测能力。如何无缝融合原始文本与图拓扑,释放跨模态数据在TAGs中的潜力,成为关键挑战。本文提出一种端到端的新范式CMUCL,同时建模文本与图结构,并通过跨模态与单模态多尺度一致性联合训练文本和图编码器,挖掘潜在的异常相关信息。相应地,设计基于不一致性挖掘的异常评分估计器,生成节点级异常分数。针对现有缺乏专用于TAGs异常检测的基准数据集的问题,我们发布了8个新数据集以促进后续研究。大量实验表明,CMUCL在文本属性图异常检测上显著领先,相比最差方法平均准确率(AP)提升11.13%。
原文摘要 · Abstract (English)
The widespread application of graph data in various high-risk scenarios has increased attention to graph anomaly detection (GAD). Faced with real-world graphs that often carry node descriptions in the form of raw text sequences, termed text-attributed graphs (TAGs), existing graph anomaly detection pipelines typically involve shallow embedding techniques to encode such textual information into features, and then rely on complex self-supervised tasks within the graph domain to detect anomalies. However, this text encoding process is separated from the anomaly detection training objective in the graph domain, making it difficult to ensure that the extracted textual features focus on GAD-relevant information, seriously constraining the detection capability. How to seamlessly integrate raw text and graph topology to unleash the vast potential of cross-modal data in TAGs for anomaly detection poses a challenging issue. This paper presents a novel end-to-end paradigm for text-attributed graph anomaly detection, named CMUCL. We simultaneously model data from both text and graph structures, and jointly train text and graph encoders by leveraging cross-modal and uni-modal multi-scale consistency to uncover potential anomaly-related information. Accordingly, we design an anomaly score estimator based on inconsistency mining to derive node-specific anomaly scores. Considering the lack of benchmark datasets tailored for anomaly detection on TAGs, we release 8 datasets to facilitate future research. Extensive evaluations show that CMUCL significantly advances in text-attributed graph anomaly detection, delivering an 11.13% increase in average accuracy (AP) over the suboptimal.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。