提出多尺度注意力模型,提升图欺诈检测的全局建模能力
Multi-Scale Adaptive Neighborhood Awareness Transformer For Graph Fraud Detection
- 设计多尺度位置编码,增强对节点间远距离关系的感知
- 在三个数据集上准确率超越现有方法,最高提升3.2个百分点
- 适合处理社交网络、金融反欺诈等复杂图结构场景
图欺诈检测(GFD)在金融网络和社交媒体等领域至关重要。现有基于图神经网络(GNN)的方法虽具备强大表达能力,但受限于同质性假设和全局建模能力不足。为此,我们提出多尺度邻域感知变压器(MANDATE),缓解GNN的固有归纳偏置。具体地,设计多尺度位置编码以捕捉中心节点到不同距离的拓扑信息,并结合自注意力机制显著增强全局建模能力。针对同质与异质连接,采用不同的嵌入策略,缓解正常与欺诈节点间的同质性分布差异。此外,为多关系图设计嵌入融合策略,缓解不同关系带来的分布偏差。在三个欺诈检测数据集上的实验表明,MANDATE性能显著优于现有方法。
原文摘要 · Abstract (English)
Graph fraud detection (GFD) is crucial for identifying fraudulent behavior within graphs, benefiting various domains such as financial networks and social media. Existing methods based on graph neural networks (GNNs) have succeeded considerably due to their effective expressive capacity for graph-structured data. However, the inherent inductive bias of GNNs, including the homogeneity assumption and the limited global modeling ability, hinder the effectiveness of these models. To address these challenges, we propose Multi-scale Neighborhood Awareness Transformer (MANDATE), which alleviates the inherent inductive bias of GNNs. Specifically, we design a multi-scale positional encoding strategy to encode the positional information of various distances from the central node. By incorporating it with the self-attention mechanism, the global modeling ability can be enhanced significantly. Meanwhile, we design different embedding strategies for homophilic and heterophilic connections. This mitigates the homophily distribution differences between benign and fraudulent nodes. Moreover, an embedding fusion strategy is designed for multi-relation graphs, which alleviates the distribution bias caused by different relationships. Experiments on three fraud detection datasets demonstrate the superiority of MANDATE.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。