用大模型生成假异常数据,提升文本图的异常检测能力
LLM-Enhanced Energy Contrastive Learning for Out-of-Distribution Detection in Text-Attributed Graphs
- 用大模型生成语义相关的假异常节点,增强数据多样性
- 基于能量函数的对比学习,准确区分正常与异常节点
- 适合处理文本属性图中的分布外检测问题
文本属性图在引文、社交和交易网络等真实场景中广泛应用,但现有方法通常假设训练与测试数据分布一致,导致面对分布外(OOD)数据时性能显著下降。本文针对文本属性图中的节点级分布外检测问题,提出 LECT 框架,融合大语言模型(LLMs)与基于能量的对比学习。通过利用 LLM 的语义理解能力生成依赖感知的伪分布外节点,构建高质量的异常样本;再结合能量函数进行对比学习,有效区分分布内(IND)与分布外(OOD)节点。在六个基准数据集上的实验表明,该方法持续优于当前最优基线,在保持高分类准确率的同时实现稳健的分布外检测能力。
原文摘要 · Abstract (English)
Text-attributed graphs, where nodes are enriched with textual attributes, have become a powerful tool for modeling real-world networks such as citation, social, and transaction networks. However, existing methods for learning from these graphs often assume that the distributions of training and testing data are consistent. This assumption leads to significant performance degradation when faced with out-of-distribution (OOD) data. In this paper, we address the challenge of node-level OOD detection in text-attributed graphs, with the goal of maintaining accurate node classification while simultaneously identifying OOD nodes. We propose a novel approach, LLM-Enhanced Energy Contrastive Learning for Out-of-Distribution Detection in Text-Attributed Graphs (LECT), which integrates large language models (LLMs) and energy-based contrastive learning. The proposed method involves generating high-quality OOD samples by leveraging the semantic understanding and contextual knowledge of LLMs to create dependency-aware pseudo-OOD nodes, and applying contrastive learning based on energy functions to distinguish between in-distribution (IND) and OOD nodes. The effectiveness of our method is demonstrated through extensive experiments on six benchmark datasets, where our method consistently outperforms state-of-the-art baselines, achieving both high classification accuracy and robust OOD detection capabilities.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。