arXiv:2607.00052cs.IRcs.AI2026-07

提出自适应掩码机制,提升图结构数据在文本生成中的表示效果

AGE: Adaptive-masking for Graph Embedding in Graph Retrieval-Augmented Generation

论文配图:AGE: Adaptive-masking for Graph Embedding in Graph Retrieval-Augmented Generation
图 1 · 摘自论文原文
  • 基于掩码的自监督学习,聚焦非关键节点预测
  • 在4个不同数据集上显著提升图问答任务准确率
  • 适合需要高效利用图知识的文本生成场景

GraphRAG 是一种扩展的检索增强生成技术,通过引用图结构数据作为外部知识来支持大语言模型(LLM)。尽管该方法能捕捉复杂关系,但对冻结的 LLM 来说,图表示与文本表示之间存在潜在特征错位问题。为此,本文提出自适应掩码图嵌入(AGE),采用类似文本编码器的 Transformer 结构,通过基于掩码的自监督学习解决特征错位。由于图数据本身是紧凑表示,存在若干关键节点蕴含主导上下文信息,难以从邻域预测,直接掩码这些节点会降低自监督效率。因此,AGE 利用可学习的节点采样器,专注于非关键节点的预测。实验表明,AGE 在使用非参数化搜索组件的 GraphQA 任务中表现优异,在四个具有不同特征的基准数据集上均取得更优准确率。

原文摘要 · Abstract (English)

GraphRAG is an extension of retrieval-augmented generation (RAG) that supports large language models (LLMs) by referring to graph-structured data as external knowledge. While this technique ideally captures intricate relationships, it often struggles with graph representations for LLMs, particularly for frozen LLMs, due to the misalignment between graph-based and text-based latent features. We tackle this issue by introducing the {\it Adaptive-masking for Graph Embedding (AGE)}. AGE employs a Transformer in a mask-based self-supervised learning (SSL) approach. We designed the architecture similar to text embedding encoders, addressing the latent feature misalignment. In contrast to natural language texts, graphs are concise representations, and there exist {\it key nodes} that hold dominant contextual information, which are challenging to predict from their surroundings. Masking such key nodes leads to inefficiency in the SSL process. Therefore, AGE focuses on predicting nodes apart from key nodes, utilizing a learnable node sampler. Our experimental results indicate that AGE significantly improves approaches using non-parametric search component in GraphQA tasks, achieving superior accuracy across four benchmark datasets with distinct characteristics.

图嵌入自监督学习检索增强生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。