让大模型高效推理图结构知识,统一处理多种数据源。
G-reasoner: Foundation Models for Unified Reasoning over Graph-structured Knowledge
- 用四层统一抽象构建标准化知识图谱,整合异构数据。
- 3400万参数图基模型联合建模拓扑与语义,提升推理能力。
- 支持多图泛化,训练高效可扩展,适合实际部署场景。
大语言模型在复杂推理中表现优异,但受限于静态且不完整的参数化知识。检索增强生成(RAG)通过引入外部知识缓解此问题,但现有方法在知识密集型任务中因信息碎片化和知识结构建模弱而表现不佳。图结构天然适合表示知识关系,但大模型本身无结构,难以有效推理图数据。尽管图增强RAG(GraphRAG)尝试桥接这一差距,仍依赖特定图设计、启发式搜索或昂贵的智能体流程,限制了可扩展性和泛化性。为此,我们提出G-reasoner,一个统一框架,集成图与语言基础模型,实现对多样化图结构知识的可扩展推理。核心是QuadGraph——一种标准化四层抽象,将异构知识源统一为通用图表示。在此基础上,我们构建了一个3400万参数的图基础模型(GFM),联合捕捉图拓扑与文本语义,并与大模型结合以增强下游推理。为确保效率与可扩展性,采用混合精度训练与分布式消息传递,支持更多GPU扩展。在六个基准上的实验表明,G-reasoner持续优于当前最优基线,显著增强大模型推理性能,同时具备强效率与跨图泛化能力。
原文摘要 · Abstract (English)
Large language models (LLMs) excel at complex reasoning but remain limited by static and incomplete parametric knowledge. Retrieval-augmented generation (RAG) mitigates this by incorporating external knowledge, yet existing RAGs struggle with knowledge-intensive tasks due to fragmented information and weak modeling of knowledge structure. Graphs offer a natural way to model relationships within knowledge, but LLMs are inherently unstructured and cannot effectively reason over graph-structured data. Recent graph-enhanced RAG (GraphRAG) attempts to bridge this gap by constructing tailored graphs and enabling LLMs to reason on them. However, these methods often depend on ad-hoc graph designs, heuristic search, or costly agent pipelines, which hinder scalability and generalization. To address these challenges, we present G-reasoner, a unified framework that integrates graph and language foundation models for scalable reasoning over diverse graph-structured knowledge. Central to our approach is QuadGraph, a standardized four-layer abstraction that unifies heterogeneous knowledge sources into a common graph representation. Building on this, we introduce a 34M-parameter graph foundation model (GFM) that jointly captures graph topology and textual semantics, and is integrated with LLMs to enhance reasoning in downstream applications. To ensure scalability and efficiency, mixed-precision training and distributed message-passing are implemented to scale GFM with more GPUs. Extensive experiments on six benchmarks show that G-reasoner consistently outperforms state-of-the-art baselines, significantly enhances LLM reasoning, and achieves strong efficiency and cross-graph generalization.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。