让大模型直接理解高阶关系,突破传统图结构限制。
Hypergraph as Language

- 提出超图原生对齐框架,将高阶关联转为语言模型可读的标记。
- 在多个任务上超越现有方法,零样本性能提升显著。
- 适合处理复杂多对象关系的场景,如知识图谱、社交网络分析。
大型语言模型(LLMs)在建模关系结构方面展现出强大潜力。然而,现有方法仍以图结构为中心:将成对关系转化为语言模型可理解的标记。事实上,许多现实世界的关系模式并不符合成对边假设,更适合用超图中的高阶关联来建模。现有超图方法往往无法保留多个对象由同一高阶关系共同连接的原始语义,限制了其对复杂结构的利用能力。为此,本文提出“超图即语言”的视角,构建超图原生对齐框架Hyper-Align。该框架将基于查询-对象中心的超图上下文直接编译为语言模型可直接处理的超图标记。具体地,引入超图关联细节模板与概览(HIDT-O),通过局部关联细节与全局概览结合的方式,将高阶关联结构序列化为固定形状的混合模板。进一步设计超图关联投影器(HIP),通过显式语义-结构解耦和顶点与超边间的双向消息传递,将原始高阶关联结构映射至语言模型的标记空间。我们还定义了具体的“超图即语言”输入协议,联合输入超图标记与文本提示,统一支持顶点级与超边级任务。为系统评估不同方法在超图建模中的表现,我们构建了HyperAlign-Bench。大量实验表明,Hyper-Align在域内及零样本评估中均显著优于现有方法。
原文摘要 · Abstract (English)
Large language models (LLMs) have recently shown strong potential in modeling relational structures. However, existing approaches remain fundamentally graph-centric: they focus on processing pairwise graph structures into tokens that LLMs can understand. In contrast, many real-world relational patterns do not naturally conform to the pairwise-edge assumption, and are better modeled as high-order associations in hypergraphs. For hypergraph structures, existing methods often fail to preserve the native semantics that multiple objects are jointly connected by the same high-order relation, limiting their ability to exploit complex structures. To address this limitation, we put forth the "Hypergraph as Language" perspective and propose Hyper-Align, a hypergraph-native alignment framework for large language models. Hyper-Align compiles the query-object-centered hypergraph context into hypergraph tokens directly consumable by a base LLM. Specifically, we introduce Hypergraph Incidence Detail Template with Overview (HIDT-O), which serializes high-order association structures into a fixed-shape hybrid template combining local incidence details and overview-level summaries. We then design a Hypergraph Incidence Projector (HIP), which maps native high-order incidence structures into the LLM token space through explicit semantic-structural decoupling and bidirectional message passing between vertices and hyperedges. We further define a concrete Hypergraph-as-Language input protocol, which jointly feeds hypergraph tokens and textual prompts into a frozen base LLM, supporting both vertex-level and hyperedge-level tasks under a unified question-answering paradigm. To systematically evaluate different methods in hypergraph structural modeling, we introduce HyperAlign-Bench. Extensive experiments show that Hyper-Align significantly outperforms existing methods across in-domain and zero-shot evaluations.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。