arXiv:2608.26132cs.LGcs.CL2026-08

用小语言模型动态选择图消息,提升属性图学习的语义精准度。

SLM-Conditioned Hierarchical Relation Routing for Labeled Property Graph Learning

论文配图:SLM-Conditioned Hierarchical Relation Routing for Labeled Property Graph Learning
图 1 · 摘自论文原文
  • 通过小语言模型生成目标相关的路由查询,动态筛选消息。
  • 在关系类型内和跨关系层级分步路由,实现层次化信息整合。
  • 支持邻居和关系级别的可解释分析,适合复杂属性图任务。

带标签的属性图结合了关系结构与节点和边上的异构文本及类别属性。传统图神经网络通常将这些属性表示为静态特征向量,限制了其对特定预测目标应采纳哪些语义证据的判断能力。本文提出SLM-Conditioned Hierarchical Relation Routing,将小型语言模型(SLM)直接集成到图消息选择中。拓扑图神经网络提供稳定的结构表征和预测锚点。对于每个目标节点,其相邻消息包含邻居的结构状态、节点属性编码、关系属性编码及关系类型。一个参数高效的SLM处理结构化的图软令牌,生成目标条件的路由查询。该查询先在每种关系类型内筛选相关消息,再在关系级摘要间传递信息。最终表征以有界残差更新拓扑锚点,保留结构证据的同时允许上下文语义信息修正预测。该架构支持邻居和关系类型级别的可解释分析,为属性丰富的图学习提供通用的语言语义融合机制。

原文摘要 · Abstract (English)

Labeled property graphs combine relational structure with heterogeneous textual and categorical properties attached to both nodes and relationships. Conventional graph neural networks typically represent these properties as static feature vectors, limiting their ability to determine which semantic evidence should influence message propagation for a particular prediction target. We propose SLM-Conditioned Hierarchical Relation Routing, an architecture that integrates a small language model directly into graph message selection. A topology GNN provides a stable structural representation and prediction anchor. For each target node, incident messages combine the neighbor's structural state, node-property encoding, relationship-property encoding, and relationship type. A parameter-efficient SLM processes structured graph soft tokens and produces a target-conditioned routing query. This query first selects relevant messages within each relationship type and subsequently routes information across relation-level summaries. The resulting representation provides a bounded residual update to the topology anchor, preserving structural evidence while allowing contextual semantic information to modify the prediction. The architecture supports interpretable analysis at both the neighbor and relationship-type levels and provides a general mechanism for integrating language-derived semantics into property-rich graph learning.

图神经网络语言模型属性图可解释性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。