arXiv:2605.30729cs.LGcs.IR2026-05KDD

用图神经网络增强语言模型的结构感知,提升数据模式匹配精度

SemStruct: Contextualizing Semantic Embeddings with Structural Information for Schema Matching

论文配图:SemStruct: Contextualizing Semantic Embeddings with Structural Information for Schema Matching
图 1 · 摘自论文原文
  • 将表格建模为异构图,通过行关联传递上下文信息
  • 在Valentine和SOTAB-SM上超越全微调基线,复杂数据集提升显著
  • 仅训练轻量结构编码器,无需微调大语言模型,适合资源受限场景

模式匹配是整合异构数据源的关键步骤。尽管预训练语言模型(PLMs)通过捕捉语言语义革新了该任务,但通常将表格数据序列化为独立列名的文本流,丢失了关键的结构信息——即行级共现关系,迫使模型仅依赖列头语义或孤立分布。为此,我们提出SemStruct框架,将冻结的PLMs语义能力与图神经网络(GNNs)的结构归纳偏置结合。我们将表格建模为异构图,其中列和值为节点,行作为连接边,使GNN能在结构上传播消歧上下文。与需专用LLM访问并微调语言模型的现有方法不同,SemStruct保持语言模型冻结,仅训练轻量级结构编码器。在Valentine和SOTAB-SM基准上的大量实验表明,SemStruct达到最先进性能,在复杂、语义可连接的数据集上超越全微调基线。此外,消融研究显示,行表示主要作为拓扑通道而非语义实体,验证了显式结构建模在模式匹配中的必要性。

原文摘要 · Abstract (English)

Schema matching is a fundamental step in integrating heterogeneous data sources. While Pre-trained Language Models (PLMs) have revolutionized this task by capturing linguistic semantics, they typically process tabular data as serialized text sequences of standalone column descriptions. This serialization discards critical structural information -- specifically, the row-level co-occurrences, i.e. the relational context -- forcing models to rely solely on column header semantics or standalone distributions. To bridge this gap, we propose SemStruct, a framework that joins the semantic power of frozen PLMs with the structural inductive bias of Graph Neural Networks (GNNs). We model the table as a heterogeneous graph where columns and values are nodes connected by rows, allowing the GNN to propagate disambiguating context across the structure. Unlike other state-of-the-art methods that require proprietary LLM access and fine-tuning of language models, SemStruct keeps the language model frozen and trains only a lightweight structural encoder. Extensive experiments on the Valentine and SOTAB-SM benchmarks demonstrate that SemStruct achieves state-of-the-art performance, outperforming fully fine-tuned baselines on complex, semantically joinable datasets. Furthermore, our ablation studies reveal that row representations serve primarily as topological conduits rather than semantic entities, validating the necessity of explicit structural modeling in schema matching.

模式匹配图神经网络预训练模型数据集成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。