格式与约束的耦合会严重损害知识图谱构建质量,需警惕
Format-Constraint Coupling in Knowledge Graph Construction from Statistical Tables

- 发现格式与模式约束协同作用导致信息丢失
- 最高造成47.6个百分点的提取精度下降
- 适合关注数据质量评估的研究者参考
抽取模板不应降低知识图谱的保真度。然而,在统计类CSV表格中,这种损失可能发生。本文研究开放数据门户中常见的国家-年份时间序列矩阵。结果显示,序列化格式与模式约束的交互效应超加性,联合影响比各自独立作用之和最高提升1.180(2×2因子实验,6个数据集)。在4/6数据集上,置信区间严格为正,尤以宽型Type-II矩阵证据最强。更关键的是,不匹配的格式与约束组合可引发灾难性偏差:4/6数据集出现事实覆盖率低于无约束基线的情况,表现为实体膨胀或提取拒绝。我们称此现象为格式-约束耦合。探查与分词消融分析支持一种基于列名表面形式锚定的解释机制。在不同格式-模式组合、GraphRAG主机及大模型家族中的控制实验均呈现一致趋势;其中一类大模型仅部分激活。该发现还具有诊断意义:三种标准检索模式基本掩盖了构建质量差异(Δ≤1pp),而直接图访问暴露出高达+47.6pp的差距(p<0.0001)。为支持保真度感知评估,我们发布了CSVFidelity-Bench,包含15个数据集、11个Type-II矩阵、4个Type-III表格,以及跨6个领域的1,892条黄金标准事实。
原文摘要 · Abstract (English)
An extraction schema should not reduce knowledge graph fidelity. On statistical CSV, however, it can. We study country-by-year time-series matrices, a common layout on open-data portals. In this setting, serialization format and schema constraints interact super-additively. Their joint effect exceeds the sum of independent effects by up to +1.180 (2x2 factorial, 6 datasets). Bootstrap 95% CIs are strictly positive on 4/6 datasets, with strongest evidence on wide Type-II matrices. More critically, a schema applied to a mismatched format can trigger catastrophic mismatch. Fact coverage falls below the unconstrained baseline on 4/6 datasets through entity inflation or extraction refusal. We call this observed pattern format-constraint coupling. Probing and token ablation support a surface-form anchoring explanation centred on column-name references. Controlled variants across format-schema pairings, GraphRAG hosts, and LLM families show the same direction within the measured scope; one LLM family shows only partial activation. The observation also has a diagnostic consequence. Three standard retrieval modes largely mask construction quality (delta <= 1pp), whereas direct graph access exposes gaps up to +47.6pp (p < 0.0001). To support fidelity-aware evaluation, we release CSVFidelity-Bench. It contains 15 datasets, 11 Type-II matrices, 4 Type-III tables, and 1,892 Gold Standard facts across 6 domains.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。