先标记再连接:在生产级知识图谱中精准处理实体身份与类别标注
Curate Before You Connect: Identity and Ontology Tagging in a Production Knowledge Graph
- 通过标识符、名称、位置等多层级判断实体同一性,避免错误合并
- 构建包含53.7万实体、220万关系的政府文档知识图谱,去重策略可防错
- 强调人工审核必要性,标注需有锚定证据,减少误分类
实体抽取生成候选实体与关系;将其写入图谱时决定实体身份,而身份决策具有不可逆性。错误类型可后续修正,但两个记录因身份相同被合并后,属性融合即无法分离,且合并过程不留痕迹。本文描述将验证后的抽取流转化为知识图谱的摄入与本体标注层,涵盖537,157个实体和2,198,567条关系,数据源来自98,795份政府文档。提出基于标识列、名称列、显示名及类型范围位置的实体身份判定阶梯,用于表格内去重;图谱写入采用更粗粒度的规范名称键,相同名称精确匹配即自动合并。主张实体解析仅作候选提示而非强制合并,该策略源于一次事故——同一名称的两种表达形式被错误合并,导致正确记录损坏并删除了八条无关文档中的实体。随后介绍多类本体标注机制,发现未预期的证据不对称性:实体名是实例标签而非类型声明,因此将名称片段匹配到类别索引会人为创造分类。要求锚定证据后,角色分配在扩充样本上从36项降至4项,全部确认正确。量化图谱的符合性债务,揭示次级分类对主类错误继承的补偿作用,并指出校验队列已达48,403条待处理提案,仅775次人工决策。
原文摘要 · Abstract (English)
Extraction produces candidate entities and relationships; writing them into a graph is where identity is decided, and identity decisions are destructive in a way extraction errors are not. A wrong type can be corrected later, but two records merged under one identity cannot be separated once their properties have been combined, and the merge leaves no error behind. This paper describes the ingestion and ontology-tagging layer that turns a validated extraction stream into a knowledge graph of 537,157 entities and 2,198,567 relationships drawn from 98,795 government documents. We describe a record-identity ladder that decides sameness from identifier columns, name columns, display names and type-scoped position rather than from name similarity. The ladder governs de-duplication within parsed tables, while the graph write applies a coarser canonical-name key, so records sharing a canonical name merge automatically on exact equality. We argue rather than demonstrate that this is where the automation line belongs: no identity benchmark is reported, and the over-merges the key permits are undetectable by construction. That policy, under which entity resolution only ever flags candidates, followed an incident in which two surface forms of one name were merged, corrupting a correct record and deleting eight entities from an unrelated document. We then describe multi-class ontology tagging and an evidence asymmetry we did not anticipate: an entity name is an instance label rather than a type assertion, so matching name fragments against a class index invents classifications. Requiring anchored evidence cut role assignments on an enriched sample from 36 to 4, all confirmed correct. We quantify the graph's conformance debt, show secondary classifications compensating for a mis-parented primary class, and describe a curation queue grown to 48,403 pending proposals against 775 human decisions.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。