用符号约束筛选大模型生成的候选答案,提升知识图谱问答准确率
Constrained Entity Selection under Partial Knowledge for LLM-Based Knowledge Graph QA
- 基于问题构建轻量符号约束,验证大模型生成的答案候选
- 在不完整知识图谱下保持召回率,精度显著提升
- 适合需要高可靠性的生物医学等专业领域问答场景
大型语言模型用于知识图谱问答时,常无法正确关联到底层图结构。现有方法或依赖完整的语义解析生成可执行查询(如SPARQL),在复杂模式或真实世界知识图谱不完整时易失效;或依赖大模型推理与答案生成,虽更鲁棒但缺乏形式化保证。本文提出在候选答案由大模型生成后,利用从问题中提取的轻量符号约束进行验证的互补设置。引入受限实体选择在部分知识下的新问题(CES-PK),聚焦于排除无效答案并为有效答案提供符号支持,无需构建可执行逻辑形式。针对知识图谱不完整性,采用三值约束语义(满足、违反、未知),避免在开放世界假设下误判。在生物医学知识图谱Hetionet上验证类型、关系和排除约束的效果:过滤无效候选使精度提升,因保留未明确违反约束的候选,召回率得以保持;满足的约束还提供了额外正向符号证据以排序剩余候选。
原文摘要 · Abstract (English)
Large language models are increasingly used for knowledge graph question answering (KGQA), but can fail to correctly ground answers in the underlying graph. Current approaches to LLM-based KGQA either rely on full semantic parsing into executable queries such as SPARQL, which is brittle in practice due to complex schemas or incompleteness of real-world KGs, or on LLM-reasoning and answer generation over KGs, which can be more robust but lacks formal guarantees. In this work, we study a complementary setting in which \emph{candidate} answers are generated by an LLM-based system and subsequently verified using lightweight symbolic constraints derived from the question. We introduce \emph{Constrained Entity Selection under Partial Knowledge (CES-PK)}, a problem formulation that focuses on eliminating invalid answers and providing symbolic support for valid ones without requiring construction of executable logical forms. To account for incomplete KGs, we employ a three-valued constraint semantics (\emph{satisfied, violated, unknown}) that avoids incorrect rejections under open-world assumptions. To demonstrate the effects of our method, we instantiate this framework over the Hetionet biomedical knowledge graph and evaluate the impact of type, relation, and exclusion constraints. Experiments show that precision improves by filtering invalid candidates, while recall is preserved due to retaining candidates whose constraints are not explicitly violated. Satisfied constraints provide additional positive symbolic evidence to rank remaining candidates.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。