控制路径历史长度,让大模型更高效地回答知识图谱问题。
Bounded Path Context: A Controlled Study of Visible Path History in LLM-Based Knowledge Graph Question Answering
- 只给模型当前实体和最近几步的路径信息,而非完整历史。
- 减少输入令牌数9.7%~12.1%,准确率反而更高或相当。
- 适合优化推理效率、调试模型决策过程的研究者。
基于大语言模型的知识图谱问答(KGQA)将图遍历任务交由语言模型完成,每个问题转化为一系列局部关系选择决策。传统做法是将完整的部分路径序列化后加入提示,但控制器本身已以符号形式存储完整路径。本文提出有界路径上下文(BPC),将路径记忆与提示内容解耦:控制器保留完整路径用于答案提取与审计,而关系选择提示仅包含问题、当前实体、候选关系及最多前K步路径。在固定图邻域、束搜索预算、深度、解码策略和答案格式的前提下,对K值进行系统测试表明,在WebQSP和CWQ数据集上,使用Qwen3.5-9B-AWQ模型时,K=1在WebQSP上达到0.487的答集合F1,优于全历史提示的0.472;在CWQ上K=0达0.287,高于全历史的0.274,同时分别减少9.7%和12.1%输入令牌。4B规模下K=1仍最优。逐例分析显示71%-84%样本不受历史长度影响,受影响案例揭示前期路径有助于消歧或造成干扰。结果表明路径序列长度应作为可调接口变量,而非默认设定。
原文摘要 · Abstract (English)
LLM-based knowledge-graph question answering (KGQA) delegates graph traversal to language models, turning each question into a sequence of local relation-selection decisions repeated across beams and hops. A common but untested default is to serialize the complete partial path into every routing prompt, even though the controller already maintains this path as exact symbolic state. Bounded Path Context (BPC) decouples these two roles: the controller retains full paths in symbolic memory for answer extraction and audit, while the relation-selection prompt exposes only the question, the current entity, outgoing relation candidates, and at most the last K hops. A controlled sweep over K -- fixing graph neighborhoods, beam budget, depth, decoding, and answer-extraction format -- shows that bounded histories match or exceed full-history prompting on complete WebQSP and CWQ test sets with Qwen3.5-9B-AWQ: K=1 achieves 0.487 answer-set F1 on WebQSP versus 0.472 for full history, and K=0 reaches 0.287 on CWQ versus 0.274, with 9.7% and 12.1% fewer input tokens respectively. At the 4B scale, K=1 remains the strongest setting on both benchmarks. Per-example analysis reveals that 71-84% of examples are unaffected by history length, while the affected cases expose when prior hops disambiguate versus distract. These results suggest that path serialization length is better treated as a tunable interface variable than as a default assumption in LLM-based graph controllers.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。