arXiv:2511.19648cs.CLcs.AI2025-11

用轻量模型实现高效可验证的多跳知识图谱问答

Efficient Multi-Hop Question Answering over Knowledge Graphs via LLM Planning and Embedding-Guided Search

  • 用一次大模型调用规划推理路径,结合广度优先搜索确保答案可追溯
  • 通过670万参数嵌入评分器,速度提升100倍以上且准确率不降
  • 压缩后40亿参数模型无需调用API,性能媲美大模型,适合部署

知识图谱上的多跳问答因推理路径组合爆炸而计算成本高。现有方法依赖昂贵的大模型进行实体链接和路径排序,限制了实际应用。此外,大模型生成的答案常缺乏结构化知识支撑。本文提出两种互补的混合算法:(1) LLM-Guided Planning,仅需一次大模型调用预测关系序列,通过广度优先搜索执行,实现近完美的准确率(微F1 > 0.90),并保证所有答案均基于知识图谱;(2) Embedding-Guided Neural Search,完全消除大模型调用,通过轻量级670万参数边评分器融合文本与图嵌入,速度提升超100倍,准确率仍具竞争力。通过知识蒸馏,将规划能力压缩至40亿参数模型,零调用成本下达到大模型性能。在MetaQA上的实验表明,结构化规划比直接生成更可迁移,且可验证推理优于无根植生成。结果证明,可验证的多跳推理无需大规模模型,关键在于符号结构与学习表征的合理结合。

原文摘要 · Abstract (English)

Multi-hop question answering over knowledge graphs remains computationally challenging due to the combinatorial explosion of possible reasoning paths. Recent approaches rely on expensive Large Language Model (LLM) inference for both entity linking and path ranking, limiting their practical deployment. Additionally, LLM-generated answers often lack verifiable grounding in structured knowledge. We present two complementary hybrid algorithms that address both efficiency and verifiability: (1) LLM-Guided Planning that uses a single LLM call to predict relation sequences executed via breadth-first search, achieving near-perfect accuracy (micro-F1 > 0.90) while ensuring all answers are grounded in the knowledge graph, and (2) Embedding-Guided Neural Search that eliminates LLM calls entirely by fusing text and graph embeddings through a lightweight 6.7M-parameter edge scorer, achieving over 100 times speedup with competitive accuracy. Through knowledge distillation, we compress planning capability into a 4B-parameter model that matches large-model performance at zero API cost. Evaluation on MetaQA demonstrates that grounded reasoning consistently outperforms ungrounded generation, with structured planning proving more transferable than direct answer generation. Our results show that verifiable multi-hop reasoning does not require massive models at inference time, but rather the right architectural inductive biases combining symbolic structure with learned representations.

知识图谱多跳问答大模型高效推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。