用超维计算让大模型一次查询完成知识图谱推理,又快又透明。
Encoder-Free Knowledge-Graph Reasoning with LLMs via Hyperdimensional Path Retrieval
- 用超维向量表示多跳路径,避免神经编码器和多次调用大模型
- 单次调用大模型即可输出答案与可引用的推理路径,准确率不降反升
- 适合追求高效、可解释的智能问答系统开发者使用
大语言模型在知识驱动推理方面取得进展,但基于知识图谱的问答系统常面临效率与透明度双重挑战。传统流程依赖神经编码器打分或多次调用大模型重排序,导致延迟高、显存消耗大且决策过程难追溯。本文提出 PathHD,一种无需编码器的图谱推理框架,将超维计算(HDC)与单次大模型调用结合。给定查询后,PathHD 将关系路径表示为块对角 GHRR 超向量,通过校准的块级余弦相似度与 Top-K 剪枝检索候选路径,并进行一次性大模型判定,输出最终答案及支持性可引用路径。该设计依赖三个技术组件:(i) 顺序敏感、非交换的路径组合算子;(ii) 稳定超向量检索的相似度校准机制;(iii) 保留可解释性且避免逐路径评分的判定阶段。在 WebQSP、CWQ 与 GrailQA 上,PathHD 在保持或超越强基线 Hits@1 的同时,仅需每查询一次大模型调用,端到端延迟降低 40%-60%,显存占用减少 3-5 倍,证明精心设计的 HDC 路径表示可作为高效且可信的知识图谱-大模型推理基础,实现优异的准确率-效率-可解释性平衡。
原文摘要 · Abstract (English)
Recent progress in large language models (LLMs) has made knowledge-grounded reasoning increasingly practical, yet KG-based QA systems often pay a steep price in efficiency and transparency. In typical pipelines, symbolic paths are scored by neural encoders or repeatedly re-ranked by multiple LLM calls, which inflates latency and GPU cost and makes the decision process hard to audit. We introduce PathHD, an encoder-free framework for knowledge-graph reasoning that couples hyperdimensional computing (HDC) with a single LLM call per query. Given a query, PathHD represents relation paths as block-diagonal GHRR hypervectors, retrieves candidate paths using a calibrated blockwise cosine similarity with Top-K pruning, and then performs a one-shot LLM adjudication that outputs the final answer together with supporting, citeable paths. The design is enabled by three technical components: (i) an order-sensitive, non-commutative binding operator for composing multi-hop paths, (ii) a robust similarity calibration that stabilizes hypervector retrieval, and (iii) an adjudication stage that preserves interpretability while avoiding per-path LLM scoring. Across WebQSP, CWQ, and GrailQA, PathHD matches or improves Hits@1 compared to strong neural baselines while using only one LLM call per query, reduces end-to-end latency by $40-60\%$, and lowers GPU memory by $3-5\times$ due to encoder-free retrieval. Overall, the results suggest that carefully engineered HDC path representations can serve as an effective substrate for efficient and faithful KG-LLM reasoning, achieving a strong accuracy-efficiency-interpretability trade-off.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。