arXiv:2602.04926cs.DBcs.CL2026-02

通过剪枝推理图减少重复计算,让大模型问答更高效

Pruning Minimal Reasoning Graphs for Efficient Retrieval-Augmented Generation

  • 用符号化图结构存储知识,只保留关键实体和关系
  • 相比基线少用上百倍的token,复杂推理准确率提升9-11点
  • 适合长期对话、多轮推理和多智能体系统

检索增强生成(RAG)已成为知识密集型大模型任务的标准方案,但多数系统将每个查询视为全新请求,反复检索长文本并从头推理,导致令牌数、延迟和成本飙升。本文提出AutoPrunedRetriever,一种图式RAG系统,能持久化早期问题构建的最小推理子图,并增量扩展用于后续问题。该系统将实体与关系存入紧凑的ID索引码本,以边序列形式表示问题、事实与答案,实现基于符号结构的检索与提示,而非原始文本。为保持图结构紧凑,采用两层合并策略(快速近似最近邻/关键字检测+内存阈值触发选择性k均值),并剪枝低价值结构;提示仅保留重叠代表与真正新证据。我们实现了两种前端:AutoPrunedRetriever-REBEL(使用REBEL作为三元组解析器)和AutoPrunedRetriever-llm(替换为LLM提取器)。在GraphRAG-Benchmark(医学与小说类)上,两种变体均达到最先进复杂推理准确率,较HippoRAG2提升约9–11分,且在上下文摘要与生成任务中表现良好。在更难的STEM与TV基准上,AutoPrunedRetriever再次排名第一,同时使用比图密集型基线少两个数量级的令牌,是长时会话、动态语料库和多智能体流水线的理想基础架构。

原文摘要 · Abstract (English)

Retrieval-augmented generation (RAG) is now standard for knowledge-intensive LLM tasks, but most systems still treat every query as fresh, repeatedly re-retrieving long passages and re-reasoning from scratch, inflating tokens, latency, and cost. We present AutoPrunedRetriever, a graph-style RAG system that persists the minimal reasoning subgraph built for earlier questions and incrementally extends it for later ones. AutoPrunedRetriever stores entities and relations in a compact, ID-indexed codebook and represents questions, facts, and answers as edge sequences, enabling retrieval and prompting over symbolic structure instead of raw text. To keep the graph compact, we apply a two-layer consolidation policy (fast ANN/KNN alias detection plus selective $k$-means once a memory threshold is reached) and prune low-value structure, while prompts retain only overlap representatives and genuinely new evidence. We instantiate two front ends: AutoPrunedRetriever-REBEL, which uses REBEL as a triplet parser, and AutoPrunedRetriever-llm, which swaps in an LLM extractor. On GraphRAG-Benchmark (Medical and Novel), both variants achieve state-of-the-art complex reasoning accuracy, improving over HippoRAG2 by roughly 9--11 points, and remain competitive on contextual summarize and generation. On our harder STEM and TV benchmarks, AutoPrunedRetriever again ranks first, while using up to two orders of magnitude fewer tokens than graph-heavy baselines, making it a practical substrate for long-running sessions, evolving corpora, and multi-agent pipelines.

RAG推理图剪枝高效生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。