用逻辑分解提升大模型推理,减少幻觉
LAG: Logic-Augmented Generation from a Cartesian Perspective
- 将复杂问题拆解为有逻辑顺序的子问题,逐步求解
- 在四个基准上准确率显著提升,幻觉大幅减少
- 适合需要严谨推理的科研、医疗等专业场景
大语言模型在多任务中表现优异,但在需要专业知识的任务中常产生幻觉。尽管检索增强生成(RAG)通过引入外部知识缓解此问题,却因依赖直接语义检索且缺乏结构化逻辑组织,在复杂推理中表现不佳。受《方法论》中笛卡尔原则启发,本文提出逻辑增强生成(LAG),一种新范式:通过系统性问题分解、原子记忆库与逻辑感知推理重构知识增强。具体而言,LAG首先将复杂问题按逻辑依赖关系分解为原子子问题,并依次求解;利用前序答案引导后续子问题的上下文检索,确保逻辑链逐步落地。在四个基准上的实验表明,与现有方法相比,LAG显著提升了准确率并减少了幻觉。
原文摘要 · Abstract (English)
Large language models (LLMs) have demonstrated remarkable capabilities across a wide range of tasks, yet exhibit critical limitations in knowledge-intensive tasks, often generating hallucinations when faced with questions requiring specialized expertise. While retrieval-augmented generation (RAG) mitigates this by integrating external knowledge, it struggles with complex reasoning scenarios due to its reliance on direct semantic retrieval and lack of structured logical organization. Inspired by Cartesian principles from \textit{Discours de la méthode}, this paper introduces Logic-Augmented Generation (LAG), a novel paradigm that reframes knowledge augmentation through systematic question decomposition, atomic memory bank and logic-aware reasoning. Specifically, LAG first decomposes complex questions into atomic sub-questions ordered by logical dependencies. It then resolves these sequentially, using prior answers to guide context retrieval for subsequent sub-questions, ensuring stepwise grounding in the logical chain. Experiments on four benchmarks demonstrate that LAG significantly improves accuracy and reduces hallucination over existing methods.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。