arXiv:2409.17174cs.CLcs.AI2024-09中稿 · presentation at IE…被引 10

提出新框架提升大模型推理能力,同时增强因果关联与一致性

CSCE: Boosting LLM Reasoning by Simultaneous Enhancing of Causal Significance and Consistency

  • 不依赖链式推理,用治疗效应评估优化损失函数
  • 推理成功率和速度双提升,长程任务表现更优
  • 适合需要高可靠性推理的场景,如科学计算、决策支持

基于思维链(CoT)的推理方法在大语言模型(LLM)解决推理任务中日益重要。然而,推理步骤与状态转移之间的因果幻觉已成为阻碍LLM推理能力发展的主要障碍,尤其在长程推理任务中。本文提出一种非链式推理框架——因果显著性与一致性增强器(CSCE),通过利用治疗效应评估定制LLM的损失函数,从因果显著性和一致性两个方面增强模型推理能力。该方法确保模型捕捉关键因果关系,并在多种场景下保持稳健一致的表现。此外,将传统的逐步递进式推理转变为一次性输出完整推理过程的因果增强方式,进一步提升了推理效率。大量实验表明,该方法显著提高了推理成功率和速度,验证了非链式方法在助力LLM完成推理任务方面的潜力。

原文摘要 · Abstract (English)

Chain-based reasoning methods like chain of thought (CoT) play a rising role in solving reasoning tasks for large language models (LLMs). However, the causal hallucinations between a step of reasoning and corresponding state transitions are becoming a significant obstacle to advancing LLMs' reasoning capabilities, especially in long-range reasoning tasks. This paper proposes a non-chain-based reasoning framework for simultaneous consideration of causal significance and consistency, i.e., the Causal Significance and Consistency Enhancer (CSCE). We customize LLM's loss function utilizing treatment effect assessments to enhance its reasoning ability from two aspects: causal significance and consistency. This ensures that the model captures essential causal relationships and maintains robust and consistent performance across various scenarios. Additionally, we transform the reasoning process from the cascading multiple one-step reasoning commonly used in Chain-Based methods, like CoT, to a causal-enhanced method that outputs the entire reasoning process in one go, further improving the model's reasoning efficiency. Extensive experiments show that our method improves both the reasoning success rate and speed. These improvements further demonstrate that non-chain-based methods can also aid LLMs in completing reasoning tasks.

大模型推理因果增强非链式方法

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。