arXiv:2412.15314cs.CLcs.AI2024-12被引 1

通过引导模型进行因果推理,用更少训练成本提升推理能力

Eliciting Causal Abilities in Large Language Models for Reasoning Tasks

  • 用自洽因果指令增强生成高质量观测数据
  • 基于文本特征估计因果效应,优化提示指令
  • 结合对象关系原则实现低成本可复用的指令设计

提示优化能自动改进提示表达,释放大语言模型在下游任务中的潜力。然而,现有方法训练成本高且可解释性差。本文提出通过提示指令引导模型具备因果推理能力,以纠正答案偏差。我们提出自洽因果指令增强(SCIE)方法:让模型生成高质量、低数量的观测数据,基于这些数据估计因果效应,并生成具有优化因果效应的指令。在SCIE中,指令被视为处理变量,文本特征用于处理自然语言,建立指令与下游任务间的因果关系。此外,引入对象-关系(OR)原则,将发现的因果关系作为任务对象的可继承类,确保低成本复用。大量实验表明,该方法在降低提示训练成本的同时有效提升推理性能,利用可解释的文本特征提供可操作洞察。

原文摘要 · Abstract (English)

Prompt optimization automatically refines prompting expressions, unlocking the full potential of LLMs in downstream tasks. However, current prompt optimization methods are costly to train and lack sufficient interpretability. This paper proposes enhancing LLMs' reasoning performance by eliciting their causal inference ability from prompting instructions to correct answers. Specifically, we introduce the Self-Causal Instruction Enhancement (SCIE) method, which enables LLMs to generate high-quality, low-quantity observational data, then estimates the causal effect based on these data, and ultimately generates instructions with the optimized causal effect. In SCIE, the instructions are treated as the treatment, and textual features are used to process natural language, establishing causal relationships through treatments between instructions and downstream tasks. Additionally, we propose applying Object-Relational (OR) principles, where the uncovered causal relationships are treated as the inheritable class across task objects, ensuring low-cost reusability. Extensive experiments demonstrate that our method effectively generates instructions that enhance reasoning performance with reduced training cost of prompts, leveraging interpretable textual features to provide actionable insights.

因果推理提示优化大模型可解释性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。