arXiv:2502.12616cs.CL2025-02ACL被引 56

用半符号化抽象提升大模型推理准确率,解决传统思维链易受偏见影响的问题。

Improving Chain-of-Thought Reasoning via Quasi-Symbolic Abstractions

  • 仅形式化关键变量和谓词,保留自然语言与符号元素共存
  • 在多个任务上提升思维链准确率最高达8%,增强鲁棒性
  • 适合需要可靠推理的小模型或对抗性测试场景

思维链(CoT)是大语言模型分解复杂任务的常见推理策略,但其生成内容易受语义偏见影响,降低可靠性。现有工作尝试结合逻辑形式化与外部符号求解器,但完全符号化需将自然语言完整翻译为形式语言,效率低且灵活性差。本文提出准符号化抽象方法——QuaSAR,使大模型在不完全形式化的情况下,仅对相关变量和谓词进行形式化,实现自然语言与符号元素共存的高层抽象推理。实验表明,该方法在上下文学习中可提升小模型推理能力,在自然语言任务(MMLU-Redux)和符号推理任务(GSM-Symbolic)上,使基于思维链的方法准确率最高提升8%,显著增强对对抗性变体的鲁棒性与一致性。

原文摘要 · Abstract (English)

Chain-of-Though (CoT) represents a common strategy for reasoning in Large Language Models (LLMs) by decomposing complex tasks into intermediate inference steps. However, explanations generated via CoT are susceptible to content biases that negatively affect their robustness and faithfulness. To mitigate existing limitations, recent work has proposed using logical formalisms coupled with external symbolic solvers. However, fully symbolic approaches possess the bottleneck of requiring a complete translation from natural language to formal languages, a process that affects efficiency and flexibility. To achieve a trade-off, this paper investigates methods to disentangle content from logical reasoning without a complete formalisation. In particular, we present QuaSAR (for Quasi-Symbolic Abstract Reasoning), a variation of CoT that guides LLMs to operate at a higher level of abstraction via quasi-symbolic explanations. Our framework leverages the capability of LLMs to formalise only relevant variables and predicates, enabling the coexistence of symbolic elements with natural language. We show the impact of QuaSAR for in-context learning and for constructing demonstrations to improve the reasoning capabilities of smaller models. Our experiments show that quasi-symbolic abstractions can improve CoT-based methods by up to 8% accuracy, enhancing robustness and consistency on challenging adversarial variations on both natural language (i.e. MMLU-Redux) and symbolic reasoning tasks (i.e., GSM-Symbolic).

思维链符号推理大模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。