arXiv:2505.15817cs.CL2025-05被引 23

让大模型同时用语言、代码和逻辑表三种方式推理,提升逻辑题解题准确率。

Learning to Reason via Mixture-of-Thought for Logical Reasoning

  • 训练时自动生成多模态思维链,融合自然语言、代码和逻辑表
  • 在FOLIO和ProofWriter上比单一模态方法平均高11.7个百分点准确率
  • 特别擅长解决复杂逻辑题,逻辑表能有效弥补语言推理的缺陷

人类在解决逻辑问题时会自然运用多种推理方式,如自然语言、代码和符号逻辑。而现有基于大模型的方法通常仅使用单一推理模态(如自然语言)进行训练,尽管部分方法在推理阶段尝试模态选择或增强,但训练过程仍对模态无感知,限制了模态间的协同效应。为此,本文提出混合思维(Mixture-of-Thought, MoT)框架,使大模型能在自然语言、代码及新引入的真值表(truth-table)三种互补模态下进行推理。真值表通过系统枚举逻辑情形,部分缓解自然语言推理中的关键失败模式。MoT采用两阶段设计:(1) 自进化训练阶段,联合学习跨模态过滤后的自生成推理路径;(2) 推理阶段,充分调动三模态协同优势以生成更优预测。在包括FOLIO和ProofWriter在内的多个逻辑推理基准上的实验表明,该框架显著优于主流单模态思维链基线,平均准确率提升达+11.7pp。进一步分析显示,该框架在训练与推理阶段均有效,尤其在较难逻辑问题上表现突出,且不同模态贡献互补能力,其中真值表推理有助于克服自然语言推理的关键瓶颈。

原文摘要 · Abstract (English)

Human beings naturally utilize multiple reasoning modalities to learn and solve logical problems, i.e., different representational formats such as natural language, code, and symbolic logic. In contrast, most existing LLM-based approaches operate with a single reasoning modality during training, typically natural language. Although some methods explored modality selection or augmentation at inference time, the training process remains modality-blind, limiting synergy among modalities. To fill in this gap, we propose Mixture-of-Thought (MoT), a framework that enables LLMs to reason across three complementary modalities: natural language, code, and a newly introduced symbolic modality, truth-table, which systematically enumerates logical cases and partially mitigates key failure modes in natural language reasoning. MoT adopts a two-phase design: (1) self-evolving MoT training, which jointly learns from filtered, self-generated rationales across modalities; and (2) MoT inference, which fully leverages the synergy of three modalities to produce better predictions. Experiments on logical reasoning benchmarks including FOLIO and ProofWriter demonstrate that our MoT framework consistently and significantly outperforms strong LLM baselines with single-modality chain-of-thought approaches, achieving up to +11.7pp average accuracy gain. Further analyses show that our MoT framework benefits both training and inference stages; that it is particularly effective on harder logical reasoning problems; and that different modalities contribute complementary strengths, with truth-table reasoning helping to overcome key bottlenecks in natural language inference.

逻辑推理多模态大模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。