arXiv:2508.05311cs.AIcs.CL2025-08被引 2

将决策树与大模型结合,实现可解释的逻辑推理。

A Novel Architecture for Symbolic Reasoning with Decision Trees and LLM Agents

  • 用决策树作符号推理引擎,大模型负责生成与规划。
  • 在证明写作任务中逻辑一致性提升7.2%,数学题准确率增5.3%。
  • 适合需要可解释推理的医疗、科研场景。

我们提出一种混合架构,将基于决策树的符号推理与大语言模型(LLM)的生成能力整合到统一的多智能体系统中。不同于以往松散耦合符号与神经模块的方法,本设计将决策树和随机森林作为可调用的推理接口嵌入系统。树形模块支持可解释的规则推断与因果逻辑,而LLM智能体负责溯因推理、泛化与交互式规划。中央协调器维护信念状态一致性,并管理智能体与外部工具间的通信,实现对结构化与非结构化输入的联合推理。系统在多个推理基准上表现优异:在ProofWriter上通过逻辑驱动的树验证,使蕴含一致性提升7.2%;在GSM8K上通过符号增强,多步数学问题准确率提高5.3%;在ARC上通过引入符号接口,抽象推理准确率提升6.0%。在临床决策支持与科学发现中的应用表明,该系统既能符号化编码领域规则,又能利用大模型进行上下文推理与假说生成。该架构为通用神经符号推理提供了鲁棒、可解释且可扩展的解决方案。

原文摘要 · Abstract (English)

We propose a hybrid architecture that integrates decision tree-based symbolic reasoning with the generative capabilities of large language models (LLMs) within a coordinated multi-agent framework. Unlike prior approaches that loosely couple symbolic and neural modules, our design embeds decision trees and random forests as callable oracles within a unified reasoning system. Tree-based modules enable interpretable rule inference and causal logic, while LLM agents handle abductive reasoning, generalization, and interactive planning. A central orchestrator maintains belief state consistency and mediates communication across agents and external tools, enabling reasoning over both structured and unstructured inputs. The system achieves strong performance on reasoning benchmarks. On \textit{ProofWriter}, it improves entailment consistency by +7.2\% through logic-grounded tree validation. On GSM8k, it achieves +5.3\% accuracy gains in multistep mathematical problems via symbolic augmentation. On \textit{ARC}, it boosts abstraction accuracy by +6.0\% through integration of symbolic oracles. Applications in clinical decision support and scientific discovery show how the system encodes domain rules symbolically while leveraging LLMs for contextual inference and hypothesis generation. This architecture offers a robust, interpretable, and extensible solution for general-purpose neuro-symbolic reasoning.

符号推理大模型决策树可解释性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。