用决策树生成可解释推理路径,提升表格数据预测的准确性与可信度。
ReSS: Learning Reasoning Models for Tabular Data Prediction via Symbolic Scaffold

- 以决策树提取实例级推理路径作为符号骨架
- 使大模型生成符合逻辑的自然语言解释,准确率提升10%
- 适合医疗金融等需高可信度预测的场景
表格数据在医疗、金融等高风险领域仍广泛使用,要求预测模型兼具高精度与人类可理解的推理能力。符号模型虽具可验证性但语义表达弱,通用大模型则需特殊微调才能掌握领域特定推理。为此,我们提出ReSS框架,通过决策树模型提取实例级决策路径作为符号骨架,结合输入特征与标签,引导大模型生成严格遵循底层逻辑的自然语言推理。由此构建高质量数据集,用于微调预训练大模型为专用表格推理模型,并采用骨架无关的数据增强策略提升泛化与可解释性。为量化评估忠实性,引入幻觉率、解释必要性与充分性等指标。在医疗与金融基准测试中,ReSS训练模型相比传统决策树与标准微调方法最高提升10%准确率,同时保持可靠一致的推理。
原文摘要 · Abstract (English)
Tabular data remains prevalent in high-stakes domains such as healthcare and finance, where predictive models are expected to provide both high accuracy and faithful, human-understandable reasoning. While symbolic models offer verifiable logic, they lack semantic expressiveness. Meanwhile, general-purpose LLMs often require specialized fine-tuning to master domain-specific tabular reasoning. To address the dual challenges of scalable data curation and reasoning consistency, we propose ReSS, a systematic framework that bridges symbolic and neural reasoning models. ReSS leverages a decision-tree model to extract instance-level decision paths as symbolic scaffolds. These scaffolds, alongside input features and labels, guide an LLM to generate grounded natural-language reasoning that strictly adheres to the underlying decision logic. The resulting high-quality dataset is used to fine-tune a pretrained LLM into a specialized tabular reasoning model, further enhanced by a scaffold-invariant data augmentation strategy to improve generalization and explainability. To rigorously assess faithfulness, we introduce quantitative metrics including hallucination rate, explanation necessity, and explanation sufficiency. Experimental results on medical and financial benchmarks demonstrate that ReSS-trained models improve traditional decision trees and standard fine-tuning approaches up to $10\%$ while producing faithful and consistent reasoning
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。