arXiv:2505.05744cs.LGcs.CL2025-05被引 2

用大模型解释指导小模型,让表格分类更准且可解释。

Harnessing LLMs Explanations to Boost Surrogate Models in Tabular Data Classification

  • 用大模型生成推理解释,指导小模型选示范样本。
  • 在多个数据集上平均提升5.31%准确率。
  • 适合需要可解释性与低资源部署的表格分类场景。

大型语言模型(LLMs)在解决复杂任务方面表现出色,使其成为增强表格学习的有力工具。然而,现有基于LLM的方法存在资源消耗高、示范样本选择不佳及可解释性有限等问题,严重制约其预测性能与实际应用。为此,我们提出一种新颖的上下文学习框架用于表格预测。核心思想是利用LLM生成的解释来指导一个更小、可本地部署的代理语言模型(SLM)进行可解释的表格预测。该框架包含三个阶段:(i) 后验解释生成,使用LLM为候选示范中的问答对生成解释,揭示答案背后的推理过程;(ii) 后验解释引导的示范选择,利用LLM生成的解释指导从候选示范中筛选最优样本;(iii) 后验解释引导的可解释SLM预测,将步骤(ii)选出的示范作为上下文,并融合对应解释作为推理依据,提升SLM性能并引导生成可解释输出。实验结果表明,该框架在多个领域各异的表格数据集上平均提升5.31%准确率。

原文摘要 · Abstract (English)

Large Language Models (LLMs) have shown remarkable ability in solving complex tasks, making them a promising tool for enhancing tabular learning. However, existing LLM-based methods suffer from high resource requirements, suboptimal demonstration selection, and limited interpretability, which largely hinder their prediction performance and application in the real world. To overcome these problems, we propose a novel in-context learning framework for tabular prediction. The core idea is to leverage the explanations generated by LLMs to guide a smaller, locally deployable Surrogate Language Model (SLM) to make interpretable tabular predictions. Specifically, our framework mainly involves three stages: (i) Post Hoc Explanation Generation, where LLMs are utilized to generate explanations for question-answer pairs in candidate demonstrations, providing insights into the reasoning behind the answer. (ii) Post Hoc Explanation-Guided Demonstrations Selection, which utilizes explanations generated by LLMs to guide the process of demonstration selection from candidate demonstrations. (iii) Post Hoc Explanation-Guided Interpretable SLM Prediction, which utilizes the demonstrations obtained in step (ii) as in-context and merges corresponding explanations as rationales to improve the performance of SLM and guide the model to generate interpretable outputs. Experimental results highlight the framework's effectiveness, with an average accuracy improvement of 5.31% across various tabular datasets in diverse domains.

表格分类可解释性小模型大模型解释

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。