arXiv:2512.07246cs.CL2025-12KDD被引 4

用大模型生成可解释的决策树,提升表格错误检测的准确性和稳定性。

Ensembling LLM-Induced Decision Trees for Explainable and Robust Error Detection

  • 让大模型根据数据上下文生成分步判断的决策树,每步明确规则或模式
  • 集成多棵决策树,通过共识机制将平均F1提升16.1%
  • 适合需要透明、可靠错误检测的金融、医疗等高风险场景

错误检测(ED)旨在识别表格数据中不正确或不一致的单元格值,对保障数据质量至关重要。现有基于大语言模型(LLM)的方法直接以模型为标签器,但其决策过程隐晦且依赖随机单次推理,导致结果不稳定。为此,我们提出一种大模型作为诱导者(LLM-as-an-inducer)框架:先用提示词引导大模型生成决策树骨架(TreeED),再对多个数据子集构建多棵决策树并集成(ForestED)。每棵树包含三类节点:规则节点执行格式或范围检查,图神经网络(GNN)节点捕捉函数依赖等复杂模式,叶节点输出最终判断。ForestED采用不确定性采样获取有信息量的行子集,并使用期望最大化算法联合估计树可靠性与优化共识预测。实验表明,该方法在准确率、可解释性与鲁棒性上均显著优于基线,平均F1提升16.1%。

原文摘要 · Abstract (English)

Error detection (ED), which aims to identify incorrect or inconsistent cell values in tabular data, is important for ensuring data quality. Recent state-of-the-art ED methods leverage the pre-trained knowledge and semantic capability of large language models (LLMs) to directly label whether a cell is erroneous. However, this LLM-as-a-labeler pipeline produces predictions through an implicit black-box process with limited traceability and explicit justification, and relies on stochastic single-pass inference, resulting in inconsistent and insufficiently robust detections across contexts. To address these limitations, we propose an LLM-as-an-inducer framework that uses an LLM to induce a decision tree for ED, termed TreeED, and ensembles multiple such trees for consensus detection, termed ForestED. Based on prompts derived from data context, decision tree specifications, and output requirements, TreeED queries the LLM to induce a decision tree skeleton whose root-to-leaf paths specify the stepwise procedure for evaluating a sample. Each tree contains three types of nodes: (1) rule nodes that perform simple validation checks, such as format or range constraints; (2) Graph Neural Network (GNN) nodes that capture complex patterns, such as functional dependencies; and (3) leaf nodes that output the final decision as error or clean. ForestED employs uncertainty sampling to obtain multiple informative row subsets and constructs a decision tree for each subset using TreeED. It then applies an Expectation-Maximization-based algorithm to jointly estimate tree reliability and optimize the consensus ED prediction. Experiments demonstrate that our methods are accurate, explainable, and robust, achieving an average F1-score improvement of 16.1% over the best baseline.

错误检测可解释性大模型决策树

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。