用大模型指导规则专家混合,让机器学习更可信可解释。
MoRE-LLM: Mixture of Rule Experts Guided by a Large Language Model
- 用大模型提炼领域规则,生成可解释的局部规则代理。
- 在多个表格数据集上表现优于可解释与不可解释基线模型。
- 适合需要高可信度和透明决策的医疗、金融等场景。
为提升人工智能系统的可信度与可解释性,需将机器学习模型与人类领域知识对齐,但这通常耗时且依赖数据科学家与领域专家的紧密协作。近期大语言模型(LLM)的发展为此提供了新思路。本文提出一种由大语言模型引导的规则专家混合模型(MoRE-LLM),将数据驱动的黑箱模型与从LLM提取的知识相结合,实现与领域知识一致且透明的预测。其中,规则专家混合(MoRE)在训练中发现局部规则代理并用于分类任务,而LLM则负责修正和上下文化这些规则以增强领域对齐。重要的是,该方法无需在测试阶段调用LLM,既保证可解释性,又避免了大模型可能产生的虚构输出。我们在多个表格数据集上评估了该方法,对比了可解释与不可解释基线模型的表现。除了定量结果,还评估了可解释规则的实际使用情况。此外,我们揭示了LLM如何通过提供额外上下文来增强模型推理过程的可理解性与可信度。
原文摘要 · Abstract (English)
To ensure the trustworthiness and interpretability of AI systems, it is essential to align machine learning models with human domain knowledge. This can be a challenging and time-consuming endeavor that requires close communication between data scientists and domain experts. Recent leaps in the capabilities of Large Language Models (LLMs) can help alleviate this burden. In this paper, we propose a Mixture of Rule Experts guided by a Large Language Model (MoRE-LLM) which combines a data-driven black-box model with knowledge extracted from an LLM to enable domain knowledge-aligned and transparent predictions. While the introduced Mixture of Rule Experts (MoRE) steers the discovery of local rule-based surrogates during training and their utilization for the classification task, the LLM is responsible for enhancing the domain knowledge alignment of the rules by correcting and contextualizing them. Importantly, our method does not rely on access to the LLM during test time and ensures interpretability while not being prone to LLM-based confabulations. We evaluate our method on several tabular data sets and compare its performance with interpretable and non-interpretable baselines. Besides performance, we evaluate our grey-box method with respect to the utilization of interpretable rules. In addition to our quantitative evaluation, we shed light on how the LLM can provide additional context to strengthen the comprehensibility and trustworthiness of the model's reasoning process.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。