arXiv:2608.17063cs.LGcs.CL2026-08

从语言模型分类器中提取可执行的决策知识,实现透明化与复用。

J-Miner: Recovering Executable Decision Knowledge from Language-Model Classifiers

论文配图:J-Miner: Recovering Executable Decision Knowledge from Language-Model Classifiers
图 1 · 摘自论文原文
  • 通过聚合多层文本特征,挖掘命名概念并生成可执行规则。
  • 规则准确率达源模型98.3%,比基于词的规则高6.0–29.5个百分点。
  • 知识可迁移至小模型,参数减少24倍仍保持99.8%准确率。

大型语言模型经过微调后可在多种文本任务中表现优异,并做出复杂判断,但其决策过程仅输出最终标签,内部知识隐含于模型中。本文提出J-Miner,通过整合跨层与词元位置的词汇对齐信号,挖掘文本级命名概念,并利用分类器自身预测学习可执行的决策规则,将局部内部读数提炼为显式分类器级知识表示。在多个分类任务中,J-Miner规则可复现高达98.3%的源分类器决策,且行为保真度比同等规模基于输入词的规则高出6.0–29.5个百分点。分析表明,命名概念反映任务决策的内在语义证据,规则则将这些分布式信号整合为可检视的决策结构。该知识还可迁移至轻量级独立学生模型:仅需源模型约1/24参数,即可从原始文本重构并执行该表示,同时保持99.8%的平均任务准确率。结果表明,特定任务的决策知识可被忠实编码为显式、可执行形式,并在原模型外复用。

原文摘要 · Abstract (English)

Large language models can be fine-tuned into specialized classifiers that perform well across diverse text tasks and make complex judgments, but they typically expose only final labels, leaving the decision knowledge acquired through fine-tuning implicit within the model. We study how to mine this internal decision knowledge from a fine-tuned classifier and encode it in an executable representation that can be inspected, validated, and reused beyond the source classifier. We introduce J-Miner, which mines text-level named concepts by aggregating vocabulary-aligned internal signals across layers and token positions, and uses the classifier's own predictions to learn executable decision rules over them. This process distills local internal readouts into an explicit classifier-level knowledge representation. Across multiple classification tasks, J-Miner rules reproduce up to 98.3\% of source-classifier decisions and achieve 6.0--29.5 percentage points higher behavioral fidelity than equally compact rules learned from input words. Further analysis shows that the named concepts reflect internal semantic evidence associated with task decisions, while the learned rules consolidate these distributed signals into inspectable decision structures. The resulting decision knowledge also transfers to lightweight standalone students: using about 1/24 as many parameters as the source classifiers, they reconstruct and execute the representation from raw text while retaining 99.8\% of the source classifiers' mean task accuracy. These findings show that task-specific decision knowledge can be faithfully represented in an explicit, executable form and reused beyond the classifier in which it was learned.

知识提取可解释性模型压缩决策规则

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。