提出分层迭代压缩法,提升多层模型推理逻辑的忠实度。
ILLC: Iterative Layer-by-Layer Compression for Enhancing Structural Faithfulness in SpArX
- 逐层压缩并实时补偿误差,减少信息丢失。
- 在乳腺癌数据集上降低输入输出与结构失真率。
- 适合需要透明解释的复杂MLP模型应用。
在可解释人工智能(XAI)领域,论点式XAI方法通过将隐藏节点解释为论证,以更透明的方式展现深度神经网络的内部推理过程。然而,随着层数增加,现有压缩方法一次性简化所有层,导致累积信息损失严重。为此,我们提出一种迭代分层压缩技术:每层单独压缩,并立即补偿下一层的还原误差,从而提升模型整体的输入-输出一致性和结构保真度。在乳腺癌诊断数据集上的实验表明,相比传统压缩方法,该方法有效降低了输入输出与结构失真,维持了论点解释中攻击-支持关系的一致性。这为在保持内部推理逻辑不变的前提下,压缩复杂MLP模型提供了新路径。
原文摘要 · Abstract (English)
In the field of Explainable Artificial Intelligence (XAI), argumentative XAI approaches have been proposed to represent the internal reasoning process of deep neural networks in a more transparent way by interpreting hidden nodes as arguements. However, as the number of layers increases, existing compression methods simplify all layers at once, which lead to high accumulative information loss. To compensate for this, we propose an iterative layer-by-layer compression technique in which each layer is compressed separately and the reduction error in the next layer is immediately compensated for, thereby improving the overall input-output and structural fidelity of the model. Experiments on the Breast Cancer Diagnosis dataset show that, compared to traditional compression, the method reduces input-output and structural unfaithfulness, and maintains a more consistent attack-support relationship in the Argumentative Explanation scheme. This is significant because it provides a new way to make complex MLP models more compact while still conveying their internal inference logic without distortion.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。