arXiv:2603.24041stat.MEcs.LG2026-03

让深度模型自动找到最小必要表示,既提升精度又可解释。

Minimal Sufficient Representations for Self-interpretable Deep Neural Networks

  • 自适应识别预测所需的最小表示维度,保留原模型表达能力。
  • 在生物医学与视觉任务中误差降低最高达30%,且自动发现可解释模式。
  • 结合统计检验,实现从模型学习到可验证推断的跨越,适合需可信AI的研究者。

深度神经网络(DNNs)虽表现卓越,却因过参数化难以解释。本文提出DeepIn框架,可自适应识别并学习维持标准DNN完整表达能力所需的最小表示。实验表明,DeepIn能准确确定最小表示维度,筛选相关变量,并恢复最小充分网络结构。所得估计器达到最优非渐近误差率,且自适应于学习到的最小维度,证明重构最小充分结构能显著改善泛化误差。基于此理论保障,我们进一步构建了针对所选变量和学习表示的假设检验方法,连接深度表征学习与正式统计推断。在生物医学与视觉基准上,DeepIn同时提升预测准确率与可解释性,在真实数据集上误差最高降低30%,并自动揭示人类可读的判别模式。结果表明,可在不牺牲性能的前提下,将可解释性与统计严谨性直接嵌入深度架构。

原文摘要 · Abstract (English)

Deep neural networks (DNNs) achieve remarkable predictive performance but remain difficult to interpret, largely due to overparameterization that obscures the minimal structure required for interpretation. Here we introduce DeepIn, a self-interpretable neural network framework that adaptively identifies and learns the minimal representation necessary for preserving the full expressive capacity of standard DNNs. We show that DeepIn can correctly identify the minimal representation dimension, select relevant variables, and recover the minimal sufficient network architecture for prediction. The resulting estimator achieves optimal non-asymptotic error rates that adapt to the learned minimal dimension, demonstrating that recovering minimal sufficient structure fundamentally improves generalization error. Building on these guarantees, we further develop hypothesis testing procedures for both selected variables and learned representations, bridging deep representation learning with formal statistical inference. Across biomedical and vision benchmarks, DeepIn improves both predictive accuracy and interpretability, reducing error by up to 30% on real-world datasets while automatically uncovering human-interpretable discriminative patterns. Our results suggest that interpretability and statistical rigor can be embedded directly into deep architectures without sacrificing performance.

可解释性最小表示统计推断深度学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。