arXiv:2508.00127cs.LG2025-08被引 2

提出结构化变换提升神经网络稳定性与可解释性

Structured Transformations for Stable and Interpretable Neural Computation

  • 将层变换分解为结构化线性部分和残差修正项
  • 改善梯度条件,降低对扰动敏感度,增强各层鲁棒性
  • 适合关注模型稳定性和可解释性的研究者

尽管现代神经网络表现优异,但缺乏促进学习稳定性和行为可解释性的结构保障。本文提出一种层级变换的重构形式,摆脱传统的无约束仿射范式。每个变换由结构化线性算子和残差校正分量组成,实现更受控的信号传播和更优的训练动态。该框架强化内部一致性,支持深层信息稳定流动,同时兼容标准学习目标与反向传播。通过一系列合成与真实世界实验,验证使用此类结构化变换的模型具备更好的梯度条件、更低的扰动敏感性以及逐层鲁棒性,且优势在不同架构规模与训练策略下均持续存在。本研究为更具原则性的神经架构设计奠定基础,兼顾稳定性与透明性,提供无需牺牲表达能力的新工具以理解学习行为。

原文摘要 · Abstract (English)

Despite their impressive performance, contemporary neural networks often lack structural safeguards that promote stable learning and interpretable behavior. In this work, we introduce a reformulation of layer-level transformations that departs from the standard unconstrained affine paradigm. Each transformation is decomposed into a structured linear operator and a residual corrective component, enabling more disciplined signal propagation and improved training dynamics. Our formulation encourages internal consistency and supports stable information flow across depth, while remaining fully compatible with standard learning objectives and backpropagation. Through a series of synthetic and real-world experiments, we demonstrate that models constructed with these structured transformations exhibit improved gradient conditioning, reduced sensitivity to perturbations, and layer-wise robustness. We further show that these benefits persist across architectural scales and training regimes. This study serves as a foundation for a more principled class of neural architectures that prioritize stability and transparency-offering new tools for reasoning about learning behavior without sacrificing expressive power.

神经网络稳定性可解释性结构化变换

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。