让训练后的神经网络更透明可控,通过逆向重构特征实现精细更新。
Hierarchical Feature-level Reverse Propagation for Post-Training Neural Networks
- 逆向传播重构标签条件特征,为上游模块提供显式监督。
- 85种场景中63次优于基线,仅4次反超标准反向传播。
- 适合需要可解释性与稳定微调的自动驾驶模型部署。
端到端神经网络已成为自动驾驶主流范式,可靠部署需具备可控的训练后适应能力与模型更新透明度。本文提出面向训练后神经网络的特征级逆向传播(FR-PT),通过冻结下游网络反向重构标签条件特征,为上游模块提供显式中间监督。首次基于计算一致性原则(CCP)与最小偏差原则(MDP)构建特征重建公式,并设计以MDP为中心的Tikhonov正则化算子特定逆向计算算法,解决数值不稳定的逆问题。具体包括:基于循环卷积定理的可扩展卷积重构、基于最近嵌入的类别标签连续目标构造、以及针对复合残差与Transformer结构的迭代逆向传播。在图像分类与自动驾驶任务上广泛实验表明,该方法在多种架构下均具有效且稳定的适应能力。85个训练后设置中,FR-PT在63次显著优于任务级基线,而匹配的反向传播参考仅在4次胜出。效率、条件性与有利条件分析揭示了重构目标的可靠性与局限性,特征响应分析进一步证明其诊断价值。代码已开源。
原文摘要 · Abstract (English)
End-to-end neural networks have become a dominant paradigm in autonomous driving, where reliable deployment requires controllable post-training adaptation and improved transparency of model updates. In this paper, we propose Feature-level Reverse Propagation for Post-Training (FR-PT), a hierarchical framework that provides explicit intermediate supervision for upstream modules by reconstructing label-conditioned features backward through frozen downstream networks. For the first time, we formulate feature reconstruction via the Computation Consistency Principle (CCP) and Minimum Deviation Principle (MDP), and develop efficient operator-specific reverse computation algorithms with MDP-centered Tikhonov regularization to handle numerically unstable inverse problems. Specifically, FR-PT incorporates circular convolution theorem-based solvers for scalable convolutional reconstruction, nearest embedding for constructing continuous output targets from categorical labels, and iterative reverse propagation for composite residual and Transformer-style blocks. Extensive experiments on image classification and autonomous driving tasks demonstrate effective and stable adaptation across diverse architectures. Among 85 post-training settings, FR-PT achieves statistically significant improvements over task-level baselines in 63 cases, while the matched backpropagation reference outperforms reconstruction-supervised configurations in only 4 cases. Additional efficiency, conditioning, and favorable-condition analyses characterize the reliability and limitations of reconstructed targets, while feature-response analyses further demonstrate their diagnostic value. Code is available at https://github.com/Dingni2000/FR-PT .
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。