arXiv:2411.13582cs.CV2024-11被引 1

通过高斯分布建模提升特征响应区分度,增强网络判别能力。

Deep Feature Response Discriminative Calibration

  • 基于高斯分布计算特征置信度,动态校准响应值
  • 在CIFAR-10、ImageNet等数据集上提升分类准确率
  • 可插拔模块,适配主流CNN架构如ResNet

深度神经网络在多个领域广泛应用。已有优化方法如ResNet和SENet通过统一标准调整特征响应以提升模型精度,但缺乏对不同特征的差异化校准,限制了输出表现。为此,本文提出一种差异化的特征响应校准方法。初步实验表明,神经特征响应符合高斯分布,因此采用高斯概率密度函数计算置信度,并将其与原始响应值融合,旨在增强特征判别性。基于该校准值,设计了一种可插拔的校准模块,集成于改进的ResNet结构中,称为响应校准网络(ResCNet)。在CIFAR-10、CIFAR-100、SVHN和ImageNet等多个数据集上的大量实验验证了该方法的有效性。代码已公开于https://github.com/tcmyxc/ResCNet。

原文摘要 · Abstract (English)

Deep neural networks (DNNs) have numerous applications across various domains. Several optimization techniques, such as ResNet and SENet, have been proposed to improve model accuracy. These techniques improve the model performance by adjusting or calibrating feature responses according to a uniform standard. However, they lack the discriminative calibration for different features, thereby introducing limitations in the model output. Therefore, we propose a method that discriminatively calibrates feature responses. The preliminary experimental results indicate that the neural feature response follows a Gaussian distribution. Consequently, we compute confidence values by employing the Gaussian probability density function, and then integrate these values with the original response values. The objective of this integration is to improve the feature discriminability of the neural feature response. Based on the calibration values, we propose a plugin-based calibration module incorporated into a modified ResNet architecture, termed Response Calibration Networks (ResCNet). Extensive experiments on datasets like CIFAR-10, CIFAR-100, SVHN, and ImageNet demonstrate the effectiveness of the proposed approach. The developed code is publicly available at https://github.com/tcmyxc/ResCNet.

特征校准CNN优化深度学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。