用熵损失提升自动驾驶3D检测模型的可解释性与准确率
Entropy Loss: An Interpretability Amplifier of 3D Object Detection Network for Intelligent Driving
- 基于特征压缩网络设计熵损失,引导模型输出更可解释的特征
- 在KITTI数据集上,60轮训练下检测精度提升4.47%
- 适合关注自动驾驶模型可解释性的研究者和工程师
随着交通环境日益复杂,智能驾驶中的安全感知愈发重要。传统感知方法依赖深度学习,存在可解释性差的问题,常被视为“黑箱”。本文提出一种新型损失函数——熵损失(Entropy Loss)及创新训练策略。该损失基于感知模型中特征压缩网络的功能设计,借鉴通信系统思想,期望特征压缩过程的信息量稳定变化且信息熵持续下降。通过将网络层输出建模为连续随机变量,构建概率模型量化信息量变化,进而推导熵损失,指导参数更新以增强模型可解释性。实验表明,采用熵损失训练策略可加速收敛;在相同60个训练周期下,KITTI测试集上的3D目标检测模型精度最高提升4.47%,验证了方法的有效性。代码已开源:https://github.com/yhbcode000/Eloss-Interpretability。
原文摘要 · Abstract (English)
With the increasing complexity of the traffic environment, the significance of safety perception in intelligent driving is intensifying. Traditional methods in the field of intelligent driving perception rely on deep learning, which suffers from limited interpretability, often described as a "black box." This paper introduces a novel type of loss function, termed "Entropy Loss," along with an innovative training strategy. Entropy Loss is formulated based on the functionality of feature compression networks within the perception model. Drawing inspiration from communication systems, the information transmission process in a feature compression network is expected to demonstrate steady changes in information volume and a continuous decrease in information entropy. By modeling network layer outputs as continuous random variables, we construct a probabilistic model that quantifies changes in information volume. Entropy Loss is then derived based on these expectations, guiding the update of network parameters to enhance network interpretability. Our experiments indicate that the Entropy Loss training strategy accelerates the training process. Utilizing the same 60 training epochs, the accuracy of 3D object detection models using Entropy Loss on the KITTI test set improved by up to 4.47\% compared to models without Entropy Loss, underscoring the method's efficacy. The implementation code is available at https://github.com/yhbcode000/Eloss-Interpretability.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。