arXiv:2509.16277cs.LGcs.AI2025-09

用信息熵正则化提升自动驾驶感知的稳定与可解释性

Stabilizing Information Flow Entropy: Regularization for Safe and Interpretable Autonomous Driving Perception

  • 将神经网络视为分层通信链,约束信息流平滑与熵递减
  • 在KITTI和nuScenes上检测分布外数据灵敏度提升达100倍
  • 无需修改结构,轻量正则器可插拔用于现有模型

自动驾驶中的深度感知网络通常依赖数据密集型训练和事后异常检测,忽视了信息处理稳定性所受的信息论约束。本文将深度神经编码器重新理解为分层通信链,逐步将原始传感输入压缩为任务相关的潜在特征。在此框架下,提出两个理论合理的设计原则:(D1) 相邻层间互信息平滑变化,(D2) 潜在熵随网络深度单调下降。分析表明,在典型架构假设下(特别是包含相同容量重复块),强制实现信息流平滑(D1)会自然促进熵衰减(D2),从而保证稳定压缩。基于此,提出Eloss——一种基于熵的轻量级正则化项,作为可插拔的训练目标。该方法不追求精度微调,而是一次范式转变:将信息论稳定性与标准感知任务统一,通过熵偏移实现显式、有理论依据的异常输入检测。在大规模3D目标检测基准KITTI和nuScenes上的实验验证表明,引入Eloss在保持或提升精度的同时,显著增强对异常情况的敏感度,分布偏移信号放大最高达两个数量级。这一稳定信息压缩视角不仅提升可解释性,也为更安全、更鲁棒的自动驾驶感知系统提供了坚实的理论基础。

原文摘要 · Abstract (English)

Deep perception networks in autonomous driving traditionally rely on data-intensive training regimes and post-hoc anomaly detection, often disregarding fundamental information-theoretic constraints governing stable information processing. We reconceptualize deep neural encoders as hierarchical communication chains that incrementally compress raw sensory inputs into task-relevant latent features. Within this framework, we establish two theoretically justified design principles for robust perception: (D1) smooth variation of mutual information between consecutive layers, and (D2) monotonic decay of latent entropy with network depth. Our analysis shows that, under realistic architectural assumptions, particularly blocks comprising repeated layers of similar capacity, enforcing smooth information flow (D1) naturally encourages entropy decay (D2), thus ensuring stable compression. Guided by these insights, we propose Eloss, a novel entropy-based regularizer designed as a lightweight, plug-and-play training objective. Rather than marginal accuracy improvements, this approach represents a conceptual shift: it unifies information-theoretic stability with standard perception tasks, enabling explicit, principled detection of anomalous sensor inputs through entropy deviations. Experimental validation on large-scale 3D object detection benchmarks (KITTI and nuScenes) demonstrates that incorporating Eloss consistently achieves competitive or improved accuracy while dramatically enhancing sensitivity to anomalies, amplifying distribution-shift signals by up to two orders of magnitude. This stable information-compression perspective not only improves interpretability but also establishes a solid theoretical foundation for safer, more robust autonomous driving perception systems.

自动驾驶信息熵感知安全正则化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。