动态调整输入分辨率,在延迟约束下提升自动驾驶安全性
Multi-Resolution End-to-End Deep Neural Network for Optimizing Latency-Accuracy Tradeoff in Autonomous Driving

- 运行时按延迟预算选择最优输入分辨率
- 减少变道失误、闯红灯和碰撞,安全指标全面优于固定分辨率模型
- 适合实时自动驾驶系统中资源受限的场景
在自动驾驶等实时应用中,延迟与精度的权衡至关重要。我们观察到:(1)当考虑延迟时,最优网络配置随场景上下文和计算资源变化;(2)单一固定分辨率模型在条件变化时变得次优。本文提出一种基于单目相机输入的多分辨率端到端深度神经网络,用于CARLA城市驾驶挑战。该方法采用支持多输入分辨率的卷积神经网络(CNN),通过每分辨率批量归一化实现运行时的理想分辨率选择,并引入分辨率重映射技术,可在无需原始训练数据的情况下进行多分辨率训练。我们在CARLA中实现并评估该模型,探索延迟-安全边界。结果表明,相比固定分辨率基线,本方法在单路线安全指标上持续提升——包括车道偏离、闯红灯和碰撞次数显著减少。
原文摘要 · Abstract (English)
Latency-accuracy tradeoffs are fundamental in real-time applications of deep neural networks (DNNs) for cyber-physical systems. In autonomous driving, in particular, safety depends on both prediction quality and the end-to-end delay from sensing to actuation. We observe that (1) when latency is accounted for, the latency-optimal network configuration varies with scene context and compute availability; and (2) a single fixed-resolution model becomes suboptimal as conditions change. We present a multi-resolution, end-to-end deep neural network for the CARLA urban driving challenge using monocular camera input. Our approach employs a convolutional neural network (CNN) that supports multiple input resolutions through per-resolution batch normalization, enabling runtime selection of an ideal input scale under a latency budget, as well as resolution retargeting, which allows multi-resolution training without access to the original training dataset. We implement and evaluate our multi-resolution end-to-end CNN in CARLA to explore the latency-safety frontier. Results show consistent improvements in per-route safety metrics - lane invasions, red-light infractions, and collisions - relative to fixed-resolution baselines.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。