arXiv:2601.07393cs.AI2026-01

提出软硬件协同优化框架,提升自动驾驶系统效率与实用性。

Software-Hardware Co-optimization for Modular E2E AV Paradigm: A Unified Framework of Optimization Approaches, Simulation Environment and Evaluation Metrics

  • 软硬件联合优化,统一系统目标,打破单一侧优化局限。
  • 实测降低推理延迟与能耗,保持原有驾驶性能水平。
  • 多维评估指标支持策略对比,适合自动驾驶部署研究者。

模块化端到端(ME2E)自动驾驶范式兼具模块可解释性与全局优化能力,表现出强劲性能。然而,现有研究多聚焦精度提升,忽视推理延迟与能耗等系统级因素,导致模型设计日益复杂,阻碍实际部署。以往的模型压缩与加速方法通常仅优化软件或硬件一侧:纯软件优化无法根除中间张量访问与算子调度开销,纯硬件优化则受限于模型结构与精度。为此,本文提出一个可复用的软硬件协同优化与闭环评估框架,将软件层模型优化与硬件层计算优化联合在统一系统目标下进行。同时引入多维度评估指标,综合考量安全性、舒适性、效率、延迟与能耗,实现不同优化策略的定量比较。在多个ME2E自动驾驶系统上的实验表明,该框架在保持基线驾驶性能的同时,显著降低推理延迟与能耗,实现显著的整体系统级提升。结果证明,该框架为ME2E自动驾驶系统的高效部署提供了切实可行的指导。

原文摘要 · Abstract (English)

Modular end-to-end (ME2E) autonomous driving paradigms combine modular interpretability with global optimization capability and have demonstrated strong performance. However, existing studies mainly focus on accuracy improvement, while critical system-level factors such as inference latency and energy consumption are often overlooked, resulting in increasingly complex model designs that hinder practical deployment. Prior efforts on model compression and acceleration typically optimize either the software or hardware side in isolation. Software-only optimization cannot fundamentally remove intermediate tensor access and operator scheduling overheads, whereas hardware-only optimization is constrained by model structure and precision. As a result, the real-world benefits of such optimizations are often limited. To address these challenges, this paper proposes a reusable software and hardware co-optimization and closed-loop evaluation framework for ME2E autonomous driving inference. The framework jointly integrates software-level model optimization with hardware-level computation optimization under a unified system-level objective. In addition, a multidimensional evaluation metric is introduced to assess system performance by jointly considering safety, comfort, efficiency, latency, and energy, enabling quantitative comparison of different optimization strategies. Experiments across multiple ME2E autonomous driving stacks show that the proposed framework preserves baseline-level driving performance while significantly reducing inference latency and energy consumption, achieving substantial overall system-level improvements. These results demonstrate that the proposed framework provides practical and actionable guidance for efficient deployment of ME2E autonomous driving systems.

自动驾驶软硬件协同系统优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。