arXiv:2602.23871cs.CVcs.LG2026-02

通过云边协同与动态压缩,实现自动驾驶360度实时三维感知

Bandwidth-adaptive Cloud-Assisted 360-Degree 3D Perception for Autonomous Vehicles

  • 采用Transformer融合多摄像头数据生成鸟瞰图,计算任务按需分发至云端
  • 实测端到端延迟降低72%,在波动带宽下仍保持20%精度提升
  • 适合高复杂度城市路况的自动驾驶系统,尤其关注低延迟与带宽适应

自动驾驶面临在严格延迟约束下维持周围障碍物实时感知的关键挑战。高算力需求与车载计算资源有限导致延迟问题,尤其在复杂城市环境中更为突出。为此,本文提出利用车联万物(V2X)通信将部分计算任务卸载至云侧,以缓解车载压力。采用基于Transformer的模型融合多摄像头数据,生成全面的鸟瞰图(BEV)表示,实现360度三维目标检测。计算任务根据本地处理层数与特征量化级别,在车辆与云端之间动态分配。为降低网络负载,传输前对特征向量进行裁剪与压缩。真实场景实验表明,该混合策略相比传统车载方案实现72%的端到端延迟降低。针对带宽波动,引入动态优化算法,自适应选择分割点与量化等级,在满足实时性前提下最大化检测精度。基于实际流量痕迹的评估显示,该自适应方法相较固定参数设置,在相同延迟下精度最高提升20%。

原文摘要 · Abstract (English)

A key challenge for autonomous driving lies in maintaining real-time situational awareness regarding surrounding obstacles under strict latency constraints. The high processing requirements coupled with limited onboard computational resources can cause delay issues, particularly in complex urban settings. To address this, we propose leveraging Vehicle-to-Everything (V2X) communication to partially offload processing to the cloud, where compute resources are abundant, thus reducing overall latency. Our approach utilizes transformer-based models to fuse multi-camera sensor data into a comprehensive Bird's-Eye View (BEV) representation, enabling accurate 360-degree 3D object detection. The computation is dynamically split between the vehicle and the cloud based on the number of layers processed locally and the quantization level of the features. To further reduce network load, we apply feature vector clipping and compression prior to transmission. In a real-world experimental evaluation, our hybrid strategy achieved a 72 \% reduction in end-to-end latency compared to a traditional onboard solution. To adapt to fluctuating network conditions, we introduce a dynamic optimization algorithm that selects the split point and quantization level to maximize detection accuracy while satisfying real-time latency constraints. Trace-based evaluation under realistic bandwidth variability shows that this adaptive approach improves accuracy by up to 20 \% over static parameterization with the same latency performance.

自动驾驶云边协同360度感知动态调度

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。