arXiv:2411.06851cs.CVcs.LG2024-11被引 3

提出轻量级鸟瞰图实例预测模型,提升自动驾驶感知速度与精度

Fast and Efficient Transformer-based Method for Bird's Eye View Instance Prediction

  • 基于简化架构,仅依赖实例分割与光流预测
  • 参数量和推理时间显著低于现有最先进方法
  • 专为实时部署优化,适合车载系统应用

准确的目标检测与预测对保障自动驾驶系统的安全与效率至关重要。预测目标轨迹与占据区域使自动驾驶车辆能够预判运动并基于未来信息做出决策,增强适应性并降低事故风险。当前最先进方法常将检测、跟踪与预测阶段分离,导致阶段间误差累积,引发显著预测偏差。近年来,通过鸟瞰图(BEV)变换改进多摄像头感知系统的特征表示,推动了端到端系统的发展,可直接从车辆传感器数据中预测环境要素。然而,这些系统往往存在处理延迟高、参数量大等问题,限制了实际部署。本文提出一种基于简化范式的新型BEV实例预测架构,仅依赖实例分割与光流预测。所提系统注重速度,相比现有SOTA架构大幅降低参数量与推理时间,得益于高效的Transformer结构。此外,该架构在PyTorch 2.1中进行了性能优化。代码与训练模型已公开于https://github.com/miguelag99/Efficient-Instance-Prediction。

原文摘要 · Abstract (English)

Accurate object detection and prediction are critical to ensure the safety and efficiency of self-driving architectures. Predicting object trajectories and occupancy enables autonomous vehicles to anticipate movements and make decisions with future information, increasing their adaptability and reducing the risk of accidents. Current State-Of-The-Art (SOTA) approaches often isolate the detection, tracking, and prediction stages, which can lead to significant prediction errors due to accumulated inaccuracies between stages. Recent advances have improved the feature representation of multi-camera perception systems through Bird's-Eye View (BEV) transformations, boosting the development of end-to-end systems capable of predicting environmental elements directly from vehicle sensor data. These systems, however, often suffer from high processing times and number of parameters, creating challenges for real-world deployment. To address these issues, this paper introduces a novel BEV instance prediction architecture based on a simplified paradigm that relies only on instance segmentation and flow prediction. The proposed system prioritizes speed, aiming at reduced parameter counts and inference times compared to existing SOTA architectures, thanks to the incorporation of an efficient transformer-based architecture. Furthermore, the implementation of the proposed architecture is optimized for performance improvements in PyTorch version 2.1. Code and trained models are available at https://github.com/miguelag99/Efficient-Instance-Prediction

自动驾驶鸟瞰图实例预测轻量化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。