提出时空解耦方法,提升自动驾驶环境占位预测的精度与速度
Spatiotemporal Decoupling for Efficient Vision-Based Occupancy Forecasting
- 将3D占位分解为2D鸟瞰图与高度值,降低空间冗余
- 通过时序关联预测实现动态物体更准追踪,推理仅需82.33ms
- 新指标C-IoU适用于标注不全数据,适合自动驾驶场景
占位预测(OCF)旨在利用历史与当前感知数据,预测自动驾驶车辆周围环境未来的占位状态,对避障与路径规划等下游任务至关重要。现有3D OCF方法难以准确预测移动物体的空间细节,且因忽略时空变化的偏置与分布不均导致推理缓慢。本文提出一种新颖的视觉基时空解耦范式,显式处理时空偏置,实现高效且精准的3D OCF。针对空域偏置,引入新型空间表示,将传统密集3D格式解耦为2D鸟瞰图(BEV)占位与对应高度值,仅依赖2D预测即可实现3D OCF,显著提升效率。针对时序静态体偏置,设计时序解耦机制,通过预测运动流实现实例时序关联,优化端到端性能。构建高效多头网络EfficientOCF,基于所提时空解耦表示实现3D OCF。同时提出新评估指标条件交并比(C-IoU),在存在缺失或不完整标注的数据集上仍具鲁棒性。实验表明,EfficientOCF在准确率与效率上均超越现有基线方法,达到当前最优水平,单卡推理时间仅为82.33ms。代码将开源。
原文摘要 · Abstract (English)
The task of occupancy forecasting (OCF) involves utilizing past and present perception data to predict future occupancy states of autonomous vehicle surrounding environments, which is critical for downstream tasks such as obstacle avoidance and path planning. Existing 3D OCF approaches struggle to predict plausible spatial details for movable objects and suffer from slow inference speeds due to neglecting the bias and uneven distribution of changing occupancy states in both space and time. In this paper, we propose a novel spatiotemporal decoupling vision-based paradigm to explicitly tackle the bias and achieve both effective and efficient 3D OCF. To tackle spatial bias in empty areas, we introduce a novel spatial representation that decouples the conventional dense 3D format into 2D bird's-eye view (BEV) occupancy with corresponding height values, enabling 3D OCF derived only from 2D predictions thus enhancing efficiency. To reduce temporal bias on static voxels, we design temporal decoupling to improve end-to-end OCF by temporally associating instances via predicted flows. We develop an efficient multi-head network EfficientOCF to achieve 3D OCF with our devised spatiotemporally decoupled representation. A new metric, conditional IoU (C-IoU), is also introduced to provide a robust 3D OCF performance assessment, especially in datasets with missing or incomplete annotations. The experimental results demonstrate that EfficientOCF surpasses existing baseline methods on accuracy and efficiency, achieving state-of-the-art performance with a fast inference time of 82.33ms with a single GPU. Our code will be released as open source.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。