提出轻量框架OccProphet,显著降低摄像头4D占用预测的计算开销。
OccProphet: Pushing Efficiency Frontier of Camera-Only 4D Occupancy Forecasting with Observer-Forecaster-Refiner Framework
- 分三阶段:观察者提取特征,预测器生成结果,精炼器优化输出。
- 计算成本降58%~78%,推理速度提升2.6倍,准确率提高4%~18%。
- 适合部署在边缘设备,对自动驾驶系统有实用价值。
预测复杂交通环境中的变化对自动驾驶安全至关重要。近期的占用预测进展已能通过观测历史2D图像,预测未来3D空间的占用状态。然而,高昂的计算需求使得该技术在训练与推理阶段效率低下,限制了其在边缘设备上的部署。本文提出新框架OccProphet,以极低的计算开销实现高效且准确的占用预测。该框架包含三个轻量组件:观察者、预测器和精炼器。观察者利用提出的高效4D聚合与三重注意力融合方法,从3D多帧体素中提取时空特征;预测器与精炼器则分别条件性地预测并优化未来的占用推断。在nuScenes、Lyft-Level5和nuScenes-Occupancy数据集上的实验表明,OccProphet兼具训练与推理友好性。相比当前最优方法Cam4DOcc,其计算成本降低58%~78%,推理速度提升2.6倍,同时实现4%~18%相对精度提升。代码与模型已公开于https://github.com/JLChen-C/OccProphet。
原文摘要 · Abstract (English)
Predicting variations in complex traffic environments is crucial for the safety of autonomous driving. Recent advancements in occupancy forecasting have enabled forecasting future 3D occupied status in driving environments by observing historical 2D images. However, high computational demands make occupancy forecasting less efficient during training and inference stages, hindering its feasibility for deployment on edge agents. In this paper, we propose a novel framework, i.e., OccProphet, to efficiently and effectively learn occupancy forecasting with significantly lower computational requirements while improving forecasting accuracy. OccProphet comprises three lightweight components: Observer, Forecaster, and Refiner. The Observer extracts spatio-temporal features from 3D multi-frame voxels using the proposed Efficient 4D Aggregation with Tripling-Attention Fusion, while the Forecaster and Refiner conditionally predict and refine future occupancy inferences. Experimental results on nuScenes, Lyft-Level5, and nuScenes-Occupancy datasets demonstrate that OccProphet is both training- and inference-friendly. OccProphet reduces 58\%$\sim$78\% of the computational cost with a 2.6$\times$ speedup compared with the state-of-the-art Cam4DOcc. Moreover, it achieves 4\%$\sim$18\% relatively higher forecasting accuracy. Code and models are publicly available at https://github.com/JLChen-C/OccProphet.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。