提出轻量级占用网络,提速3倍且精度更高。
Fast Occupancy Network
- 用可变形2D卷积升维,结合高效金字塔结构降低计算开销。
- 在NuScenes上用ResNet50主干超越SOTA 1.7%精度,推理速度提升3倍。
- 无需额外计算成本,可无缝嵌入现有鸟瞰图模型中使用。
占用网络近年来在自动驾驶领域受到广泛关注。与单目3D检测及近期鸟瞰图(BEV)模型预测障碍物3D边界框不同,占用网络通过将3D检测任务转化为3D体素分割任务,在处理类别异常障碍物和提供细粒度3D表示方面具有显著优势。然而,现有方法通常比以往方法需要大量计算资源,限制了其在智能驾驶系统中的应用。为此,本文分析了占用网络推理开销的瓶颈,提出一种简单高效的占用网络模型:采用可变形2D卷积层将BEV特征提升至3D体素特征,并设计高效的体素特征金字塔网络(FPN)模块,在计算开销极低的情况下提升性能。此外,在特征提取器后引入无成本的透视视图2D分割分支,以进一步提升精度。实验结果表明,该方法在准确率和推理速度上均持续优于现有方法,在使用ResNet50主干时,较最新SOTA模型OCCNet提升1.7%精度,并实现约3倍的推理加速。此外,该方法可轻松应用于现有BEV模型,将其转换为占用网络模型。
原文摘要 · Abstract (English)
Occupancy Network has recently attracted much attention in autonomous driving. Instead of monocular 3D detection and recent bird's eye view(BEV) models predicting 3D bounding box of obstacles, Occupancy Network predicts the category of voxel in specified 3D space around the ego vehicle via transforming 3D detection task into 3D voxel segmentation task, which has much superiority in tackling category outlier obstacles and providing fine-grained 3D representation. However, existing methods usually require huge computation resources than previous methods, which hinder the Occupancy Network solution applying in intelligent driving systems. To address this problem, we make an analysis of the bottleneck of Occupancy Network inference cost, and present a simple and fast Occupancy Network model, which adopts a deformable 2D convolutional layer to lift BEV feature to 3D voxel feature and presents an efficient voxel feature pyramid network (FPN) module to improve performance with few computational cost. Further, we present a cost-free 2D segmentation branch in perspective view after feature extractors for Occupancy Network during inference phase to improve accuracy. Experimental results demonstrate that our method consistently outperforms existing methods in both accuracy and inference speed, which surpasses recent state-of-the-art (SOTA) OCCNet by 1.7% with ResNet50 backbone with about 3X inference speedup. Furthermore, our method can be easily applied to existing BEV models to transform them into Occupancy Network models.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。