提出快速自适应的LiDAR场景补全方法,实现10Hz实时处理。
Towards Real-Time and Adaptable LiDAR Scene Completion

- 将初始化阶段设计为可学习的自适应模块,根据局部几何自动扩展点云
- 在SemanticKITTI和KITTI-360上达到顶尖性能,单场景补全仅需0.1秒
- 无需人工调参,适配不同传感器配置,适合自动驾驶实时感知系统
LiDAR场景补全是自动驾驶中3D感知的关键环节,需实现实时补全以支持下游任务。现有方法多采用先初始化后优化的范式:先构建粗略场景,再逐步优化。生成式方法因迭代噪声重构而速度慢,非生成方法则使用固定噪声扰动,难以覆盖大空洞与遮挡区域,且需针对每种传感器配置手动重调。本文提出RapidLiDAR,将初始化过程建模为数据驱动的可学习组件。设计自适应初始化模块,对输入点云的每个点预测空间变化位移,实现基于局部几何的粗略场景扩展,无需人工设定噪声参数。进一步通过多尺度重建模块,利用输入扫描构建的多尺度3D体素与2D BEV特征图,精修点位置。通过用体素与BEV特征提取替代传统的点邻域操作(如最远点采样、k近邻搜索),模型更高效,天然支持不同输入分辨率。在SemanticKITTI与KITTI-360上的实验表明,本方法性能媲美当前最优,单场景补全时间仅0.1秒,较最快前序方法快2.3倍,满足典型车载LiDAR的10Hz采集频率,迈向真正实时的场景补全。
原文摘要 · Abstract (English)
LiDAR scene completion is a key component of 3D perception in autonomous driving, where the scene must be completed in real time to be usable in downstream tasks. Existing approaches typically follow an initialize-and-refine paradigm, in which a coarse initialization of the scene is first constructed, then refined into complete 3D geometry. Generative models are slower because they iteratively refine random Gaussian noise into the scene, while non-generative methods perturb the partial scene with a fixed noise scale, which limits coverage of large gaps and occluded regions and requires manual recalibration for each new sensor configuration. We present RapidLiDAR, a LiDAR scene completion method that treats the initialization itself as a learned, data-driven component. We propose an adaptive initialization module that predicts a spatially varying displacement for each partial input point, expanding the partial observations into a coarse scene initialization adapted to the local geometry, without requiring manual noise tuning. To refine this coarse initialization into a complete and coherent scene, we additionally propose a multi-scale reconstruction module that further refines point positions by querying multi-scale 3D voxel and 2D BEV feature maps constructed from the input scan. By replacing point-neighborhood operators such as farthest point sampling and $k$-nearest neighbor search with voxel- and BEV-based feature extraction, our architecture is faster and can handle different input resolutions by design. Experiments on SemanticKITTI and KITTI-360 show that our method achieves completion performance on par with the state of the art while completing a full scene in 0.1 seconds, which is 2.3 times faster than the fastest prior method. This matches the 10 Hz acquisition rate of typical automotive LiDAR sensors, taking a step toward real-time LiDAR scene completion.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。