用扩散模型高效补全稀疏点云,三招解决精度与速度难题。
CloudDiffusion: Diffusion-Based Scene Completion in the Point Cloud Domain

- 多令牌高斯VAE稳定压缩点云,避免传统方法崩溃
- 基于ICP的真值优化使误差降低16倍,仅需单步推理
- 单帧209毫秒完成补全,实时性远超现有方案
从稀疏激光雷达点云中重建稠密3D场景是自动驾驶中的基础挑战,扩散模型为此提供了新思路。然而,现有方法依赖物体级自编码器,在室外大尺度下易产生不稳定的全局表征,且受里程计漂移影响,真值数据质量下降,严重削弱监督效果。此外,多步扩散推理导致延迟过高,难以满足实时部署需求。本文提出CloudDiffusion,包含三个独立组件:首先,采用带交叉注意力池化的多令牌高斯VAE实现稳定场景级点云压缩,作为独立重建模块,避免了先前自编码器的全局池化和码本坍缩问题;其次,设计基于锚点的ICP真值优化流程,消除里程计漂移带来的噪声,在SemanticKITTI seq.08上将单步x0扩散教师的切比雪夫距离从0.396降至0.024 m²(约16倍),无需修改模型结构;第三,同一教师直接在坐标空间进行单步x0推理,无需潜空间转换,每帧仅需209毫秒,推理延迟较迭代扩散基线降低65-138倍。结果表明,此场景下数据质量远超模型设计的重要性,提示多令牌潜在空间可作为未来基于潜空间扩散模型的稳定预处理阶段。
原文摘要 · Abstract (English)
Reconstructing dense 3D scenes from sparse LiDAR point clouds (LiDAR scene completion) is a fundamental challenge in autonomous driving, where diffusion models offer a promising solution. However, existing approaches rely on object-level autoencoders that collapse into unstable global representations at outdoor scale, and suffer from ground truth data corrupted by odometry drift that systematically degrades supervision quality. Furthermore, multi-step diffusion inference incurs prohibitive latency for real-time deployment. We present CloudDiffusion, addressing these issues with three independent components. First, a multi-token Gaussian VAE with cross-attention pooling provides stable scene-scale LiDAR compression as a standalone reconstruction module, avoiding the global-pooling and codebook-collapse failure modes of prior point-cloud autoencoders. Second, an anchor-based ICP ground truth refinement pipeline eliminates drift-induced noise from training supervision, reducing our single-step x0 diffusion teacher's squared Chamfer distance by approximately 16x on SemanticKITTI seq. 08 (0.396 to 0.024 m^2) with no model change (partly aided by the denser, more compact refined references). Third, the same teacher completes scenes in a single x0 step, operating directly in coordinate space, not in the VAE latent. It runs in near real time at 209ms/frame, 65-138x lower inference latency than iterative diffusion baselines. Our results indicate that data quality dominates model design in this regime, and suggest that multi-token latent spaces could serve as a stable first stage for future latent diffusion-based scene completion.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。