用鸟瞰图生成点云,解决激光雷达缺失时的场景生成难题
FPSGen: Flexible Point Cloud Scene Generation with BEV-Supported Transport Flows

- 基于鸟瞰图预测密度、高度和掩码,构建独立于局部扫描的点源
- 通过近似最优传输学习速度场,使点云迁移路径更直接,提升生成质量
- 支持无条件与条件生成,在稀疏区域和遮挡区表现更好,适合自动驾驶应用
现有基于点云的室外场景生成方法主要聚焦于激光雷达条件下的补全任务。训练时通过扰动完整真值场景构建噪声点云,推理时则通过复制部分扫描添加噪声初始化,导致训练与推理不一致,继承了部分扫描的稀疏性和可见性偏差,造成远距离区域稀疏、遮挡区几何不完整。此外,依赖部分扫描限制了在无激光雷达观测或使用布局线索时的生成能力。本文提出FPSGen,一种灵活框架,可独立于部分扫描构建点源。首先从有效线索中预测包含密度、高度和掩码通道的鸟瞰图先验;密度图采样生成鸟瞰图支持的点源,实现无条件与条件初始化。采用教师-学生近似最优传输方案,利用教师预测的终点学习速度场,诱导更直的传输路径。通过结合鸟瞰图点源构建与路径直化传输,FPSGen为无条件及灵活线索条件生成提供统一框架。大量实验表明,FPSGen在SemanticKITTI补全任务上达到最佳JSD与体素IoU性能,且单步点传输仍保持优异表现。在KITTI-360无条件生成任务中,其覆盖率(COV)优于对比方法。
原文摘要 · Abstract (English)
Existing point-based generative methods for outdoor scenes primarily focus on LiDAR-conditioned completion. During training, noisy point clouds are constructed by perturbing complete ground-truth scenes, whereas during inference, they are initialized by adding noise to duplicated partial scans. This train-inference mismatch inherits the sparsity and visibility bias of partial scans, leading to sparse distant regions and incomplete geometry in occluded areas. Moreover, the reliance on partial scans restricts generation when LiDAR observations are unavailable or replaced by layout cues. We present FPSGen, a flexible framework that constructs point sources independently of partial scans. FPSGen first predicts a bird's-eye-view (BEV) prior with density, height, and mask channels from the active cues. The density map is then sampled to form a BEV-supported point source, enabling both unconditional and conditioned initialization. A teacher-student approximate optimal transport scheme then uses teacher-predicted endpoints to learn a velocity field that induces straighter transport paths. By integrating BEV point source construction with path-straightening transport, FPSGen provides a unified framework for unconditional and flexible cue-conditioned scene generation. Extensive experiments show that FPSGen achieves state-of-the-art JSD and voxel IoU performance on SemanticKITTI completion while maintaining strong performance with a single point transport step. On KITTI-360 unconditional generation, it also achieves the best Coverage (COV) among the compared methods.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。