统一生成八种场景的3D激光雷达数据,支持跨域可控合成。
OmniLiDAR: A Unified Diffusion Framework for Multi-Domain 3D LiDAR Generation

- 采用共享范围图像表示与跨域训练策略,一模型覆盖多场景。
- 在8个不同域上生成质量高,下游任务提升显著,尤其小样本时。
- 适合自动驾驶仿真、数据增强与抗干扰测试场景。
激光雷达场景生成对可扩展模拟和合成数据创建日益重要,尤其在难以大规模采集的复杂感知条件下。现有基于扩散模型的生成器多限于单一领域,需为不同数据集或传感条件分别建模,难以实现异构分布下的统一可控合成。为此,本文提出OmniLiDAR,一种统一的文本条件扩散框架,可在共享范围图像表示下生成跨越八个代表性领域的激光雷达扫描,涵盖三种分布偏移类型:恶劣天气、传感器配置变化(如减少光束数)以及跨平台采集(车辆、无人机、四足机器人)。为在异构域上训练单个模型而不按域隔离优化,提出跨域训练策略(CDTS),在每批次中混合不同域数据,并利用条件控制生成方向;进一步设计跨域特征建模(CDFM)以捕捉方位角与俯仰轴向的定向依赖,反映范围图像的非各向同性扫描结构;并引入轻量级域自适应特征缩放(DAFS)以在去噪过程中补偿结构化域相关特征偏移。由于缺乏公开的综合性基准,我们通过结合真实扫描、物理驱动的天气模拟及系统性光束缩减构建了8域数据集,并遵循官方划分。大量实验表明,生成结果保真度高,在下游任务中表现优异,包括激光雷达语义分割与3D目标检测的数据增强,以及在各种噪声条件下的鲁棒性评估,且在少样本情形下仍具持续优势。
原文摘要 · Abstract (English)
LiDAR scene generation is increasingly important for scalable simulation and synthetic data creation, especially under diverse sensing conditions that are costly to capture at scale. Typically, diffusion-based LiDAR generators are developed under single-domain settings, requiring separate models for different datasets or sensing conditions and hindering unified, controllable synthesis under heterogeneous distribution shifts. To this end, we present OmniLiDAR, a unified text-conditioned diffusion framework that generates LiDAR scans in a shared range-image representation across eight representative domains spanning three shift types: adverse weather, sensor-configuration changes (e.g., reduced beams), and cross-platform acquisition (vehicle, drone, and quadruped). To enable training a single model over heterogeneous domains without isolating optimization by domain, we introduce a Cross-Domain Training Strategy (CDTS) that mixes domains within each mini-batch and leverages conditioning to steer generation. We further propose Cross-Domain Feature Modeling (CDFM), which captures directional dependencies along azimuth and elevation axes to reflect the anisotropic scanning structure of range images, and Domain-Adaptive Feature Scaling (DAFS) as a lightweight modulation to account for structured domain-dependent feature shifts during denoising. In the absence of a public consolidated benchmark, we construct an 8-domain dataset by combining real-world scans with physically based weather simulation and systematic beam reduction while following official splits. Extensive experiments demonstrate strong generation fidelity and consistent gains in downstream use cases, including generative data augmentation for LiDAR semantic segmentation and 3D object detection, as well as robustness evaluation under corruptions, with consistent benefits in limited-label regimes.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。