用废弃的全景相机与激光雷达数据,生成高质量3D数字孪生模型。
Transforming Omnidirectional RGB-LiDAR data into 3D Gaussian Splatting
- 将全景图像和激光雷达数据转为立方体贴图并分层降采样,提升定位精度。
- 通过特征匹配与点云迭代最近点算法,成功重建复杂场景的几何结构。
- 无需专用采集设备,适合自动驾驶平台的旧数据再利用。
机器人与自动驾驶领域对大规模数字孪生的需求快速增长。然而,使用3D高斯溅射(3DGS)构建这些环境通常依赖昂贵的定制化数据采集。与此同时,部署平台持续积累大量全向RGB与激光雷达日志,但因传输限制和缺乏可扩展重用流程,大量数据被直接丢弃或低效利用。本文提出一种全向RGB-LiDAR重用流水线,将这些归档数据转化为3DGS的稳健初始化资源。原始数据直接转换存在实际瓶颈:固有的非线性畸变导致结构光流(SfM)追踪不可靠,密集无序的激光雷达点云在3DGS优化中造成计算负担。为此,我们的流水线集成ERP-to-cubemap转换模块实现确定性空间锚定,并引入PRISM——一种基于颜色分层的降采样策略。通过基于FPFH的全局配准与ICP算法融合多模态输入,成功将大量被废弃的数据转化为可用的SfM几何信息。此外,相比仅依赖视觉的基线方法,激光雷达增强的初始化在结构复杂场景中显著提升了最终3DGS渲染保真度。本工作提供了一种从标准归档传感器日志生成仿真级数字孪生的确定性流程。
原文摘要 · Abstract (English)
The demand for large-scale digital twins is rapidly growing in robotics and autonomous driving. However, constructing these environments with 3D Gaussian Splatting (3DGS) usually requires expensive, purpose-built data collection. Meanwhile, deployed platforms routinely collect extensive omnidirectional RGB and LiDAR logs, but a significant portion of these sensor data is directly discarded or strictly underutilized due to transmission constraints and the lack of scalable reuse pipeline. In this paper, we present an omnidirectional RGB-LiDAR reuse pipeline that transforms these archived logs into robust initialization assets for 3DGS. Direct conversion of such raw logs introduces practical bottlenecks: inherent non-linear distortion leads to unreliable Structure-from-Motion (SfM) tracking, and dense, unorganized LiDAR clouds cause computational overhead during 3DGS optimization. To overcome these challenges, our pipeline strategically integrates an ERP-to-cubemap conversion module for deterministic spatial anchoring, alongside PRISM-a color stratified downsampling strategy. By bridging these multi-modal inputs via Fast Point Feature Histograms (FPFH) based global registration and Iterative Closest Point (ICP), our pipeline successfully repurposes a considerable fraction of discarded data into usable SfM geometry. Furthermore, our LiDAR-reinforced initialization consistently enhances the final 3DGS rendering fidelity in structurally complex scenes compared to vision-only baselines. Ultimately, this work provides a deterministic workflow for creating simulation-grade digital twins from standard archived sensor logs.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。