arXiv:2411.10546cs.CVcs.RO2024-11中稿 · IJRR被引 51

公开大尺度多模态数据集,评测三维定位、重建与新视角合成性能。

The Oxford Spires Dataset: Benchmarking Large-Scale LiDAR-Visual Localisation, Reconstruction and Radiance Field Methods

  • 构建含激光雷达与视觉的同步感知系统,实现毫米级精度地图。
  • 发现当前神经辐射场方法严重依赖训练视角,泛化能力差。
  • 提供真实世界基准,适合研究SLAM与辐射场融合的学者使用。

本文提出一个大规模多模态数据集,覆盖牛津著名地标,采用自研多传感器感知单元(三台同步全局快门相机、车载3D激光雷达、惯性传感器)采集,并基于地面激光扫描仪(TLS)生成毫米级精度地图。以TLS三维模型为重建真值,通过将移动激光扫描与TLS模型配准获得定位真值。对辐射场方法(如NeRF、3D Gaussian Splatting)评估不仅使用输入轨迹采样姿态,还包含远离训练姿态的视角。结果表明:现有辐射场方法严重过拟合训练视角,对非序列视角泛化能力弱;且在三维重建上表现不如仅使用视觉输入的MVS系统。该数据集与基准旨在推动辐射场方法与SLAM系统的更好融合。原始及处理后数据、解析与评估工具可访问 https://dynamic.robots.ox.ac.uk/datasets/oxford-spires/。

原文摘要 · Abstract (English)

This paper introduces a large-scale multi-modal dataset captured in and around well-known landmarks in Oxford using a custom-built multi-sensor perception unit as well as a millimetre-accurate map from a Terrestrial LiDAR Scanner (TLS). The perception unit includes three synchronised global shutter colour cameras, an automotive 3D LiDAR scanner, and an inertial sensor - all precisely calibrated. We also establish benchmarks for tasks involving localisation, reconstruction, and novel-view synthesis, which enable the evaluation of Simultaneous Localisation and Mapping (SLAM) methods, Structure-from-Motion (SfM) and Multi-view Stereo (MVS) methods as well as radiance field methods such as Neural Radiance Fields (NeRF) and 3D Gaussian Splatting. To evaluate 3D reconstruction the TLS 3D models are used as ground truth. Localisation ground truth is computed by registering the mobile LiDAR scans to the TLS 3D models. Radiance field methods are evaluated not only with poses sampled from the input trajectory, but also from viewpoints that are from trajectories which are distant from the training poses. Our evaluation demonstrates a key limitation of state-of-the-art radiance field methods: we show that they tend to overfit to the training poses/images and do not generalise well to out-of-sequence poses. They also underperform in 3D reconstruction compared to MVS systems using the same visual inputs. Our dataset and benchmarks are intended to facilitate better integration of radiance field methods and SLAM systems. The raw and processed data, along with software for parsing and evaluation, can be accessed at https://dynamic.robots.ox.ac.uk/datasets/oxford-spires/.

三维重建辐射场定位数据集

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。