新数据集SLAM&Render,专为融合SLAM与神经渲染的算法评测而生。
SLAM&Render: A Benchmark for the Intersection Between Neural Rendering, Gaussian Splatting and SLAM
- 用机械臂采集数据,实现高精度运动轨迹重建。
- 包含40组同步RGB-D、IMU与位姿数据,支持多模态分析。
- 适合研究机器人视觉、神经渲染融合的学者使用。
原本用于新视角合成与场景渲染的模型(如NeRF和Gaussian Splatting)正被越来越多地用作同时定位与地图构建(SLAM)中的表示方法。然而,现有数据集缺乏两领域交叉的关键挑战,如序列操作、多模态输入或跨视角、光照条件的泛化能力。此外,多数数据由手持设备或无人机采集,难以精确复现传感器运动。为此,我们提出SLAM&Render,一个专为评估SLAM、新视角渲染与Gaussian Splatting交叉方法而设计的新数据集。该数据集由机械臂采集,包含40个序列,提供时间同步的RGB-D图像、IMU读数、机器人运动学数据和真值位姿流。通过公开机器人运动学数据,可评估近期SLAM范式在机器人应用中的集成效果。数据集包含五种设置,涵盖消费级与工业级物体,在四种受控光照条件下进行,每种设置均有独立训练与测试轨迹。所有序列均为静态场景,含不同程度的物体重排与遮挡。基于多个文献基线的实验结果验证了该数据集在这一新兴研究领域的有效性。
原文摘要 · Abstract (English)
Models and methods originally developed for Novel View Synthesis and Scene Rendering, such as Neural Radiance Fields (NeRF) and Gaussian Splatting, are increasingly being adopted as representations in Simultaneous Localization and Mapping (SLAM). However, existing datasets fail to include the specific challenges of both fields, such as sequential operations and, in many settings, multi-modality in SLAM or generalization across viewpoints and illumination conditions in neural rendering. Additionally, the data are often collected using sensors which are handheld or mounted on drones or mobile robots, which complicates the accurate reproduction of sensor motions. To bridge these gaps, we introduce SLAM&Render, a novel dataset designed to benchmark methods in the intersection between SLAM, Novel View Rendering and Gaussian Splatting. Recorded with a robot manipulator, it uniquely includes 40 sequences with time-synchronized RGB-D images, IMU readings, robot kinematic data, and ground-truth pose streams. By releasing robot kinematic data, the dataset also enables the assessment of recent integrations of SLAM paradigms within robotic applications. The dataset features five setups with consumer and industrial objects under four controlled lighting conditions, each with separate training and test trajectories. All sequences are static with different levels of object rearrangements and occlusions. Our experimental results, obtained with several baselines from the literature, validate SLAM&Render as a relevant benchmark for this emerging research area.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。