首个融合单光子相机的月球高纬度视觉数据集,助力机器人在极端光影下导航。
SPICE-HL3: Single-Photon, Inertial, and Stereo Camera dataset for Exploration of High-Latitude Lunar Landscapes
- 用多传感器记录7条轨迹,模拟从黎明到深夜的月球高纬度光照变化。
- 包含130万张图像,涵盖慢速(5厘米/秒)与快速(50厘米/秒)移动场景。
- 首次引入单光子雪崩二极管相机,适合研究极端弱光下的感知系统。
探索月球高纬度区域对机器人视觉构成极大挑战:低太阳高度角与极少光散射导致动态范围极高,阴影漫长且剧烈变化。在地球上复现此类条件需复杂模拟器与专用设施。本文介绍由卢森堡大学SnT团队在LunaLab室内测试场采集的独特数据集,该设施可模拟多个月球纬度的光学特性。数据集包含机器人沿七条不同轨迹、在多种光照条件下(含无头灯与有头灯)运行所产生的图像、惯性测量及轮式里程计数据,共生成88个独立序列,总计130万张图像。采集设备包括双目RGB-惯性传感器、单目黑白相机,以及首次应用于该场景的单光子雪崩二极管(SPAD)相机。同时记录静态与动态图像序列,机器人行进速度分别为5厘米/秒和50厘米/秒。所有数据均已校准、同步并打时间戳,为基于视觉的自主导航与未来月球科学成像任务提供关键验证资源。数据与补充材料可在https://github.com/spaceuma/spice-hl3 获取。
原文摘要 · Abstract (English)
Exploring high-latitude lunar regions presents an extremely challenging visual environment for robots. The low sunlight elevation angle and minimal light scattering result in a visual field dominated by a high dynamic range featuring long, dynamic shadows. Reproducing these conditions on Earth requires sophisticated simulators and specialized facilities. We introduce a unique dataset recorded at the LunaLab from the SnT - University of Luxembourg, an indoor test facility designed to replicate the optical characteristics of multiple lunar latitudes. Our dataset includes images, inertial measurements, and wheel odometry data from robots navigating seven distinct trajectories under multiple illumination scenarios, simulating high-latitude lunar conditions from dawn to nighttime with and without the aid of headlights, resulting in 88 distinct sequences containing a total of 1.3M images. Data was captured using a stereo RGB-inertial sensor, a monocular monochrome camera, and for the first time, a novel single-photon avalanche diode (SPAD) camera. We recorded both static and dynamic image sequences, with robots navigating at slow (5 cm/s) and fast (50 cm/s) speeds. All data is calibrated, synchronized, and timestamped, providing a valuable resource for validating perception tasks from vision-based autonomous navigation to scientific imaging for future lunar missions targeting high-latitude regions or those intended for robots operating across perceptually degraded environments. The dataset and all supplementary material can be accessed from and found at https://github.com/spaceuma/spice-hl3.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。