arXiv:2601.02777cs.RO2026-01被引 2

为高速运动与复杂光照下的机器人感知,构建多波段立体事件视觉惯性数据集。

M-SEVIQ: A Multi-band Stereo Event Visual-Inertial Quadruped-based Dataset for Perception under Rapid Motion and Challenging Illumination

  • 用四足机器人采集多波段立体事件相机与惯性传感器数据
  • 覆盖30+真实场景,含不同速度、光照和波长条件
  • 支持高速运动下视觉融合与语义分割研究

敏捷运动的腿式机器人对视觉感知提出严峻挑战。传统帧图像相机在快速运动和低光条件下易产生模糊图像。事件相机以异步方式捕捉亮度变化,具备低延迟、高时间分辨率和高动态范围优势,适合在剧烈运动和复杂光照下实现鲁棒感知。然而现有事件相机数据集在立体配置和多波段感知方面仍存在局限。为此,本文提出M-SEVIQ,一个基于Unitree Go2四足机器人采集的多波段立体事件视觉惯性数据集,配备双事件相机、帧相机、惯性测量单元(IMU)及关节编码器。数据集包含30多个真实世界序列,涵盖多种速度水平、光照波长和照明条件。同时提供完整的标定数据,包括内参、外参及时间对齐信息,便于精准传感器融合与基准测试。M-SEVIQ可支持敏捷机器人感知、传感器融合、语义分割及多模态视觉在挑战性环境中的研究。

原文摘要 · Abstract (English)

Agile locomotion in legged robots poses significant challenges for visual perception. Traditional frame-based cameras often fail in these scenarios for producing blurred images, particularly under low-light conditions. In contrast, event cameras capture changes in brightness asynchronously, offering low latency, high temporal resolution, and high dynamic range. These advantages make them suitable for robust perception during rapid motion and under challenging illumination. However, existing event camera datasets exhibit limitations in stereo configurations and multi-band sensing domains under various illumination conditions. To address this gap, we present M-SEVIQ, a multi-band stereo event visual and inertial quadruped dataset collected using a Unitree Go2 equipped with stereo event cameras, a frame-based camera, an inertial measurement unit (IMU), and joint encoders. This dataset contains more than 30 real-world sequences captured across different velocity levels, illumination wavelengths, and lighting conditions. In addition, comprehensive calibration data, including intrinsic, extrinsic, and temporal alignments, are provided to facilitate accurate sensor fusion and benchmarking. Our M-SEVIQ can be used to support research in agile robot perception, sensor fusion, semantic segmentation and multi-modal vision in challenging environments.

事件相机传感器融合四足机器人多模态感知

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。