用事件相机与毫米波雷达融合,无IMU无特征匹配实现高速机器人运动估计。
Radar and Event Camera Fusion for Agile Robot Ego-Motion Estimation
- 直接利用事件与多普勒数据解算旋转和平移速度,无需特征匹配。
- 在无纹理环境中误差低于0.15 m/s,实时性满足边缘设备需求。
- 适合高速飞行器等极端动态场景的轻量级运动估计任务。
为实现高速机器人(如特技飞行器)的可靠自运动估计,传统传感器常因响应延迟、模糊和失真而失效。本文提出一种无IMU、无特征关联的融合框架,结合事件相机与毫米波雷达,直接从原始事件和多普勒测量中推导出旋转与平移速度。该方法避免复杂帧间关联,在无纹理或无结构环境更鲁棒,且计算效率高,适用于边缘设备。后端采用连续时间状态空间模型,以固定滞后平滑方式融合异构时序数据,实现高精度运动速度估计。在自采集实验数据集上验证表明,该方法在挑战性环境下仍能稳定输出可靠速度,平均误差低于0.15 m/s。代码、视频及数据集已公开于https://github.com/ZzhYgwh/TwistEstimator。
原文摘要 · Abstract (English)
Achieving reliable ego motion estimation for agile robots, e.g., aerobatic aircraft, remains challenging because most robot sensors fail to respond timely and clearly to highly dynamic robot motions, often resulting in measurement blurring, distortion, and delays. In this paper, we propose an IMU-free and feature-association-free framework to achieve aggressive ego-motion velocity estimation of a robot platform in highly dynamic scenarios by combining two types of exteroceptive sensors, an event camera and a millimeter wave radar, First, we used instantaneous raw events and Doppler measurements to derive rotational and translational velocities directly. Without a sophisticated association process between measurement frames, the proposed method is more robust in texture-less and structureless environments and is more computationally efficient for edge computing devices. Then, in the back-end, we propose a continuous-time state-space model to fuse the hybrid time-based and event-based measurements to estimate the ego-motion velocity in a fixed-lagged smoother fashion. In the end, we validate our velometer framework extensively in self-collected experiment datasets. The results indicate that our IMU-free and association-free ego motion estimation framework can achieve reliable and efficient velocity output in challenging environments. The source code, illustrative video and dataset are available at https://github.com/ZzhYgwh/TwistEstimator.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。