用单目事件相机实现四旋翼避障,低速反而更易撞上
Monocular Event-Based Vision for Obstacle Avoidance with a Quadrotor
- 用深度预测预训练事件到控制的避障策略,再用真实数据微调
- 5米/秒高速下事件深度估计更好,避障成功率高于1米/秒低速
- 户外避障成功率常高于特定室内场景,适合高动态飞行应用
我们提出了首个仅使用机载单目事件相机的四旋翼静态障碍物避障方法。传统视觉系统在未知环境中自主飞行困难,受限于摄像头性能;而事件相机虽能实现近乎零运动模糊和高动态范围,但在剧烈自运动下产生海量事件,且仿真中缺乏连续时间传感器模型,导致直接模拟到现实迁移不可行。通过在学习框架中将深度预测作为预训练任务,我们先用近似仿真的事件数据预训练反应式避障策略,再用少量真实世界的事件与深度数据微调感知模块,成功在室内外多种场景下实现避障。实验表明,与传统视觉方法相反,1米/秒低速时任务更难、更易碰撞,而5米/秒高速下事件深度估计更优,避障表现更佳。此外,户外场景的成功率常显著高于某些室内场景。
原文摘要 · Abstract (English)
We present the first static-obstacle avoidance method for quadrotors using just an onboard, monocular event camera. Quadrotors are capable of fast and agile flight in cluttered environments when piloted manually, but vision-based autonomous flight in unknown environments is difficult in part due to the sensor limitations of traditional onboard cameras. Event cameras, however, promise nearly zero motion blur and high dynamic range, but produce a very large volume of events under significant ego-motion and further lack a continuous-time sensor model in simulation, making direct sim-to-real transfer not possible. By leveraging depth prediction as a pretext task in our learning framework, we can pre-train a reactive obstacle avoidance events-to-control policy with approximated, simulated events and then fine-tune the perception component with limited events-and-depth real-world data to achieve obstacle avoidance in indoor and outdoor settings. We demonstrate this across two quadrotor-event camera platforms in multiple settings and find, contrary to traditional vision-based works, that low speeds (1m/s) make the task harder and more prone to collisions, while high speeds (5m/s) result in better event-based depth estimation and avoidance. We also find that success rates in outdoor scenes can be significantly higher than in certain indoor scenes.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。