用事件相机+神经符号系统,让无人机低功耗避障飞行
Energy-Efficient Autonomous Aerial Navigation with Dynamic Vision Sensors: A Physics-Guided Neuromorphic Approach
- 事件相机配合轻量脉冲网络,无监督检测移动障碍物
- 物理引导神经网络预测最优飞行时机,实现近最低能耗路径
- 适合做低延迟、低功耗无人机自主导航研究者参考
基于视觉的目标跟踪是实现自主飞行导航的关键,尤其在避障场景中。受生物视觉启发的类脑动态视觉传感器(DVS)或事件相机,能异步感知亮度变化,具有高动态范围且抗运动模糊,适用于复杂光照条件。脉冲神经网络(SNN)可高效异步处理此类事件信号。同时,基于物理的人工智能通过物理建模将系统级知识融入神经网络,提升鲁棒性、能效并提供符号化可解释性。本文提出一种类脑导航框架,用于无人机自主飞行,重点实现对动态门的检测与避障。采用事件相机结合浅层SNN架构,在无监督条件下检测移动物体;并融合轻量级能量感知物理引导神经网络(PgNN),利用深度输入预测最优飞行时机,生成近似最小能耗路径。系统在Gazebo仿真环境中实现,集成基于机器人操作系统(ROS)的传感器融合视觉-规划神经符号框架。该工作展示了事件视觉与物理引导规划结合在低延迟、高能效自主导航中的潜力。
原文摘要 · Abstract (English)
Vision-based object tracking is a critical component for achieving autonomous aerial navigation, particularly for obstacle avoidance. Neuromorphic Dynamic Vision Sensors (DVS) or event cameras, inspired by biological vision, offer a promising alternative to conventional frame-based cameras. These cameras can detect changes in intensity asynchronously, even in challenging lighting conditions, with a high dynamic range and resistance to motion blur. Spiking neural networks (SNNs) are increasingly used to process these event-based signals efficiently and asynchronously. Meanwhile, physics-based artificial intelligence (AI) provides a means to incorporate system-level knowledge into neural networks via physical modeling. This enhances robustness, energy efficiency, and provides symbolic explainability. In this work, we present a neuromorphic navigation framework for autonomous drone navigation. The focus is on detecting and navigating through moving gates while avoiding collisions. We use event cameras for detecting moving objects through a shallow SNN architecture in an unsupervised manner. This is combined with a lightweight energy-aware physics-guided neural network (PgNN) trained with depth inputs to predict optimal flight times, generating near-minimum energy paths. The system is implemented in the Gazebo simulator and integrates a sensor-fused vision-to-planning neuro-symbolic framework built with the Robot Operating System (ROS) middleware. This work highlights the future potential of integrating event-based vision with physics-guided planning for energy-efficient autonomous navigation, particularly for low-latency decision-making.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。