融合事件相机与深度相机,实现高速无人机避障
An End-to-end Flight Control Network for High-speed UAV Obstacle Avoidance based on Event-Depth Fusion
- 双向交叉注意力融合事件与深度数据
- 17米/秒下成功率超80%,比传统方法高近20%
- 适合高速复杂环境下的无人机自主飞行研究
在包含静态、动态或混合障碍物的复杂环境中实现安全、高速的自主飞行仍具挑战性,单一感知模态存在信息不完整问题。深度相机对静态物体有效,但在高速下易产生运动模糊;事件相机擅长捕捉快速运动,却难以感知静态场景。为发挥两种传感器的互补优势,我们提出一种端到端飞行控制网络,通过双向交叉注意力模块实现深度图像与事件数据的特征级融合。该网络采用模仿学习训练,依赖高质量监督信号。基于此,我们设计了一种高效的专家规划器,使用球面主成分搜索(SPS),将计算复杂度从 $O(n^2)$ 降至 $O(n)$,生成更平滑轨迹,在 17m/s 速度下成功率超过 80%,比传统规划器高出近 20%。仿真实验表明,本方法在 17 m/s 速度下于多种场景中成功率达 70-80%,优于单模态及单向融合模型 10-20%。结果表明,双向融合能有效整合事件与深度信息,提升复杂环境下静态与动态障碍物的避障可靠性。
原文摘要 · Abstract (English)
Achieving safe, high-speed autonomous flight in complex environments with static, dynamic, or mixed obstacles remains challenging, as a single perception modality is incomplete. Depth cameras are effective for static objects but suffer from motion blur at high speeds. Conversely, event cameras excel at capturing rapid motion but struggle to perceive static scenes. To exploit the complementary strengths of both sensors, we propose an end-to-end flight control network that achieves feature-level fusion of depth images and event data through a bidirectional crossattention module. The end-to-end network is trained via imitation learning, which relies on high-quality supervision. Building on this insight, we design an efficient expert planner using Spherical Principal Search (SPS). This planner reduces computational complexity from $O(n^2)$ to $O(n)$ while generating smoother trajectories, achieving over 80% success rate at 17m/s--nearly 20% higher than traditional planners. Simulation experiments show that our method attains a 70-80% success rate at 17 m/s across varied scenes, surpassing single-modality and unidirectional fusion models by 10-20%. These results demonstrate that bidirectional fusion effectively integrates event and depth information, enabling more reliable obstacle avoidance in complex environments with both static and dynamic objects.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。