arXiv:2411.13945cs.ROcs.LG2024-11被引 15

用脉冲神经网络实现无人机端到端姿态控制,超低功耗且实时响应。

Neuromorphic Attitude Estimation and Control

论文配图:Neuromorphic Attitude Estimation and Control
图 1 · 摘自论文原文
  • 分模块训练并融合估计与控制子网,通过模仿学习从传感器直接输出电机指令。
  • 在真实无人机上实现500Hz控制频率,平均姿态跟踪误差3.0度,接近传统系统表现。
  • 通过数据增强提升预测能力,减少震荡,适合资源受限的嵌入式智能飞行系统。

小型无人机的实际应用受制于能源限制。类脑计算有望实现极低功耗的自主飞行智能,但其在真实机器人上的训练与部署仍具挑战。为充分发挥类脑计算优势,需在单个类脑芯片上实现从底层姿态控制到高层导航的全栈自主。本研究首次构建基于脉冲神经网络(SNN)的类脑控制系统,将无人机原始感知输入直接映射为电机指令。该方法应用于四旋翼无人机的低层姿态估计与控制,部署于微型Crazyflie无人机。提出模块化SNN结构,分别训练估计与控制子网后进行合并。使用包含感知-动作对的飞行数据集,通过模仿学习训练网络。训练后,网络在Crazyflie上以500Hz频率运行,根据传感器输入生成控制命令。训练中引入额外激励飞行并时间移位目标数据以增强训练数据。实际测试中,感知-控制SNN的姿态追踪平均误差为3.0度,优于常规飞行栈的2.7度。同时,所提学习改进有效降低平均误差并抑制震荡。本工作验证了类脑端到端控制的可行性,为高能效、低延迟的类脑自动驾驶仪奠定基础。

原文摘要 · Abstract (English)

The real-world application of small drones is mostly hampered by energy limitations. Neuromorphic computing promises extremely energy-efficient AI for autonomous flight but is still challenging to train and deploy on real robots. To reap the maximal benefits from neuromorphic computing, it is necessary to perform all autonomy functions end-to-end on a single neuromorphic chip, from low-level attitude control to high-level navigation. This research presents the first neuromorphic control system using a spiking neural network (SNN) to effectively map a drone's raw sensory input directly to motor commands. We apply this method to low-level attitude estimation and control for a quadrotor, deploying the SNN on a tiny Crazyflie. We propose a modular SNN, separately training and then merging estimation and control sub-networks. The SNN is trained with imitation learning, using a flight dataset of sensory-motor pairs. Post-training, the network is deployed on the Crazyflie, issuing control commands from sensor inputs at 500Hz. Furthermore, for the training procedure we augmented training data by flying a controller with additional excitation and time-shifting the target data to enhance the predictive capabilities of the SNN. On the real drone, the perception-to-control SNN tracks attitude commands with an average error of 3.0 degrees, compared to 2.7 degrees for the regular flight stack. We also show the benefits of the proposed learning modifications for reducing the average tracking error and reducing oscillations. Our work shows the feasibility of performing neuromorphic end-to-end control, laying the basis for highly energy-efficient and low-latency neuromorphic autopilots.

类脑计算无人机控制脉冲神经网络端到端

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。