用近似模仿学习让事件相机无人机在复杂环境高速飞行,训练快28倍。
Approximate Imitation Learning for Event-based Quadrotor Flight in Cluttered Environments
- 分离表征与策略搜索,离线学表征,线上只用轻量状态
- 训练时间从52.44小时缩至1.86小时,提速28倍
- 真实无人机实现9.8米/秒高速穿越密集障碍物
事件相机具备高时间分辨率和低延迟,适合高速机器人应用,但其在机器人学习中的广泛应用受限于在线训练时高频事件数据的计算成本。本文提出近似模仿学习框架,从根本上解决该瓶颈:将复杂敏捷无人机飞行的策略训练时间从52.44小时降至1.86小时,实现28倍计算加速。核心思路是将表征学习与策略搜索分离:先利用大规模离线数据集学习特定任务表征空间,随后策略通过仅依赖轻量状态信息的在线交互进行微调,彻底避免了主动策略搜索阶段的事件渲染。该范式显著降低开发开销,使基于事件的控制策略可扩展至复杂环境。此外,部署时无需依赖标准相机或中间表示,直接将事件映射为控制指令。仿真中,本方法性能达到或超过需完整在线事件渲染的标准模仿学习基线。最终,我们在真实世界成功验证框架,基于此超高效范式训练的策略使四旋翼无人机在高度密集环境中以高达9.8米/秒的速度飞行。
原文摘要 · Abstract (English)
Event cameras offer high temporal resolution and low latency, making them ideal sensors for high-speed robotic applications where conventional cameras suffer from motion blur. However, their widespread adoption in robot learning is severely bottlenecked by the computational cost of simulating high-frequency event data during online training. In this work, we present Approximate Imitation Learning, a novel framework that fundamentally resolves this bottleneck, reducing policy training time for complex, agile drone flight from 52.44 hours to just 1.86 hours - a 28x computational speedup. Our key insight is to separate representation learning from policy search. We first leverage a large-scale offline dataset to learn a task-specific representation space. Subsequently, the policy is fine-tuned through online interactions that rely solely on lightweight state information, completely eliminating the need to render events during the active policy search phase. This training paradigm drastically reduces development overhead and enables event-based control policies to scale to complex environments. Furthermore, our approach eliminates the reliance on standard cameras or intermediate representations during deployment, mapping events directly to control commands. In simulation, our method matches or exceeds the performance of standard imitation learning baselines that require full online event rendering. Finally, we successfully validate the framework in the real world, demonstrating that a policy trained via this ultra-efficient paradigm enables a quadrotor to fly through highly cluttered environments at remarkable speeds of up to 9.8 m/s.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。