让无人机在视野受限时也能安全飞行,靠历史视觉信息补全环境
PILOT: Privileged Imitation Learning for End-to-End Motion Planning of Autonomous UAVs under Partial Observability

- 用历史深度图和里程计融合推断隐藏环境,无需持久地图
- 训练时显式约束轨迹连续性与避障,提升未见场景适应力
- 比理想专家快80%以上,实测室内室外都能零样本部署
在复杂环境中自主导航受限于部分可观测性和动态约束。本文提出PILOT,一种面向视觉端到端无人机运动规划的约束感知特权模仿学习框架。该框架将计算密集型最优控制专家的规划策略提炼为学生策略,通过双目标损失函数正则化以满足安全与动态要求。为缓解部分可观测性,设计基于时间卷积网络(TCN)的时空感知融合模块,整合历史深度图像与里程计,从历史观测中推断任务相关的隐含上下文,增强瞬时视场外的空间感知能力,且无需维护持久地图记忆。轨迹参数化层输出结构化轨迹,训练时显式保证连续性、动态一致性及障碍物软惩罚,促进对未见观测的约束满足,虽无形式化保证但有效提升泛化能力。四旋翼与固定翼飞机的仿真验证表明,PILOT性能接近特权专家,计算开销降低超80%。室内与室外零样本部署成功,证实了规划器的实际可行性与跨域泛化能力。
原文摘要 · Abstract (English)
Autonomous navigation in cluttered environments is hampered by partial observability and dynamic constraints. This paper presents PILOT, a constraint-aware privileged imitation learning framework for vision-based end-to-end UAV motion planning under partial observability. The framework distills planning strategies from a computationally intensive optimal control expert into a student policy regularized toward safety and dynamic requirements via a dual-objective loss function. To mitigate partial observability, a spatiotemporal perception fusion module using a Temporal Convolutional Network (TCN) is developed to integrate historical depth images and odometry. This module infers task-relevant latent context from historical observations, enhancing spatial awareness beyond the instantaneous FOV without maintaining persistent map memory. A trajectory parameterization layer mapping network outputs to a structured trajectory, while enabling explicit continuity, dynamic-consistency, and obstacle soft penalties during training, encouraging constraint satisfaction for unseen observations without formal guarantees. Simulations on quadrotor and fixed-wing aircraft demonstrate that PILOT achieves performance comparable to the privileged expert while reducing computational overhead by over 80\%. Successful indoor and outdoor zero-shot deployment confirms the practical feasibility and cross-domain generalization of the planner.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。