让无人机在复杂环境中自主飞行,靠的是会记地图、懂视野的智能模型。
MAD: Mapping-Aware World Models for Agile Quadrotor Flight

- 用隐状态同时重建局部地图和可见性,让无人机记住看过的区域。
- 在模拟和真实森林中分别实现9.66米/秒和5.05米/秒的高速飞行。
- 适合需要实时避障与跨任务迁移的自主飞行系统研究者。
在复杂场景中实现敏捷四旋翼飞行不仅需要从深度图到控制命令的反应式映射,还要求飞行器记住已观测区域、推断邻近障碍物,并在部分可视与严格延迟限制下行动。本文提出面向视觉导航的几何感知世界模型——映射感知梦想家(MAD),其不以原始图像重构为主导自监督目标,而是学习递归隐状态,联合重建以机体为中心的占据网格与可见性网格地图,以及本体感知状态。该设计迫使隐状态编码局部几何、可见性历史与自身运动信息,直接服务于避障。MAD在DiffAero环境中训练,通过GPU并行地图构建模块提供高吞吐量的占据与可见性监督。所学表示支持三种策略学习模式:基于想象的MAD-Dreamer,以及基于PPO和SHAC的特征提取变体。在视觉导航与竞速任务中,基于MAD的智能体成功率更高、飞行更快,且跨任务迁移能力优于纯视觉基线。模型还能从深度观测中生成可解释的地图预测与准确的自身运动估计。我们在搭载Intel RealSense D435i的物理四旋翼上部署策略,成功实现有限感知下的室内外安全飞行,模拟速度达9.66米/秒,真实森林实验达到5.05米/秒。结果表明,映射感知世界模型为模块化空中导航与端到端学习提供了实用折中方案。
原文摘要 · Abstract (English)
Agile quadrotor flight in cluttered scenes requires more than a reactive mapping from a depth image to a control command: the vehicle must remember which regions have been observed, infer nearby occupied space, and act under partial visibility and tight latency. In this paper, we present Mapping-Aware Dreamer (MAD), a geometry-aware world model for vision-based quadrotor flight. Instead of using raw-image reconstruction as the main self-supervised objective, MAD learns recurrent latent dynamics that reconstruct robocentric occupancy and visibility grid maps together with proprioceptive states. This design forces the latent state to encode local geometry, visibility history, and ego-motion in a form that is directly relevant to collision avoidance. MAD is trained in DiffAero using a GPU-parallel map-construction module that provides high-throughput supervision for occupancy and visibility. The learned representation is used in three policy-learning modes: imagination-based MAD-Dreamer and feature-extractor variants based on PPO and SHAC. Across visual navigation and racing tasks, MAD-based agents achieve higher success rates, faster flight, and better cross-task transfer than corresponding vision-only baselines. The model also produces interpretable map predictions and accurate ego-motion estimates from depth observations. We further deploy the learned policy on a physical quadrotor with an Intel RealSense D435i and demonstrate safe indoor and outdoor flight under limited sensing, reaching 9.66 m/s in simulation and 5.05 m/s in real-world forest experiments. These results show that mapping-aware world models provide a practical middle ground between modular aerial navigation and end-to-end learning.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。