让四旋翼无人机在晃动的斜面上精准降落,靠视觉和强化学习。
PerchRL: Vision-Based Agile Perching on Inclined Platforms under Rapid and Irregular Motion

- 分两阶段训练:先用状态预训练,再用视觉微调。
- 在快速不规则运动中实现稳定着陆,成功率高且实时性好。
- 适合需要空中与地面协同的机器人任务,如巡检、救援。
自主视觉引导的四旋翼无人机在移动斜面上着陆对空地协作至关重要,但受限于视野范围(FOV)仍具挑战。本文提出PerchRL,一种基于强化学习的视觉引导敏捷着陆框架,适用于快速且不规则运动的倾斜平台。采用两阶段学习策略:先进行基于状态的预训练,再通过视觉微调优化。为提升对多样化平台运动的泛化能力,引入随机化平台轨迹防止过拟合,并使用时间增强方法捕捉历史观测中的潜在运动模式。在视觉微调阶段,提出融合可见性感知状态增强与主动感知奖励的混合学习框架,以增强间歇性视觉丢失下的鲁棒性。大量仿真与真实实验验证了PerchRL的可行性、稳定性与实时性能;不同四旋翼平台的成功部署进一步证明其适应性。源代码将公开以促进社区发展。
原文摘要 · Abstract (English)
Autonomous vision-based perching of quadrotors on moving inclined platforms is critical for air-ground collaboration but remains challenging due to the limited field of view (FOV). In this paper, we propose PerchRL, a reinforcement learning (RL) framework for vision-based agile perching on inclined platforms under rapid and irregular motion. Specifically, we employ a two-stage learning strategy consisting of state-based pre-training followed by vision-based fine-tuning. To improve generalization across diverse platform motions, we employ randomized platform trajectories to prevent overfitting and temporal augmentation methods to capture latent motion patterns from historical observations. During vision-based fine-tuning, a hybrid learning framework consisting of visibility-aware state augmentation and active perception rewards is presented to improve robustness under intermittent visual loss. Extensive simulation and real-world experiments demonstrate the feasibility, stability, and real-time performance of PerchRL, while successful deployment across distinct quadrotor platforms further validates its adaptability. The source code will be released to benefit the community.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。