用语义分割评估城市空域自动着陆风险,提升无人机应急降落安全性。
Risk Assessment for Autonomous Landing in Urban Environments using Semantic Segmentation
- 基于SegFormer视觉变压器实现城市环境实时语义分割
- 通过分类结果量化风险,识别最安全着陆点
- 适用于无人机系统故障或人为失误时的紧急降落场景
本文针对复杂城市环境中基于视觉的自主着陆问题,提出一种结合深度神经网络语义分割与风险评估的方法。采用前沿视觉变换器模型SegFormer对无人机(UAV)搭载的RGB相机采集图像进行城市环境语义分割,识别出常见类别并映射为风险等级,综合考虑潜在物损、无人机自毁及人员安全风险。该策略在真实飞行中实时执行,通过多个案例研究验证,证明基于语义分割的风险评估可有效识别最优着陆区域,显著提升无人机在城市环境中的应急自主着陆能力,有望推动其在民用领域的广泛应用。
原文摘要 · Abstract (English)
In this paper, we address the vision-based autonomous landing problem in complex urban environments using deep neural networks for semantic segmentation and risk assessment. We propose employing the SegFormer, a state-of-the-art visual transformer network, for the semantic segmentation of complex, unstructured urban environments. This approach yields valuable information that can be utilized in smart autonomous landing missions, particularly in emergency landing scenarios resulting from system failures or human errors. The assessment is done in real-time flight, when images of an RGB camera at the Unmanned Aerial Vehicle (UAV) are segmented with the SegFormer into the most common classes found in urban environments. These classes are then mapped into a level of risk, considering in general, potential material damage, damaging the drone itself and endanger people. The proposed strategy is validated through several case studies, demonstrating the huge potential of semantic segmentation-based strategies to determining the safest landing areas for autonomous emergency landing, which we believe will help unleash the full potential of UAVs on civil applications within urban areas.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。