构建首个无人机视角主动检测数据集,提升遮挡目标识别能力
UEVAVD: A Dataset for Developing UAV's Eye View Active Object Detection
- 用时序观测+门控循环单元建模状态,应对部分可观测性
- 结合SAM分割预处理,过滤无关信息,提升策略泛化性能
- 适用于无人机视觉、强化学习、主动感知等方向研究
遮挡是制约无人机目标检测的长期难题。现有方法多通过改进检测模型缓解,但较少利用无人机可自主调整视角的优势。主动目标检测(AOD)通过深度强化学习实现无人机自主路径规划,寻找更利于目标识别的观察视角。然而,当前缺乏可用于开发无人机AOD方法的数据集。为此,本文发布首个无人机视角主动视觉数据集UEVAVD,以推动该领域研究。同时,改进现有DRL-based AOD方法:首先,针对部分可观测性问题,采用门控循环单元从观测序列中提取状态表示;其次,利用分割任意模型(SAM)预分解场景,并通过生成掩码过滤无关信息。实验验证了所提方法在UEVAVD数据集上的有效性。数据集将很快开源于https://github.com/Leo000ooo/UEVAVD_dataset。
原文摘要 · Abstract (English)
Occlusion is a longstanding difficulty that challenges the UAV-based object detection. Many works address this problem by adapting the detection model. However, few of them exploit that the UAV could fundamentally improve detection performance by changing its viewpoint. Active Object Detection (AOD) offers an effective way to achieve this purpose. Through Deep Reinforcement Learning (DRL), AOD endows the UAV with the ability of autonomous path planning to search for the observation that is more conducive to target identification. Unfortunately, there exists no available dataset for developing the UAV AOD method. To fill this gap, we released a UAV's eye view active vision dataset named UEVAVD and hope it can facilitate research on the UAV AOD problem. Additionally, we improve the existing DRL-based AOD method by incorporating the inductive bias when learning the state representation. First, due to the partial observability, we use the gated recurrent unit to extract state representations from the observation sequence instead of the single-view observation. Second, we pre-decompose the scene with the Segment Anything Model (SAM) and filter out the irrelevant information with the derived masks. With these practices, the agent could learn an active viewing policy with better generalization capability. The effectiveness of our innovations is validated by the experiments on the UEVAVD dataset. Our dataset will soon be available at https://github.com/Leo000ooo/UEVAVD_dataset.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。