针对无人机恶劣场景目标检测,提出动态反馈的师生框架提升模型鲁棒性。
Teaching in adverse scenes: a statistically feedback-driven threshold and mask adjustment teacher-student framework for object detection in UAV images under adverse scenes
- 基于训练反馈动态调整掩码和阈值,自适应学习不同阶段特征。
- 通过方差惩罚优化置信度阈值,提升伪标签质量并减少域偏移。
- 首个面向恶劣天气下无人机目标检测的基准框架,适合低资源环境应用。
无监督域适应(UDA)在缓解源域与目标域间性能下降方面展现出潜力,可推广至恶劣环境下无人机目标检测。然而,现有研究多基于自然图像或清晰无人机影像,针对恶劣条件下无人机图像的研究仍处于起步阶段。由于无人机视角独特且受恶劣条件干扰,现有方法常无法准确对齐特征,并受制于有限或噪声伪标签。为此,本文提出首个恶劣场景下无人机目标检测基准——统计反馈驱动的阈值与掩码调整师生框架(SF-TMAT)。具体地,引入动态步进反馈掩码调整自编码器(DSFMA),结合训练进展与损失反馈,动态调整掩码比例并重构特征图,实现不同训练阶段的学习焦点自适应。同时提出方差反馈平滑阈值(VFST)策略,统计每类平均置信度,并引入方差惩罚项动态调节选择阈值,提升伪标签质量并挖掘潜在有效标签,从而缓解域偏移。大量实验表明,所提SF-TMAT在恶劣场景下的无人机目标检测中具备优越性与强泛化能力。代码已开源:https://github.com/ChenHuyoo。
原文摘要 · Abstract (English)
Unsupervised Domain Adaptation (UDA) has shown promise in effectively alleviating the performance degradation caused by domain gaps between source and target domains, and it can potentially be generalized to UAV object detection in adverse scenes. However, existing UDA studies are based on natural images or clear UAV imagery, and research focused on UAV imagery in adverse conditions is still in its infancy. Moreover, due to the unique perspective of UAVs and the interference from adverse conditions, these methods often fail to accurately align features and are influenced by limited or noisy pseudo-labels. To address this, we propose the first benchmark for UAV object detection in adverse scenes, the Statistical Feedback-Driven Threshold and Mask Adjustment Teacher-Student Framework (SF-TMAT). Specifically, SF-TMAT introduces a design called Dynamic Step Feedback Mask Adjustment Autoencoder (DSFMA), which dynamically adjusts the mask ratio and reconstructs feature maps by integrating training progress and loss feedback. This approach dynamically adjusts the learning focus at different training stages to meet the model's needs for learning features at varying levels of granularity. Additionally, we propose a unique Variance Feedback Smoothing Threshold (VFST) strategy, which statistically computes the mean confidence of each class and dynamically adjusts the selection threshold by incorporating a variance penalty term. This strategy improves the quality of pseudo-labels and uncovers potentially valid labels, thus mitigating domain bias. Extensive experiments demonstrate the superiority and generalization capability of the proposed SF-TMAT in UAV object detection under adverse scene conditions. The Code is released at https://github.com/ChenHuyoo .
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。