夜间无人机追踪中,用条件生成去噪器提升精度与速度。
Conditional Generative Denoiser for Nighttime UAV Tracking
- 根据输入条件生成噪声并去除,突破传统去噪方法限制。
- 在DarkTrack2021上提升追踪精度18.18%,速度比次优去噪器快5.8倍。
- 适合需要实时性与高鲁棒性的复杂夜间无人机视觉追踪场景。
当前最先进的视觉目标追踪方法显著提升了无人飞行器(UAV)的自主能力。然而,在低光照条件下,环境中的不规则真实噪声严重降低这些先进方法的性能。此外,现有主流去噪技术作为即插即用模块部署于UAV追踪时,难以满足实时处理需求。为此,本文提出一种新型条件生成去噪器(CGDenoiser),摆脱传统确定性范式局限,基于输入条件生成噪声并予以消除。为更好匹配输入维度并加速推理,设计了新型嵌套残差Transformer条件器;同时引入创新的多核条件精炼器,精准优化去噪输出。大量实验表明,CGDenoiser在DarkTrack2021上使SOTA追踪器精度提升18.18%,且运行速度达次优去噪器的5.8倍。真实世界复杂场景测试进一步验证了其有效性与实用性。代码、视频演示及补充证明已开源:https://github.com/vision4robotics/CGDenoiser。
原文摘要 · Abstract (English)
State-of-the-art (SOTA) visual object tracking methods have significantly enhanced the autonomy of unmanned aerial vehicles (UAVs). However, in low-light conditions, the presence of irregular real noise from the environments severely degrades the performance of these SOTA methods. Moreover, existing SOTA denoising techniques often fail to meet the real-time processing requirements when deployed as plug-and-play denoisers for UAV tracking. To address this challenge, this work proposes a novel conditional generative denoiser (CGDenoiser), which breaks free from the limitations of traditional deterministic paradigms and generates the noise conditioning on the input, subsequently removing it. To better align the input dimensions and accelerate inference, a novel nested residual Transformer conditionalizer is developed. Furthermore, an innovative multi-kernel conditional refiner is designed to pertinently refine the denoised output. Extensive experiments show that CGDenoiser promotes the tracking precision of the SOTA tracker by 18.18\% on DarkTrack2021 whereas working 5.8 times faster than the second well-performed denoiser. Real-world tests with complex challenges also prove the effectiveness and practicality of CGDenoiser. Code, video demo and supplementary proof for CGDenoier are now available at: \url{https://github.com/vision4robotics/CGDenoiser}.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。