针对夜间无人机追踪中光照不均问题,提出LDEnhancer增强算法。
Enhancing Nighttime UAV Tracking with Light Distribution Suppression
- 分离光照与图像内容特征,实现针对性增强。
- 在NAT2024-2数据集上超过74K帧,性能优于现有方法。
- 已在真实无人机平台验证,适合实际部署场景。
视觉目标跟踪已广泛应用于无人机(UAV)智能系统。然而,当前最先进的夜间无人机跟踪增强方法常忽视低光图像中不均匀的光照分布,导致复杂光照条件下过度增强。为此,本文提出一种新型增强器LDEnhancer,通过抑制光照分布提升夜间无人机跟踪效果。具体地,设计了一种新颖的图像内容精炼模块,将特征空间中的光照分布信息与图像内容信息分离,实现对图像内容信息的精准增强;同时构建新的光照分布生成模块以有效捕捉光照分布。分别将含光照分布与图像内容的信息送入不同参数估计模块,预测参数图。最后,利用两个参数图,提出创新的交织迭代调整策略,实现低光图像的协同像素级校正。此外,构建了具有挑战性的夜间无人机跟踪数据集NAT2024-2,包含40个复杂序列,总计超过74,000帧,用于全面评估。在权威UAV基准和所提NAT2024-2上的实验表明,LDEnhancer在夜间无人机跟踪中显著优于其他SOTA低光增强方法。进一步在搭载NVIDIA Orin NX的典型无人机平台上进行实测,验证了其实际可用性与高效性。代码已开源:https://github.com/vision4robotics/LDEnhancer。
原文摘要 · Abstract (English)
Visual object tracking has boosted extensive intelligent applications for unmanned aerial vehicles (UAVs). However, the state-of-the-art (SOTA) enhancers for nighttime UAV tracking always neglect the uneven light distribution in low-light images, inevitably leading to excessive enhancement in scenarios with complex illumination. To address these issues, this work proposes a novel enhancer, i.e., LDEnhancer, enhancing nighttime UAV tracking with light distribution suppression. Specifically, a novel image content refinement module is developed to decompose the light distribution information and image content information in the feature space, allowing for the targeted enhancement of the image content information. Then this work designs a new light distribution generation module to capture light distribution effectively. The features with light distribution information and image content information are fed into the different parameter estimation modules, respectively, for the parameter map prediction. Finally, leveraging two parameter maps, an innovative interweave iteration adjustment is proposed for the collaborative pixel-wise adjustment of low-light images. Additionally, a challenging nighttime UAV tracking dataset with uneven light distribution, namely NAT2024-2, is constructed to provide a comprehensive evaluation, which contains 40 challenging sequences with over 74K frames in total. Experimental results on the authoritative UAV benchmarks and the proposed NAT2024-2 demonstrate that LDEnhancer outperforms other SOTA low-light enhancers for nighttime UAV tracking. Furthermore, real-world tests on a typical UAV platform with an NVIDIA Orin NX confirm the practicality and efficiency of LDEnhancer. The code is available at https://github.com/vision4robotics/LDEnhancer.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。