针对无人机视角下小目标追踪难题,提出高效鲁棒的YOLOv8-SMOT框架。
YOLOv8-SMOT: An Efficient and Robust Framework for Real-Time Small Object Tracking via Slice-Assisted Training and Adaptive Association
- 采用切片训练与自适应关联策略提升小目标检测与追踪性能
- 在SMOT4SB测试集上达到55.205的SO-HOTA得分,领先现有方法
- 适合需要实时小目标追踪的无人机、监控等应用场景
从无人机视角追踪小型多目标(如鸟类)是一项极具挑战性的计算机视觉任务。难点源于三方面:目标外观特征极度稀疏、相机与目标共同运动导致的复杂运动纠缠,以及密集群飞引发的频繁遮挡和身份混淆。本文介绍我们在MVA 2025「寻找鸟类」小多目标追踪挑战赛中的冠军解决方案,基于检测-追踪范式,在检测与关联层面进行针对性创新。检测端提出系统性训练增强框架「SliceTrain」,通过‘确定性全覆盖切片’与‘切片级随机增强’协同,有效解决高分辨率图像中对小目标学习不足的问题。追踪端设计完全不依赖外观信息的鲁棒追踪器,整合了‘运动方向保持(EMA)’机制与结合‘边界框扩展和距离惩罚’的自适应相似度度量,嵌入OC-SORT框架,可稳定处理不规则运动并维持目标身份。该方法在SMOT4SB公开测试集上取得55.205的SO-HOTA得分,充分验证了其在复杂真实场景下的有效性与先进性。代码将开源于https://github.com/Salvatore-Love/YOLOv8-SMOT。
原文摘要 · Abstract (English)
Tracking small, agile multi-objects (SMOT), such as birds, from an Unmanned Aerial Vehicle (UAV) perspective is a highly challenging computer vision task. The difficulty stems from three main sources: the extreme scarcity of target appearance features, the complex motion entanglement caused by the combined dynamics of the camera and the targets themselves, and the frequent occlusions and identity ambiguity arising from dense flocking behavior. This paper details our championship-winning solution in the MVA 2025 "Finding Birds" Small Multi-Object Tracking Challenge (SMOT4SB), which adopts the tracking-by-detection paradigm with targeted innovations at both the detection and association levels. On the detection side, we propose a systematic training enhancement framework named \textbf{SliceTrain}. This framework, through the synergy of 'deterministic full-coverage slicing' and 'slice-level stochastic augmentation, effectively addresses the problem of insufficient learning for small objects in high-resolution image training. On the tracking side, we designed a robust tracker that is completely independent of appearance information. By integrating a \textbf{motion direction maintenance (EMA)} mechanism and an \textbf{adaptive similarity metric} combining \textbf{bounding box expansion and distance penalty} into the OC-SORT framework, our tracker can stably handle irregular motion and maintain target identities. Our method achieves state-of-the-art performance on the SMOT4SB public test set, reaching an SO-HOTA score of \textbf{55.205}, which fully validates the effectiveness and advancement of our framework in solving complex real-world SMOT problems. The source code will be made available at https://github.com/Salvatore-Love/YOLOv8-SMOT.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。