用多帧输入提升YOLO在视频中检测鲁棒性,不增加计算负担。
Lightweight Multi-Frame Integration for Robust YOLO Object Detection in Videos
- 多帧堆叠输入仅监督单帧输出,保留原有架构简单性。
- MOT20Det上轻量模型检测精度提升12.3%,接近重型模型性能。
- 适用于监控与自动驾驶,尤其改善模糊、遮挡场景下的表现。
现代基于图像的目标检测模型(如YOLOv7)通常独立处理每一帧,忽略视频中的时间上下文。现有视频检测方法常引入复杂的时序模块,显著增加模型大小和计算开销。在监控、自动驾驶等实际应用中,运动模糊、遮挡和突变外观会严重降低单帧检测性能。为此,我们提出一种简单而高效的方法:将多个连续帧堆叠作为输入,仅对目标帧的输出进行监督。该方法在不改变原有架构的前提下利用时间信息,保持结构简洁、计算高效及实时推理能力。在挑战性数据集MOT20Det和我们提出的BOAT360数据集上的大量实验表明,该方法显著提升了检测鲁棒性,尤其对轻量级模型效果明显,有效缩小了紧凑型与重型检测网络之间的差距。此外,我们还发布了BOAT360基准数据集,包含从船载视角拍摄的鱼眼视频序列,涵盖真实世界复杂场景,以支持未来多帧视频目标检测研究。
原文摘要 · Abstract (English)
Modern image-based object detection models, such as YOLOv7, primarily process individual frames independently, thus ignoring valuable temporal context naturally present in videos. Meanwhile, existing video-based detection methods often introduce complex temporal modules, significantly increasing model size and computational complexity. In practical applications such as surveillance and autonomous driving, transient challenges including motion blur, occlusions, and abrupt appearance changes can severely degrade single-frame detection performance. To address these issues, we propose a straightforward yet highly effective strategy: stacking multiple consecutive frames as input to a YOLO-based detector while supervising only the output corresponding to a single target frame. This approach leverages temporal information with minimal modifications to existing architectures, preserving simplicity, computational efficiency, and real-time inference capability. Extensive experiments on the challenging MOT20Det and our BOAT360 datasets demonstrate that our method improves detection robustness, especially for lightweight models, effectively narrowing the gap between compact and heavy detection networks. Additionally, we contribute the BOAT360 benchmark dataset, comprising annotated fisheye video sequences captured from a boat, to support future research in multi-frame video object detection in challenging real-world scenarios.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。