无需标注,高效检测卫星视频中的微小移动目标。
Highly Efficient and Unsupervised Framework for Moving Object Detection in Satellite Videos
- 用自进化伪标签替代人工标注,降低标注成本。
- 通过稀疏时空点云表示,实现每秒98.8帧的处理速度。
- 适合需要低延迟、无监督的卫星视频分析场景。
卫星视频中的运动目标检测(SVMOD)因目标极小且暗淡而极具挑战性。现有基于学习的方法依赖多帧密集表示与人工标注来提取时空信息,导致标注成本高且计算冗余严重,源于前景与背景区域的巨大不平衡。本文提出一种高效无监督框架:首先设计通用无监督方法,利用传统方法生成的伪标签随训练过程迭代优化,提升检测性能;其次提出一种高效的稀疏卷积无锚框检测网络,将密集多帧图像转化为稀疏时空点云表示,跳过背景区域的冗余计算。结合两项设计,实现高效率(标注与计算效率)与高效果兼顾。大量实验表明,该方法在1024x1024图像上可达到每秒98.8帧的处理速度,并取得当前最优性能。数据集重标注版本与代码已开源:https://github.com/ChaoXiao12/Moving-object-detection-in-satellite-videos-HiEUM。
原文摘要 · Abstract (English)
Moving object detection in satellite videos (SVMOD) is a challenging task due to the extremely dim and small target characteristics. Current learning-based methods extract spatio-temporal information from multi-frame dense representation with labor-intensive manual labels to tackle SVMOD, which needs high annotation costs and contains tremendous computational redundancy due to the severe imbalance between foreground and background regions. In this paper, we propose a highly efficient unsupervised framework for SVMOD. Specifically, we propose a generic unsupervised framework for SVMOD, in which pseudo labels generated by a traditional method can evolve with the training process to promote detection performance. Furthermore, we propose a highly efficient and effective sparse convolutional anchor-free detection network by sampling the dense multi-frame image form into a sparse spatio-temporal point cloud representation and skipping the redundant computation on background regions. Coping these two designs, we can achieve both high efficiency (label and computation efficiency) and effectiveness. Extensive experiments demonstrate that our method can not only process 98.8 frames per second on 1024x1024 images but also achieve state-of-the-art performance. The relabeled dataset and code are available at https://github.com/ChaoXiao12/Moving-object-detection-in-satellite-videos-HiEUM.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。