arXiv:2409.05230cs.CV2024-09被引 1

提出低成本视频摘要框架与标准数据集,提升监控视频压缩效率。

A Low-Computational Video Synopsis Framework with a Standard Dataset

  • 用空帧检测优化深度检测器,降低计算开销
  • 通过管状结构重组实现每帧最多非重叠物体数
  • 适合需要高效视频压缩的安防系统应用

视频摘要是一种高效压缩监控视频的方法。该技术首先检测并跟踪目标,生成包含时序边界框序列的目标管状结构。为生成浓缩视频,需重新排列管状结构以最大化每帧非重叠目标数量,再将其拼接至源视频提取的背景图上。现有研究缺乏标准数据集,阻碍模型对比。本文提出专用于视频摘要任务的标准数据集 SynoClip,包含评估各类模型所需的全部要素。同时提出低计算成本的视频摘要模型 FGS:引入空帧目标检测器识别无目标帧,提升深度检测器利用效率;设计管状分组算法保持管状间关系;提出贪心管状重排算法,高效确定各管状起始时间。模型在所提数据集上进行评估,代码、微调检测模型及教程已开源。

原文摘要 · Abstract (English)

Video synopsis is an efficient method for condensing surveillance videos. This technique begins with the detection and tracking of objects, followed by the creation of object tubes. These tubes consist of sequences, each containing chronologically ordered bounding boxes of a unique object. To generate a condensed video, the first step involves rearranging the object tubes to maximize the number of non-overlapping objects in each frame. Then, these tubes are stitched to a background image extracted from the source video. The lack of a standard dataset for the video synopsis task hinders the comparison of different video synopsis models. This paper addresses this issue by introducing a standard dataset, called SynoClip, designed specifically for the video synopsis task. SynoClip includes all the necessary features needed to evaluate various models directly and effectively. Additionally, this work introduces a video synopsis model, called FGS, with low computational cost. The model includes an empty-frame object detector to identify frames empty of any objects, facilitating efficient utilization of the deep object detector. Moreover, a tube grouping algorithm is proposed to maintain relationships among tubes in the synthesized video. This is followed by a greedy tube rearrangement algorithm, which efficiently determines the start time of each tube. Finally, the proposed model is evaluated using the proposed dataset. The source code, fine-tuned object detection model, and tutorials are available at https://github.com/Ramtin-ma/VideoSynopsis-FGS.

视频摘要监控压缩低计算量数据集

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。