arXiv:2506.17838cs.CVeess.IV2025-06被引 2

针对低帧率和多种噪声的劣质视频,提出基于卷积稀疏表示的前景背景分离方法。

Robust Foreground-Background Separation for Severely-Degraded Videos Using Convolutional Sparse Representation Modeling

  • 用卷积稀疏表示建模前景,自适应捕捉图像中的局部结构特征。
  • 在低帧率下仍能准确分离前景与背景,对红外和显微视频均有效。
  • 显式建模多种噪声类型,适合处理硬件受限场景下的视频分析。

本文提出一种基于卷积稀疏表示(CSR)的前景-背景分离(FBS)方法,用于处理在硬件、环境或供电限制下获取的劣质视频。现有方法存在两大局限:仅捕获组件的数据特异性或通用特征;未显式建模各类噪声以在分离过程中去除。为此,我们构建了基于CSR的前景模型,可自适应提取成像数据中分散的特定空间结构。将FBS建模为包含CSR、通用特征函数及多类噪声显式表征函数的约束多凸优化问题。该设计使方法同时捕捉数据特异与通用特征,在低帧率和多种噪声条件下实现精确分离。针对优化问题,提出交替求解两个凸子问题的新算法。实验表明,该方法在红外视频与显微视频两类劣质视频上均优于现有方法。

原文摘要 · Abstract (English)

This paper proposes a foreground-background separation (FBS) method with a novel foreground model based on convolutional sparse representation (CSR). In order to analyze the dynamic and static components of videos acquired under undesirable conditions, such as hardware, environmental, and power limitations, it is essential to establish an FBS method that can handle videos with low frame rates and various types of noise. Existing FBS methods have two limitations that prevent us from accurately separating foreground and background components from such degraded videos. First, they only capture either data-specific or general features of the components. Second, they do not include explicit models for various types of noise to remove them in the FBS process. To this end, we propose a robust FBS method with a CSR-based foreground model. This model can adaptively capture specific spatial structures scattered in imaging data. Then, we formulate FBS as a constrained multiconvex optimization problem that incorporates CSR, functions that capture general features, and explicit noise characterization functions for multiple types of noise. Thanks to these functions, our method captures both data-specific and general features to accurately separate the components from various types of noise even under low frame rates. To obtain a solution of the optimization problem, we develop an algorithm that alternately solves its two convex subproblems by newly established algorithms. Experiments demonstrate the superiority of our method over existing methods using two types of degraded videos: infrared and microscope videos.

前景分离稀疏表示视频去噪低帧率视频

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。