arXiv:2507.01182cs.CV2025-07TPAMI被引 23

用差异卷积提升图像与视频显著性检测速度,轻量高效适配边缘设备。

Rapid Salient Object Detection with Difference Convolutional Neural Networks

  • 引入像素差异卷积捕捉特征对比,结合传统方法与现代CNN优势。
  • 模型参数少于100万,在Jetson Orin上图像/视频分别达46/150帧每秒。
  • 适合移动端或嵌入式部署,显著快于现有轻量级模型且精度更高。

本文针对资源受限设备上实现实时显著性物体检测的挑战,提出一种高效的网络设计。尽管深度神经网络提升了显著性检测性能,但主流先进模型计算开销大。本工作融合经典显著性检测中的对比线索思想与现代CNN的表征能力,提出像素差异卷积(PDCs)来编码特征对比。与传统方法不同,PDC被嵌入到CNN架构中,从丰富特征图中提取对比信息。为提升效率,设计了差异卷积重参数化(DCR)策略,将PDC转化为标准卷积,推理时无额外计算和参数开销。此外,提出时空差异卷积(STDC),增强标准3D卷积以捕获时空对比。所提模型SDNet(图像)与STDNet(视频)在效率-精度权衡上表现显著。在Jetson Orin设备上,参数少于100万,图像与视频流分别达到46 FPS和150 FPS,比第二优轻量模型速度快2倍以上和3倍以上,同时保持更高精度。代码将在https://github.com/hellozhuo/stdnet.git发布。

原文摘要 · Abstract (English)

This paper addresses the challenge of deploying salient object detection (SOD) on resource-constrained devices with real-time performance. While recent advances in deep neural networks have improved SOD, existing top-leading models are computationally expensive. We propose an efficient network design that combines traditional wisdom on SOD and the representation power of modern CNNs. Like biologically-inspired classical SOD methods relying on computing contrast cues to determine saliency of image regions, our model leverages Pixel Difference Convolutions (PDCs) to encode the feature contrasts. Differently, PDCs are incorporated in a CNN architecture so that the valuable contrast cues are extracted from rich feature maps. For efficiency, we introduce a difference convolution reparameterization (DCR) strategy that embeds PDCs into standard convolutions, eliminating computation and parameters at inference. Additionally, we introduce SpatioTemporal Difference Convolution (STDC) for video SOD, enhancing the standard 3D convolution with spatiotemporal contrast capture. Our models, SDNet for image SOD and STDNet for video SOD, achieve significant improvements in efficiency-accuracy trade-offs. On a Jetson Orin device, our models with $<$ 1M parameters operate at 46 FPS and 150 FPS on streamed images and videos, surpassing the second-best lightweight models in our experiments by more than $2\times$ and $3\times$ in speed with superior accuracy. Code will be available at https://github.com/hellozhuo/stdnet.git.

显著性检测轻量化模型边缘计算差异卷积

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。