arXiv:2504.20872cs.CV2025-04被引 1

用极少数据训练超轻量模型,实现高精度显著性目标检测。

FLIM-based Salient Object Detection Networks with Adaptive Decoders

  • 通过标记点反推编码器参数,无需梯度更新训练
  • 自适应解码器按输入图像动态调整权重,提升定位精度
  • 仅需3-4张图训练,适合数据稀缺场景

显著性目标检测(SOD)旨在定位图像中突出物体,并在显著图中为其像素赋予更高值,最终二值化输出预测分割掩码。当前趋势是采用预训练轻量级模型而非深度神经网络,以应对计算资源受限的应用。本文提出一种基于特征学习图像标记(FLIM)的方法,假设编码器卷积核可从少数代表性图像的判别区域标记点估计得出。结合FLIM编码器与自适应解码器,构建了数百倍于轻量级模型的超轻量飞重网络(flyweight networks),其解码器权重由特定启发函数针对每张输入图像动态估计。该方法仅需3至4张代表性图像即可训练,且无需反向传播,适用于标注数据受限场景。研究了五种自适应解码器,其中两种为首次提出;不同于以往每个像素共享权重的单神经元结构,新解码器的启发函数为每个像素独立估计神经元权重。实验对比了两种挑战性SOD任务中的表现,涵盖三种最先进轻量级网络、两种通过反向传播训练的FLIM网络,以及一种由标记定义解码器权重的FLIM网络。结果表明,所提方法优于基线,凸显此类方法在新应用中进一步探索的重要性。

原文摘要 · Abstract (English)

Salient Object Detection (SOD) methods can locate objects that stand out in an image, assign higher values to their pixels in a saliency map, and binarize the map outputting a predicted segmentation mask. A recent tendency is to investigate pre-trained lightweight models rather than deep neural networks in SOD tasks, coping with applications under limited computational resources. In this context, we have investigated lightweight networks using a methodology named Feature Learning from Image Markers (FLIM), which assumes that the encoder's kernels can be estimated from marker pixels on discriminative regions of a few representative images. This work proposes flyweight networks, hundreds of times lighter than lightweight models, for SOD by combining a FLIM encoder with an adaptive decoder, whose weights are estimated for each input image by a given heuristic function. Such FLIM networks are trained from three to four representative images only and without backpropagation, making the models suitable for applications under labeled data constraints as well. We study five adaptive decoders; two of them are introduced here. Differently from the previous ones that rely on one neuron per pixel with shared weights, the heuristic functions of the new adaptive decoders estimate the weights of each neuron per pixel. We compare FLIM models with adaptive decoders for two challenging SOD tasks with three lightweight networks from the state-of-the-art, two FLIM networks with decoders trained by backpropagation, and one FLIM network whose labeled markers define the decoder's weights. The experiments demonstrate the advantages of the proposed networks over the baselines, revealing the importance of further investigating such methods in new applications.

显著性检测轻量模型少样本学习自适应解码

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。