arXiv:2504.11112cs.CV2025-04

无需大量标注数据,用轻量模型高效检测生物医学图像中的显著目标。

Flyweight FLIM Networks for Salient Object Detection in Biomedical Images

  • 基于图像标记学习卷积核,跳过反向传播和预训练。
  • 参数量和计算量大幅降低,性能接近重型模型。
  • 适合标注少、算力弱的生物医学图像分析场景。

深度学习在显著物体检测(SOD)中通常需要大量计算资源和标注数据,难以应用于资源受限场景。轻量模型虽缓解计算压力,但在复杂且标注稀缺的数据下表现不佳。特征学习从图像标记(FLIM)方法通过在少数代表性图像的判别区域提取图像块,学习编码器的卷积核,无需大规模标注数据、预训练或反向传播,利用生物医学图像中常见的信息冗余特性。本文提出在不使用反向传播的情况下学习空洞可分离卷积核与多空洞层,并引入新型网络简化方法减少核冗余和编码器规模。结合近期提出的自适应解码器(为每张图像估计逐点卷积),构建了高效(称作flyweight)的生物医学图像SOD模型。在挑战性数据集上的实验表明,该模型在效率和有效性上优于轻量级模型,以显著更少的参数和浮点运算量,达到与重型模型相当的性能。这些进展凸显了FLIM网络在数据有限且资源受限、具有信息冗余的应用中的潜力。

原文摘要 · Abstract (English)

Salient Object Detection (SOD) with deep learning often requires substantial computational resources and large annotated datasets, making it impractical for resource-constrained applications. Lightweight models address computational demands but typically strive in complex and scarce labeled-data scenarios. Feature Learning from Image Markers (FLIM) learns an encoder's convolutional kernels among image patches extracted from discriminative regions marked on a few representative images, dismissing large annotated datasets, pretraining, and backpropagation. Such a methodology exploits information redundancy commonly found in biomedical image applications. This study presents methods to learn dilated-separable convolutional kernels and multi-dilation layers without backpropagation for FLIM networks. It also proposes a novel network simplification method to reduce kernel redundancy and encoder size. By combining a FLIM encoder with an adaptive decoder, a concept recently introduced to estimate a pointwise convolution per image, this study presents very efficient (named flyweight) SOD models for biomedical images. Experimental results in challenging datasets demonstrate superior efficiency and effectiveness to lightweight models. By requiring significantly fewer parameters and floating-point operations, the results show competitive effectiveness to heavyweight models. These advances highlight the potential of FLIM networks for data-limited and resource-constrained applications with information redundancy.

显著目标检测轻量模型生物医学图像无监督学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。