arXiv:2606.26849cs.CV2026-06

融合CNN与SSM的频域互补性,提升通用显著物检测性能

Liquid Fusion of Heterogeneous Representations Towards General Salient Object Detection

论文配图:Liquid Fusion of Heterogeneous Representations Towards General Salient Object Detection
图 1 · 摘自论文原文
  • 用液态神经网络动态融合VMamba与ConvNeXt特征
  • 在5个任务上达到最优精度与效率平衡
  • 适合多模态显著物检测研究者参考

通用显著物检测(SOD)旨在从单模态或多模态场景中识别并分割视觉突出对象,近期由状态空间模型(SSMs)推动发展。然而当前方法忽略不同神经网络范式固有的谱偏差。通过数据集级分析发现,卷积神经网络(CNNs)与SSMs的语义表征在频率偏好上具有互补性。受此启发,本文提出液态融合网络(LFNet),通过液态神经网络(LNNs)的动态信息传播机制,动态整合来自VMamba和ConvNeXt的特征。具体地,将连续的VMamba特征视为演化状态,将ConvNeXt特征作为外部刺激,采用内容感知的动态门控机制实现特征聚合。该状态-刺激范式可扩展至多模态输入,提升通用SOD灵活性。此外,引入显著性引导上采样(SGU)操作,在浅层传播特征,通过谱-空间协同设计抑制上采样伪影并保留语义。在五个多样化任务(RGB、RGB-D、RGB-T、VSOD、VDT)上的实验表明,LFNet取得最先进性能,兼顾检测精度与模型效率。代码已开源。

原文摘要 · Abstract (English)

General Salient Object Detection (SOD) aims to identify and segment visually interesting objects from uni-modality or multi-modality scenes, recently advanced by cutting-edge State Space Models (SSMs). However, a critical limitation of current approaches is their neglect of the inherent spectral biases exhibited by different neural network paradigms. By digging to the dataset-level spectral analysis of Convolutional Neural Networks (CNNs) and SSMs, their semantic representations are inherently complementary based on their complementary frequency preferences. Inspired by this, we harmonize heterogeneous representations from SSMs and CNNs to bridge their spectral biases for general salient object detection. To this end, inspired by the dynamic information propagation of Liquid Neural Networks (LNNs), we introduce a liquid fusion to dynamically integrates features from two backbones, including VMamba and ConvNeXt, referred to Liquid Fusion Network (LFNet). Concretely, by treating the continuous VMamba features and ConvNeXt features as evolving states and exogenous stimulus, respectively, LFNet employs a dynamic gating mechanism for content-aware feature aggregation. Crucially, this state-stimulus paradigm enables to scale to multi-modal cues, resulting in flexibility in general SOD. Besides, a Saliency-Guided Upsampling (SGU) operator to propagate the features to the shallow layer, which leverages a spectral-spatial co-design to suppress upsampling artifacts while preserving semantics. Extensive experiments across five diverse tasks (RGB, RGB-D, RGB-T, VSOD, and VDT) demonstrate that LFNet achieves state-of-the-art performance, offering a superior trade-off between detection accuracy and model efficiency. Code has been released at https://github.com/cke520/LFNet.

显著物检测多模态融合状态空间模型液态网络

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。