arXiv:2603.21999cs.CV2026-03中稿 · IEEE TMM被引 2

用超像素提升多模态显著目标检测,兼顾全局与局部细节

STENet: Superpixel Token Enhancing Network for RGB-D Salient Object Detection

  • 引入超像素优化跨模态交互,降低计算复杂度
  • 通过超像素分组捕捉区域信息,提升全局特征表达
  • 适合需要高效高精度显著目标检测的视觉应用

基于Transformer的RGB-D显著目标检测方法因能捕捉长距离像素依赖而受到关注。然而,现有方法存在注意力机制二次复杂度高、局部细节提取有限等问题。为此,我们提出超像素增强网络STENet,将超像素引入跨模态交互。STENet采用双流编码器-解码器结构,核心为两个定制的超像素驱动的跨模态交互模块,分别负责全局和局部特征增强。具体而言,扩展每个超像素的邻域范围以实现像素与超像素间的灵活转换;提出超像素注意力全局增强模块,建模像素到超像素的全局关系,捕捉区域级信息并降低计算开销;提出超像素注意力局部精炼模块,利用超像素内像素相似性筛选出局部像素子集,并对这些局部像素进行特征增强,从而捕获关键局部细节。此外,融合全局、局部及跨尺度特征,实现全面特征表示。在七个RGB-D显著目标检测数据集上的实验表明,STENet性能优于或媲美当前最优方法。代码与结果见https://github.com/Mark9010/STENet。

原文摘要 · Abstract (English)

Transformer-based methods for RGB-D Salient Object Detection (SOD) have gained significant interest, owing to the transformer's exceptional capacity to capture long-range pixel dependencies. Nevertheless, current RGB-D SOD methods face challenges, such as the quadratic complexity of the attention mechanism and the limited local detail extraction. To overcome these limitations, we propose a novel Superpixel Token Enhancing Network (STENet), which introduces superpixels into cross-modal interaction. STENet follows the two-stream encoder-decoder structure. Its cores are two tailored superpixel-driven cross-modal interaction modules, responsible for global and local feature enhancement. Specifically, we update the superpixel generation method by expanding the neighborhood range of each superpixel, allowing for flexible transformation between pixels and superpixels. With the updated superpixel generation method, we first propose the Superpixel Attention Global Enhancing Module to model the global pixel-to-superpixel relationship rather than the traditional global pixel-to-pixel relationship, which can capture region-level information and reduce computational complexity. We also propose the Superpixel Attention Local Refining Module, which leverages pixel similarity within superpixels to filter out a subset of pixels (i.e., local pixels) and then performs feature enhancement on these local pixels, thereby capturing concerned local details. Furthermore, we fuse the globally and locally enhanced features along with the cross-scale features to achieve comprehensive feature representation. Experiments on seven RGB-D SOD datasets reveal that our STENet achieves competitive performance compared to state-of-the-art methods. The code and results of our method are available at https://github.com/Mark9010/STENet.

显著目标检测多模态超像素Transformer

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。