arXiv:2606.15118cs.CV2026-06

通过高阶多视角融合,提升太空弱目标检测与分割精度

Multi-view feature High-order Fusion for Space Weak Object Detection and Segmentation

论文配图:Multi-view feature High-order Fusion for Space Weak Object Detection and Segmentation
图 1 · 摘自论文原文
  • 设计高阶多视角特征融合机制,增强对弱目标的表征能力
  • 在三个数据集上实现检测与分割的最新性能,显著优于基线模型
  • 模块可即插即用,适用于多种视觉模型,适合航天图像分析场景

空间应用中的图像和视频中普遍存在弱目标,但其有限的外观信息难以学习有效表示。受多视角学习启发,本文提出简单多视角注意力机制,将输出视为多视角特征,并进一步构建多视角特征高阶融合方法(MHF),以聚合更准确、更丰富的弱目标特征。该方法将常用的低阶特征融合扩展至高阶,通过引入高阶多视角特征感知和递归任务贡献门控选择机制,增强了模型捕捉相关与互补信息的能力。新操作具有高度灵活性与可定制性,兼容多种多视角特征表示形式。在两个新构建的空间科学数据集及一个公开的大规模卫星视频数据集上进行了大量实验。结果显示,MHF作为即插即用模块,显著提升多种视觉变压器与基于卷积的检测与分割模型性能,在三项任务中均达到当前最优水平。该方法可作为多视角学习下弱目标视觉建模的新基础模块。代码将在 https://github.com/Kingdroper/MHF 公开。

原文摘要 · Abstract (English)

Weak objects are common in images and videos of space applications. However, it is hard to learn proper representations from their limited appearance information. Inspired by multi-view learning, we develop simple multi-view attentions, treating their outputs as multi-view features. We also propose a multi-view feature high-order fusion method (MHF) to aggregate more accurate and richer features of weak objects. Our MHF extends the commonly used low-order feature fusion method to higher orders. It enhances the model's capacity to capture relevant and complementary information about weak objects. This is achieved by introducing high-order multi-view features perception and a recursive task-contribution gated selection of multi-view features. The new operation is highly flexible and customizable. It is compatible with various variants of multi-view feature representations. We conduct extensive experiments on two newly constructed space science datasets and an open, large-scale satellite video dataset. Our MHF serves as a plug-and-play module and significantly improves various vision transformers and convolution-based detection and segmentation models. We achieve all state-of-the-art accuracies on both tasks across three datasets. Our MHF can be a new basic module for visual modeling that effectively represents weak objects in terms of multi-view learning. The code will be available at https://github.com/Kingdroper/MHF.

弱目标检测多视角融合空间视觉视觉模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。