arXiv:2606.14005cs.CV2026-06

用高层上下文指导低层特征对齐,提升目标检测融合效果

Context-Guided Semantic Alignment for Feature Fusion Networks

论文配图:Context-Guided Semantic Alignment for Feature Fusion Networks
图 1 · 摘自论文原文
  • 通过跨层级注意力,用高层语义引导低层特征修正
  • 引入对齐感知采样,将注意力计算量降低一个数量级
  • 轻量模块适配多种检测器,提升精度且不增加负担

特征融合网络是现代目标检测器的核心,通过整合多尺度特征来检测不同大小的目标。然而,直接融合不同层级的特征常引发语义不一致,导致信息冲突,扭曲融合表示并降低检测精度。本文提出特征交互网络(FINE),一种轻量级语义对齐模块,在融合前利用高层上下文引导低层特征进行修正。为弥合结构差异并保证效率,引入对齐感知令牌采样,对齐各尺度对应的空间区域,使注意力复杂度降低一个数量级。生成的注意力权重形成空间-通道调制图,通过残差逐元素调制上采样后作用于低层特征。该机制可选择性增强语义相关像素,同时保持密集预测任务所需的亚像素定位精度。FINE可广泛应用于各类检测器,始终在极小计算开销下提升检测精度。代码已公开于 https://github.com/HyungseopLee/FINE。

原文摘要 · Abstract (English)

Feature fusion networks are fundamental components in modern object detectors, aggregating multi-scale features to detect objects of varying sizes. However, directly fusing features from different pyramid levels often introduces semantic inconsistency, causing information conflicts that distort the fused representation and degrade detection accuracy. In this paper, we propose Feature Interaction NEtwork (FINE), a lightweight semantic alignment module that refines low-level features via high-level contextual guidance using cross-level attention prior to fusion. To bridge the structural gap and ensure computational efficiency, we introduce an Alignment-Aware Token Sampling that aligns corresponding spatial regions across scales, reducing the attention complexity by an order of magnitude. % The resulting attention weights generate a spatial-channel modulation map that is upsampled and applied to the low-level features via residual element-wise modulation. The resulting attention weights generate a spatial-channel modulation map that is applied to the low-level features via residual modulation. This mechanism ensures that the network selectively enhances semantically relevant pixels while preserving the sub-pixel localization accuracy necessary for dense prediction tasks. FINE is generally applicable to various detectors and consistently improves detection accuracy with minimal computational overhead. Our code is publicly available at https://github.com/HyungseopLee/FINE.

特征融合目标检测注意力机制轻量设计

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。