arXiv:2512.18291cs.CV2025-12

提出新型多模态检测架构,提升无人机图像中小目标识别精度。

Pyramidal Adaptive Cross-Gating for Multimodal Detection

  • 设计双向对称门控模块,抑制跨模态噪声并保留语义
  • 通过分层门控重建特征金字塔,有效保留细粒度细节
  • 在两个数据集上达到新最优,尤其擅长小目标检测

无人机侦察中的航拍图像目标检测至关重要。现有方法虽探索了多模态特征交互,但普遍采用简单融合策略,易引入跨模态噪声,并破坏特征金字塔的层级结构,影响小目标的精细检测。为此,我们提出金字塔自适应交叉门控网络(PACGNet),在主干网络中实现深层融合。核心组件包括对称交叉门控(SCG)模块与金字塔特征感知多模态门控(PFMG)模块。SCG采用双向对称的水平门控机制,选择性吸收互补信息,抑制噪声,保持各模态语义完整性。PFMG通过渐进式分层门控重构特征层级,利用前一高分辨率层的细节特征引导当前低分辨率层的融合,有效保留特征传播过程中的细粒度信息。在DroneVehicle和VEDAI数据集上的实验表明,PACGNet达到新最佳性能,mAP50分别达82.2%和82.1%。

原文摘要 · Abstract (English)

Object detection in aerial imagery is a critical task in applications such as UAV reconnaissance. Although existing methods have extensively explored feature interaction between different modalities, they commonly rely on simple fusion strategies for feature aggregation. This introduces two critical flaws: it is prone to cross-modal noise and disrupts the hierarchical structure of the feature pyramid, thereby impairing the fine-grained detection of small objects. To address this challenge, we propose the Pyramidal Adaptive Cross-Gating Network (PACGNet), an architecture designed to perform deep fusion within the backbone. To this end, we design two core components: the Symmetrical Cross-Gating (SCG) module and the Pyramidal Feature-aware Multimodal Gating (PFMG) module. The SCG module employs a bidirectional, symmetrical "horizontal" gating mechanism to selectively absorb complementary information, suppress noise, and preserve the semantic integrity of each modality. The PFMG module reconstructs the feature hierarchy via a progressive hierarchical gating mechanism. This leverages the detailed features from a preceding, higher-resolution level to guide the fusion at the current, lower-resolution level, effectively preserving fine-grained details as features propagate. Through evaluations conducted on the DroneVehicle and VEDAI datasets, our PACGNet sets a new state-of-the-art benchmark, with mAP50 scores reaching 82.2% and 82.1% respectively.

多模态检测无人机图像小目标检测特征融合

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。