用超图建模多尺度时序关联,提升红外小目标检测精度
HyperTea: A Hypergraph-based Temporal Enhancement and Alignment Network for Moving Infrared Small Target Detection
- 构建全局与局部时序增强模块,融合超图学习高阶时空关联
- 在DAUB和IRDST数据集上实现当前最优性能,检测率显著提升
- 首次结合CNN/RNN/HGNN,适合红外目标检测与视频分析研究者
实际应用中,运动红外小目标检测(MIRSTD)因目标尺寸小、强度弱及运动模式复杂而极具挑战。现有方法通常仅建模特征节点间的低阶相关性,且局限于单一时间尺度的特征提取与增强。尽管超图广泛用于高阶相关性学习,但在MIRSTD中尚未受到重视。为探索超图潜力并增强多时尺度特征表示,本文提出HyperTea,融合全局与局部时序视角,有效建模特征的高阶时空关联。HyperTea包含三个模块:全局时序增强模块(GTEM)通过语义聚合与传播实现全局时序上下文增强;局部时序增强模块(LTEM)捕捉相邻帧间局部运动模式并增强局部时序上下文;此外,设计时序对齐模块(TAM)以解决跨尺度特征错位问题。据我们所知,HyperTea是首个将卷积神经网络(CNN)、循环神经网络(RNN)与超图神经网络(HGNN)联合应用于MIRSTD的工作,显著提升检测性能。在DAUB和IRDST数据集上的实验验证了其领先效果。源代码已开源:https://github.com/Lurenjia-LRJ/HyperTea。
原文摘要 · Abstract (English)
In practical application scenarios, moving infrared small target detection (MIRSTD) remains highly challenging due to the target's small size, weak intensity, and complex motion pattern. Existing methods typically only model low-order correlations between feature nodes and perform feature extraction and enhancement within a single temporal scale. Although hypergraphs have been widely used for high-order correlation learning, they have received limited attention in MIRSTD. To explore the potential of hypergraphs and enhance multi-timescale feature representation, we propose HyperTea, which integrates global and local temporal perspectives to effectively model high-order spatiotemporal correlations of features. HyperTea consists of three modules: the global temporal enhancement module (GTEM) realizes global temporal context enhancement through semantic aggregation and propagation; the local temporal enhancement module (LTEM) is designed to capture local motion patterns between adjacent frames and then enhance local temporal context; additionally, we further develop a temporal alignment module (TAM) to address potential cross-scale feature misalignment. To our best knowledge, HyperTea is the first work to integrate convolutional neural networks (CNNs), recurrent neural networks (RNNs), and hypergraph neural networks (HGNNs) for MIRSTD, significantly improving detection performance. Experiments on DAUB and IRDST demonstrate its state-of-the-art (SOTA) performance. Our source codes are available at https://github.com/Lurenjia-LRJ/HyperTea.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。