arXiv:2601.01022cs.CVcs.AI2026-01被引 2

通过频域解耦幅度与相位注意力,提升事件相机在目标跟踪中的效率与精度。

Decoupling Amplitude and Phase Attention in Frequency Domain for RGB-Event based Visual Object Tracking

  • 在频域对RGB与事件图像进行幅度和相位解耦融合,聚焦高频率信息。
  • 在FE108、FELT、COESOT上均实现更优跟踪性能,计算量显著降低。
  • 适合关注事件相机高效融合与实时目标跟踪的研究者与开发者。

现有基于RGB-事件相机的目标跟踪方法主要依赖传统特征级融合,未能充分发挥事件相机的特性。特别是其高动态范围和运动敏感性常被忽视,低信息区域处理均匀,导致骨干网络产生不必要的计算开销。为此,我们提出一种新型跟踪框架,在频域进行早期融合,有效聚合事件模态的高频信息。具体地,通过快速傅里叶变换将RGB与事件模态从空间域转换至频域,并解耦其幅度与相位成分。利用幅度与相位注意力,选择性地将高频事件信息融合进RGB模态,增强特征表示的同时大幅降低骨干网络计算量。此外,设计了运动引导的空间稀疏化模块,利用事件相机的运动敏感性,捕捉目标运动线索与空间概率分布的关系,过滤低信息区域并强化目标相关特征。最终,仅将一组稀疏的目标相关特征输入骨干网络进行学习,跟踪头预测目标位置。在三个广泛使用的RGB-事件跟踪基准数据集FE108、FELT和COESOT上的大量实验表明,该方法在性能与效率方面均表现优异。论文源码将发布于https://github.com/Event-AHU/OpenEvTracking。

原文摘要 · Abstract (English)

Existing RGB-Event visual object tracking approaches primarily rely on conventional feature-level fusion, failing to fully exploit the unique advantages of event cameras. In particular, the high dynamic range and motion-sensitive nature of event cameras are often overlooked, while low-information regions are processed uniformly, leading to unnecessary computational overhead for the backbone network. To address these issues, we propose a novel tracking framework that performs early fusion in the frequency domain, enabling effective aggregation of high-frequency information from the event modality. Specifically, RGB and event modalities are transformed from the spatial domain to the frequency domain via the Fast Fourier Transform, with their amplitude and phase components decoupled. High-frequency event information is selectively fused into RGB modality through amplitude and phase attention, enhancing feature representation while substantially reducing backbone computation. In addition, a motion-guided spatial sparsification module leverages the motion-sensitive nature of event cameras to capture the relationship between target motion cues and spatial probability distribution, filtering out low-information regions and enhancing target-relevant features. Finally, a sparse set of target-relevant features is fed into the backbone network for learning, and the tracking head predicts the final target position. Extensive experiments on three widely used RGB-Event tracking benchmark datasets, including FE108, FELT, and COESOT, demonstrate the high performance and efficiency of our method. The source code of this paper will be released on https://github.com/Event-AHU/OpenEvTracking

目标跟踪事件相机频域融合稀疏特征

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。