提出旋转不变的多光谱目标检测框架,提升复杂视角下检测精度。
Fully Rotation-Equivariant Spectral-Spatial Learning for Multispectral Object Detection

- 通过隐式坐标映射实现连续光谱重采样,保持光谱顺序性。
- 自适应融合光谱与空间特征,抑制噪声并增强可靠信号。
- 无需重复参数即可稳定检测任意朝向物体,模型更轻量。
现有多光谱检测方法受限于离散光谱处理、金字塔层级中光谱与空间线索相对可靠性随尺度变化,以及对任意朝向目标缺乏显式的旋转等变几何先验。为此,我们提出 FressDet,一种全旋转等变的光谱-空间学习框架,能够捕捉光谱结构的连续有序特性,并在任意平面旋转下实现可靠的光谱-空间融合。FressDet 集成三个互补模块:光谱隐式变形(SpeIW)通过坐标条件隐式场实现查询驱动的光谱重采样,生成单调且保序的映射;旋转等变一致性加权(ReCoW)基于分支可靠性自适应融合光谱与空间分支,强化有效信息并抑制噪声;定向感知头利用群索引特征,稳定预测定向目标而无需参数复制。整体上,FressDet 在旋转扰动下学习更具判别力和鲁棒性的光谱-空间表示。在五个公开基准上以93%更少参数达到领先性能,验证了其有效性与泛化能力。
原文摘要 · Abstract (English)
Existing multispectral detectors are limited by discrete spectral processing, a scale-dependent shift in the relative reliability of spectral and spatial cues across pyramid levels, and the lack of explicit rotation-equivariant geometric priors for arbitrarily oriented objects. To tackle these limitations, we propose FressDet, a fully rotation-equivariant spectral-spatial learning framework for multispectral object detection, capable of capturing the continuous, ordered nature of spectral structure and enabling reliable spectral-spatial fusion across pyramid levels under arbitrary in-plane rotations. FressDet integrates three complementary components. Spectral Implicit Warp (SpeIW) enables query-based spectral resampling via a coordinate-conditioned implicit field, yielding a monotone, order-preserving warp. Rotation-Equivariant Consistency Weighting (ReCoW) adaptively fuses spectral and spatial branches based on branch reliability, reinforcing informative cues while suppressing noise across pyramid levels. The oriented-aware head exploits group-indexed features to stably predict oriented objects without parameter replication. Taken together, FressDet learns more discriminative and robust spectral-spatial representations even under rotational perturbations. By achieving state-of-the-art performance with 93% fewer parameters on five public benchmarks, FressDet demonstrates its effectiveness and generalizability.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。