arXiv:2503.18783cs.CVcs.AI2025-03CVPR被引 100

通过频域分组动态卷积,在不增参数量下提升图像密集预测性能。

Frequency Dynamic Convolution for Dense Image Prediction

论文配图:Frequency Dynamic Convolution for Dense Image Prediction
图 1 · 摘自论文原文
  • 在傅里叶域划分参数预算,实现频率多样化的自适应卷积核
  • ResNet-50上仅增360万参数,超越需额外9000万参数的方法
  • 适用于多种主流架构,适合追求高效精准的视觉任务研究者

动态卷积虽能通过并行权重与注意力机制实现自适应,但其权重频率响应高度相似,导致参数开销大而适应性弱。本文提出频域动态卷积(FDConv),在傅里叶域学习固定参数预算,将预算划分为无重叠傅里叶索引的频率组,构建频率多样权重而不增加参数量。为增强适应性,引入核空间调制(KSM)与频带调制(FBM):KSM在空间层面动态调节滤波器频率响应,FBM在频域分解权重并基于局部内容动态调制。大量实验验证有效性:应用于ResNet-50时仅增加360万参数,性能优于需增加9000万(CondConv)或7650万(KW)参数的方法。FDConv可无缝集成至ConvNeXt、Swin-Transformer等架构,为现代视觉任务提供灵活高效的解决方案。代码已公开于https://github.com/Linwei-Chen/FDConv。

原文摘要 · Abstract (English)

While Dynamic Convolution (DY-Conv) has shown promising performance by enabling adaptive weight selection through multiple parallel weights combined with an attention mechanism, the frequency response of these weights tends to exhibit high similarity, resulting in high parameter costs but limited adaptability. In this work, we introduce Frequency Dynamic Convolution (FDConv), a novel approach that mitigates these limitations by learning a fixed parameter budget in the Fourier domain. FDConv divides this budget into frequency-based groups with disjoint Fourier indices, enabling the construction of frequency-diverse weights without increasing the parameter cost. To further enhance adaptability, we propose Kernel Spatial Modulation (KSM) and Frequency Band Modulation (FBM). KSM dynamically adjusts the frequency response of each filter at the spatial level, while FBM decomposes weights into distinct frequency bands in the frequency domain and modulates them dynamically based on local content. Extensive experiments on object detection, segmentation, and classification validate the effectiveness of FDConv. We demonstrate that when applied to ResNet-50, FDConv achieves superior performance with a modest increase of +3.6M parameters, outperforming previous methods that require substantial increases in parameter budgets (e.g., CondConv +90M, KW +76.5M). Moreover, FDConv seamlessly integrates into a variety of architectures, including ConvNeXt, Swin-Transformer, offering a flexible and efficient solution for modern vision tasks. The code is made publicly available at https://github.com/Linwei-Chen/FDConv.

动态卷积频域建模轻量化设计视觉任务

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。