用频谱定向的连续卷积提升模型对几何变换和分辨率变化的鲁棒性。
SONIC: Spectral Oriented Neural Invariant Convolutions
- 基于频谱方向选择的连续参数化,实现全局感受野和跨尺度自适应。
- 参数量少一个数量级,在图像分类与3D医学数据上性能媲美或超越现有方法。
- 适合需要高鲁棒性与低参数量的视觉任务,如医学图像分析、遥感图像处理。
卷积神经网络依赖固定尺寸卷积核扫描局部区域,难以捕捉全局上下文或长程依赖,除非使用极深架构。视觉变换器虽具全局连接能力,但缺乏空间归纳偏置,依赖显式位置编码,且受限于初始分块大小。弥合这些缺陷需兼具结构化与全局性的表征。本文提出SONIC(频谱定向神经不变卷积),一种连续频谱参数化方法,通过少量共享的方向选择性组件建模卷积算子。这些组件在全频率域产生平滑响应,实现全局感受野及自然适应多分辨率的滤波器。在合成基准、大规模图像分类与3D医学数据集上,SONIC展现出对几何变换、噪声和分辨率变化更强的鲁棒性,且以一个数量级更少的参数达到或超越传统卷积、注意力机制及先前频谱架构的性能。结果表明,连续且方向感知的频谱参数化为传统空间与频域算子提供了一种原理严谨且可扩展的替代方案。
原文摘要 · Abstract (English)
Convolutional Neural Networks (CNNs) rely on fixed-size kernels scanning local patches, which limits their ability to capture global context or long-range dependencies without very deep architectures. Vision Transformers (ViTs), in turn, provide global connectivity but lack spatial inductive bias, depend on explicit positional encodings, and remain tied to the initial patch size. Bridging these limitations requires a representation that is both structured and global. We introduce SONIC (Spectral Oriented Neural Invariant Convolutions), a continuous spectral parameterisation that models convolutional operators using a small set of shared, orientation-selective components. These components define smooth responses across the full frequency domain, yielding global receptive fields and filters that adapt naturally across resolutions. Across synthetic benchmarks, large-scale image classification, and 3D medical datasets, SONIC shows improved robustness to geometric transformations, noise, and resolution shifts, and matches or exceeds convolutional, attention-based, and prior spectral architectures with an order of magnitude fewer parameters. These results demonstrate that continuous, orientation-aware spectral parameterisations provide a principled and scalable alternative to conventional spatial and spectral operators.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。