arXiv:2507.06152cs.LGcs.NA2025-07

从框架理论视角分析卷积层混叠问题,提升模型稳定性。

Aliasing in Convnets: A Frame-Theoretic Perspective

  • 用框架理论建模一维卷积的混叠现象
  • 提出可高效计算的稳定性优化目标
  • 揭示随机卷积层初始化时的混叠特性

在卷积层中使用步长会引入混叠,影响数值稳定性和统计泛化能力。尽管已有参数化方法通过伪酉系统促进正交卷积以保证Parseval稳定性,但尚未有系统性分析混叠及其对稳定性的影响。本文采用框架理论描述一维核卷积层中的混叠,给出针对短核尺寸的稳定性界估计和Parseval稳定性的表征。基于此,推导出两个计算高效的优化目标,通过系统抑制混叠来促进稳定性。对于随机核层,我们推导出描述混叠效应项的期望与方差的闭式表达式,揭示了初始化阶段混叠行为的本质特征。

原文摘要 · Abstract (English)

Using a stride in a convolutional layer inherently introduces aliasing, which has implications for numerical stability and statistical generalization. While techniques such as the parametrizations via paraunitary systems have been used to promote orthogonal convolution and thus ensure Parseval stability, a general analysis of aliasing and its effects on the stability has not been done in this context. In this article, we adapt a frame-theoretic approach to describe aliasing in convolutional layers with 1D kernels, leading to practical estimates for stability bounds and characterizations of Parseval stability, that are tailored to take short kernel sizes into account. From this, we derive two computationally very efficient optimization objectives that promote Parseval stability via systematically suppressing aliasing. Finally, for layers with random kernels, we derive closed-form expressions for the expected value and variance of the terms that describe the aliasing effects, revealing fundamental insights into the aliasing behavior at initialization.

卷积网络混叠分析稳定性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。