用双坐标切换机制,实现深度网络对分段线性细化迭代的精确模拟。
Neural network realization of binary refinement iterates via a two-chart atlas selector
- 通过双坐标系切换解决二进制选择带来的不连续问题。
- 固定宽度网络可精确实现任意步数的细化迭代,深度线性增长。
- 适用于任意紧支撑分段线性函数,支持局部种子与平移不变性。
细化算子生成波纹构造、细分方案和几何建模中广泛使用的一类函数。其有限次迭代会迅速产生大量线性段,是检验深度神经网络表达能力的理想案例。先前研究发现,对于具有有限支撑掩码的标量二进制细化,每个紧支撑连续分段线性种子的有限次迭代均可被固定宽度、深度随迭代步数线性增长的ReLU网络精确实现。本文给出该定理的新构造:难点在于细化级联由不连续的二进制数字选择驱动,而ReLU网络输出连续的分段线性映射。我们通过圆周的多边形模型表示残差动力学,采用两个重叠坐标系(普通与偏移半单位)描述位置,其不连续点错开。网络仅在两坐标系均有效且对应线性级联更新一致处切换,确保切换精确且无需变量选择器乘法。该构造还可精确读出满足自然端点兼容条件的所有连续分段线性圆周函数。局部种子通过双通路网络处理,平移协变性、有限分解与粘合扩展结果至任意紧支撑连续分段线性种子,保持支撑窗口不变。
原文摘要 · Abstract (English)
Refinement operators generate many functions used in wavelet constructions, subdivision schemes, and geometric modeling. Their finite iterates can develop rapidly increasing numbers of linear pieces, making them a natural test case for the expressive power of deep neural networks. Earlier work showed that, for scalar binary refinement with a finitely supported mask, every compactly supported continuous piecewise linear seed has finite refinement iterates that admit exact ReLU realizations of fixed width and depth growing linearly with the number of refinement steps. The present paper gives a new construction of this known theorem. The difficulty is that the refinement cascade is driven by discontinuous binary digit choices, whereas ReLU networks produce continuous piecewise linear maps. We represent the residual dynamics on a polygonal model of the circle and describe each residual position in two overlapping coordinate systems, one ordinary and one shifted by one half. Their discontinuities occur at different points. The network switches between the two descriptions only where both are valid and the corresponding fixed linear cascade updates agree, so the switch is exact and requires no multiplication by a variable selector. The construction also gives exact readout of every continuous piecewise linear circle function satisfying the natural endpoint compatibility condition. Localized seeds are handled by a two-pass network, and translation covariance, finite decomposition, and gluing extend the result to arbitrary compactly supported continuous piecewise linear seeds in a preserved support window.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。