SASNet通过自适应频率控制,让图像和3D模型重建更清晰稳定。
SASNet: Spatially-Adaptive Sinusoidal Networks for INRs
- 用固定频率层加可学习空间掩码,动态调节不同区域的频率响应
- 在2D图像、3D体数据和SDF重建中收敛更快,细节更锐利,背景更干净
- 适合需要高质量隐式表示的视觉与图形任务,尤其关注细节与噪声控制
正弦神经网络(SIRENs)是视觉与图形领域低维信号的强大隐式神经表示(INRs)。通过正弦函数编码输入坐标,可实现高频图像与表面重建。然而,训练SIRENs常不稳定且对频率初始化敏感:过小频率导致细节区域过于平滑,过大则在平滑区域引入虚假高频成分,表现为噪声。为此,我们提出SASNet,一种空间自适应正弦网络,将冻结的频率嵌入层(显式固定网络频率支持)与联合学习的空间掩码相结合,以定位神经元在域内的影响范围。该设计稳定了优化过程,增强了边缘锐度,并抑制了平滑区域的噪声。在2D图像、3D体数据拟合及符号距离场(SDF)重建基准测试中,SASNet实现了更快收敛、更优重建质量以及鲁棒的频率定位——将低频神经元分配至平滑区域,高频神经元分配至细节区域,同时保持参数效率。代码已公开:https://github.com/Fengyee/SASNet_inr。
原文摘要 · Abstract (English)
Sinusoidal neural networks (SIRENs) are powerful implicit neural representations (INRs) for low-dimensional signals in vision and graphics. By encoding input coordinates with sinusoidal functions, they enable high-frequency image and surface reconstruction. However, training SIRENs is often unstable and highly sensitive to frequency initialization: small frequencies produce overly smooth reconstructions in detailed regions, whereas large ones introduce spurious high-frequency components that manifest as noise in smooth areas such as image backgrounds. To address these challenges, we propose SASNet, a Spatially-Adaptive Sinusoidal Network that couples a frozen frequency embedding layer, which explicitly fixes the network's frequency support, with jointly learned spatial masks that localize neuron influence across the domain. This pairing stabilizes optimization, sharpens edges, and suppresses noise in smooth areas. Experiments on 2D image and 3D volumetric data fitting as well as signed distance field (SDF) reconstruction benchmarks demonstrate that SASNet achieves faster convergence, superior reconstruction quality, and robust frequency localization -- assigning low- and high-frequency neurons to smooth and detailed regions respectively -- while maintaining parameter efficiency. Code available here: https://github.com/Fengyee/SASNet_inr.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。