用谐波纹理增强点阵模型,实现实时高质量新视角合成。
Neural Harmonic Textures for High-Quality Primitive Based Neural Reconstruction

- 在每个几何基元周围设置虚拟支架,注入可插值的隐向量。
- 通过周期性激活将透明度融合转为谐波分量加权和,提升高频细节表现。
- 仅需一次延迟解码,计算开销低,适配现有3D点阵框架。
基于基元的方法(如3D高斯泼溅)已成为新视角合成与相关重建任务的最新技术。相比神经场,这类表示更具灵活性、自适应性,且在大场景中扩展性更好。但单个基元表达能力有限,难以建模高频细节。本文提出神经谐波纹理,将隐特征向量锚定于每个基元周围的虚拟支架上,并在射线相交点处进行插值。受傅里叶分析启发,对插值特征应用周期性激活,使透明度融合变为谐波分量的加权和。最终信号通过一个小型神经网络在单次延迟传递中解码,显著降低计算成本。该方法在实时新视角合成中达到当前最佳性能,弥合了基元与神经场方法之间的差距。其可无缝集成至现有基元管线(如3DGUT、Triangle Splatting、2DGS)。我们还展示了其在2D图像拟合与语义重建中的泛化能力。
原文摘要 · Abstract (English)
Primitive-based methods such as 3D Gaussian Splatting have recently become the state-of-the-art for novel-view synthesis and related reconstruction tasks. Compared to neural fields, these representations are more flexible, adaptive, and scale better to large scenes. However, the limited expressivity of individual primitives makes modeling high-frequency detail challenging. We introduce Neural Harmonic Textures, a neural representation approach that anchors latent feature vectors on a virtual scaffold surrounding each primitive. These features are interpolated within the primitive at ray intersection points. Inspired by Fourier analysis, we apply periodic activations to the interpolated features, turning alpha blending into a weighted sum of harmonic components. The resulting signal is then decoded in a single deferred pass using a small neural network, significantly reducing computational cost. Neural Harmonic Textures yield state-of-the-art results in real-time novel view synthesis while bridging the gap between primitive- and neural-field-based reconstruction. Our method integrates seamlessly into existing primitive-based pipelines such as 3DGUT, Triangle Splatting, and 2DGS. We further demonstrate its generality with applications to 2D image fitting and semantic reconstruction.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。