arXiv:2412.04282cs.CV2024-12CVPR被引 11

用可学习的无穷泰勒展开建模高斯动态,提升视图渲染质量。

Learnable Infinite Taylor Gaussian for Dynamic View Rendering

  • 用可学习的无穷泰勒级数显式建模高斯属性随时间变化
  • 在公开数据集上实现当前最佳的动态视图渲染效果
  • 兼顾隐式网络灵活性与显式函数可解释性,通用性强

由于时间变化参数众多且可用的光度数据有限,捕捉高斯属性(如位置、旋转、尺度)的时序演化极具挑战,常导致收敛困难。尽管端到端神经网络能有效建模复杂动态,但缺乏显式监督,难以生成高质量变换场;而采用时间条件多项式函数虽具可解释性,却需大量手工设计且泛化能力差。本文提出基于可学习无穷泰勒公式的新方法,兼具隐式网络的灵活性与显式多项式的可解释性,实现对各类动态场景中高斯动态的鲁棒、通用建模。在多个公开数据集上的动态新视角渲染实验表明,该方法达到该领域最先进性能。

原文摘要 · Abstract (English)

Capturing the temporal evolution of Gaussian properties such as position, rotation, and scale is a challenging task due to the vast number of time-varying parameters and the limited photometric data available, which generally results in convergence issues, making it difficult to find an optimal solution. While feeding all inputs into an end-to-end neural network can effectively model complex temporal dynamics, this approach lacks explicit supervision and struggles to generate high-quality transformation fields. On the other hand, using time-conditioned polynomial functions to model Gaussian trajectories and orientations provides a more explicit and interpretable solution, but requires significant handcrafted effort and lacks generalizability across diverse scenes. To overcome these limitations, this paper introduces a novel approach based on a learnable infinite Taylor Formula to model the temporal evolution of Gaussians. This method offers both the flexibility of an implicit network-based approach and the interpretability of explicit polynomial functions, allowing for more robust and generalizable modeling of Gaussian dynamics across various dynamic scenes. Extensive experiments on dynamic novel view rendering tasks are conducted on public datasets, demonstrating that the proposed method achieves state-of-the-art performance in this domain. More information is available on our project page(https://ellisonking.github.io/TaylorGaussian).

视图渲染高斯建模动态建模泰勒展开

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。