arXiv:2509.24325eess.IVcs.CV2025-09NeurIPS被引 10

动态场景实时重建新方法,内存占用减半且画质更优

ReCon-GS: Continuum-Preserved Gaussian Streaming for Fast and Compact Reconstruction of Dynamic Scenes

  • 用分层自适应的锚点高斯分布捕捉运动变化,分解为粗到细的表示
  • 在保持时间一致性前提下,实现超过50%的内存压缩,训练效率提升15%
  • 适合需要低延迟、低存储的动态场景实时渲染应用

在线自由视角视频(FVV)重建面临每帧优化慢、运动估计不一致和存储需求不可持续的问题。为此,我们提出可重构连续高斯流(ReCon-GS),一种新型存储感知框架,实现高保真在线动态场景重建与实时渲染。具体而言,我们以密度自适应方式动态分配多层级锚点高斯分布,捕捉帧间几何形变,将场景运动分解为紧凑的粗到细表示;设计动态层次重配置策略,通过按需锚点重分层保留局部运动表达力,同时利用层次内变形继承保证时间一致性,将变换先验限制在对应层级;引入存储感知优化机制,灵活调节不同层级锚点高斯密度,实现重建保真度与内存使用间的可控权衡。在三个常用数据集上的大量实验表明,相比最先进方法,ReCon-GS训练效率提升约15%,在等效渲染质量下内存需求减少超50%,且合成质量更优、鲁棒性更强。

原文摘要 · Abstract (English)

Online free-viewpoint video (FVV) reconstruction is challenged by slow per-frame optimization, inconsistent motion estimation, and unsustainable storage demands. To address these challenges, we propose the Reconfigurable Continuum Gaussian Stream, dubbed ReCon-GS, a novel storage-aware framework that enables high fidelity online dynamic scene reconstruction and real-time rendering. Specifically, we dynamically allocate multi-level Anchor Gaussians in a density-adaptive fashion to capture inter-frame geometric deformations, thereby decomposing scene motion into compact coarse-to-fine representations. Then, we design a dynamic hierarchy reconfiguration strategy that preserves localized motion expressiveness through on-demand anchor re-hierarchization, while ensuring temporal consistency through intra-hierarchical deformation inheritance that confines transformation priors to their respective hierarchy levels. Furthermore, we introduce a storage-aware optimization mechanism that flexibly adjusts the density of Anchor Gaussians at different hierarchy levels, enabling a controllable trade-off between reconstruction fidelity and memory usage. Extensive experiments on three widely used datasets demonstrate that, compared to state-of-the-art methods, ReCon-GS improves training efficiency by approximately 15% and achieves superior FVV synthesis quality with enhanced robustness and stability. Moreover, at equivalent rendering quality, ReCon-GS slashes memory requirements by over 50% compared to leading state-of-the-art methods.

动态重建高斯泼溅实时渲染内存优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。