arXiv:2510.19210cs.CV2025-10中稿 · ICLR被引 2

用专家协作提升动态场景重建质量,实现更稳定逼真的视角合成。

MoE-GS: Mixture of Experts for Dynamic Gaussian Splatting

  • 通过体积感知的像素路由机制,动态融合多个专用专家
  • 在N3V和Technicolor数据集上显著超越现有方法,提升渲染质量
  • 支持轻量化部署,适合需要高精度动态重建的应用

动态场景重建近年来受益于3D高斯点阵技术,但现有方法在不同场景中表现不一,难以应对所有动态挑战。为此,我们提出面向动态高斯点阵的专家混合模型(MoE-GS),通过新颖的体积感知像素路由机制,集成多个专用专家。与侧重稀疏性的大语言模型中的专家混合架构不同,MoE-GS旨在结合异构形变先验以提升动态新视角合成质量,而非降低计算开销。其路由模块通过可微权重点阵化,将体素级权重投影至像素空间,实现时空一致的结果融合。尽管模型容量增加导致帧率下降,我们提出两种互补策略:一是单次遍历多专家渲染与门控高斯剪枝,提升效率;二是蒸馏策略,将MoE性能迁移至单一专家,实现无需架构变更的轻量部署。据我们所知,MoE-GS是首个将专家混合技术引入动态高斯点阵的方法。在N3V和Technicolor数据集上的大量实验表明,该方法持续优于当前最优方案,并兼顾效率。视频演示见 cvsp-lab.github.io/MoE-GS。

原文摘要 · Abstract (English)

Recent advances in dynamic scene reconstruction have significantly benefited from 3D Gaussian Splatting, yet existing methods show inconsistent performance across diverse scenes, indicating no single approach effectively handles all dynamic challenges. To overcome these limitations, we propose Mixture of Experts for Dynamic Gaussian Splatting (MoE-GS), a unified framework integrating multiple specialized experts via a novel Volume-aware Pixel Router. Unlike sparsity-oriented MoE architectures in large language models, MoE-GS is designed to improve dynamic novel view synthesis quality by combining heterogeneous deformation priors, rather than to reduce training or inference-time FLOPs. Our router adaptively blends expert outputs by projecting volumetric Gaussian-level weights into pixel space through differentiable weight splatting, ensuring spatially and temporally coherent results. Although MoE-GS improves rendering quality, the increased model capacity and reduced FPS are inherent to the MoE architecture. To mitigate this, we explore two complementary directions: (1) single-pass multi-expert rendering and gate-aware Gaussian pruning, which improve efficiency within the MoE framework, and (2) a distillation strategy that transfers MoE performance to individual experts, enabling lightweight deployment without architectural changes. To the best of our knowledge, MoE-GS is the first approach incorporating Mixture-of-Experts techniques into dynamic Gaussian splatting. Extensive experiments on the N3V and Technicolor datasets demonstrate that MoE-GS consistently outperforms state-of-the-art methods with improved efficiency. Video demonstrations are available at cvsp-lab.github.io/MoE-GS.

动态重建高斯点阵专家混合视觉合成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。