通过分层竞争分配，实现动态3D高保真渲染与高效分割。
Multi4D: High-Fidelity Dynamic Gaussian Splatting via Multi-Level Competitive Allocation
- 分三层次建模：静态结构、持久动态几何、瞬时外观
- 动态竞争解释图像误差，减少40%以上动态点数
- 支持实时渲染与高速4D语义分割，适合动态场景重建
动态3D高斯点阵面临运动一致性与视觉保真度的矛盾。基于形变的方法虽保持时间对应性，但存在运动过分解和高频动态模糊问题；而4D原语方法虽捕捉细节，却导致时间参数冗余，破坏物体身份并带来严重存储开销。为此，我们提出Multi4D框架，采用多层级竞争分配机制。不使用单一表示，而是将建模能力分布在三个结构化层级：静态结构、持久动态几何与瞬时外观原语。通过共享光栅化与残差驱动优化，各层级动态竞争以解释光度误差，实现自适应分工而无需预设分解。该方法在保持长期运动一致性的同时捕捉精细动态细节，达到业界最优渲染质量与实时性能，且动态原语数量显著减少。此外，因模型显式追踪紧凑的持久高斯点，可后续嵌入语义特征，使Multi4D在4D分割任务中实现领先精度，速度提升一个数量级。项目页：https://batfacewayne.github.io/Multi4D.io/
原文摘要 · Abstract (English)
Dynamic 3D Gaussian splatting faces a fundamental tension between motion consistency and visual fidelity. Deformation-based approaches preserve temporal correspondence but suffer from motion over-factorization, oversmoothing high-frequency dynamics. In contrast, 4D-primitive methods capture fine visual details yet incur temporal overparameterization, breaking object identity and leading to severe storage overhead. To resolve this, we introduce Multi4D, a framework for high-fidelity dynamic Gaussian Splatting based on multi-level competitive allocation. Instead of a monolithic representation, we distribute modeling capacity across three structured levels: static structure, persistent dynamic geometry, and transient appearance primitives. Through shared rasterization and residual-driven optimization, these levels dynamically compete to explain photometric error, enabling adaptive specialization without pre-assigned decomposition. This allocation preserves long-term motion consistency while capturing fine dynamic detail, achieving state-of-the-art rendering quality and real-time performance with significantly fewer dynamic primitives. Furthermore, because our representation explicitly tracks compact persistent Gaussians over time, semantic features can be embedded afterward, enabling Multi4D to achieve state-of-the-art 4D segmentation accuracy with an order-of-magnitude speedup. Project page: https://batfacewayne.github.io/Multi4D.io/
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。