arXiv:2608.21828cs.CV2026-08中稿 · ECCV

提出运动感知滤波器,解决动态场景4D表示的伪影问题。

Towards Alias-Free 4D Gaussian Representations with Motion-Aware Filtering

论文配图:Towards Alias-Free 4D Gaussian Representations with Motion-Aware Filtering
图 1 · 摘自论文原文
  • 根据局部运动信息自适应调整3D平滑滤波强度。
  • 在标准数据集上显著降低视角变化时的伪影,保持渲染质量。
  • 适用于多种4D表示方法,适合做动态场景生成的研究者。

动态场景的新视角合成对AR/VR应用至关重要,但仍是难题。现有方法将3D高斯点阵(3DGS)和神经辐射场(NeRF)扩展至第四维时间构建4D表示,但仍存在伪影,尤其在视角缩放时。虽有如Mip-Splatting中的3D平滑滤波器,但未考虑局部运动,仍会产生伪影。为此,本文提出一种专为4D表示设计的运动感知3D平滑滤波器,通过非参数估计方法建模时间和焦距-深度比的联合密度函数,在推理时采样该分布以确定合适滤波强度,实现自适应平滑。该策略可集成于多种4D表示中。在标准数据集上的评估显示,性能优于当前最优方法。

原文摘要 · Abstract (English)

Novel-view synthesis of dynamic scenes, crucial for AR/VR applications, remains a challenging problem. Recent methods adapt representations like 3D Gaussian Splatting (3DGS) and Neural Radiance Fields (NeRF) for dynamic scenes by incorporating time as the fourth dimension (4D representations). These 4D representations still suffer from aliasing artifacts, especially when generating novel views from divergent viewpoints (zoom-in/zoom-out operations). While using 3D smoothing filters like those proposed in Mip-Splatting might seem like a possible solution, they fail to account for local motion and also exhibit aliasing. To address this, we propose a motion-aware 3D smoothing filter specifically designed for 4D representations. Our approach adapts the filter strength based on local motion information, effectively mitigating aliasing without compromising rendering quality. This is achieved by estimating the joint density function of time and focal-to-depth ratio using a non-parametric estimation method. During inference, we sample from this joint distribution to determine the appropriate smoothing filter. This flexible strategy can be integrated with various 4D representations. Our evaluations on standard datasets demonstrate superior performance compared to state-of-the-art methods.

4D表示动态场景伪影消除运动感知

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。