让照片生成动态高光效3D场景,支持任意视角和时间点渲染。
Dynamic Novel View Synthesis in High Dynamic Range
- 基于高斯点云,设计动态色调映射模块连接低/高动态范围图像
- 实现时序辐射度一致性与空间颜色精准转换,生成逼真HDR画面
- 适合做影视特效、虚拟拍摄的动态场景重建
高动态范围新视角合成(HDR NVS)旨在从常规成像条件下的低动态范围(LDR)图像中学习HDR 3D模型。现有方法多聚焦静态场景,隐含假设所有元素保持静止且非生命体。然而真实场景常包含移动物体、变化光照等动态因素,带来更大挑战。为此,我们提出更贴近现实的HDR动态新视角合成(HDR DNVS)问题,强调需联合建模时序辐射度变化与LDR到HDR间的复杂3D映射。为应对这一交织难题,我们提出基于高斯点云的HDR-4DGS架构,引入创新的动态色调映射模块,显式关联HDR与LDR域,通过随时间演化辐射分布动态调整映射函数,保持时序辐射度连贯性。实验表明,HDR-4DGS在定量指标与视觉保真度上均超越现有最优方法。代码已开源。
原文摘要 · Abstract (English)
High Dynamic Range Novel View Synthesis (HDR NVS) seeks to learn an HDR 3D model from Low Dynamic Range (LDR) training images captured under conventional imaging conditions. Current methods primarily focus on static scenes, implicitly assuming all scene elements remain stationary and non-living. However, real-world scenarios frequently feature dynamic elements, such as moving objects, varying lighting conditions, and other temporal events, thereby presenting a significantly more challenging scenario. To address this gap, we propose a more realistic problem named HDR Dynamic Novel View Synthesis (HDR DNVS), where the additional dimension ``Dynamic'' emphasizes the necessity of jointly modeling temporal radiance variations alongside sophisticated 3D translation between LDR and HDR. To tackle this complex, intertwined challenge, we introduce HDR-4DGS, a Gaussian Splatting-based architecture featured with an innovative dynamic tone-mapping module that explicitly connects HDR and LDR domains, maintaining temporal radiance coherence by dynamically adapting tone-mapping functions according to the evolving radiance distributions across the temporal dimension. As a result, HDR-4DGS achieves both temporal radiance consistency and spatially accurate color translation, enabling photorealistic HDR renderings from arbitrary viewpoints and time instances. Extensive experiments demonstrate that HDR-4DGS surpasses existing state-of-the-art methods in both quantitative performance and visual fidelity. Source code is available at https://github.com/prinasi/HDR-4DGS.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。