提出新数据集与方法,实现大范围移动场景的高质量4D重建。
WideRange4D: Enabling High-Quality 4D Reconstruction with Wide-Range Movements and Scenes
- 设计新基准WideRange4D,涵盖大范围空间运动的4D数据。
- 提出Progress4D方法,在复杂场景中生成稳定高质量4D结果。
- 适合研究动态3D重建、视频生成与数字人应用的开发者。
随着3D重建技术的快速发展,4D重建研究也取得进展,现有方法可生成高质量4D场景。然而,由于多视角视频数据获取困难,当前4D重建基准主要聚焦原地动作(如舞蹈)和有限场景。实际应用中,大量场景涉及大范围空间运动,暴露了现有4D重建数据集的局限性。此外,现有方法依赖变形场估计3D物体动态,但变形场难以处理大范围空间运动,限制了高质量4D重建能力。本文聚焦于具有显著物体空间移动的4D场景重建,提出新型4D重建基准WideRange4D,包含丰富的大空间变化4D场景数据,支持对4D生成方法能力的全面评估。同时,提出新方法Progress4D,可在多种复杂4D重建任务中生成稳定且高质量的结果。在WideRange4D上进行定量与定性对比实验,验证Progress4D优于现有先进方法。
原文摘要 · Abstract (English)
With the rapid development of 3D reconstruction technology, research in 4D reconstruction is also advancing, existing 4D reconstruction methods can generate high-quality 4D scenes. However, due to the challenges in acquiring multi-view video data, the current 4D reconstruction benchmarks mainly display actions performed in place, such as dancing, within limited scenarios. In practical scenarios, many scenes involve wide-range spatial movements, highlighting the limitations of existing 4D reconstruction datasets. Additionally, existing 4D reconstruction methods rely on deformation fields to estimate the dynamics of 3D objects, but deformation fields struggle with wide-range spatial movements, which limits the ability to achieve high-quality 4D scene reconstruction with wide-range spatial movements. In this paper, we focus on 4D scene reconstruction with significant object spatial movements and propose a novel 4D reconstruction benchmark, WideRange4D. This benchmark includes rich 4D scene data with large spatial variations, allowing for a more comprehensive evaluation of the generation capabilities of 4D generation methods. Furthermore, we introduce a new 4D reconstruction method, Progress4D, which generates stable and high-quality 4D results across various complex 4D scene reconstruction tasks. We conduct both quantitative and qualitative comparison experiments on WideRange4D, showing that our Progress4D outperforms existing state-of-the-art 4D reconstruction methods. Project: https://github.com/Gen-Verse/WideRange4D
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。