用几何约束的4D拼接技术,快速生成更准确的动态场景模型。
Geometric 4D Stitching for Grounded 4D Generation

- 通过显式识别缺失几何区域并添加受几何约束的4D拼接块
- 单次场景扩展仅需10分钟内完成,且显著提升几何一致性
- 支持4D网格迭代扩展与场景编辑,适合动态场景重建应用
近期的4D生成方法利用生成模型补全场景级缺失信息,并重构为基于辐射场的表示。然而,这些流程常出现几何不一致问题,且辐射场重建需昂贵优化。此外,辐射场表示将几何不一致吸收进视图依赖特性中,无法保证几何一致性。为此,我们提出几何4D拼接框架,显式识别缺失几何区域,并以几何对齐的4D拼接块进行补全。该方法在单张NVIDIA RTX 5090 GPU上实现每步场景扩展低于10分钟的高效生成,同时显著提升几何一致性。此外,我们证明该显式4D拼接支持4D网格的迭代扩展与4D场景编辑。
原文摘要 · Abstract (English)
Recent 4D generation methods complete scene-level missing information using generative models and reconstruct the scene into radiance-based representations. However, these pipelines often present geometric inconsistencies in the generated content, and the radiance-based reconstruction requires expensive optimization. Furthermore, radiance-based representations often absorb these geometric inconsistencies into their view-dependent nature, failing to enforce the grounded geometric consistency. To address these issues, we propose Geometric 4D Stitching, an efficient framework that explicitly identifies missing geometric regions and complements them with geometrically grounded 4D stitches. As a result, our method constructs 4D scene representations in under 10 minutes on a single NVIDIA RTX 5090 GPU per one-step scene expansion, while improving geometric consistency. Moreover, we demonstrate that our explicit 4D stitching supports interative expansion of 4D mesh as well as 4D scene editing.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。