arXiv:2510.17568cs.CV2025-10被引 10

让3D模型在动态场景中同时准确定位与重建,无需后处理。

PAGE-4D: Disentangled pose and geometry estimation for vggt-4d perception

  • 用动态感知聚合器分离静态与动态信息,任务间互不干扰。
  • 在动态场景中,相机位姿、深度和点云重建均优于原VGGT模型。
  • 适合需要实时动态场景理解的自动驾驶与机器人应用。

近期的3D前馈模型(如视觉几何接地变压器,VGGT)在静态场景3D属性推断上表现优异。然而,由于通常在静态数据集上训练,这些模型在涉及复杂动态元素(如移动的人体或可变形物体如雨伞)的真实场景中表现不佳。为解决此问题,我们提出PAGE-4D,一个扩展VGGT以支持动态场景的前馈模型,实现无需后处理的相机位姿估计、深度预测与点云重建。多任务4D重建的核心挑战在于任务间的内在冲突:准确的相机位姿估计需抑制动态区域,而几何重建则需建模它们。为此,我们提出一种动态感知聚合器,通过预测动态感知掩码,分离静态与动态信息——对位姿估计抑制运动线索,对几何重建增强运动线索。大量实验表明,PAGE-4D在动态场景中持续优于原版VGGT,显著提升相机位姿估计、单目与视频深度估计以及密集点图重建性能。相关代码与演示见:https://page4d.github.io/,包含训练与推理掩码变体,以及仅训练掩码变体(即推理阶段等同于VGGT架构)。

原文摘要 · Abstract (English)

Recent 3D feed-forward models, such as the Visual Geometry Grounded Transformer (VGGT), have shown strong capability in inferring 3D attributes of static scenes. However, since they are typically trained on static datasets, these models often struggle in real-world scenarios involving complex dynamic elements, such as moving humans or deformable objects like umbrellas. To address this limitation, we introduce PAGE-4D, a feedforward model that extends VGGT to dynamic scenes, enabling camera pose estimation, depth prediction and point cloud reconstruction - all without post-processing. A central challenge in multitask 4D reconstruction is the inherent conflict between tasks: accurate camera pose estimation requires suppressing dynamic regions, while geometry reconstruction requires modeling them. To resolve this tension, we propose a dynamics aware aggregator that disentangles static and dynamic information by predicting a dynamics-aware mask - suppressing motion cues for pose estimation while amplifying them for geometry reconstruction. Extensive experiments show that PAGE-4D consistently outperforms the original VGGT in dynamic scenarios, achieving superior results in camera pose estimation, monocular and video depth estimation, and dense point map reconstruction. Necessary code and additional demos are available at Link: https://page4d.github.io/, including both the training-and-inference masking variant and the training-only masking variant (= VGGT architecture at inference). Keywords: VGGT-4D, 4D Perception, Dynamic Scene Reconstruction.

4D感知动态重建位姿估计

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。