arXiv:2607.21471cs.CV2026-07

提出未来表面重建新基准,突破传统评估局限。

Future Rendering $\neq$ Future Surface: A Benchmark and Dataset for Dynamic Surface Reconstruction Beyond the Observed Window

论文配图:Future Rendering $\neq$ Future Surface: A Benchmark and Dataset for Dynamic Surface Reconstruction Beyond the Observed Window
图 1 · 摘自论文原文
  • 设计可控动态场景数据集,提供精确未来真值
  • 实测模型未来几何误差达观测阶段2.7-6.6倍
  • 揭示未来渲染与表面精度可解耦,适合机器人等前瞻场景

动态场景重建通常在观测窗口内评估,但增强现实、机器人交互和前瞻规划等应用需要预测窗口外的未来表面。现有缺乏标准基准。本文提出FutureSurf,一个控制性诊断基准与数据集,以牺牲场景多样性换取精确的未来真值与可验证性。方法在序列前75%训练,用切比雪夫距离(Chamfer distance)评估未来帧表面,报告绝对未来CD作为主指标,以及未来/观测差距作为诊断。数据集包含八种解析定义的受控运动,含三种可验证干扰控制,提供每帧精确网格真值。同时提供真值侧可恢复性判别器。发布内容包括分割文件、评分代码、基准卡片及Croissant元数据。在受控运动上,DG-Mesh主干模型仍存在2.7-4.1倍差距,即使未来可由固定规则恢复(五中四可恢复)。干扰控制表现符合预期(表面不变运动无差距)。该差距在六个动画DG-Mesh资产场景及第二主干Deformable-3DGS(2.0-6.6×;共用变形MLP时间模型)中持续存在。基准还显示:未来渲染质量与未来表面准确性统计解耦,现有新视角合成指标无法追踪未来几何。未来误差具有结构性,集中在表面运动区域。数据集、评估工具与评分代码已开源于Hugging Face与GitHub。

原文摘要 · Abstract (English)

Dynamic-scene reconstruction is almost always evaluated inside the observed time window, yet deployment settings such as AR overlays, robot interaction, and anticipatory planning need the future surface: the geometry at times beyond those captured. No standard benchmark measures this. We introduce FutureSurf, a controlled diagnostic benchmark and dataset for future-time surface reconstruction that trades scene diversity for exact future ground truth and falsification controls. A method trains on the observed first 75% of a sequence; we score its extracted per-frame surface on the held-out future by Chamfer distance, reporting absolute future CD as the primary score and the future/observed gap as a diagnostic. The dataset contains eight analytically defined controlled motions, including three falsification controls, with exact per-frame ground-truth meshes. We also provide a ground-truth-side recoverability oracle. The release includes split files, scoring code, a benchmark card, and Croissant metadata. On the controlled motions, the DG-Mesh backbone leaves a 2.7-4.1$\times$ gap even for futures predictable in principle (four of five recoverable from observed motion by a fixed rule), while the falsification controls behave as designed (the surface-invariant motion shows no gap). Beyond the contributed dataset, the gap persists across six animated DG-Mesh asset scenes and a second backbone, Deformable-3DGS (2.0-6.6$\times$; both share a deformation-MLP temporal model). The benchmark also shows that future rendering quality and future-surface accuracy are statistically decoupled, so the novel-view-synthesis metrics the field reports do not track future geometry. The future error is structured, concentrating where the surface moves. The dataset, evaluation toolkit, and scoring code are available on Hugging Face and GitHub (https://github.com/Ricky-S/futuresurf).

表面重建未来预测基准测试动态场景

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。