arXiv:2608.25401cs.CVcs.AI2026-08

构建真实场景多轨迹测试集,评估3D重建对姿态、相机参数和视角的鲁棒性。

PIVOT: A Multi-Trajectory Dataset and Testbed for Pose, Intrinsics, and Novel Viewpoint Evaluation in Real-World 3D Reconstruction

论文配图:PIVOT: A Multi-Trajectory Dataset and Testbed for Pose, Intrinsics, and Novel Viewpoint Evaluation in Real-World 3D Reconstruction
图 1 · 摘自论文原文
  • 设计多轨迹数据集,分离测试姿态、内参与视点变化影响
  • 实测姿态与优化姿态间存在显著重建质量差异
  • 适合机器人、无人机等实际应用中的3D重建性能评估

神经辐射场(NeRFs)、3D高斯泼溅(3DGS)等新视角合成方法常在理想条件下评估,依赖于重建友好的轨迹、优化后的相机位姿与内参,以及训练轨迹中采样的保留视角。这些假设掩盖了真实系统中使用实测位姿、可复用相机标定及结构不同路径时的性能表现。我们提出PIVOT(Pose, Intrinsics and Viewpoint Oriented Testbed),一个包含多轨迹的真实世界数据集、处理流程与评估框架,用于独立研究上述因素的影响。PIVOT通过多样化的相机轨迹采集场景,保留传感器获取的实测位姿与COLMAP优化位姿,以及校准与优化后的相机内参。定义三类基准:(1)已见与未见轨迹的新视角泛化;(2)实测与优化位姿敏感性;(3)校准与优化内参敏感性。引入有向位姿空间切比雪夫距离,量化训练位姿对评估轨迹的覆盖程度。PIVOT v1包含五个使用DJI Mini 4 Pro拍摄的真实场景,并提供基于Nerfstudio的开源处理与评估工具链。基准结果表明,代表轨迹上的保留视角与未见轨迹间存在持续的质量差距,且对位姿来源与相机内参变化高度敏感。

原文摘要 · Abstract (English)

Neural radiance fields (NeRFs), 3D Gaussian Splatting (3DGS), and related novel-view synthesis methods are commonly evaluated under capture and reconstruction conditions cleaner than those encountered by robots, drones, and autonomous systems. Benchmarks often rely on reconstruction-friendly trajectories, optimized camera poses and intrinsics, and held-out views sampled from trajectories represented during training. These assumptions can obscure performance with measured poses, reusable camera calibration, and structurally different camera paths. We introduce PIVOT (Pose, Intrinsics and Viewpoint Oriented Testbed), a multi-trajectory dataset, processing pipeline, and evaluation framework for independently studying these factors. PIVOT captures each scene using diverse camera trajectories and retains, where available, both sensor-derived measured poses and COLMAP-optimized poses, together with calibrated and optimized camera intrinsics. It defines three benchmark families: (1) seen versus unseen trajectory novel-view generalization, (2) measured versus optimized pose sensitivity, and (3) calibrated versus optimized intrinsics sensitivity. We also introduce a directed pose-space Chamfer distance to quantify how well training poses cover an evaluation trajectory. PIVOT v1 contains five real-world scenes captured with a DJI Mini 4 Pro and provides an open processing and Nerfstudio-based evaluation toolchain. Benchmark results show a consistent quality gap between held-out views on represented trajectories and unseen trajectories, as well as substantial sensitivity to pose source and camera intrinsics.

3D重建多视角评估真实世界位姿敏感性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。