arXiv:2410.22715cs.CV2024-10NeurIPS被引 13

构建高精度3D室内场景数据集框架,支持密集几何任务评估

SCRREAM : SCan, Register, REnder And Map:A Framework for Annotating Accurate and Dense 3D Indoor Scenes with a Benchmark

  • 通过扫描、配准、渲染与映射流程生成完整三维网格
  • 在11个场景上提供精确深度图作为密集几何任务的真值
  • 适用于室内重建、物体移除、6D姿态估计等任务

传统3D室内数据集为追求规模常牺牲真实精度,导致网格不完整,影响深度渲染等密集几何任务的评估效果。本文提出SCRREAM框架,可对场景中物体生成完整稠密网格,并将相机位姿注册到真实图像序列,从而为稀疏与密集3D任务提供准确真值。详细展示了数据标注流程,并基于该框架生成四种数据集变体,涵盖室内重建、SLAM、场景编辑与物体移除、人体重建及6D姿态估计等应用。以近期室内重建与SLAM方法为新基准,在11个样本场景上对比评估,使用精确渲染的真值深度图进行验证。

原文摘要 · Abstract (English)

Traditionally, 3d indoor datasets have generally prioritized scale over ground-truth accuracy in order to obtain improved generalization. However, using these datasets to evaluate dense geometry tasks, such as depth rendering, can be problematic as the meshes of the dataset are often incomplete and may produce wrong ground truth to evaluate the details. In this paper, we propose SCRREAM, a dataset annotation framework that allows annotation of fully dense meshes of objects in the scene and registers camera poses on the real image sequence, which can produce accurate ground truth for both sparse 3D as well as dense 3D tasks. We show the details of the dataset annotation pipeline and showcase four possible variants of datasets that can be obtained from our framework with example scenes, such as indoor reconstruction and SLAM, scene editing & object removal, human reconstruction and 6d pose estimation. Recent pipelines for indoor reconstruction and SLAM serve as new benchmarks. In contrast to previous indoor dataset, our design allows to evaluate dense geometry tasks on eleven sample scenes against accurately rendered ground truth depth maps.

3D重建数据集稠密几何SLAM

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。