新数据集HuSc3D挑战真实场景下3D重建模型的鲁棒性。
HuSc3D: Human Sculpture dataset for 3D object reconstruction
- 用6个极简白色雕塑建模,含复杂孔洞与低纹理特征
- 每场景图像数差异大,模拟真实采集中数据不全问题
- 适合评估模型对几何细节、颜色模糊和数据量变化的敏感度
从2D图像进行3D场景重建是计算机图形学中的核心任务。然而,现有数据集和基准主要聚焦于理想化的合成数据或精心采集的真实数据,难以反映新获取真实场景中的固有复杂性。尤其在户外拍摄时,背景常动态变化,且普遍使用手机摄像头,导致白平衡等存在偏差。为填补这一空白,我们提出HuSc3D——一个专为在真实采集挑战下严格评估3D重建模型而设计的新数据集。该数据集包含6个高度精细、全白的雕塑,具有复杂的穿孔结构,且纹理和颜色变化极小。此外,各场景图像数量差异显著,部分实例面临数据稀缺挑战,而其他场景则拥有标准视图数。通过在该多样化数据集上评估主流3D重建方法,我们验证了HuSc3D能有效区分模型性能,尤其凸显了模型对细微几何结构、颜色模糊以及数据可用性变化的敏感性——这些局限常被传统数据集所掩盖。
原文摘要 · Abstract (English)
3D scene reconstruction from 2D images is one of the most important tasks in computer graphics. Unfortunately, existing datasets and benchmarks concentrate on idealized synthetic or meticulously captured realistic data. Such benchmarks fail to convey the inherent complexities encountered in newly acquired real-world scenes. In such scenes especially those acquired outside, the background is often dynamic, and by popular usage of cell phone cameras, there might be discrepancies in, e.g., white balance. To address this gap, we present HuSc3D, a novel dataset specifically designed for rigorous benchmarking of 3D reconstruction models under realistic acquisition challenges. Our dataset uniquely features six highly detailed, fully white sculptures characterized by intricate perforations and minimal textural and color variation. Furthermore, the number of images per scene varies significantly, introducing the additional challenge of limited training data for some instances alongside scenes with a standard number of views. By evaluating popular 3D reconstruction methods on this diverse dataset, we demonstrate the distinctiveness of HuSc3D in effectively differentiating model performance, particularly highlighting the sensitivity of methods to fine geometric details, color ambiguity, and varying data availability--limitations often masked by more conventional datasets.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。