首个同步真实与模拟城市点云数据集,助力3D场景理解的跨域研究
TrueCity: Real and Simulated Urban Data for Cross-Domain 3D Scene Understanding
- 构建真实与仿真对齐的城市点云数据,支持语义分割的域迁移分析
- 提供厘米级精度标注的真实点云与对应仿真点云,覆盖多类城市要素
- 面向3D视觉中真实与合成数据差距量化,适合模型泛化性研究者使用
3D语义场景理解仍是3D计算机视觉领域的长期挑战。核心问题在于真实世界标注数据有限,难以训练通用模型。通常通过仿真生成新数据来缓解,但合成数据因人为设计而缺乏真实复杂性与传感器噪声,导致合成到真实的域差异。此外,尚无基准能提供用于分割任务的同步真实与仿真点云。我们提出TrueCity,首个包含厘米级精度标注的真实城市点云、语义3D城市模型及对应标注仿真点云的都市语义分割基准。其语义类别符合国际3D城市建模标准,实现合成到真实差距的一致评估。我们在常见基线模型上开展广泛实验,量化了域偏移,并揭示了利用合成数据提升真实场景理解的有效策略。我们相信TrueCity将推动合成到真实差距的量化研究,促进可泛化数据驱动模型的发展。数据、代码与3D模型已公开:https://tum-gis.github.io/TrueCity/
原文摘要 · Abstract (English)
3D semantic scene understanding remains a long-standing challenge in the 3D computer vision community. One of the key issues pertains to limited real-world annotated data to facilitate generalizable models. The common practice to tackle this issue is to simulate new data. Although synthetic datasets offer scalability and perfect labels, their designer-crafted scenes fail to capture real-world complexity and sensor noise, resulting in a synthetic-to-real domain gap. Moreover, no benchmark provides synchronized real and simulated point clouds for segmentation-oriented domain shift analysis. We introduce TrueCity, the first urban semantic segmentation benchmark with cm-accurate annotated real-world point clouds, semantic 3D city models, and annotated simulated point clouds representing the same city. TrueCity proposes segmentation classes aligned with international 3D city modeling standards, enabling consistent evaluation of synthetic-to-real gap. Our extensive experiments on common baselines quantify domain shift and highlight strategies for exploiting synthetic data to enhance real-world 3D scene understanding. We are convinced that the TrueCity dataset will foster further development of sim-to-real gap quantification and enable generalizable data-driven models. The data, code, and 3D models are available online: https://tum-gis.github.io/TrueCity/
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。