筛选50万高质量3D模型,提升生成效果与训练效率
Objaverse++: Curated 3D Object Dataset with Quality Annotations
- 人工标注1万模型属性,训练神经网络自动标注剩余数据
- 用高质量数据训练的模型收敛更快,生成效果更优
- 适合追求高效3D生成的开发者和研究者
本文提出Objaverse++,从原始超过80万3D模型的Objaverse中精选并人工标注1万模型的详细属性,包括美学质量评分、纹理颜色分类、多物体组合标记、透明度特征等。基于这些标签,训练神经网络对剩余数据进行自动标注,最终构建约50万高质量3D模型的数据集。实验与用户研究显示,基于该高质量子集预训练的模型在图像到3D生成任务中表现优于使用完整低质数据集的模型。此外,不同质量筛选子集对比表明,数据质量越高,训练损失收敛越快。结果表明,精细化数据标注可有效弥补数据规模不足,为3D生成模型提供更高效训练路径。我们已公开约50万经筛选的3D模型,以支持下游3D视觉任务研究,并计划未来扩展至整个Objaverse数据集。
原文摘要 · Abstract (English)
This paper presents Objaverse++, a curated subset of Objaverse enhanced with detailed attribute annotations by human experts. Recent advances in 3D content generation have been driven by large-scale datasets such as Objaverse, which contains over 800,000 3D objects collected from the Internet. Although Objaverse represents the largest available 3D asset collection, its utility is limited by the predominance of low-quality models. To address this limitation, we manually annotate 10,000 3D objects with detailed attributes, including aesthetic quality scores, texture color classifications, multi-object composition flags, transparency characteristics, etc. Then, we trained a neural network capable of annotating the tags for the rest of the Objaverse dataset. Through experiments and a user study on generation results, we demonstrate that models pre-trained on our quality-focused subset achieve better performance than those trained on the larger dataset of Objaverse in image-to-3D generation tasks. In addition, by comparing multiple subsets of training data filtered by our tags, our results show that the higher the data quality, the faster the training loss converges. These findings suggest that careful curation and rich annotation can compensate for the raw dataset size, potentially offering a more efficient path to develop 3D generative models. We release our enhanced dataset of approximately 500,000 curated 3D models to facilitate further research on various downstream tasks in 3D computer vision. In the near future, we aim to extend our annotations to cover the entire Objaverse dataset.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。