构建高质量汽车3D数据集,提升生成模型在工程领域的应用效果。
MeshFleet: Filtered and Annotated 3D Vehicle Dataset for Domain Specific Generative Modeling
- 用自研分类器自动筛选高质量汽车3D模型,基于视觉与文本特征联合判断。
- 在SV3D上微调验证,筛选数据使生成质量显著优于传统方法。
- 适合需要高精度、可控性3D生成的工业设计与自动驾驶研究者使用。
生成模型在3D物体领域取得了显著进展,但在工程等专业领域的实际应用仍受限,因缺乏准确性、质量和可控性。微调大型生成模型是解决此问题的可行路径,但高质量领域专用3D数据集的构建仍是瓶颈。本文提出MeshFleet,从目前最大公开3D物体库Objaverse-XL中提取并筛选汽车类3D模型。通过构建自动化过滤管道,利用在人工标注子集上训练的质量分类器实现筛选,该分类器融合DINOv2与SigLIP嵌入,结合标题分析和置信度估计进行优化。对比基于标题和图像美学评分的方法,实验表明本方法在微调SV3D时显著提升生成质量,凸显了针对特定领域数据选择的重要性。
原文摘要 · Abstract (English)
Generative models have recently made remarkable progress in the field of 3D objects. However, their practical application in fields like engineering remains limited since they fail to deliver the accuracy, quality, and controllability needed for domain-specific tasks. Fine-tuning large generative models is a promising perspective for making these models available in these fields. Creating high-quality, domain-specific 3D datasets is crucial for fine-tuning large generative models, yet the data filtering and annotation process remains a significant bottleneck. We present MeshFleet, a filtered and annotated 3D vehicle dataset extracted from Objaverse-XL, the most extensive publicly available collection of 3D objects. Our approach proposes a pipeline for automated data filtering based on a quality classifier. This classifier is trained on a manually labeled subset of Objaverse, incorporating DINOv2 and SigLIP embeddings, refined through caption-based analysis and uncertainty estimation. We demonstrate the efficacy of our filtering method through a comparative analysis against caption and image aesthetic score-based techniques and fine-tuning experiments with SV3D, highlighting the importance of targeted data selection for domain-specific 3D generative modeling.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。