arXiv:2409.07236eess.IVcs.CV2024-09被引 17

构建首个3D生成内容质量评估数据集,揭示6类常见失真问题。

3DGCQA: A Quality Assessment Database for 3D AI-Generated Contents

  • 基于7种文本生成3D方法,用50个固定提示生成313个带纹理网格。
  • 主观评分显示不同方法生成质量差异显著,客观算法表现有限。
  • 开源数据集助力3D生成质量评测,适合研究人员与开发者使用。

尽管3D生成内容(3DGC)在降低制作成本和加速设计周期方面具有优势,但其质量常不及专业制作的3D内容。常见质量问题凸显了及时有效质量评估的重要性。此类评估不仅保障终端用户获得更高标准的3DGC,也为推进生成技术提供关键洞察。为填补该领域空白,本文提出一个新型3DGC质量评估数据集3DGCQA,基于7种代表性Text-to-3D生成方法构建。在数据集构建过程中,采用50个固定提示生成所有方法的内容,共产生313个带纹理网格,构成3DGCQA数据集。可视化直观揭示生成3DGC中存在6类常见失真。为进一步探索生成内容质量,对评估者进行主观质量评分,结果显示不同生成方法间质量差异显著。此外,在3DGCQA数据集上测试了若干客观质量评估算法,结果暴露现有算法性能局限,强调开发更专业化评估方法的必要性。为促进未来3D内容生成与质量评估研究,数据集已开源:https://github.com/zyj-2000/3DGCQA。

原文摘要 · Abstract (English)

Although 3D generated content (3DGC) offers advantages in reducing production costs and accelerating design timelines, its quality often falls short when compared to 3D professionally generated content. Common quality issues frequently affect 3DGC, highlighting the importance of timely and effective quality assessment. Such evaluations not only ensure a higher standard of 3DGCs for end-users but also provide critical insights for advancing generative technologies. To address existing gaps in this domain, this paper introduces a novel 3DGC quality assessment dataset, 3DGCQA, built using 7 representative Text-to-3D generation methods. During the dataset's construction, 50 fixed prompts are utilized to generate contents across all methods, resulting in the creation of 313 textured meshes that constitute the 3DGCQA dataset. The visualization intuitively reveals the presence of 6 common distortion categories in the generated 3DGCs. To further explore the quality of the 3DGCs, subjective quality assessment is conducted by evaluators, whose ratings reveal significant variation in quality across different generation methods. Additionally, several objective quality assessment algorithms are tested on the 3DGCQA dataset. The results expose limitations in the performance of existing algorithms and underscore the need for developing more specialized quality assessment methods. To provide a valuable resource for future research and development in 3D content generation and quality assessment, the dataset has been open-sourced in https://github.com/zyj-2000/3DGCQA.

3D生成质量评估数据集文本生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。