Eval3D可细粒度评估3D生成质量,兼顾几何与语义一致性。
Eval3D: Interpretable and Fine-grained Evaluation for 3D Generation
- 用多种基础模型作为探针,检测生成3D资产在不同维度的不一致
- 实现像素级测量与精准3D空间反馈,更贴近人工判断
- 适合研究3D生成质量评估的学者和开发者使用
尽管3D生成领域取得了显著进展,当前系统仍难以产出视觉吸引人且多视角下几何与语义一致的高质量3D资产。现有评估指标或忽略几何质量,或依赖黑箱多模态大模型进行粗略评估。本文提出Eval3D,一种细粒度、可解释的评估工具,能基于多个互补标准准确评估生成3D资产的质量。核心思路是:通过测量多种基础模型与工具间的不一致性,捕捉3D生成中语义与几何一致性等关键属性。Eval3D相比以往方法,支持像素级测量,提供精确3D空间反馈,并更贴近人类判断。我们利用Eval3D全面评估现有3D生成模型,揭示其局限与挑战。
原文摘要 · Abstract (English)
Despite the unprecedented progress in the field of 3D generation, current systems still often fail to produce high-quality 3D assets that are visually appealing and geometrically and semantically consistent across multiple viewpoints. To effectively assess the quality of the generated 3D data, there is a need for a reliable 3D evaluation tool. Unfortunately, existing 3D evaluation metrics often overlook the geometric quality of generated assets or merely rely on black-box multimodal large language models for coarse assessment. In this paper, we introduce Eval3D, a fine-grained, interpretable evaluation tool that can faithfully evaluate the quality of generated 3D assets based on various distinct yet complementary criteria. Our key observation is that many desired properties of 3D generation, such as semantic and geometric consistency, can be effectively captured by measuring the consistency among various foundation models and tools. We thus leverage a diverse set of models and tools as probes to evaluate the inconsistency of generated 3D assets across different aspects. Compared to prior work, Eval3D provides pixel-wise measurement, enables accurate 3D spatial feedback, and aligns more closely with human judgments. We comprehensively evaluate existing 3D generation models using Eval3D and highlight the limitations and challenges of current models.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。