提出分层3D生成评估框架,兼顾整体与局部质量。
Hi3DEval: Advancing 3D Generation Evaluation with Hierarchical Validity
- 构建对象与部件双层级评估体系,融合多维度质量分析。
- 在真实感材质属性上表现优于现有图像指标,更贴近人工偏好。
- 适合3D生成模型开发者及评测研究人员使用。
尽管3D内容生成技术快速发展,生成资产的质量评估仍具挑战性。现有方法主要依赖图像指标且仅在对象层面操作,难以捕捉空间连贯性、材质真实性和高保真局部细节。为此,我们提出Hi3DEval,一种面向3D生成内容的分层评估框架,整合对象级与部件级评估,实现多维度整体评估与细粒度质量分析。同时,将纹理评估扩展至材质真实性,重点分析反照率、饱和度和金属度等属性。为支持该框架,我们构建了大规模数据集Hi3DBench,包含多样化的3D资产与高质量标注,并设计可靠的多智能体标注流程。我们还提出基于混合3D表示的自动化评分系统:利用视频表示进行对象级与材质主题评估,以增强时空一致性建模;采用预训练3D特征实现部件级感知。大量实验表明,本方法在建模3D特性方面优于现有图像指标,与人类偏好高度一致,为人工评估提供可扩展替代方案。
原文摘要 · Abstract (English)
Despite rapid advances in 3D content generation, quality assessment for the generated 3D assets remains challenging. Existing methods mainly rely on image-based metrics and operate solely at the object level, limiting their ability to capture spatial coherence, material authenticity, and high-fidelity local details. 1) To address these challenges, we introduce Hi3DEval, a hierarchical evaluation framework tailored for 3D generative content. It combines both object-level and part-level evaluation, enabling holistic assessments across multiple dimensions as well as fine-grained quality analysis. Additionally, we extend texture evaluation beyond aesthetic appearance by explicitly assessing material realism, focusing on attributes such as albedo, saturation, and metallicness. 2) To support this framework, we construct Hi3DBench, a large-scale dataset comprising diverse 3D assets and high-quality annotations, accompanied by a reliable multi-agent annotation pipeline. We further propose a 3D-aware automated scoring system based on hybrid 3D representations. Specifically, we leverage video-based representations for object-level and material-subject evaluations to enhance modeling of spatio-temporal consistency and employ pretrained 3D features for part-level perception. Extensive experiments demonstrate that our approach outperforms existing image-based metrics in modeling 3D characteristics and achieves superior alignment with human preference, providing a scalable alternative to manual evaluations. The project page is available at https://zyh482.github.io/Hi3DEval/.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。