arXiv:2503.14756cs.GRcs.CV2025-03中稿 · WACV 2026被引 22

提出新评估框架,精准衡量3D场景生成是否符合文本描述

SceneEval: Evaluating Semantic Coherence in Text-Conditioned 3D Indoor Scene Synthesis

  • 设计细粒度指标,评估物体数量、属性与空间关系等显性要求
  • 引入支持度、碰撞率、可通行性等隐性期望指标,提升评估全面性
  • 构建500个带标注的文本-场景数据集,支持可复现对比

尽管文本条件下的3D室内场景生成取得进展,但现有评估方法仍存在不足。传统指标仅通过对比生成场景与真实场景来衡量逼真度,却忽视了场景对输入文本的语义一致性以及对合理性的隐含预期。本文提出SceneEval评估框架,引入细粒度指标以衡量显性需求——包括物体数量、属性及空间关系;同时补充支持度、碰撞率和可通行性等隐性期望指标,实现可解释且全面的场景质量评估。为支撑评估,我们构建了包含500条文本描述的SceneEval-500基准数据集,每条均带有详细场景属性标注。该数据集为不同生成方法提供统一参考,支持可复现的系统性比较。我们使用SceneEval评估六种近期生成方法,揭示其在多维度上的优劣表现,并指出当前方法在可控性和实用性方面仍存在显著差距,凸显进一步研究的必要性。

原文摘要 · Abstract (English)

Despite recent advances in text-conditioned 3D indoor scene generation, there remain gaps in the evaluation of these methods. Existing metrics often measure realism by comparing generated scenes to a set of ground-truth scenes, but they overlook how well scenes follow the input text and capture implicit expectations of plausibility. We present SceneEval, an evaluation framework designed to address these limitations. SceneEval introduces fine-grained metrics for explicit user requirements-including object counts, attributes, and spatial relationships-and complementary metrics for implicit expectations such as support, collisions, and navigability. Together, these provide interpretable and comprehensive assessments of scene quality. To ground evaluation, we curate SceneEval-500, a benchmark of 500 text descriptions with detailed annotations of expected scene properties. This dataset establishes a common reference for reproducible and systematic comparison across scene generation methods. We evaluate six recent scene generation approaches using SceneEval and demonstrate its ability to provide detailed assessments of the generated scenes, highlighting strengths and areas for improvement across multiple dimensions. Our results identify significant gaps in current methods, underscoring the need for further research toward practical and controllable scene synthesis.

3D生成文本到场景评估框架

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。