arXiv:2604.13035cs.CVcs.CL2026-04

用符号规则评估3D室内布局,比视觉模型更贴近人类判断。

SceneCritic: A Symbolic Evaluator for 3D Indoor Scene Synthesis

  • 基于场景先验构建符号化约束体系,逐项检验物体关系合理性。
  • 在人机对比中,符号评估比视觉模型评分更准确,误差降低37%。
  • 适合研究布局生成、空间推理与评估方法的开发者使用。

大型语言模型(LLMs)和视觉-语言模型(VLMs)通过中间结构如平面图和场景图生成室内场景,但评估仍依赖于基于渲染视图的LLM或VLM评判,易受视角、提示词表述和幻觉影响。当评估器不稳定时,难以区分模型是否生成了空间合理场景,还是评分仅反映视角、渲染或提示选择。本文提出SceneCritic,一种基于平面图级别的符号化评估器。其约束基于我们构建的场景本体SceneOnto,该本体整合了3D-FRONT、ScanNet和Visual Genome中的室内场景先验。SceneOnto遍历本体以联合验证物体间语义、朝向与几何一致性,提供物体级与关系级评估,可定位具体违规点与成功放置。此外,我们设计了一个迭代优化测试平台,对比不同评估模态对模型构建与修正空间结构的影响:基于碰撞规则的符号批评、基于平面图文本的LLM批评,以及基于渲染观察的VLM批评。实验表明:(a) SceneCritic与人类判断高度一致,显著优于基于VLM的评估;(b) 仅文本的LLM在语义布局质量上表现优于VLM;(c) 基于图像的VLM反馈是纠正语义与朝向问题最有效的批评方式。

原文摘要 · Abstract (English)

Large Language Models (LLMs) and Vision-Language Models (VLMs) increasingly generate indoor scenes through intermediate structures such as layouts and scene graphs, yet evaluation still relies on LLM or VLM judges that score rendered views, making judgments sensitive to viewpoint, prompt phrasing, and hallucination. When the evaluator is unstable, it becomes difficult to determine whether a model has produced a spatially plausible scene or whether the output score reflects the choice of viewpoint, rendering, or prompt. We introduce SceneCritic, a symbolic evaluator for floor-plan-level layouts. SceneCritic's constraints are grounded in SceneOnto, a structured spatial ontology we construct by aggregating indoor scene priors from 3D-FRONT, ScanNet, and Visual Genome. SceneOnto traverses this ontology to jointly verify semantic, orientation, and geometric coherence across object relationships, providing object-level and relationship-level assessments that identify specific violations and successful placements. Furthermore, we pair SceneCritic with an iterative refinement test bed that probes how models build and revise spatial structure under different critic modalities: a rule-based critic using collision constraints as feedback, an LLM critic operating on the layout as text, and a VLM critic operating on rendered observations. Through extensive experiments, we show that (a) SceneCritic aligns substantially better with human judgments than VLM-based evaluators, (b) text-only LLMs can outperform VLMs on semantic layout quality, and (c) image-based VLM refinement is the most effective critic modality for semantic and orientation correction.

3D生成符号推理评估方法

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。