arXiv:2607.13539cs.CVcs.GR2026-07

用分步推理生成更合理可编辑的3D室内场景

ThinkBLOX: 3D Indoor Scene Generation with Progressive Reasoning

论文配图:ThinkBLOX: 3D Indoor Scene Generation with Progressive Reasoning
图 1 · 摘自论文原文
  • 通过逐步推理和迭代优化设计3D布局,避免一次性生成的缺陷
  • 在20万组数据上训练,显著提升物理合理性与语义一致性
  • 适合需要灵活修改场景的交互式应用,如家居设计

传统图形方法多采用自回归或层次化生成3D室内场景,而近期基于视觉语言模型(VLM)的生成器主要采用一次完成的范式,导致交互编辑时需全局重优化或完全重建,常出现物理或语义不合理的问题。为此,我们提出ThinkBLOX,一种基于VLM的渐进式推理框架,将布局生成视为状态条件下的逐步推理与动作过程。我们构建了包含224,757对程序化布局的ThinkBLOX-Data-200K数据集,标注有多视角场景上下文、显式的思维链(CoT)推理过程及结构化JSON布局。通过在此数据集上的监督微调(SFT),VLM学会在增量更新下弥合推理与动作之间的差距。此外,考虑到场景合成本质上是多解任务,SFT存在奖励冲突问题,我们引入分层解耦的广义去偏强化学习(Tier-Decoupled GDPO),将异构奖励分为不同层级,稳定策略优化在物理合理性、语义合理性与推理-动作一致性上的表现。大量实验表明,ThinkBLOX在物理合理性、语义对齐和交互编辑性方面显著优于近期的一次性与迭代基线。同时,其支持包括全局与局部生成、场景重排在内的多样化应用。

原文摘要 · Abstract (English)

While traditional graphics methods often synthesize 3D indoor scenes autoregressively or hierarchically, recent vision-language model (VLM)-based generators predominantly adopt a one-shot paradigm where the full layout is planned at once. This one-shot approach often requires global re-optimization or complete reconstruction during interactive editing (e.g., inserting or moving objects) and can lead to physically or semantically poorly organized arrangements. To address these challenges, we propose ThinkBLOX, a VLM-based progressive reasoning framework that iteratively designs and refines 3D scenes. ThinkBLOX treats layout generation as a state-conditioned, step-by-step reasoningand-action process. To power this, we construct the ThinkBLOX-Data-200K dataset, containing 224,757 procedural placement pairs annotated with multi-view scene context, explicit Chain-of-Thought (CoT) rationales, and structured JSON layouts. Through supervised fine-tuning (SFT) on this dataset, the VLM learns to bridge the reasoning-action gap under incremental updates. Furthermore, recognizing that scene synthesis is inherently a multisolution task where SFT suffers from reward conflict, we introduce Tier-Decoupled GDPO. This reinforcement learning scheme organizes heterogeneous rewards into distinct tiers, stabilizing policy optimization across physical validity, semantic plausibility, and reasoning-action consistency. Extensive experiments show that ThinkBLOX significantly outperforms recent one-shot and iterative baselines in physical plausibility, semantic alignment, and interactive editability. Additionally, we show that it supports diverse applications, including both global and local generation and rearrangement of 3D scenes.

3D生成视觉语言模型交互式编辑推理链

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。