用短描述生成更合理的3D室内场景,提升布局真实感。
SDesc3D: Towards Layout-Aware 3D Indoor Scene Generation from Short Descriptions
- 引入多视角结构先验增强文本信息,弥补描述不足
- 通过功能感知布局锚定,实现层级化场景组织
- 自修正迭代优化,显著提升生成场景的合理性
基于简短文本描述的3D室内场景生成为无需繁琐布局设计的交互式3D环境构建提供了新路径。尽管近期取得进展,现有方法在语义压缩场景下仍存在物理合理性差、细节贫乏的问题,主要源于对显式对象及其空间关系语义线索的依赖。为此,我们提出SDesc3D,一种短文本条件下的3D室内场景生成框架,通过融合多视角结构先验和区域功能隐含信息,实现稀疏文本引导下的3D布局推理。具体地,我们设计了多视角场景先验增强模块,将聚合的多视角结构知识注入未充分描述的输入,由不可见的关系线索转向多视角关系先验聚合;在此基础上,提出功能感知布局定位机制,利用区域功能进行隐式空间锚定,并实施层级化布局推理以增强场景组织与语义合理性;此外,采用迭代反思-修正机制,通过自我修正实现结构合理性的逐步优化。大量实验表明,该方法在短文本条件3D室内场景生成任务上优于现有方法。代码将公开。
原文摘要 · Abstract (English)
3D indoor scene generation conditioned on short textual descriptions provides a promising avenue for interactive 3D environment construction without the need for labor-intensive layout specification. Despite recent progress in text-conditioned 3D scene generation, existing works suffer from poor physical plausibility and insufficient detail richness in such semantic condensation cases, largely due to their reliance on explicit semantic cues about compositional objects and their spatial relationships. This limitation highlights the need for enhanced 3D reasoning capabilities, particularly in terms of prior integration and spatial anchoring. Motivated by this, we propose SDesc3D, a short-text conditioned 3D indoor scene generation framework, that leverages multi-view structural priors and regional functionality implications to enable 3D layout reasoning under sparse textual guidance. Specifically, we introduce a Multi-view scene prior augmentation that enriches underspecified textual inputs with aggregated multi-view structural knowledge, shifting from inaccessible semantic relation cues to multi-view relational prior aggregation. Building on this, we design a Functionality-aware layout grounding, employing regional functionality grounding for implicit spatial anchors and conducting hierarchical layout reasoning to enhance scene organization and semantic plausibility. Furthermore, an Iterative reflection-rectification scheme is employed for progressive structural plausibility refinement via self-rectification. Extensive experiments show that our method outperforms existing approaches on short-text conditioned 3D indoor scene generation. Code will be publicly available.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。