arXiv:2605.18451cs.CVcs.GR2026-05被引 4

用代码生成3D房间,从俯视图出发,更精准稳定。

Code-as-Room: Generating 3D Rooms from Top-Down View Images via Agentic Code Synthesis

论文配图:Code-as-Room: Generating 3D Rooms from Top-Down View Images via Agentic Code Synthesis
图 1 · 摘自论文原文
  • 通过解析俯视图提取元素与空间关系,生成可执行的Blender代码
  • 引入跨阶段记忆模块,避免传统智能体框架的上下文遗忘问题
  • 构建专用评测基准,验证生成效果优于现有方法

设计真实且功能完整的3D室内场景对室内设计、虚拟现实、游戏及具身AI等应用至关重要。尽管基于多模态大模型(MLLM)的方法在从文本或参考图像生成3D房间方面展现出潜力,但文本驱动方法难以捕捉精确的空间信息,而现有图像条件智能体在处理从俯视图生成完整房间时存在不稳定性与无限循环问题。为此,我们提出Code-as-Room,一种基于MLLM的智能体框架,采用结构化执行机制,以Blender代码表示3D房间。给定俯视图,框架解析参考图像,提取场景元素及其空间关系,并在分阶段的流程中合成几何、材质和光照的可执行Blender代码。通过维持跨阶段记忆模块,缓解现有智能体框架固有的上下文遗忘问题。我们进一步构建了专门针对代码化3D房间生成的基准测试,涵盖多种评估协议。基于该基准,对现有智能体方法进行了全面对比,验证了所提执行机制的有效性。

原文摘要 · Abstract (English)

Designing realistic and functional 3D indoor rooms is essential for a wide range of applications, including interior design, virtual reality, gaming, and embodied AI. While recent MLLM-based approaches have shown great potential for 3D room synthesis from textual descriptions or reference images, text-based methods struggle to capture precise spatial information, and existing image-conditioned agents suffer from instability and infinite looping when tasked with holistic room generation from top-down views. To address these limitations, we propose Code-as-Room, an MLLM-based agentic framework equipped with a structured execution harness, which represents 3D rooms with Blender codes. Given a top-down room image, the framework parses the reference image to extract scene elements and their spatial relationships, and synthesizes executable Blender code for geometry, materials, and lighting in a principled, multi-stage pipeline. A cross-stage memory module is maintained throughout to mitigate context forgetting inherent to existing agent-based frameworks. We further introduce a dedicated benchmark for code-based 3D room synthesis, encompassing various evaluation protocols. Based on our benchmark, comprehensive comparisons against existing agent-based methods are conducted to validate the effectiveness of our proposed execution harness.

3D生成智能体代码生成室内设计

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。