只需一段文字,自动生成合理布局的3D房间场景。
RoomPlanner: Explicit Layout Planner for Easier LLM-Driven 3D Room Generation
- 用分层语言代理解析文本,生成带空间与语义属性的点云
- 通过双约束迭代优化,实现无碰撞且可通行的布局
- 新采样策略使生成时间低于30分钟,适合快速原型设计
本文提出RoomPlanner,首个完全自动化的3D房间生成框架,仅需简短文本即可生成逼真的室内场景。无需手动布局或全景图引导,该框架能自动生成合理的空间布置准则。首先引入基于语言驱动的分层代理规划器,将模糊的短文本转化为详细的场景描述,包含每类物体及背景的原始空间与语义属性,并据此初始化3D点云。为在限定空间内摆放物体,我们设计了两种排列约束,通过迭代优化确保布局无碰撞且可达。最终渲染阶段,提出AnyReach采样策略用于相机轨迹生成,结合区间时间步流采样(ITFS),高效优化粗粒度3D高斯场景表示。实验表明,该方法能在30分钟内完成生成,几何合理性优于现有方法,在渲染速度与视觉质量上表现更优,同时保持可编辑性。
原文摘要 · Abstract (English)
In this paper, we propose RoomPlanner, the first fully automatic 3D room generation framework for painlessly creating realistic indoor scenes with only short text as input. Without any manual layout design or panoramic image guidance, our framework can generate explicit layout criteria for rational spatial placement. We begin by introducing a hierarchical structure of language-driven agent planners that can automatically parse short and ambiguous prompts into detailed scene descriptions. These descriptions include raw spatial and semantic attributes for each object and the background, which are then used to initialize 3D point clouds. To position objects within bounded environments, we implement two arrangement constraints that iteratively optimize spatial arrangements, ensuring a collision-free and accessible layout solution. In the final rendering stage, we propose a novel AnyReach Sampling strategy for camera trajectory, along with the Interval Timestep Flow Sampling (ITFS) strategy, to efficiently optimize the coarse 3D Gaussian scene representation. These approaches help reduce the total generation time to under 30 minutes. Extensive experiments demonstrate that our method can produce geometrically rational 3D indoor scenes, surpassing prior approaches in both rendering speed and visual quality while preserving editability. The code will be available soon.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。