首个统一生成城市内外场景的框架,让室内外布局自动对齐。
To See a World in a Living Context: Unified Indoor-Outdoor Urban World Generation

- 基于动态更新的跨尺度世界上下文,逐步构建城市与建筑信息
- 外景生成平均AQS提升7.68%,保持块间连续性与建筑一致性
- 适合城市规划、游戏开发等需要真实3D环境的场景
文本驱动的3D生成在大规模户外环境和细节化室内场景方面发展迅速,但这些领域通常独立生成,缺乏构成连贯城市世界的对应关系。我们提出HoloWorld,一个基于持续更新的跨尺度世界上下文的统一室内外城市世界生成框架。从用户描述出发,HoloWorld逐步表示并更新从城市级规划到单体建筑的多样化世界信息,使生成的室内与对应的外部建筑保持明确对应。在不断演化的上下文和先前生成邻近区块的条件下,HoloWorld自回归生成具有一致空间组织与视觉标识的都市外景。生成的外部表征进一步锚定于3D建筑实例与轮廓,支持基于几何约束布局和继承外观特征的建筑级室内生成。据我们所知,HoloWorld是首个在连贯3D城市世界中统一室内外生成的框架。大量实验表明,其外景生成性能优于当前最优(SOTA),平均AQS得分提升7.68%,获得最高平均RDR得分,同时保持强建筑级室内外对应关系及统一3D城市世界中的块间连续性。
原文摘要 · Abstract (English)
Text-driven 3D generation has advanced rapidly in creating large-scale outdoor environments and detailed indoor scenes, but these domains are usually synthesized independently, lacking the correspondence required for a coherent urban world. We present HoloWorld, a unified indoor-outdoor urban world generation framework built on a continuously updated cross-scale world context. Initializing from a user description, HoloWorld progressively represents and updates the diverse world information, from city-scale planning to individual buildings, allowing generated interiors to maintain explicit correspondence with their associated exterior buildings. Conditioned on the evolving context and previously generated neighboring blocks, HoloWorld autoregressively generates urban exteriors with consistent spatial organization and visual identity across blocks. The generated exterior representations are further grounded in 3D building instances and footprints, enabling building-specific indoor generation with geometry-constrained layouts and inherited appearance characteristics. To our knowledge, HoloWorld is the first framework to unify indoor and outdoor generation within a coherent 3D urban world. Extensive experiments demonstrate that HoloWorld achieves superior urban exterior generation performance, improving the average AQS score over the SOTA by 7.68\% and obtaining the highest average RDR score, while maintaining strong building-level indoor-outdoor correspondence and cross-block continuity within a unified 3D urban world. Our project page: https://huangxb326.github.io/HoloWorld/.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。