用文字图像视频生成可探索的3D世界，支持地图级空间定位。
ABot-3DWorld 0: A Universal World Model to Explore Any 3D Space
- 统一空间生成基元（SGP）融合全景图与点云，高效描述3D空间。
- 多模态输入可转为高保真3D场景，单图或文本也能创造性生成。
- 支持地图原生探索，适合内容创作者与地理应用开发者。
我们提出ABot-3DWorld 0，一个通用多模态3D世界模型，可将文本、图像和视频输入转化为高保真、可交互的3D世界。其核心是统一的空间生成基元（SGP），由高质量全景图与空间点云构成，能高效表征任意3D空间。多模态输入首先被映射至SGP；随后3D一致的全景视频生成器沿规划轨迹探索该基元；最后，全景视频重建引擎将其转为清晰、逼真的3D高斯溅射（3DGS）世界。该流程涵盖两种模式：丰富输入（多视角图像集、随意视频）通过几何严谨恢复生成真实场景；单一图像或句子则通过生成式补全构建创意世界。结果是一个低门槛的通用3D内容创作引擎，并将生成世界锚定于地理兴趣点，实现消费者级别的地图原生空间探索。实验表明，该模型在开源方法中达到最新水平，且在多模态输入下场景保真度优于Marble。
原文摘要 · Abstract (English)
We present ABot-3DWorld 0, a universal multimodal 3D world model that turns text, image, and video inputs into high-fidelity, explorable 3D worlds. At the heart of our framework is a unified Spatial Generative Primitive (SGP), a compact tuple of a high-quality panorama and a spatial point cloud that delivers an efficient description of any 3D space. Multimodal inputs are first lifted into this primitive; a 3D-consistent panoramic video generator then explores the primitive along a planned trajectory; finally, our panoramic video reconstruction engine converts the generated video into a clean, photorealistic 3D Gaussian Splatting (3DGS) world. This pipeline covers two regimes: rich inputs (multi-view sets, casual video) are lifted into the SGP through a geometry-rigorous recovery that mirrors the observed scene, while a single image or sentence is completed generatively into a creative world. The result is one low-barrier engine for general 3D content creation that further anchors generated worlds to geographic points of interest, enabling map-native spatial exploration at consumer scale. Experiments show that ABot-3DWorld 0 sets the state of the art among open-source methods and demonstrates stronger scene fidelity than Marble under rich multimodal inputs.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。