arXiv:2506.05449cs.GRcs.CV2025-06综述被引 3

系统梳理生成式AI在3D场景构建中的应用与挑战

AI-powered Contextual 3D Environment Generation: A Systematic Review

  • 归纳主流生成架构与多模态融合技术
  • 指出训练数据质量决定输出效果,计算成本高
  • 适合关注AI生成3D内容的开发者与研究者

高质量3D环境生成对游戏、虚拟现实和电影产业至关重要,但依赖人工流程导致资源消耗大。本文系统回顾现有生成式AI在3D场景生成中的技术,分析其特性、优缺点及改进潜力。通过评估前沿方法,揭示场景真实感不足、文本输入影响大等关键挑战。重点关注AI融合不同艺术风格的能力、训练数据对输出质量的影响,以及当前模型的局限性。同时梳理现有评估指标,探讨行业如何将AI融入工作流。研究表明,先进生成架构虽能实现高质量3D内容生成,但计算开销大;跨注意力与潜在空间对齐等多模态整合技术有效支持文生3D任务;训练数据的质量与多样性,结合全面评估指标,是实现可扩展、鲁棒3D场景生成的关键。

原文摘要 · Abstract (English)

The generation of high-quality 3D environments is crucial for industries such as gaming, virtual reality, and cinema, yet remains resource-intensive due to the reliance on manual processes. This study performs a systematic review of existing generative AI techniques for 3D scene generation, analyzing their characteristics, strengths, limitations, and potential for improvement. By examining state-of-the-art approaches, it presents key challenges such as scene authenticity and the influence of textual inputs. Special attention is given to how AI can blend different stylistic domains while maintaining coherence, the impact of training data on output quality, and the limitations of current models. In addition, this review surveys existing evaluation metrics for assessing realism and explores how industry professionals incorporate AI into their workflows. The findings of this study aim to provide a comprehensive understanding of the current landscape and serve as a foundation for future research on AI-driven 3D content generation. Key findings include that advanced generative architectures enable high-quality 3D content creation at a high computational cost, effective multi-modal integration techniques like cross-attention and latent space alignment facilitate text-to-3D tasks, and the quality and diversity of training data combined with comprehensive evaluation metrics are critical to achieving scalable, robust 3D scene generation.

3D生成生成式AI多模态系统综述

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。