arXiv:2502.07007cs.CV2025-02IJCAI综述被引 24

让AI生成内容更符合物理规律,提升真实感。

Grounding Creativity in Physics: A Brief Survey of Physical Priors in AIGC

  • 从视觉、NeRF、高斯溅射三类方法切入,融合物理约束
  • 覆盖静态与动态3D生成,支持4D时序模拟与交互建模
  • 适合关注真实物理行为的生成模型研究者

近年来,AI生成内容在3D与4D生成方面显著提升了真实感。然而,多数现有方法侧重外观一致性,忽视底层物理原理,导致出现不合理的形变、动力学不稳定及物体交互异常等问题。将物理先验融入生成模型已成为提升结构完整性和运动真实性的关键方向。本文综述了面向生成模型的物理感知方法,系统分析物理约束如何被整合到3D与4D生成中。首先,探讨了静态与动态3D生成中引入物理先验的近期工作,按表示类型(视觉基础、NeRF、高斯溅射)进行分类。其次,研究了4D生成中的新兴技术,聚焦于通过物理模拟建模时间动态的方法。最后,对主要方法进行了对比分析,指出了其优势、局限性及在不同材料与运动动态下的适用性。本文旨在深化对物理驱动AIGC的理解,弥合生成模型与物理真实之间的差距,为未来物理一致的内容生成研究提供洞见。

原文摘要 · Abstract (English)

Recent advancements in AI-generated content have significantly improved the realism of 3D and 4D generation. However, most existing methods prioritize appearance consistency while neglecting underlying physical principles, leading to artifacts such as unrealistic deformations, unstable dynamics, and implausible objects interactions. Incorporating physics priors into generative models has become a crucial research direction to enhance structural integrity and motion realism. This survey provides a review of physics-aware generative methods, systematically analyzing how physical constraints are integrated into 3D and 4D generation. First, we examine recent works in incorporating physical priors into static and dynamic 3D generation, categorizing methods based on representation types, including vision-based, NeRF-based, and Gaussian Splatting-based approaches. Second, we explore emerging techniques in 4D generation, focusing on methods that model temporal dynamics with physical simulations. Finally, we conduct a comparative analysis of major methods, highlighting their strengths, limitations, and suitability for different materials and motion dynamics. By presenting an in-depth analysis of physics-grounded AIGC, this survey aims to bridge the gap between generative models and physical realism, providing insights that inspire future research in physically consistent content generation.

物理先验3D生成4D生成AIGC

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。