用高斯点云实现实时4D天气模拟与场景重建。
Weather-Magician: Reconstruction and Rendering Framework for 4D Weather Synthesis In Real Time
- 基于高斯点云重建真实场景并动态渲染天气效果。
- 支持连续天气变化，控制细节且实现实时渲染。
- 适合游戏、虚拟现实及数字孪生场景应用。
在城市数字孪生、虚拟现实/增强现实、游戏场景设计或合成影视制作中，传统方法依赖手工建模和渲染引擎，成本高且难以还原复杂真实场景。更高效的方法是利用真实场景数据，通过重建与渲染算法快速复现。然而现有算法难以有效处理真实天气效果的重建与渲染。为此，我们提出基于高斯点云的框架，可重建真实场景并实时渲染合成的4D天气效果。该方法通过高斯建模与渲染技术模拟多种常见天气现象，支持连续动态天气变化，可灵活调控效果细节。系统硬件需求低，具备实时渲染能力。演示视频可访问项目主页：weathermagician.github.io。
原文摘要 · Abstract (English)
For tasks such as urban digital twins, VR/AR/game scene design, or creating synthetic films, the traditional industrial approach often involves manually modeling scenes and using various rendering engines to complete the rendering process. This approach typically requires high labor costs and hardware demands, and can result in poor quality when replicating complex real-world scenes. A more efficient approach is to use data from captured real-world scenes, then apply reconstruction and rendering algorithms to quickly recreate the authentic scene. However, current algorithms are unable to effectively reconstruct and render real-world weather effects. To address this, we propose a framework based on gaussian splatting, that can reconstruct real scenes and render them under synthesized 4D weather effects. Our work can simulate various common weather effects by applying Gaussians modeling and rendering techniques. It supports continuous dynamic weather changes and can easily control the details of the effects. Additionally, our work has low hardware requirements and achieves real-time rendering performance. The result demos can be accessed on our project homepage: weathermagician.github.io
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。