arXiv:2503.14845cs.GRcs.CV2025-03被引 2

用3D高斯实现实时气候模拟,速度更快、效果更真。

ClimateGS: Real-Time Climate Simulation with 3D Gaussian Style Transfer

  • 用线性变换直接调整球谐函数,快速实现风格迁移。
  • 联合监督与自监督训练,加速收敛且保留场景细节。
  • 支持实时渲染,适合交互式自动驾驶测试应用。

恶劣气候对自动驾驶系统感知与决策构成挑战,需在多样环境中有可靠表现。现有基于物理的NeRF渲染方法虽能生成逼真场景,但渲染慢、预处理时间长,难以满足实时测试与交互需求。本文提出ClimateGS,将3D高斯表示与物理模拟结合,实现实时气候效果渲染。创新点包括:1)设计线性变换实现3D高斯的摄影风格迁移,可直接修改球谐函数各频段,高效一致地适应不同天气风格;2)采用监督与自监督联合训练策略,加快收敛并保持原始场景细节;3)开发融合物理效应的实时渲染方法,实现高效且逼真的气候模拟。在MipNeRF360和Tanks and Temples数据集上评估显示,该方法达到或超过当前2D/3D最优方法的视觉质量,同时支持实时渲染,适用于交互式应用场景。

原文摘要 · Abstract (English)

Adverse climate conditions pose significant challenges for autonomous systems, demanding reliable perception and decision-making across diverse environments. To better simulate these conditions, physically-based NeRF rendering methods have been explored for their ability to generate realistic scene representations. However, these methods suffer from slow rendering speeds and long preprocessing times, making them impractical for real-time testing and user interaction. This paper presents ClimateGS, a novel framework integrating 3D Gaussian representations with physical simulation to enable real-time climate effects rendering. The novelty of this work is threefold: 1) developing a linear transformation for 3D Gaussian photorealistic style transfer, enabling direct modification of spherical harmonics across bands for efficient and consistent style adaptation; 2) developing a joint training strategy for 3D style transfer, combining supervised and self-supervised learning to accelerate convergence while preserving original scene details; 3) developing a real-time rendering method for climate simulation, integrating physics-based effects with 3D Gaussian to achieve efficient and realistic rendering. We evaluate ClimateGS on MipNeRF360 and Tanks and Temples, demonstrating real-time rendering with comparable or superior visual quality to SOTA 2D/3D methods, making it suitable for interactive applications.

气候模拟3D高斯实时渲染自动驾驶

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。