提出新数据集与方法,提升雨天3D场景重建质量
Rethinking Rainy 3D Scene Reconstruction via Perspective Transforming and Brightness Tuning
- 构建含视角差异和亮度动态的OmniRain3D数据集
- 端到端框架实现雨痕消除与3D场景恢复,重建精度显著提升
- 适合关注多视角去雨与3D重建的研究者
雨滴会降低多视角图像的视觉质量,影响3D场景重建的准确性与完整性。现有数据集常忽略真实雨天3D场景的两个关键特性:雨丝在不同视角下因投影产生的外观变化,以及降雨时云层遮蔽导致的环境亮度下降。为此,我们构建了新数据集OmniRain3D,引入视角异质性与亮度动态性,更真实地模拟雨天对3D场景的退化。基于该数据集,提出端到端重建框架REVR-GSNet(Rain Elimination and Visibility Recovery for 3D Gaussian Splatting)。该方法通过联合交替优化,集成递归亮度增强、高斯原语优化与基于GS的雨痕消除,在雨损输入下实现高保真清洁3D场景重建。大量实验验证了数据集与方法的有效性。本工作为多视角去雨与雨天3D场景重建提供了基础支持。
原文摘要 · Abstract (English)
Rain degrades the visual quality of multi-view images, which are essential for 3D scene reconstruction, resulting in inaccurate and incomplete reconstruction results. Existing datasets often overlook two critical characteristics of real rainy 3D scenes: the viewpoint-dependent variation in the appearance of rain streaks caused by their projection onto 2D images, and the reduction in ambient brightness resulting from cloud coverage during rainfall. To improve data realism, we construct a new dataset named OmniRain3D that incorporates perspective heterogeneity and brightness dynamicity, enabling more faithful simulation of rain degradation in 3D scenes. Based on this dataset, we propose an end-to-end reconstruction framework named REVR-GSNet (Rain Elimination and Visibility Recovery for 3D Gaussian Splatting). Specifically, REVR-GSNet integrates recursive brightness enhancement, Gaussian primitive optimization, and GS-guided rain elimination into a unified architecture through joint alternating optimization, achieving high-fidelity reconstruction of clean 3D scenes from rain-degraded inputs. Extensive experiments show the effectiveness of our dataset and method. Our dataset and method provide a foundation for future research on multi-view image deraining and rainy 3D scene reconstruction.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。