arXiv:2506.16262cs.CV2025-06综述被引 5

让3D渲染在模糊、低清等坏条件下仍能保持高保真

R3eVision: A Survey on Robust Rendering, Restoration, and Enhancement for 3D Low-Level Vision

  • 将2D图像修复思路拓展到3D空间,实现鲁棒3D重建
  • 解决真实场景中多视角一致性与优化不稳定的难题
  • 适合自动驾驶、AR/VR等对3D感知可靠性要求高的场景

神经渲染方法如神经辐射场(NeRF)和3D高斯泼溅(3DGS)在逼真3D场景重建与新视角合成方面取得显著进展。然而,现有模型大多假设输入为干净且高分辨率(HR)的多视图数据,难以应对真实世界中的噪声、模糊、低分辨率(LR)及天气引起的伪影。为此,新兴的3D低级视觉(3D LLV)将传统2D低级视觉任务(如超分辨率(SR)、去模糊、天气退化去除、恢复与增强)拓展至3D空间。本综述R³eVision系统梳理了3D LLV中鲁棒渲染、修复与增强的关键技术,形式化退化感知渲染问题,识别出时空一致性与病态优化等核心挑战。通过分类近期融合低级视觉的神经渲染方法,揭示其在恶劣条件下的高保真3D重建能力。还讨论了自动驾驶、AR/VR、机器人等应用场景中可靠3D感知的重要性。通过回顾代表性方法、数据集与评估协议,本文强调3D LLV是实现真实环境中鲁棒3D内容生成与场景级重建的根本方向。

原文摘要 · Abstract (English)

Neural rendering methods such as Neural Radiance Fields (NeRF) and 3D Gaussian Splatting (3DGS) have achieved significant progress in photorealistic 3D scene reconstruction and novel view synthesis. However, most existing models assume clean and high-resolution (HR) multi-view inputs, which limits their robustness under real-world degradations such as noise, blur, low-resolution (LR), and weather-induced artifacts. To address these limitations, the emerging field of 3D Low-Level Vision (3D LLV) extends classical 2D Low-Level Vision tasks including super-resolution (SR), deblurring, weather degradation removal, restoration, and enhancement into the 3D spatial domain. This survey, referred to as R\textsuperscript{3}eVision, provides a comprehensive overview of robust rendering, restoration, and enhancement for 3D LLV by formalizing the degradation-aware rendering problem and identifying key challenges related to spatio-temporal consistency and ill-posed optimization. Recent methods that integrate LLV into neural rendering frameworks are categorized to illustrate how they enable high-fidelity 3D reconstruction under adverse conditions. Application domains such as autonomous driving, AR/VR, and robotics are also discussed, where reliable 3D perception from degraded inputs is critical. By reviewing representative methods, datasets, and evaluation protocols, this work positions 3D LLV as a fundamental direction for robust 3D content generation and scene-level reconstruction in real-world environments.

3D视觉图像修复神经渲染鲁棒重建

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。