用光线追踪提升动态反光场景的重建精度与真实感。
TraceFlow: Dynamic 3D Reconstruction of Specular Scenes Driven by Ray Tracing
- 基于残差材质增强的2D高斯泼溅，动态建模几何与材质。
- 混合渲染管线分离漫反射与镜面反射，提升真实感。
- 粗到精训练策略稳定优化，适合复杂动态反光场景应用。
我们提出TraceFlow，一种高保真动态反光场景渲染新框架，解决两个核心挑战：精确反射方向估计和物理准确的反射建模。为此，我们设计了残差材质增强的2D高斯泼溅表示，用于建模动态几何与材质属性，实现精准反射光线计算。同时引入动态环境高斯和混合渲染管线，将渲染分解为漫反射与镜面反射成分，通过光栅化与光线追踪结合实现物理驱动的镜面合成。最后，采用粗到精训练策略提升优化稳定性，促进物理合理的分解。在多个动态场景基准测试中，TraceFlow在定量与定性指标上均优于现有方法，生成更清晰、更真实的复杂动态环境中的镜面反射。
原文摘要 · Abstract (English)
We present TraceFlow, a novel framework for high-fidelity rendering of dynamic specular scenes by addressing two key challenges: precise reflection direction estimation and physically accurate reflection modeling. To achieve this, we propose a Residual Material-Augmented 2D Gaussian Splatting representation that models dynamic geometry and material properties, allowing accurate reflection ray computation. Furthermore, we introduce a Dynamic Environment Gaussian and a hybrid rendering pipeline that decomposes rendering into diffuse and specular components, enabling physically grounded specular synthesis via rasterization and ray tracing. Finally, we devise a coarse-to-fine training strategy to improve optimization stability and promote physically meaningful decomposition. Extensive experiments on dynamic scene benchmarks demonstrate that TraceFlow outperforms prior methods both quantitatively and qualitatively, producing sharper and more realistic specular reflections in complex dynamic environments.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。