arXiv:2606.29379cs.CVcs.AI2026-06

让2D高斯点云能变形、可重光照,真实还原材质反射。

DR-GS: Physically-Based Deformable and Relightable 2D Gaussians

论文配图:DR-GS: Physically-Based Deformable and Relightable 2D Gaussians
图 1 · 摘自论文原文
  • 分离几何、光照、材质三要素,实现物理一致的渲染
  • 动态变形与重光照下仍保持镜面高光和反射真实
  • 适合需要后期编辑材质的3D内容创作者

高斯点阵(GS)因其显式参数化和高效渲染,在虚拟现实、增强现实及数字内容创作中备受关注。然而,现有基于GS的可变形物体方法存在两大局限:(i) 光照被错误地烘焙到纹理中,导致动态形变或光照变化时出现物理不一致;(ii) 基于快照的重建方式限制了重建后的材质编辑。为此,我们提出可变形且可重光照的高斯点阵(DR-GS),一个统一的高斯框架,集成物理基础逆渲染、重光照与形变感知操作。通过显式解耦几何、光照与材质表示,DR-GS克服静态快照的限制,在不同条件下的外观表现更真实,并支持重建后参数编辑。大量实验表明,DR-GS在静态重建、动态形变与重光照任务中均达到领先视觉质量,可靠保留光泽表面的反射与高光效果。该方法建立完全解耦的几何-光照-材质流程,支持高质量3D资产生成与全面后期编辑。

原文摘要 · Abstract (English)

Gaussian splatting (GS) has garnered significant attention in VR/AR and digital content creation due to its explicit parameterization and efficient rendering capabilities. However, existing GS-based methods for deformable objects face two key limitations: (i) illumination is erroneously baked into textures, causing physically inconsistent responses under dynamic deformations and lighting changes; (ii) snapshot-based reconstruction restricts post-reconstruction material editing. To address these challenges, we propose Deformable and Relightable GS (DR-GS), a unified Gaussian framework that integrates physically-based inverse rendering, relighting, and deformation-aware manipulation. Through explicitly disentangling geometry, illumination, and material representations, DR-GS overcomes the limitations of static snapshots, resolving unrealistic appearance under varying conditions while enabling post-reconstruction parameter editing. Extensive experiments show that DR-GS achieves leading visual quality across static reconstruction, dynamic deformation, and relighting, reliably preserving reflections and specular highlights on glossy surfaces. It further establishes a fully decoupled geometry-illumination-material pipeline, enabling high-quality 3D asset creation and comprehensive post-editing.

高斯点阵可变形重光照3D重建

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。