arXiv:2606.29329cs.CV2026-06被引 1

实现3D高斯_avatar实时真实阴影,无需网格重建

RAGA: Real Time Ray Traced Gaussian Shadow Casting for 3DGS Avatar-Scene Interaction

论文配图:RAGA: Real Time Ray Traced Gaussian Shadow Casting for 3DGS Avatar-Scene Interaction
图 1 · 摘自论文原文
  • 在高斯空间直接计算阴影,用积分替代碰撞检测
  • 支持单/多人物及交互场景,达50帧/秒实时性能
  • 适合虚拟人、数字孪生等需真实光影的交互应用

本文研究在现有3D高斯溅射(3DGS)场景中动画3DGS-avatar时的物理逼真阴影生成问题,涵盖单个、多人及物体交互场景。与依赖二值交点检测和网格阴影体的已有方法不同,本方法完全在高斯空间内进行阴影计算,无需任何网格重建。提出RAGA:基于精确射线-高斯线积分的实时射线追踪阴影算法。对每个遮挡高斯,沿阴影射线积分其不透明度分布,并归一化至理论最大积分,得到反映射线穿越遮挡物程度的权重,而非仅判断是否相交。为降低动画中衣物形变带来的时序噪声,进一步引入人物代理表示,在保持视觉保真度的同时稳定阴影生成。RAGA通过自定义CUDA内核集成NVIDIA OptiX框架实现,可达到约50 FPS的运行速度。在多个数据集的单人、多人及人物-物体交互场景中评估,显著提升阴影真实感、时序稳定性与场景一致性。

原文摘要 · Abstract (English)

We study the problem of physically plausible shadow casting when animating 3D Gaussian Splatting (3DGS) avatars, either individually or in multi-avatar and object-interaction scenarios, within existing 3DGS scenes. In contrast to prior methods that rely on binary hit tests and mesh-based shadow casters, our method performs shadow computation entirely in Gaussian space, without requiring any mesh reconstruction. We introduce RAGA, a Ray-Traced Gaussian Shadow Casting formulation based on exact ray-Gaussian line integrals. For each occluding Gaussian, we integrate the opacity profile along the shadow ray and normalize by the theoretical maximum integral, producing a weight that captures how the ray traverses the occluder rather than merely whether an intersection occurred. To reduce temporal variance from clothing deformations in animated avatars, we further introduce an avatar proxy representation that stabilizes shadow casting while preserving visual fidelity. We implement RAGA using custom CUDA kernels integrated with the NVIDIA OptiX framework; as such, our shadow tracer runs at rates of about 50 FPS. We evaluate on single-avatar, multi-avatar, and avatar-object interaction scenarios across multiple datasets, demonstrating substantially improved shadow realism, temporal stability, and scene coherence. Our project page is available at https://miraymen.github.io/raga/.

3D高斯实时渲染阴影生成虚拟人

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。