用3D高斯模拟多材料物理交互，解决渲染失真问题
PIG: Physically-based Multi-Material Interaction with 3D Gaussians
- 通过2D到3D高斯的精准映射实现物体级分割
- 为不同材料赋予物理属性，支持多材质耦合交互
- 约束高斯缩放旋转，消除几何失真，提升视觉一致性
3D高斯点阵在重建静态与动态3D场景方面取得了显著进展。然而，在由3D高斯原语表示的场景中，物体间的交互存在3D分割不准确、不同材料间形变不精确及严重渲染伪影等问题。为此，我们提出PIG：基于物理的3D高斯多材料交互方法，将3D物体分割与高精度物体交互模拟相结合。首先，本方法实现了从2D像素到3D高斯的快速精准映射，支持精确的3D物体级分割。其次，对场景中对应分割出的物体分配独立物理属性，实现多材料耦合交互。最后，通过将约束尺度嵌入形变梯度，具体限制高斯原语的缩放与旋转，消除伪影，实现几何保真与视觉一致性。实验表明，该方法在视觉质量上超越当前最优（SOTA）水平，并为物理真实场景生成开辟了新方向与技术路径。
原文摘要 · Abstract (English)
3D Gaussian Splatting has achieved remarkable success in reconstructing both static and dynamic 3D scenes. However, in a scene represented by 3D Gaussian primitives, interactions between objects suffer from inaccurate 3D segmentation, imprecise deformation among different materials, and severe rendering artifacts. To address these challenges, we introduce PIG: Physically-Based Multi-Material Interaction with 3D Gaussians, a novel approach that combines 3D object segmentation with the simulation of interacting objects in high precision. Firstly, our method facilitates fast and accurate mapping from 2D pixels to 3D Gaussians, enabling precise 3D object-level segmentation. Secondly, we assign unique physical properties to correspondingly segmented objects within the scene for multi-material coupled interactions. Finally, we have successfully embedded constraint scales into deformation gradients, specifically clamping the scaling and rotation properties of the Gaussian primitives to eliminate artifacts and achieve geometric fidelity and visual consistency. Experimental results demonstrate that our method not only outperforms the state-of-the-art (SOTA) in terms of visual quality, but also opens up new directions and pipelines for the field of physically realistic scene generation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。