为3D高斯点云设计高效安全的水印方案,兼顾隐蔽性与抗破坏能力。
GuardSplat: Efficient and Robust Watermarking for 3D Gaussian Splatting
- 用CLIP引导优化解码器,低成本实现高精度信息提取
- 将水印嵌入球谐特征,保持3D结构且几乎不降低画质
- 新增抗畸变提取模块,有效防御各类恶意篡改
3D高斯点云(3DGS)近年来在多种应用中生成了令人惊叹的3D资产。然而,现有水印方法无法适配其渲染流程,在版权保护方面存在安全、容量、隐蔽性和训练效率不足的问题。本文提出GuardSplat,一种创新且高效的3DGS资产水印框架:1)设计基于CLIP引导的优化管道,通过利用CLIP的对齐能力与丰富表征,以极低开销实现高精度信息提取,展现卓越的容量与效率;2)提出球谐感知(SH-aware)消息嵌入模块,将信息无缝嵌入每个3D高斯的球谐特征中,同时保持原始3D结构,实现近乎无损的水印嵌入,防止攻击者从模型文件中移除水印,满足隐蔽性与安全性需求;3)引入抗畸变消息提取模块,显著提升对各类畸变的鲁棒性。实验表明,GuardSplat优于现有最优方法,且优化速度迅速。项目主页:https://narcissusex.github.io/GuardSplat,代码地址:https://github.com/NarcissusEx/GuardSplat。
原文摘要 · Abstract (English)
3D Gaussian Splatting (3DGS) has recently created impressive 3D assets for various applications. However, considering security, capacity, invisibility, and training efficiency, the copyright of 3DGS assets is not well protected as existing watermarking methods are unsuited for its rendering pipeline. In this paper, we propose GuardSplat, an innovative and efficient framework for watermarking 3DGS assets. Specifically, 1) We propose a CLIP-guided pipeline for optimizing the message decoder with minimal costs. The key objective is to achieve high-accuracy extraction by leveraging CLIP's aligning capability and rich representations, demonstrating exceptional capacity and efficiency. 2) We tailor a Spherical-Harmonic-aware (SH-aware) Message Embedding module for 3DGS, seamlessly embedding messages into the SH features of each 3D Gaussian while preserving the original 3D structure. This enables watermarking 3DGS assets with minimal fidelity trade-offs and prevents malicious users from removing the watermarks from the model files, meeting the demands for invisibility and security. 3) We present an Anti-distortion Message Extraction module to improve robustness against various distortions. Experiments demonstrate that GuardSplat outperforms state-of-the-art and achieves fast optimization speed. Project page is at https://narcissusex.github.io/GuardSplat, and Code is at https://github.com/NarcissusEx/GuardSplat.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。