用敏感度引导的对抗扰动保护NeRF的知识产权
AegisRF: Adversarial Perturbations Guided with Sensitivity for Protecting Intellectual Property of Neural Radiance Fields
- 通过可学习敏感度场控制几何扰动,保持渲染质量
- 在多视角分类和3D定位任务中有效干扰未经授权使用
- 适合需保护3D内容版权的研究者与开发者
随着神经辐射场(NeRF)成为3D场景建模与新视角合成的强大工具,其知识产权(IP)保护日益重要。本文提出AegisRF框架,通过注入对抗性扰动来阻止未经授权的应用。传统方法因破坏3D几何结构导致渲染质量显著下降,故多回避几何扰动或仅限于显式网格空间。为此,我们引入可学习的敏感度场,量化几何扰动对渲染质量的空间变化影响。AegisRF包含扰动场(在预渲染输出的颜色与体密度上注入扰动以欺骗下游目标模型)和敏感度场(自适应约束几何扰动,保障视觉保真度)。实验表明,该方法在多视角图像分类与基于体素的3D定位等多样化任务中均具泛化能力,同时保持高视觉质量。代码已开源。
原文摘要 · Abstract (English)
As Neural Radiance Fields (NeRFs) have emerged as a powerful tool for 3D scene representation and novel view synthesis, protecting their intellectual property (IP) from unauthorized use is becoming increasingly crucial. In this work, we aim to protect the IP of NeRFs by injecting adversarial perturbations that disrupt their unauthorized applications. However, perturbing the 3D geometry of NeRFs can easily deform the underlying scene structure and thus substantially degrade the rendering quality, which has led existing attempts to avoid geometric perturbations or restrict them to explicit spaces like meshes. To overcome this limitation, we introduce a learnable sensitivity to quantify the spatially varying impact of geometric perturbations on rendering quality. Building upon this, we propose AegisRF, a novel framework that consists of a Perturbation Field, which injects adversarial perturbations into the pre-rendering outputs (color and volume density) of NeRF models to fool an unauthorized downstream target model, and a Sensitivity Field, which learns the sensitivity to adaptively constrain geometric perturbations, preserving rendering quality while disrupting unauthorized use. Our experimental evaluations demonstrate the generalized applicability of AegisRF across diverse downstream tasks and modalities, including multi-view image classification and voxel-based 3D localization, while maintaining high visual fidelity. Codes are available at https://github.com/wkim97/AegisRF.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。