提出新型神经场景编码方法,实现无需重训练的精准局部编辑。
Affine-Equivariant Kernel Space Encoding for NeRF Editing
- 用各向异性高斯核构建局部影响区域,实现变形感知特征表示
- 在多种空间变换下保持特征连续性,重建质量接近原始模型
- 支持直接通过核函数进行编辑,适合需要精细调整的3D场景应用
神经场景表示通过将3D场景编码为连续函数实现高保真渲染,但其潜在空间通常隐式且全局纠缠,难以实现局部编辑与物理合理操作。尽管已有工作引入显式控制结构或基于点的潜在表示以提升可编辑性,但常受限于局部性不足、对形变敏感或产生视觉伪影。本文提出仿射等变核空间编码(EKS),一种用于神经辐射场的空间编码方法,提供局部化且形变感知的特征表示。不同于在离散点或网格顶点直接查询潜在特征,我们的编码通过一组各向异性高斯核的场进行特征聚合,每个核定义一个局部影响区域。该核基公式在空间变换下实现稳定特征插值,同时保持连续性和高质量重建。为进一步保留细节而不牺牲可编辑性,我们提出一种训练时特征蒸馏机制,将多分辨率哈希网格编码的信息迁移至核场,从而在推理时获得紧凑且完全无网格的表示。这使得可通过高斯核直接进行直观的局部场景编辑,而无需重新训练,同时保持高质量渲染。代码见:https://github.com/MikolajZielinski/eks
原文摘要 · Abstract (English)
Neural scene representations achieve high-fidelity rendering by encoding 3D scenes as continuous functions, but their latent spaces are typically implicit and globally entangled, making localized editing and physically grounded manipulation difficult. While several works introduce explicit control structures or point-based latent representations to improve editability, these approaches often suffer from limited locality, sensitivity to deformations, or visual artifacts. In this paper, we introduce Affine-Equivariant Kernel Space Encoding (EKS), a spatial encoding for neural radiance fields that provides localized, deformation-aware feature representations. Instead of querying latent features directly at discrete points or grid vertices, our encoding aggregates features through a field of anisotropic Gaussian kernels, each defining a localized region of influence. This kernel-based formulation enables stable feature interpolation under spatial transformations while preserving continuity and high reconstruction quality. To preserve detail without sacrificing editability, we further propose a training-time feature distillation mechanism that transfers information from multi-resolution hash grid encodings into the kernel field, yielding a compact and fully grid-free representation at inference. This enables intuitive, localized scene editing directly via Gaussian kernels without retraining, while maintaining high-quality rendering. The code can be found under (https://github.com/MikolajZielinski/eks)
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。