让神经场突破线性限制,实现少样本高效重建。
Kernel Reboot: Breaking the Boundaries of Neural Tangent Kernels for Neural Fields

- 用可学习的坐标支持集替代传统核方法,实现非线性重构
- 通过元学习共享初始化,仅需微调少量参数即可适应新场景
- 结合两者优势,在极稀疏数据下仍能生成高保真结果,适合快速部署
神经场将连续坐标映射为颜色或密度等信号,但如何从稀疏观测中快速高质量重建仍具挑战。经典神经正切核(NTK)回归虽有闭式解,却本质为线性,无法积累可复用的任务先验。本文提出三种算法:NTK-KIP 学习一个精简的坐标支持集(含可选标签),使有限的NTK能从少量观测中修复大范围缺失区域,获得紧凑的非线性表示;MetaQuill 元学习一个INR的共享初始化,使新场景仅需更新少量任务特异权重偏移,实现真正特征学习与可复用先验;MetaQuill-KIP 融合二者:以KIP风格的非线性预热启动任务,再仅微调该小偏移量。该方法在极稀疏观测下达成高PSNR重建和语义合理补全,而仅需轻量级实例适配,远优于依赖大型预训练生成模型和昂贵图像级调优的扩散基线。结果表明,基于NTK的神经场可同时具备非线性和元学习能力,显著缩小解析核与实际少样本重建之间的差距。
原文摘要 · Abstract (English)
Neural fields (NFs) map continuous coordinates to signals such as color or density, but fast high-quality reconstruction from sparse observations remains difficult. Classical Neural Tangent Kernel (NTK) regression gives closed-form fits, yet it is fundamentally linear and cannot accumulate reusable task priors. We develop three algorithms that address these gaps. NTK-KIP learns a distilled support set of coordinates (and optional labels) so that a finite NTK can inpaint large missing regions from little observed data, yielding a compact non-linear representation instead of a raw kernel solve. MetaQuill meta-learns a shared initialization for an INR so that new scenes can be adapted by updating only a small task-specific weight offset, which provides true feature learning and a reusable prior. Finally, MetaQuill-KIP fuses both ideas: it seeds the task with a KIP-style non-linear warm start, then refines only that small offset around the meta-learned initialization. MetaQuill-KIP achieves high-PSNR reconstructions and semantically plausible inpainting under very sparse observations, while requiring only lightweight per-instance adaptation, whereas diffusion-style baselines typically depend on large pretrained generative priors and costly per-image tuning. This shows that NTK-driven neural fields can be made both non-linear and meta-learnable, narrowing the gap between analytic kernels and practical few-shot reconstruction.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。