增量更新3D神经辐射场,无需旧数据也能避免遗忘。
$Δ$-NeRF: Incremental Refinement of Neural Radiance Fields through Residual Control and Knowledge Transfer
- 用残差控制器在冻结模型上逐层修正,实现无历史数据的增量优化。
- 不确定性门控机制防止过度修正,保持预测稳定,提升精度43.5%。
- 适合卫星遥感等持续采集数据的场景,训练效率提升30%-42%。
神经辐射场(NeRF)在3D重建和新视角合成方面表现卓越,但现有方法在新增视图时需重新训练,难以适应数据连续输入的场景,尤其在卫星地形分析中问题突出。本文提出Δ-NeRF,一种模块化残差框架,实现无需历史数据的增量优化:(1) 残差控制器向冻结基模型注入逐层修正;(2) 不确定性感知门控机制自适应融合基模型与修正结果,防止过拟合;(3) 视图选择策略减少47%训练数据量。通过知识蒸馏,将增强模型压缩至原大小的20%。在卫星图像上的实验表明,Δ-NeRF性能接近联合训练,训练时间减少30%-42%,在PSNR上比直接微调提升43.5%,部分指标超越联合训练。
原文摘要 · Abstract (English)
Neural Radiance Fields (NeRFs) have demonstrated remarkable capabilities in 3D reconstruction and novel view synthesis. However, most existing NeRF frameworks require complete retraining when new views are introduced incrementally, limiting their applicability in domains where data arrives sequentially. This limitation is particularly problematic in satellite-based terrain analysis, where regions are repeatedly observed over time. Incremental refinement of NeRFs remains underexplored, and naive approaches suffer from catastrophic forgetting when past data is unavailable. We propose $Δ$-NeRF, a unique modular residual framework for incremental NeRF refinement. $Δ$-NeRF introduces several novel techniques including: (1) a residual controller that injects per-layer corrections into a frozen base NeRF, enabling refinement without access to past data; (2) an uncertainty-aware gating mechanism that prevents overcorrection by adaptively combining base and refined predictions; and (3) a view selection strategy that reduces training data by up to 47\% while maintaining performance. Additionally, we employ knowledge distillation to compress the enhanced model into a compact student network (20\% of original size). Experiments on satellite imagery demonstrate that $Δ$-NeRF achieves performance comparable to joint training while reducing training time by 30-42\%. $Δ$-NeRF consistently outperforms existing baselines, achieving an improvement of up to 43.5\% in PSNR over naive fine-tuning and surpassing joint training on some metrics.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。