arXiv:2507.23033cs.CVcs.NE2025-07被引 1

自适应调整脉冲神经网络推理时长,大幅降低能耗。

Adaptive Time-step Training for Enhancing Spike-Based Neural Radiance Fields

  • 根据场景特性动态优化脉冲神经网络的推理时长。
  • 在保持画质的前提下,能耗最高降低68.90%。
  • 适合追求能效比的神经渲染应用开发。

脉冲神经网络(SNN)为神经渲染提供了节能计算范式,但现有基于脉冲的神经辐射场(NeRF)模型通常对所有场景采用固定的推理时长,效率低下。由于NeRF具有场景特异性训练特点,不同场景对时长需求各异。本文提出预训练引导的自适应时长调整(PATA)框架,将目标推理时长设为可学习变量,并通过两阶段训练优化。混合输入模式增强早期输出,全步软监督、平滑渲染损失与时长预算损失协同保障画质并减少计算量。学习到的时长参数在单个场景内共享,保持了NeRF的并行渲染结构。在INGP-NeRF和TensoRF主干上,针对Synthetic-NeRF、Mip-NeRF 360和LLFF数据集的实验表明,PATA持续降低推理开销,同时保持良好画质。在INGP-NeRF上最多节省57.57%估算能耗,在TensoRF上达68.90%,验证了其在多种神经渲染表示中的有效性。

原文摘要 · Abstract (English)

Spiking Neural Networks (SNNs) provide an energy-efficient computing paradigm for neural rendering, but existing spike-based Neural Radiance Field (NeRF) models usually use a fixed inference time step for all scenes. This fixed temporal budget is inefficient because NeRF follows a scene-specific training paradigm, and different scenes require different temporal capacities to preserve rendering quality. This paper proposes Pretraining-based Adaptive Time-step Adjustment (PATA), a scene-wise adaptive time-step training framework for spike-based NeRF. PATA parameterizes the target inference time step as a trainable variable and optimizes it through a two-stage training process. A hybrid input mode strengthens early time-step outputs, while full-step soft supervision, smoothed rendering loss, and temporal-budget loss jointly maintain rendering fidelity and reduce temporal computation. The learned target time step is shared by all ray samples within a scene, preserving the parallel rendering structure of NeRF. Experiments on INGP-NeRF and TensoRF backbones across Synthetic-NeRF, Mip-NeRF 360, and LLFF show that PATA consistently reduces inference cost while maintaining competitive rendering quality. PATA reduces the estimated inference energy by up to 57.57\% on INGP-NeRF and 68.90\% on TensoRF, demonstrating its effectiveness across different neural rendering representations.

脉冲神经网络神经渲染能效优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。