用进化思想选关键点训练,提速近七成且不丢精度
EVOS: Efficient Implicit Neural Training via EVOlutionary Selector
- 只训练进化选出的最优样本点,减少冗余计算
- 训练时间减少48%-66%,收敛速度更快且无额外开销
- 适合追求高效训练的图像/3D建模研究者
我们提出EVOlutionary Selector(EVOS),一种用于加速隐式神经表示(INR)训练的高效范式。与传统方法在每轮迭代中处理所有样本不同,EVOS仅对经策略选择的关键点进行训练,通过消除冗余前向传播降低计算开销。具体地,将每个样本视为进化过程中的个体,仅让适应度高的样本存活并参与训练,其选择过程随神经网络动态自适应演化。尽管概念上类似进化算法,但目标为加速训练而非优化解,因此需重构进化机制:设计稀疏适应度评估、频域引导交叉和增强无偏变异,分别实现低开销采样选择、频域平衡性能提升及缓解放射偏差。大量实验表明,该方法在保证更优收敛性的同时,实现约48%–66%的训练时间缩减,在近期基于采样的加速策略中达到最先进水平。
原文摘要 · Abstract (English)
We propose EVOlutionary Selector (EVOS), an efficient training paradigm for accelerating Implicit Neural Representation (INR). Unlike conventional INR training that feeds all samples through the neural network in each iteration, our approach restricts training to strategically selected points, reducing computational overhead by eliminating redundant forward passes. Specifically, we treat each sample as an individual in an evolutionary process, where only those fittest ones survive and merit inclusion in training, adaptively evolving with the neural network dynamics. While this is conceptually similar to Evolutionary Algorithms, their distinct objectives (selection for acceleration vs. iterative solution optimization) require a fundamental redefinition of evolutionary mechanisms for our context. In response, we design sparse fitness evaluation, frequency-guided crossover, and augmented unbiased mutation to comprise EVOS. These components respectively guide sample selection with reduced computational cost, enhance performance through frequency-domain balance, and mitigate selection bias from cached evaluation. Extensive experiments demonstrate that our method achieves approximately 48%-66% reduction in training time while ensuring superior convergence without additional cost, establishing state-of-the-art acceleration among recent sampling-based strategies.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。