arXiv:2502.02372cs.CVcs.AI2025-02AAAI被引 1

用持续学习让数字人像实时更新,不丢失旧形象。

MaintaAvatar: A Maintainable Avatar Based on Neural Radiance Fields by Continual Learning

  • 结合全局-局部存储与姿态蒸馏,避免遗忘旧外观。
  • 仅需少量新数据即可快速更新,无显著退化。
  • 适合长期维护的虚拟人像系统开发者。

虚拟数字人像生成是计算机视觉的重要研究方向。现有基于神经辐射场(NeRF)的方法虽效果出色,但通常假设训练图像固定不变,难以应对真实场景中人物外观与姿态持续变化的问题。如何在更新人像的同时保持对旧外观的渲染能力,成为实际挑战。简单地将NeRF模型与持续学习结合,会导致模型遗忘过往信息,引发颜色溢出及姿态错误等问题。本文提出基于持续学习的可维护数字人像(MaintaAvatar),通过全局-局部联合存储模块与姿态蒸馏模块,有效缓解灾难性遗忘。实验表明,该方法仅需有限数据即可快速微调,同时保持历史外观的高质量重建,实现真正可持续维护的虚拟人像系统。

原文摘要 · Abstract (English)

The generation of a virtual digital avatar is a crucial research topic in the field of computer vision. Many existing works utilize Neural Radiance Fields (NeRF) to address this issue and have achieved impressive results. However, previous works assume the images of the training person are available and fixed while the appearances and poses of a subject could constantly change and increase in real-world scenarios. How to update the human avatar but also maintain the ability to render the old appearance of the person is a practical challenge. One trivial solution is to combine the existing virtual avatar models based on NeRF with continual learning methods. However, there are some critical issues in this approach: learning new appearances and poses can cause the model to forget past information, which in turn leads to a degradation in the rendering quality of past appearances, especially color bleeding issues, and incorrect human body poses. In this work, we propose a maintainable avatar (MaintaAvatar) based on neural radiance fields by continual learning, which resolves the issues by utilizing a Global-Local Joint Storage Module and a Pose Distillation Module. Overall, our model requires only limited data collection to quickly fine-tune the model while avoiding catastrophic forgetting, thus achieving a maintainable virtual avatar. The experimental results validate the effectiveness of our MaintaAvatar model.

数字人像持续学习NeRF虚拟化身

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。