arXiv:2601.03357cs.CVcs.GR2026-01

无需复杂光照拍摄,一张图也能让3D头像自由换光。

RelightAnyone: A Generalized Relightable 3D Gaussian Head Model

  • 两阶段训练:先建模普通光照下的3D头像,再学习物理反射参数。
  • 仅需少量特殊光照数据训练,即可实现跨主体高质量重光照。
  • 支持单图适配,适合数字人、虚拟偶像等实时渲染场景。

3D高斯点云已成为重建和渲染逼真3D头像的标准方法。其主要挑战在于使头像能匹配任意场景光照。现有方法需在复杂时间复用光照(如逐灯拍摄)下采集数据。我们提出一种通用可重光照的3D高斯头像模型,可在仅单视角或多视角图像条件下实现重光照,无需为该主体采集逐灯数据。核心思路是学习从平光3DGS头像到对应可重光照高斯参数的映射。模型分两阶段:第一阶段在无逐灯光照的多视角数据集上训练,通过自监督光照对齐学习数据集特异性光照编码;第二阶段在少量逐灯光照数据上训练映射网络。该设计使模型具备跨主体泛化能力,可将任意第一阶段模型视为已采集逐灯数据。此外,仅需单张图像即可拟合新主体,适用于数字人新型视图合成与重光照应用。

原文摘要 · Abstract (English)

3D Gaussian Splatting (3DGS) has become a standard approach to reconstruct and render photorealistic 3D head avatars. A major challenge is to relight the avatars to match any scene illumination. For high quality relighting, existing methods require subjects to be captured under complex time-multiplexed illumination, such as one-light-at-a-time (OLAT). We propose a new generalized relightable 3D Gaussian head model that can relight any subject observed in a single- or multi-view images without requiring OLAT data for that subject. Our core idea is to learn a mapping from flat-lit 3DGS avatars to corresponding relightable Gaussian parameters for that avatar. Our model consists of two stages: a first stage that models flat-lit 3DGS avatars without OLAT lighting, and a second stage that learns the mapping to physically-based reflectance parameters for high-quality relighting. This two-stage design allows us to train the first stage across diverse existing multi-view datasets without OLAT lighting ensuring cross-subject generalization, where we learn a dataset-specific lighting code for self-supervised lighting alignment. Subsequently, the second stage can be trained on a significantly smaller dataset of subjects captured under OLAT illumination. Together, this allows our method to generalize well and relight any subject from the first stage as if we had captured them under OLAT lighting. Furthermore, we can fit our model to unseen subjects from as little as a single image, allowing several applications in novel view synthesis and relighting for digital avatars.

3D高斯重光照数字人单图建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。