arXiv:2603.15811cs.CV2026-03被引 1

0.5秒生成高精度头像,无需追踪与优化。

Feed-forward Gaussian Registration for Head Avatar Creation and Editing

  • 用Transformer直接预测多视角对应高斯点纹理。
  • 生成头像仅需0.5秒/帧,比基线快10倍。
  • 支持表情迁移、身份插值等编辑应用。

我们提出MATCH(基于拓扑对应头像的多视角高斯注册方法),一种用于高质量头像创建与编辑的多视角高斯注册技术。现有先进方法需耗时头部追踪并进行昂贵的头像优化,总创建时间常超过一天。相比之下,MATCH仅需0.5秒/帧即可从校准的多视角图像中直接预测对应关系下的高斯点纹理,无需数据预处理。通过学习帧内个体间对应关系,实现个性化头像快速生成;跨个体对应关系支持表情迁移、无优化追踪、语义编辑及身份插值等应用。我们采用基于Transformer的端到端模型,在模板网格固定UV布局下预测高斯点纹理。为此,提出新型注册引导注意力模块,每个UV图标记仅关注对应网格区域的图像标记,相比密集跨视角注意力更高效且性能更优。MATCH在新视角合成、几何配准和头像生成方面优于现有方法,头像创建速度比最接近的基线快10倍。代码与模型权重已在项目网站公开。

原文摘要 · Abstract (English)

We present MATCH (Multi-view Avatars from Topologically Corresponding Heads), a multi-view Gaussian registration method for high-quality head avatar creation and editing. State-of-the-art multi-view head avatar methods require time-consuming head tracking followed by expensive avatar optimization, often resulting in a total creation time of more than one day. MATCH, in contrast, directly predicts Gaussian splat textures in correspondence from calibrated multi-view images in just 0.5 seconds per frame, without requiring data preprocessing. The learned intra-subject correspondence across frames enables fast creation of personalized head avatars, while correspondence across subjects supports applications such as expression transfer, optimization-free tracking, semantic editing, and identity interpolation. We establish these correspondences end-to-end using a transformer-based model that predicts Gaussian splat textures in the fixed UV layout of a template mesh. To achieve this, we introduce a novel registration-guided attention block, where each UV-map token attends exclusively to image tokens depicting its corresponding mesh region. This design improves efficiency and performance compared to dense cross-view attention. MATCH outperforms existing methods in novel-view synthesis, geometry registration, and head avatar generation, while making avatar creation 10 times faster than the closest competing baseline. The code and model weights are available on the project website.

头像生成高斯渲染快速建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。