用快速注册方法生成非人类头像的可动画表情形态集
RegHead: Non-Humanoid Head Blendshapes via Feed-Forward Registration

- 通过图像编辑扩展小规模表情库,构建大规模非人类头像数据集
- 提出基于锚点的局部形变表示,实现高保真表情网格重建
- 支持实时从真人面部追踪信号驱动非人类角色表情
我们提出RegHead框架,用于构建可动画非人类头像的语义混合形状集。固定的表情词汇表使混合形状具备低维且可解释的动画接口,并支持跨身份重定向。构建此类混合形状集成本高昂,原因在于:(i) 表情一致性监督稀缺;(ii) 生成的4D资产通常缺乏对应关系;(iii) 面部运动高度局部化。为此,我们提出:(1) 通过微调图像编辑扩展小规模艺术家绑定库,获得大规模非人类身份与共享表情词汇配对的数据集;(2) 设计针对局部面部形变的密集随机锚点运动表示;(3) 提出快速前馈注册模型,通过从中性形状预测锚点形变,将未对齐的表情网格转换为对应混合形状基。实验表明,该方法在表达保真度上优于基线,且运行速度比优化方法快多个数量级。我们进一步展示了从真人面部追踪信号实时重定向至非人类角色的能力,能同时捕捉头部姿态与局部面部动作。项目主页见https://snap-research.github.io/RegHead/
原文摘要 · Abstract (English)
We present RegHead, a framework for constructing semantic blendshape sets for animatable non-humanoid head avatars. With a fixed expression vocabulary, semantic blendshapes provide a low-dimensional and interpretable animation interface and support cross-identity retargeting. Building such blendshape sets remains expensive because (i) expression-consistent supervision is scarce, (ii) generated 4D assets typically lack correspondence, and (iii) facial motion is highly localized. We propose (1) a large-scale dataset of non-humanoid identities paired with a shared expression vocabulary, obtained by expanding a small artist-rigged library via fine-tuned image editing; (2) a dense stochastic anchor motion representation tailored to localized facial deformations; and (3) a fast feed-forward registration model that converts unregistered expression meshes into a corresponded blendshape basis by predicting anchor-based deformations from the neutral shape. Experiments show that our approach produces higher-fidelity expression meshes than baselines, while running orders of magnitude faster than optimization. We further demonstrate real-time retargeting from human face tracking signals to non-humanoid characters, capturing both head pose and localized facial motions. Our project page is available at https://snap-research.github.io/RegHead/.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。