arXiv:2511.18601cs.CV2025-11NeurIPS被引 1

用无标注数据训练神经网络,自动为复杂人脸网格生成可动骨架

RigAnyFace: Scaling Neural Facial Mesh Auto-Rigging with Unlabeled Data

  • 设计无需三角剖分的表面学习网络,支持多分离组件输入
  • 在专业艺术家标注的有限数据上训练,结合2D监督扩展数据量
  • 支持眼球等独立部件,适合影视动画中高精度表情驱动

本文提出RigAnyFace(RAF),一个可扩展的神经自动绑定框架,用于处理不同拓扑结构的人脸网格,包括多个分离组件。RAF将静态中性人脸网格变形为行业标准的FACS动作,构建表达性强的混合形状绑定。通过引入专有架构设计的三角剖分无关表面学习网络,模型能根据FACS参数条件化变形,并高效处理分离组件。训练时,我们构建了包含人脸网格的数据集,其中一部分由专业艺术家精细绑定,作为精确3D变形监督的真值。由于人工绑定成本高,该子集规模有限,制约模型泛化能力。为此,我们设计了一种针对无标注中性网格的2D监督策略,提升数据多样性并实现规模化训练,从而增强模型泛化性能。大量实验表明,RAF不仅能在我们艺术家制作的资产上成功绑定,还能处理野外采集样本,在准确性和泛化性上优于现有方法。此外,本方法首次支持如眼球等多个分离组件,实现更精细的表情动画。

原文摘要 · Abstract (English)

In this paper, we present RigAnyFace (RAF), a scalable neural auto-rigging framework for facial meshes of diverse topologies, including those with multiple disconnected components. RAF deforms a static neutral facial mesh into industry-standard FACS poses to form an expressive blendshape rig. Deformations are predicted by a triangulation-agnostic surface learning network augmented with our tailored architecture design to condition on FACS parameters and efficiently process disconnected components. For training, we curated a dataset of facial meshes, with a subset meticulously rigged by professional artists to serve as accurate 3D ground truth for deformation supervision. Due to the high cost of manual rigging, this subset is limited in size, constraining the generalization ability of models trained exclusively on it. To address this, we design a 2D supervision strategy for unlabeled neutral meshes without rigs. This strategy increases data diversity and allows for scaled training, thereby enhancing the generalization ability of models trained on this augmented data. Extensive experiments demonstrate that RAF is able to rig meshes of diverse topologies on not only our artist-crafted assets but also in-the-wild samples, outperforming previous works in accuracy and generalizability. Moreover, our method advances beyond prior work by supporting multiple disconnected components, such as eyeballs, for more detailed expression animation. Project page: https://wenchao-m.github.io/RigAnyFace.github.io

神经绑定人脸动画无监督学习混合形状

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。