arXiv:2511.16711cs.CVeess.IV2025-11

用动作迁移增强的StyleGAN2生成多样猴脸表情,解决数据少难题。

Motion Transfer-Enhanced StyleGAN for Generating Diverse Macaque Facial Expressions

  • 通过动作迁移将静态图像动画化,扩充面部表情数据。
  • 生成多只猴子的多样化表情,优于仅用原始图像训练的模型。
  • 可分离运动为风格参数,适合神经科学与进化研究使用。

利用生成式AI生成动物面部表情具有挑战性,因可用训练图像数量有限且表情变化不足,尤其在不同个体间。本研究聚焦广泛用于系统神经科学与进化研究的猕猴,提出基于风格的生成图像模型(即StyleGAN2)生成其面部表情的方法。为应对数据限制,我们实施:1)通过动作迁移将静态图像动画化以合成新表情图像;2)基于初始训练的StyleGAN2模型中猕猴面部的潜在表示进行样本选择,确保训练数据的多样性与均匀采样;3)优化损失函数以准确再现细微动作,如眼球运动。结果表明,所提方法能生成多个猕猴个体的多样化面部表情,优于仅使用原始静态图像训练的模型。此外,该模型在基于风格的图像编辑中表现良好,特定风格参数对应特定面部动作。这些发现凸显模型解耦运动成分作为风格参数的潜力,为猕猴面部表情研究提供有力工具。

原文摘要 · Abstract (English)

Generating animal faces using generative AI techniques is challenging because the available training images are limited both in quantity and variation, particularly for facial expressions across individuals. In this study, we focus on macaque monkeys, widely studied in systems neuroscience and evolutionary research, and propose a method to generate their facial expressions using a style-based generative image model (i.e., StyleGAN2). To address data limitations, we implemented: 1) data augmentation by synthesizing new facial expression images using a motion transfer to animate still images with computer graphics, 2) sample selection based on the latent representation of macaque faces from an initially trained StyleGAN2 model to ensure the variation and uniform sampling in training dataset, and 3) loss function refinement to ensure the accurate reproduction of subtle movements, such as eye movements. Our results demonstrate that the proposed method enables the generation of diverse facial expressions for multiple macaque individuals, outperforming models trained solely on original still images. Additionally, we show that our model is effective for style-based image editing, where specific style parameters correspond to distinct facial movements. These findings underscore the model's potential for disentangling motion components as style parameters, providing a valuable tool for research on macaque facial expressions.

生成模型动物表情StyleGAN动作迁移

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。