让机器人模仿人脸表情不再受脸型影响,更自然真实。
Morphology-Independent Facial Expression Imitation for Human-Face Robots
- 通过自监督分离表情与脸型特征,实现解耦表达
- 基于表情误差感知的迁移模块,精准生成驱动指令
- 专为表情模拟设计的机器人平台,支持真实验证
在人形机器人中实现精准的面部表情模仿对提升人机交互自然性至关重要。现有方法多通过2D面部关键点映射到机器人执行器命令来实现逼真的表情再现,但其关键点轨迹易受面部形态差异干扰,导致性能下降。本文提出一种与脸型无关的表情模仿方法,将表情从面部形态中解耦,消除形态影响,从而生成更真实的表情。具体而言,构建表达解耦模块,通过自监督学习分离表达与形态表征;设计表达迁移模块,基于表情误差感知目标将表达表征转化为机器人执行器命令,实现基于学习表达语义的精准表情生成。为支持实验验证,我们开发了一款定制化、高度表情丰富的仿真人形机器人Pengrui作为实验平台。大量实验证明,该方法能有效使机器人重现多样化的类人表情。所有代码与机器人实现细节将公开发布。
原文摘要 · Abstract (English)
Accurate facial expression imitation on human-face robots is crucial for achieving natural human-robot interaction. Most existing methods have achieved photorealistic expression imitation through mapping 2D facial landmarks to a robot's actuator commands. Their imitation of landmark trajectories is susceptible to interference from facial morphology, which would lead to a performance drop. In this paper, we propose a morphology-independent expression imitation method that decouples expressions from facial morphology to eliminate morphological influence and produce more realistic expressions for human-face robots. Specifically, we construct an expression decoupling module to learn expression semantics by disentangling the expression representation from the morphology representation in a self-supervised manner. We devise an expression transfer module to map the representations to the robot's actuator commands through a learning objective of perceiving expression errors, producing accurate facial expressions based on the learned expression semantics. To support experimental validation, a custom-designed and highly expressive human-face robot, namely Pengrui, is developed to serve as an experimental platform for realistic expression imitation. Extensive experiments demonstrate that our method enables the human-face robot to reproduce a wide range of human-like expressions effectively. All code and implementation details of the robot will be released.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。