arXiv:2503.14513cs.CVcs.AI2025-03被引 2

用神经气体网络生成更真实、更快的情绪化身体动作数据。

Synthetic Data Generation of Body Motion Data by Neural Gas Network for Emotion Recognition

  • 用神经气体网络学习骨骼拓扑,生成新姿态
  • 合成速度更快,情绪区分度更高
  • 适合缺乏多样动作数据的智能情感识别研究

在基于身体动作的情感识别领域,主要挑战是缺乏多样且通用的数据集。自动情感识别利用机器学习与人工智能技术,从文本、图像、声音和身体动作等多模态数据中识别人的情绪状态。身体动作因年龄、性别、种族、性格及疾病等因素影响,呈现多样性,导致专门用于情感识别的高质量数据稀缺。为此,采用合成数据生成(SDG)方法如生成对抗网络(GANs)和变分自编码器(VAEs)具有潜力,但通常复杂度高。本研究首次将神经气体网络(NGN)应用于身体动作数据合成,优化多样性与生成速度。通过学习骨骼结构拓扑,将神经元或气体粒子定位在关节处,生成的粒子构成后续骨骼结构,再通过帧间连接形成新的身体姿态,最终生成合成动作序列。我们使用弗雷切特初始距离(FID)、多样性等基准指标,对比了由GANs、VAEs及其他基准算法生成的数据。同时采用分类准确率、精确率、召回率等指标评估模型性能。提取关节相关特征与运动学参数,在未见数据上进行测试。结果表明,NGN生成的动作数据更具真实感,情绪区分更明显,且生成速度优于现有方法。

原文摘要 · Abstract (English)

In the domain of emotion recognition using body motion, the primary challenge lies in the scarcity of diverse and generalizable datasets. Automatic emotion recognition uses machine learning and artificial intelligence techniques to recognize a person's emotional state from various data types, such as text, images, sound, and body motion. Body motion poses unique challenges as many factors, such as age, gender, ethnicity, personality, and illness, affect its appearance, leading to a lack of diverse and robust datasets specifically for emotion recognition. To address this, employing Synthetic Data Generation (SDG) methods, such as Generative Adversarial Networks (GANs) and Variational Auto Encoders (VAEs), offers potential solutions, though these methods are often complex. This research introduces a novel application of the Neural Gas Network (NGN) algorithm for synthesizing body motion data and optimizing diversity and generation speed. By learning skeletal structure topology, the NGN fits the neurons or gas particles on body joints. Generated gas particles, which form the skeletal structure later on, will be used to synthesize the new body posture. By attaching body postures over frames, the final synthetic body motion appears. We compared our generated dataset against others generated by GANs, VAEs, and another benchmark algorithm, using benchmark metrics such as Fréchet Inception Distance (FID), Diversity, and a few more. Furthermore, we continued evaluation using classification metrics such as accuracy, precision, recall, and a few others. Joint-related features or kinematic parameters were extracted, and the system assessed model performance against unseen data. Our findings demonstrate that the NGN algorithm produces more realistic and emotionally distinct body motion data and does so with more synthesizing speed than existing methods.

动作生成情感识别合成数据神经气体

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。