arXiv:2409.08907cs.AIcs.CL2024-09被引 11

基础模型正重塑情感计算,推动多模态数据生成与分析。

Affective Computing Has Changed: The Foundation Model Disruption

  • 用基础模型合成视觉、语言、语音三模态情感数据
  • 揭示基础模型在情感计算中的新兴能力与潜力
  • 探讨其伦理与监管挑战,适合关注AI应用的学者

基础模型的出现一方面彻底革新了众多研究问题,另一方面也使公众能够更广泛地访问和使用基于AI的工具。我们甚至观察到这些模型已渗透至与人类心理学相关的领域,如情感计算,暗示其具备情感相关的新兴能力。本文旨在通过合成生成并分析多模态情感数据(聚焦视觉、语言和语音/声学),提升对基础模型在情感计算中潜力的认识。同时,我们也讨论了该领域应用基础模型所涉及的一些根本性问题,如伦理和监管方面的问题。

原文摘要 · Abstract (English)

The dawn of Foundation Models has on the one hand revolutionised a wide range of research problems, and, on the other hand, democratised the access and use of AI-based tools by the general public. We even observe an incursion of these models into disciplines related to human psychology, such as the Affective Computing domain, suggesting their affective, emerging capabilities. In this work, we aim to raise awareness of the power of Foundation Models in the field of Affective Computing by synthetically generating and analysing multimodal affective data, focusing on vision, linguistics, and speech (acoustics). We also discuss some fundamental problems, such as ethical issues and regulatory aspects, related to the use of Foundation Models in this research area.

情感计算基础模型多模态生成模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。