构建可自适应交互的社交智能体平台，支持多模态实时响应
GRETA: Modular Platform to Create Adaptive Socially Interactive Agents
- 基于外部特征动态调整交互策略，融合语音、眼神、手势等多模态输入
- 实现对话增量处理，支持与人类或虚拟角色的连续自然互动
- 适用于人机协作、虚拟助手等需要情感敏感性的场景
人类互动极为复杂，涉及语音、视线、手势等多种模态，且受社会态度和情绪影响。交互状态还受对话伙伴状态的影响。现有社交互动智能体（SIAs）致力于根据交互对象状态进行自我调节。本文介绍GRETA平台的架构，该平台在与人类或其他实体交互时考虑外部特征，并实现对话的增量式处理。文中展示了GRETA的新架构，涵盖外部特征处理、自适应机制及对话的增量式处理方法。
原文摘要 · Abstract (English)
The interaction between humans is very complex to describe since it is composed of different elements from different modalities such as speech, gaze, and gestures influenced by social attitudes and emotions. Furthermore, the interaction can be affected by some features which refer to the interlocutor's state. Actual Socially Interactive Agents SIAs aim to adapt themselves to the state of the interaction partner. In this paper, we discuss this adaptation by describing the architecture of the GRETA platform which considers external features while interacting with humans and/or another ECA and process the dialogue incrementally. We illustrate the new architecture of GRETA which deals with the external features, the adaptation, and the incremental approach for the dialogue processing.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。