arXiv:2605.02672cs.AIcs.CL2026-05被引 1

构建对话中两人情感与互动动态的基准,推动跨语言多模态交互研究。

The 2026 ACII Dyadic Conversations (DaiKon) Workshop & Challenge

论文配图:The 2026 ACII Dyadic Conversations (DaiKon) Workshop & Challenge
图 1 · 摘自论文原文
  • 基于945组双人对话数据,设计三类协同挑战,捕捉双向影响、发言时机与情感联结
  • 最佳模型在方向性影响预测上达0.40 CCC,发言预测准确率0.66 Macro-F1
  • 适合关注人际互动建模、跨文化对话分析的研究者使用

2026年ACII双人对话(ACII-DaiKon)研讨会与挑战赛提出一个用于建模双人对话中人际情感与社会动态的基准。尽管对话情感建模发展迅速,但现有基准多以说话人为中心,未能充分反映双方在时间上的耦合演化过程,如方向性影响、发言时机协调及关系发展。为此,ACII-DaiKon基于Hume-DaiKon数据集(包含945组自然情境下的双人对话,覆盖五种语言,总计743.4小时音视频数据),设立三个协同子任务:(1) 方向性人际影响预测,(2) 发言者与下次发言时间预测,(3) 全程关系轨迹建模。该基准支持多模态建模、时序推理与跨上下文泛化,提供固定训练/验证/测试划分、标准化评估指标及基线系统。评估采用一致性相关系数(CCC)、皮尔逊相关系数、宏平均F1和均方误差(MAE)。基线实验显示,影响预测最佳结果为0.40 CCC与0.50皮尔逊相关,发言预测为0.66 Macro-F1与1.50秒MAE,关系轨迹建模为0.68 CCC与0.70皮尔逊相关。结果表明,当前方法仅能捕捉粗粒度的双人互动模式,对方向依赖性和长周期人际动态建模仍具挑战。研讨会为数据有效性、评估协议与文化敏感建模提供了跨学科交流平台。

原文摘要 · Abstract (English)

The 2026 ACII Dyadic Conversations (ACII-DaiKon) Workshop & Challenge introduces a benchmark for modeling interpersonal affect and social dynamics in dyadic conversations. Although conversational affect modeling has advanced rapidly, most benchmarks remain speaker-centric and underrepresent coupled, time-evolving processes between partners, including directional influence, conversational timing coordination, and rapport development. To address this gap, ACII-DaiKon presents three coordinated sub-challenges built on a shared dataset: (1) directional interpersonal influence prediction, (2) turn-taking prediction (next-speaker and time-to-next-speech), and (3) rapport trajectory prediction across full interactions. The challenge is built on the Hume-DaiKon dataset, comprising 945 dyadic conversations (743.4 hours of audiovisual data) collected under naturalistic conditions across five languages. The benchmark supports multimodal modeling, temporal reasoning, and cross-context generalization through fixed train/validation/test splits, standardized metrics, and released baseline systems. Evaluation uses Concordance Correlation Coefficient (CCC), Pearson correlation, Macro-F1, and Mean Absolute Error (MAE) depending on the sub-challenge. Baseline experiments establish initial reference performance, with best test results of 0.40 CCC and 0.50 Pearson for influence prediction, 0.66 Macro-F1 and 1.50~s MAE for turn-taking, and 0.68 CCC and 0.70 Pearson for rapport trajectory modeling. These results indicate that while current methods capture coarse dyadic patterns, robust modeling of directional dependence and long-horizon interpersonal dynamics remains challenging. The workshop provides a shared platform for rigorous comparison and cross-disciplinary discussion on data validity, evaluation protocols, and culturally aware modeling for dyadic interaction.

对话建模情感分析多模态双人互动

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。