arXiv:2605.24907cs.CL2026-05ACL综述被引 15

用心理防御机制分类框架,分析支持性对话中的情绪表达层次。

Overview of the PsyDefDetect Shared Task at BioNLP 2026: Detecting Levels of Psychological Defense Mechanisms in Supportive Conversations

论文配图:Overview of the PsyDefDetect Shared Task at BioNLP 2026: Detecting Levels of Psychological Defense Mechanisms in Supportive Conversations
图 1 · 摘自论文原文
  • 基于临床框架DMRS,将对话中求助者语句分为九类防御机制等级。
  • 最佳模型宏F1达0.420,仍存在明显提升空间。
  • 适合对心理语言分析与大模型应用感兴趣的NLP研究者。

我们介绍了与ACL 2026 BioNLP同期举办的PsyDefDetect共享任务,该任务旨在检测情感支持对话中心理防御机制的层级。基于经临床验证的防御机制评分量表(DMRS)框架,任务要求系统在给定对话上下文的情况下,将目标求助者语句分类为九类:七种层级化的DMRS等级及两类辅助标签。参赛者使用新发布的PsyDefConv语料库,包含200段对话和2336个已标注的求助者语句,标注依据DMRS并具有较高的标注者一致性。共有172名参与者在CodaBench提交了563次提交,21支队伍正式注册最终结果。最佳系统取得0.420的宏平均F1分数,显著优于数据集论文中报告的最强微调基线,但仍留有明显提升空间。分析揭示:(i) 持续高估多数类别‘高适应’;(ii) 准确率与宏F1差距扩大,暴露类别不平衡敏感性;(iii) 理论感知与基于大模型的方法对细粒度防御功能分类具有价值。我们公开所有任务材料,邀请社区继续探索临床心理学与自然语言处理的这一新兴交叉领域。

原文摘要 · Abstract (English)

We present an overview of PsyDefDetect, the shared task on detecting levels of psychological defense mechanisms in emotional support dialogues, co-located with BioNLP@ACL 2026. Grounded in the clinically validated Defense Mechanism Rating Scales (DMRS) framework, the task asks systems to classify a target seeker utterance, given its preceding dialogue context, into one of nine categories: seven hierarchical DMRS levels plus two auxiliary labels. Participants worked on PsyDefConv, a newly released corpus of 200 dialogues and 2336 help-seeker utterances annotated under DMRS with substantial inter-annotator agreement. The task attracted 172 participants on CodaBench who produced 563 submissions, with 21 teams officially registering their results for the final ranking. The best system achieved a macro F1-score of 0.420, surpassing the strongest fine-tuned baseline reported in the dataset paper by a notable margin, yet leaving clear headroom. Our analysis highlights (i) a persistent tendency to over-predict the majority High-Adaptive class, (ii) a widening gap between accuracy and macro-F1 that reveals class-imbalance sensitivity, and (iii) the value of theory-aware and LLM-based approaches for fine-grained defensive-function classification. We release all task materials and invite the community to continue work on this novel intersection of clinical psychology and NLP.

心理分析对话理解防御机制NLP

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。