arXiv:2412.16302cs.CLcs.LG2024-12中稿 · 2024 IEEE 6th Inte…被引 2

用真实叙事文本分析心理健康,发现BERT比专业模型更懂隐含情绪。

Decoding Linguistic Nuances in Mental Health Text Classification Using Expressive Narrative Stories

  • 用Reddit上的个人叙事数据,对比BERT与MentalBERT对心理状态的识别能力。
  • 传统模型依赖关键词,而BERT在缺少明显术语时仍保持高准确率(P<0.05)。
  • 适合做心理健康的深度语义分析,尤其适用于无明确关键词的真实文本。

近年来自然语言处理的发展推动了社交媒体文本中精神健康相关语言特征的分析。然而,表达性叙事故事(ENS)——即深刻个人化、情绪强烈的叙述——仍缺乏深入研究。本研究基于Reddit数据集,聚焦于自述抑郁与非抑郁个体的ENS,评估BERT与MentalBERT等先进语言模型相较于传统模型的表现。结果表明,传统模型对缺乏显式主题词的情况敏感,可能限制其在无明确精神健康术语的ENS中的应用。尽管MentalBERT专为精神科语境设计,但在缺乏特定主题词时仍依赖关键词,影响分类准确性(P值<0.05)。相比之下,BERT对主题词缺失不敏感,展现出更强的理解深层语言特征的能力,更适合真实场景应用。两者均能有效识别语言细微差别,并在叙事顺序被打乱时保持较高准确率,这种鲁棒性具有统计显著性(P值<0.05),尤其体现在有无心理健康声明的用户间对比中。研究强调应深入探索ENS以获取心理健康的深层洞察,倡导超越关键词检测的精细化分析方法。

原文摘要 · Abstract (English)

Recent advancements in NLP have spurred significant interest in analyzing social media text data for identifying linguistic features indicative of mental health issues. However, the domain of Expressive Narrative Stories (ENS)-deeply personal and emotionally charged narratives that offer rich psychological insights-remains underexplored. This study bridges this gap by utilizing a dataset sourced from Reddit, focusing on ENS from individuals with and without self-declared depression. Our research evaluates the utility of advanced language models, BERT and MentalBERT, against traditional models. We find that traditional models are sensitive to the absence of explicit topic-related words, which could risk their potential to extend applications to ENS that lack clear mental health terminology. Despite MentalBERT is design to better handle psychiatric contexts, it demonstrated a dependency on specific topic words for classification accuracy, raising concerns about its application when explicit mental health terms are sparse (P-value<0.05). In contrast, BERT exhibited minimal sensitivity to the absence of topic words in ENS, suggesting its superior capability to understand deeper linguistic features, making it more effective for real-world applications. Both BERT and MentalBERT excel at recognizing linguistic nuances and maintaining classification accuracy even when narrative order is disrupted. This resilience is statistically significant, with sentence shuffling showing substantial impacts on model performance (P-value<0.05), especially evident in ENS comparisons between individuals with and without mental health declarations. These findings underscore the importance of exploring ENS for deeper insights into mental health-related narratives, advocating for a nuanced approach to mental health text analysis that moves beyond mere keyword detection.

心理健康叙事分析BERT语言模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。