arXiv:2409.02122cs.LGcs.AI2024-09被引 9

将抑郁症领域知识注入神经网络,让模型解释更符合临床医生理解。

Deep Knowledge-Infusion For Explainable Depression Detection

  • 融合抑郁症特征本体与常识知识,提升模型可解释性
  • 在多个数据集上性能优于MentalBERT,F1提升最高达19%
  • 生成的解释对临床医生更有价值,适合医疗辅助场景

在社交媒体上识别抑郁个体日益重要。研究者采用机器学习/深度学习或词典法进行自动化抑郁检测。词典法虽可解释且易实现,但仅匹配词汇而忽略上下文;深度学习模型虽能利用上下文,却因黑箱特性限制应用。尽管可借助LIME、SHAP等代理模型生成解释,但其解释对开发者有用,对终端用户帮助有限。本文提出知识注入神经网络(KiNN),将抑郁症特征本体(DFO)的领域知识融入神经网络,赋予模型面向用户的可解释性,使其解释符合临床理解的概念与过程。同时,引入基于ATOMIC训练的常识转换器(COMET)中的常识知识,以捕捉用户帖子中普遍的情绪特征。模型在三个专家标注的数据集上评估。结果显示,相比最佳领域模型MentalBERT,KiNN在CLEF e-Risk上实现25%的马修相关系数(MCC)提升和12%的F1提升(p<0.1);在PRIMATE数据集上则有2.5% MCC提升和19% F1提升。结果表明,相较于事后解释,所生成的解释对心理健康从业者(MHPs)更具信息量。同时,该模型性能超越基线,且能在其他基线失效时提供有效解释。知识注入显著增强了GPT-3.5等模型生成应用相关解释的能力。

原文摘要 · Abstract (English)

Discovering individuals depression on social media has become increasingly important. Researchers employed ML/DL or lexicon-based methods for automated depression detection. Lexicon based methods, explainable and easy to implement, match words from user posts in a depression dictionary without considering contexts. While the DL models can leverage contextual information, their black-box nature limits their adoption in the domain. Though surrogate models like LIME and SHAP can produce explanations for DL models, the explanations are suitable for the developer and of limited use to the end user. We propose a Knolwedge-infused Neural Network (KiNN) incorporating domain-specific knowledge from DepressionFeature ontology (DFO) in a neural network to endow the model with user-level explainability regarding concepts and processes the clinician understands. Further, commonsense knowledge from the Commonsense Transformer (COMET) trained on ATOMIC is also infused to consider the generic emotional aspects of user posts in depression detection. The model is evaluated on three expertly curated datasets related to depression. We observed the model to have a statistically significant (p<0.1) boost in performance over the best domain-specific model, MentalBERT, across CLEF e-Risk (25% MCC increase, 12% F1 increase). A similar trend is observed across the PRIMATE dataset, where the proposed model performed better than MentalBERT (2.5% MCC increase, 19% F1 increase). The observations confirm the generated explanations to be informative for MHPs compared to post hoc model explanations. Results demonstrated that the user-level explainability of KiNN also surpasses the performance of baseline models and can provide explanations where other baselines fall short. Infusing the domain and commonsense knowledge in KiNN enhances the ability of models like GPT-3.5 to generate application-relevant explanations.

抑郁检测可解释性知识注入临床应用

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。