通过分析表情符号与语境,提升大模型对自残意图的识别能力。
Just a Scratch: Enhancing LLM Capabilities for Self-harm Detection through Intent Differentiation and Emoji Interpretation
- 基于100个表情符号的语境解读矩阵,增强输入理解
- 多任务微调使模型在自残检测上准确率提升12.3%
- 可生成解释性推理,适合心理健康领域研究者使用
社交媒体上的自残行为检测对早期干预和心理健康支持至关重要,但因表达隐晦、依赖上下文而困难重重。当前大语言模型(LLMs)难以解析日常语言和表情符号中的隐含线索。本文提出通过区分意图来增强模型对自残内容的理解,构建了包含100个表情符号及其上下文自残含义的中心纪念表情符号敏感矩阵(CESM-100),并创建了自残识别与意图提取带支持的表情符号敏感数据集(SHINES),包含自残标签、非正式提及(CMs)和严重意图(SIs)的详细标注。提出的统一框架:一、用CESM-100丰富输入;二、对LLMs进行多任务微调(主任务:自残检测,辅助任务:CM/SI片段识别);三、生成预测的可解释理由。在三个主流模型(Llama 3、Mental-Alpaca、MentalLlama)上评估,涵盖零样本、少样本及微调场景。结合意图区分与上下文线索,显著提升了检测与解释性能,有效缓解自残信号的内在模糊性。数据集、矩阵与代码已公开:https://www.iitp.ac.in/~ai-nlp-ml/resources.html#SHINES。
原文摘要 · Abstract (English)
Self-harm detection on social media is critical for early intervention and mental health support, yet remains challenging due to the subtle, context-dependent nature of such expressions. Identifying self-harm intent aids suicide prevention by enabling timely responses, but current large language models (LLMs) struggle to interpret implicit cues in casual language and emojis. This work enhances LLMs' comprehension of self-harm by distinguishing intent through nuanced language-emoji interplay. We present the Centennial Emoji Sensitivity Matrix (CESM-100), a curated set of 100 emojis with contextual self-harm interpretations and the Self-Harm Identification aNd intent Extraction with Supportive emoji sensitivity (SHINES) dataset, offering detailed annotations for self-harm labels, casual mentions (CMs), and serious intents (SIs). Our unified framework: a) enriches inputs using CESM-100; b) fine-tunes LLMs for multi-task learning: self-harm detection (primary) and CM/SI span detection (auxiliary); c) generates explainable rationales for self-harm predictions. We evaluate the framework on three state-of-the-art LLMs-Llama 3, Mental-Alpaca, and MentalLlama, across zero-shot, few-shot, and fine-tuned scenarios. By coupling intent differentiation with contextual cues, our approach commendably enhances LLM performance in both detection and explanation tasks, effectively addressing the inherent ambiguity in self-harm signals. The SHINES dataset, CESM-100 and codebase are publicly available at: https://www.iitp.ac.in/~ai-nlp-ml/resources.html#SHINES .
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。