arXiv:2510.20085cs.LGcs.CY2025-10被引 1

用双头模型更准识别社交媒体上的自杀风险等级。

Hierarchical Dual-Head Model for Suicide Risk Assessment via MentalRoBERTa

  • 双头结构分别处理等级顺序和类别区分,提升分类精度。
  • 在四类风险等级上宏F1达0.76,优于单一分类模型。
  • 适合心理安全监测、智能医疗等需要细粒度风险评估的场景。

社交媒体已成为识别自杀风险的重要来源,但自动化检测系统面临严重类别不平衡、发帖模式的时间复杂性,以及风险等级兼具序数与类别双重属性的挑战。本文提出一种基于MentalRoBERTa的分层双头神经网络,将自杀风险分为四个等级:指标、意念、行为与尝试。模型采用两个互补的预测头共享序列表示:一个CORAL(一致秩对数)头保持风险等级间的序数关系,一个标准分类头实现灵活的类别区分。使用三层Transformer编码器(8头多头注意力)建模帖子序列中的时间依赖性,并通过显式时间间隔嵌入捕捉发帖行为动态。模型采用组合损失函数(0.5 CORAL + 0.3交叉熵 + 0.2焦点损失),同时兼顾序数结构保持、过自信抑制与类别不平衡问题。为提升计算效率,冻结MentalRoBERTa前6层(50%),并采用混合精度训练。通过5折分层交叉验证评估,以宏F1分数为主要指标。

原文摘要 · Abstract (English)

Social media platforms have become important sources for identifying suicide risk, but automated detection systems face multiple challenges including severe class imbalance, temporal complexity in posting patterns, and the dual nature of risk levels as both ordinal and categorical. This paper proposes a hierarchical dual-head neural network based on MentalRoBERTa for suicide risk classification into four levels: indicator, ideation, behavior, and attempt. The model employs two complementary prediction heads operating on a shared sequence representation: a CORAL (Consistent Rank Logits) head that preserves ordinal relationships between risk levels, and a standard classification head that enables flexible categorical distinctions. A 3-layer Transformer encoder with 8-head multi-head attention models temporal dependencies across post sequences, while explicit time interval embeddings capture posting behavior dynamics. The model is trained with a combined loss function (0.5 CORAL + 0.3 Cross-Entropy + 0.2 Focal Loss) that simultaneously addresses ordinal structure preservation, overconfidence reduction, and class imbalance. To improve computational efficiency, we freeze the first 6 layers (50%) of MentalRoBERTa and employ mixed-precision training. The model is evaluated using 5-fold stratified cross-validation with macro F1 score as the primary metric.

自杀风险双头模型心理健康序列建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。