通过时间微调提升模型对用户心理风险的早期识别速度与准确率
Temporal fine-tuning for early risk detection
- 在训练中显式融入时间维度,让Transformer模型理解用户发言的时间序列
- 在西班牙语抑郁与进食障碍任务中达到与2023年最佳模型相当的效果
- 适合关注社交健康预警、需兼顾精度与响应速度的研究者
网络早期风险检测(ERD)旨在及时发现面临社会与健康问题的用户。传统方法逐条分析用户发帖,需在关键时刻兼顾判断准确率与响应速度,挑战巨大。现有研究多采用多目标优化,分别优化分类性能与决策时延。本文提出全新策略——时间微调,通过在学习过程中显式引入时间信息,使基于Transformer的模型能够分析完整的用户发帖历史,结合上下文与时间进程进行优化,并使用时间相关指标评估训练效果。我们在西班牙语抑郁症与进食障碍任务上验证了该方法,结果在MentalRiskES 2023基准中表现优异。实验表明,时间微调能有效优化考虑上下文与时间演进的决策过程。由此,可通过统一优化精度与速度,充分发挥Transformer模型在早期风险检测中的潜力。
原文摘要 · Abstract (English)
Early Risk Detection (ERD) on the Web aims to identify promptly users facing social and health issues. Users are analyzed post-by-post, and it is necessary to guarantee correct and quick answers, which is particularly challenging in critical scenarios. ERD involves optimizing classification precision and minimizing detection delay. Standard classification metrics may not suffice, resorting to specific metrics such as ERDE(theta) that explicitly consider precision and delay. The current research focuses on applying a multi-objective approach, prioritizing classification performance and establishing a separate criterion for decision time. In this work, we propose a completely different strategy, temporal fine-tuning, which allows tuning transformer-based models by explicitly incorporating time within the learning process. Our method allows us to analyze complete user post histories, tune models considering different contexts, and evaluate training performance using temporal metrics. We evaluated our proposal in the depression and eating disorders tasks for the Spanish language, achieving competitive results compared to the best models of MentalRiskES 2023. We found that temporal fine-tuning optimized decisions considering context and time progress. In this way, by properly taking advantage of the power of transformers, it is possible to address ERD by combining precision and speed as a single objective.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。