arXiv:2511.20672cs.CLcs.AI2025-11被引 3

MindSET用1300万条自报病史帖子构建新基准,提升心理健康研究精度。

MindSET: Advancing Mental Health Benchmarking through Large-Scale Social Media Data

  • 基于自报诊断数据,从Reddit精选超1300万条帖子构建新数据集
  • 在自闭症检测上模型性能较旧基准最高提升18点F1值
  • 适合关注社交媒体心理分析、早期风险预警的研究者使用

社交媒体数据已成为研究心理健康的重要资源,可提供传统方法难以捕捉的实时思维、情绪与行为洞察。然而,现有基准数据集多因数据有限、清洗不足及内容多样性(如多语言、有害信息)而过时。本文提出新基准数据集MindSET,基于Reddit中用户自报诊断信息构建。该标注数据集包含超过1300万条帖子,覆盖七类精神健康状况,规模为此前基准的两倍以上。通过语言过滤、NSFW与重复内容剔除等严格预处理保障质量。进一步利用LIWC进行语言学分析,考察八组群体的心理词汇频率。实验表明,使用微调语言模型与词袋特征在诊断检测任务中,基于MindSET训练的模型持续优于旧基准,自闭症检测的F1值最高提升18点。整体而言,MindSET为社交网络与心理健康交叉研究提供了坚实基础,支持早期风险识别与新兴心理趋势深度分析。

原文摘要 · Abstract (English)

Social media data has become a vital resource for studying mental health, offering real-time insights into thoughts, emotions, and behaviors that traditional methods often miss. Progress in this area has been facilitated by benchmark datasets for mental health analysis; however, most existing benchmarks have become outdated due to limited data availability, inadequate cleaning, and the inherently diverse nature of social media content (e.g., multilingual and harmful material). We present a new benchmark dataset, \textbf{MindSET}, curated from Reddit using self-reported diagnoses to address these limitations. The annotated dataset contains over \textbf{13M} annotated posts across seven mental health conditions, more than twice the size of previous benchmarks. To ensure data quality, we applied rigorous preprocessing steps, including language filtering, and removal of Not Safe for Work (NSFW) and duplicate content. We further performed a linguistic analysis using LIWC to examine psychological term frequencies across the eight groups represented in the dataset. To demonstrate the dataset utility, we conducted binary classification experiments for diagnosis detection using both fine-tuned language models and Bag-of-Words (BoW) features. Models trained on MindSET consistently outperformed those trained on previous benchmarks, achieving up to an \textbf{18-point} improvement in F1 for Autism detection. Overall, MindSET provides a robust foundation for researchers exploring the intersection of social media and mental health, supporting both early risk detection and deeper analysis of emerging psychological trends.

心理健康社交媒体数据集自闭症检测

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。