arXiv:2508.02574cs.CLcs.AI2025-08被引 4

用ChatGPT和人工审核结合,构建首个可解释的阿拉伯语医疗情感分析数据集。

EHSAN: Leveraging ChatGPT in a Hybrid Framework for Arabic Aspect-Based Sentiment Analysis in Healthcare

  • 用ChatGPT生成伪标签,再经人工筛选,构建混合标注流程。
  • 仅用机器标签时模型准确率仍高,人审比例降至50%性能下降极小。
  • 适合医疗舆情分析、多语言NLP研究者参考。

阿拉伯语患者反馈因方言多样性和缺乏细粒度情感标签而长期未被充分分析。为此,我们提出EHSAN——一个以数据为中心的混合框架,将ChatGPT伪标注与定向人工审核结合,构建首个可解释的阿拉伯语医疗领域方面级情感分析数据集。每条句子均标注方面与情感(正/负/中性),并附上ChatGPT生成的推理依据以提升透明性。为评估标注质量对模型的影响,我们构建三类训练数据:全监督(全部人工审核)、半监督(50%人工审核)与无监督(仅机器生成)。在两种Transformer模型上进行微调。实验表明,即使仅使用ChatGPT标签,我们的阿拉伯语专用模型仍保持高准确率,50%人工审核时性能下降微弱;减少方面类别数量显著提升分类指标。结果验证了该方法在医疗领域阿拉伯语情感分析中的有效性与可扩展性,融合大模型标注与人工校验,产出鲁棒且可解释的数据集。未来方向包括跨医院泛化、提示优化与可解释建模。

原文摘要 · Abstract (English)

Arabic-language patient feedback remains under-analysed because dialect diversity and scarce aspect-level sentiment labels hinder automated assessment. To address this gap, we introduce EHSAN, a data-centric hybrid pipeline that merges ChatGPT pseudo-labelling with targeted human review to build the first explainable Arabic aspect-based sentiment dataset for healthcare. Each sentence is annotated with an aspect and sentiment label (positive, negative, or neutral), forming a pioneering Arabic dataset aligned with healthcare themes, with ChatGPT-generated rationales provided for each label to enhance transparency. To evaluate the impact of annotation quality on model performance, we created three versions of the training data: a fully supervised set with all labels reviewed by humans, a semi-supervised set with 50% human review, and an unsupervised set with only machine-generated labels. We fine-tuned two transformer models on these datasets for both aspect and sentiment classification. Experimental results show that our Arabic-specific model achieved high accuracy even with minimal human supervision, reflecting only a minor performance drop when using ChatGPT-only labels. Reducing the number of aspect classes notably improved classification metrics across the board. These findings demonstrate an effective, scalable approach to Arabic aspect-based sentiment analysis (SA) in healthcare, combining large language model annotation with human expertise to produce a robust and explainable dataset. Future directions include generalisation across hospitals, prompt refinement, and interpretable data-driven modelling.

情感分析阿拉伯语医疗NLP大模型标注

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。