arXiv:2508.01486cs.CL2025-08ACL

为泰卢固语构建带人类理由的标注数据,提升情感分析的可解释性与公平性。

Human-Centered Supervision for Sentiment Analysis in Telugu: A Systematic Inquiry Beyond Accuracy

  • 构建首个泰卢固语情感分析带理由数据集TeSent,融合多母语者标注。
  • 引入人类理由监督后,模型对齐度与预测性能均显著提升。
  • 适用于关注低资源语言可解释性、公平性的研究者与开发者。

在可解释性、人类对齐与公平性日益重要的背景下,低资源语言的情感分析仍面临挑战,主要源于标注数据稀缺及难以实现可靠的人类可理解分析。泰卢固语作为拥有超过9600万使用者的主要达罗毗荼语系语言,亦存在此问题。本文提出TeSent——一个大规模泰卢固语情感分类数据集,包含情感标签和多位母语者提供的理由标注。该资源支持基于理由的监督,以实现模型与人类推理的对齐。我们对五种基于Transformer的模型在有无理由监督下进行微调,并在分类性能、解释质量与社会偏见方面进行评估。为实现可控的公平性评估,额外构建了TeEEC评测语料库。结果表明,引入人类理由能持续提升模型对齐度,且常带来整体性能提升。通过多维度解释质量与公平性分析,揭示了对齐导向监督在资源匮乏语言场景中的广泛影响。

原文摘要 · Abstract (English)

Sentiment analysis for low-resource languages remains challenging in an era where interpretability, human alignment, and fairness are increasingly non-negotiable aspects of modern machine learning systems. These challenges stem both from the scarcity of annotated data and from the resulting difficulty of conducting reliable, human-interpretable analyses that go beyond predictive accuracy. Telugu, one of the primary Dravidian languages with over 96 million speakers, is not an exception. In this work, we first introduce TeSent, a large-scale Telugu sentiment classification dataset annotated with sentiment labels and human-selected rationales from multiple native speakers. This resource enables the study of rationale-based supervision for aligning models with human reasoning in this low-resource setting. We fine-tune five transformer-based models with and without rationale supervision and evaluate them on classification performance, explanation quality, and social bias. To facilitate controlled fairness evaluation, we additionally construct TeEEC, an evaluation corpus for Telugu sentiment analysis. Our results show that incorporating human rationales consistently improves alignment and often leads to holistic gains in predictive performance. We further provide extensive analysis of multi-facade explanation quality and fairness, offering insights into the broader effects of alignment-oriented supervision in resource-scarce language contexts.

情感分析低资源语言可解释性公平性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。