arXiv:2505.23452cs.IRcs.SE2025-05中稿 · the 33rd IEEE Inte…被引 6

构建手机应用评论情感细粒度分类体系,助力精准理解用户情绪。

What About Emotions? Guiding Fine-Grained Emotion Extraction from Mobile App Reviews

  • 基于普拉奇克情绪理论构建标注框架与数据集
  • 大模型可显著降低人工标注成本,但完全自动化仍有挑战
  • 适合需求工程、用户体验分析等场景的从业者参考

意见挖掘在分析用户反馈和提取文本信息方面至关重要。尽管多数研究聚焦于情感极性(如正面、负面、中性),但应用评论中的细粒度情绪分类仍研究不足。为更好理解用户的情感反应并支持特征-情绪分析、以用户为中心的发布规划和问题分级等下游任务,本文针对应用评论中的细粒度情绪分析存在的挑战与局限展开研究。通过将普拉奇克情绪分类体系适配至应用评论,构建了结构化标注框架与数据集。经过多轮人工标注迭代,制定了清晰的标注规范,并记录了情绪分类的关键难点。此外,评估了使用大语言模型自动化标注的可行性,分析其成本效益及与人工标注的一致性。结果表明,大语言模型能显著减少人工工作量且与人工标注保持较高一致性,但因情绪解读复杂,完全自动化仍具挑战。本工作通过提供结构化指南、标注数据集及自动化流程开发洞见,推动了需求工程中的意见挖掘发展。

原文摘要 · Abstract (English)

Opinion mining plays a vital role in analysing user feedback and extracting insights from textual data. While most research focuses on sentiment polarity (e.g., positive, negative, neutral), fine-grained emotion classification in app reviews remains underexplored. Fine-grained emotion classification is thus needed to better understand users' affective responses and support downstream tasks such as feature-emotion analysis, user-oriented release planning, and issue triaging. This paper addresses this gap by identifying and addressing the challenges and limitations in fine-grained emotion analysis in the context of app reviews. Our study adapts Plutchik's emotion taxonomy to app reviews by developing a structured annotation framework and dataset. Through an iterative human annotation process, we define clear annotation guidelines and document key challenges in emotion classification. Additionally, we evaluate the feasibility of automating emotion annotation using large language models, assessing their cost-effectiveness and agreement with human-labelled data. Our findings reveal that while large language models significantly reduce manual effort and maintain substantial agreement with human annotators, full automation remains challenging due to the complexity of emotional interpretation. This work contributes to opinion mining in requirements engineering by providing structured guidelines, an annotated dataset, and insights for developing automated pipelines to capture the complexity of emotions in app reviews.

情感分析需求工程大模型应用

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。