用情感、情绪、论点和话题标注预测个体价值观念,提升AI对多元视角的理解。
Taking a SEAT: Predicting Value Interpretations from Sentiment, Emotion, Argument, and Topic Annotations
- 通过情感、情绪、论点和话题四维度标注,构建个体价值解读的预测模型。
- 多维度联合标注比单一维度或无标注信息时表现更优,零样本与少样本下均有效。
- 揭示个体标注差异的重要性,为个性化AI系统提供新思路,适合价值观研究者参考。
人们对价值概念的理解受社会文化背景与生活经验影响,具有主观性。识别个体的价值解读对开发能适配多元人类视角、避免主流偏见的AI系统至关重要。为此,我们探究语言模型能否通过多维主观标注(情感、情绪、论点、话题)作为个体解读视角的代理,来预测其价值立场。在不同零样本与少样本设置下的实验表明,同时提供所有SEAT维度的信息,显著优于单独使用任一维度或不提供个体信息的基线。此外,标注者间的个体差异凸显了纳入主观标注行为的重要性。据我们所知,这是首个在控制条件下超越人口统计特征,研究标注行为对价值预测影响的工作,虽规模较小,但为未来大规模验证奠定了基础。
原文摘要 · Abstract (English)
Our interpretation of value concepts is shaped by our sociocultural background and lived experiences, and is thus subjective. Recognizing individual value interpretations is important for developing AI systems that can align with diverse human perspectives and avoid bias toward majority viewpoints. To this end, we investigate whether a language model can predict individual value interpretations by leveraging multi-dimensional subjective annotations as a proxy for their interpretive lens. That is, we evaluate whether providing examples of how an individual annotates Sentiment, Emotion, Argument, and Topics (SEAT dimensions) helps a language model in predicting their value interpretations. Our experiment across different zero- and few-shot settings demonstrates that providing all SEAT dimensions simultaneously yields superior performance compared to individual dimensions and a baseline where no information about the individual is provided. Furthermore, individual variations across annotators highlight the importance of accounting for the incorporation of individual subjective annotators. To the best of our knowledge, this controlled setting, although small in size, is the first attempt to go beyond demographics and investigate the impact of annotation behavior on value prediction, providing a solid foundation for future large-scale validation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。