arXiv:2512.16034cs.CL2025-12Conference of the …

研究不同类型自述信息对预测社会规范判断的作用

Examining the Utility of Self-disclosure Types for Modeling Annotators of Social Norms

  • 将自述信息分类,用于构建标注者模型
  • 少量与原帖相关的评论即可有效预测判断模式
  • 广泛采样比精心筛选更优,提示需探索更优信息特征

近期研究尝试通过个人描述或自述信息提升对个体特征的建模及主观任务中标注者标签的预测能力。以往自述信息量有限,对其类型影响缺乏深入探讨。本文对自述内容进行分类,并用于构建社会规范判断的标注者预测模型。通过多组消融实验与分析,发现仅需少量与原始帖子相关的评论即可实现良好预测效果。此外,标注者自述样本越多样,性能未必越好;从更大评论池中无筛选采样反而表现最佳,表明仍有大量未被发掘的、对判决预测最有用的标注者信息待探索。

原文摘要 · Abstract (English)

Recent work has explored the use of personal information in the form of persona sentences or self-disclosures to improve modeling of individual characteristics and prediction of annotator labels for subjective tasks. The volume of personal information has historically been restricted and thus little exploration has gone into understanding what kind of information is most informative for predicting annotator labels. In this work, we categorize self-disclosures and use them to build annotator models for predicting judgments of social norms. We perform several ablations and analyses to examine the impact of the type of information on our ability to predict annotation patterns. Contrary to previous work, only a small number of comments related to the original post are needed. Lastly, a more diverse sample of annotator self-disclosures did not lead to the best performance. Sampling from a larger pool of comments without filtering still yields the best performance, suggesting that there is still much to uncover in terms of what information about an annotator is most useful for verdict prediction.

标注者建模社会规范自述信息

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。