分析1.68万用户对平台干预的反应,找出最影响行为变化的关键特征。
Quantifying Feature Importance for Online Content Moderation
- 从753个特征中筛选出预测用户行为改变最有效的少数关键特征。
- 活动与毒性变化比参与多样性变化更容易预测,准确率更高。
- 研究结果支持个性化干预策略,适合平台内容治理与算法设计者。
准确评估用户对内容治理措施的反应,是制定有效且以用户为中心的治理策略的关键。本文旨在厘清哪些用户特征与不同行为反应相关。研究基于Reddit上一次重大治理干预,分析了16.8K受影响用户的753个社会行为、语言、关系及心理特征的预测能力。通过量化任务框架与贪心特征选择策略,同时实现特征重要性排序与预测性能优化。结果发现:少数特征在活动、毒性、参与多样性三类任务中均具强预测力;多数特征仅适用于特定任务或效用有限。此外,活动与毒性变化的预测表现优于参与多样性。研究为构建可预测用户反应的系统提供依据,并揭示治理后用户行为的复杂性,强调干预需兼顾用户特质与具体目标。
原文摘要 · Abstract (English)
Accurately estimating how users respond to moderation interventions is paramount for developing effective and user-centred moderation strategies. However, this requires a clear understanding of which user characteristics are associated with different behavioural responses, which is the goal of this work. We investigate the informativeness of 753 socio-behavioural, linguistic, relational, and psychological features, in predicting the behavioural changes of 16.8K users affected by a major moderation intervention on Reddit. To reach this goal, we frame the problem in terms of "quantification", a task well-suited to estimating shifts in aggregate user behaviour. We then apply a greedy feature selection strategy with the double goal of (i) identifying the features that are most predictive of changes in user activity, toxicity, and participation diversity, and (ii) estimating their importance. Our results allow identifying a small set of features that are consistently informative across all tasks, and determining that many others are either task-specific or of limited utility altogether. We also find that predictive performance varies according to the task, with changes in activity and toxicity being easier to estimate than changes in diversity. Overall, our results pave the way for the development of accurate systems that predict user reactions to moderation interventions. Furthermore, our findings highlight the complexity of post-moderation user behaviour, and indicate that effective moderation should be tailored not only to user traits but also to the specific objective of the intervention.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。