预测维基百科条目长期质量维持能力,揭示可持续成功的关键因素。
A Test of Time: Predicting the Sustainable Success of Online Collaboration in Wikipedia
- 提出'可持续成功'新指标,衡量协作内容的长期质量保持力。
- 基于4万+条目数据,模型预测准确率达AU-ROC 0.88。
- 用户经验最重要,且高质量需时间沉淀,适用于广泛在线协作场景。
互联网极大拓展了全球协作潜力,使数百万用户能参与维基百科等集体项目。然而,现有研究多忽略时间维度,未能评估协作成果的持久性。本文填补这一空白,提出新指标‘可持续成功’,衡量协作内容维持高质量的能力。以维基百科为案例,构建包含4万余篇条目、300余特征(如编辑历史、用户经验、团队构成)的SustainPedia数据集,并训练机器学习模型进行预测。最佳模型平均实现AU-ROC 0.88的性能。分析发现:条目越晚被认定为高质量,越可能长期维持;用户经验是最重要的预测因子。研究对在线运动、开源软件等领域的集体行动具有启示意义。所有数据与代码已公开。
原文摘要 · Abstract (English)
The Internet has significantly expanded the potential for global collaboration, allowing millions of users to contribute to collective projects like Wikipedia. While prior work has assessed the success of online collaborations, most approaches are time-agnostic, evaluating success without considering its longevity. Research on the factors that ensure the long-term preservation of high-quality standards in online collaboration is scarce. In this study, we address this gap. We propose a novel metric, `Sustainable Success,' which measures the ability of collaborative efforts to maintain their quality over time. Using Wikipedia as a case study, we introduce the SustainPedia dataset, which compiles data from over 40K Wikipedia articles, including each article's sustainable success label and more than 300 explanatory features such as edit history, user experience, and team composition. Using this dataset, we develop machine learning models to predict the sustainable success of Wikipedia articles. Our best-performing model achieves a high AU-ROC score of 0.88 on average. Our analysis reveals important insights. For example, we find that the longer an article takes to be recognized as high-quality, the more likely it is to maintain that status over time (i.e., be sustainable). Additionally, user experience emerged as the most critical predictor of sustainability. Our analysis provides insights into broader collective actions beyond Wikipedia (e.g., online activism, crowdsourced open-source software), where the same social dynamics that drive success on Wikipedia might play a role. We make all data and code used for this study publicly available for further research.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。