用机器学习在社交游戏中提前预警重大变化,准确率超常规方法。
Interpretable Early Warnings using Machine Learning in an Online Game-experiment
- 融合多种时间序列的梯度提升模型,带记忆特征预测转折点。
- 20分钟内检测50%转折,误报率仅3.6%,2023年数据仍有效。
- 通过SHAP分析揭示预警背后的复杂行为模式,适合社会系统研究者。
源自物理学并应用于生态等领域的临界转变理论认为,某些系统突变前会出现统计预警信号。Reddit的r/place实验为检验这些信号提供了独特机会:数百万用户协作绘制像素画,当一幅作品快速取代另一幅时即发生转变。本文构建基于机器学习的预警系统,利用梯度提升决策树整合多种特定系统的时间序列,并引入保留记忆的特征。该方法显著优于传统预警指标。在2022年r/place数据上训练后,算法可在20分钟内检测到50%的转变,误报率仅为3.6%。在2023年事件中表现依然稳健,验证了跨场景泛化能力。通过SHapley Additive exPlanations(SHAP)解释预测,我们发现转变前存在多重模式:临界迟滞或加速、创新或协作不足、历史动荡以及图像复杂性下降。结果表明,机器学习预警指标在社会-生态系统的突变预测与动态理解中具有潜力。
原文摘要 · Abstract (English)
Stemming from physics and later applied to other fields such as ecology, the theory of critical transitions suggests that some regime shifts are preceded by statistical early warning signals. Reddit's r/place experiment, a large-scale social game, provides a unique opportunity to test these signals consistently across thousands of subsystems undergoing critical transitions. In r/place, millions of users collaboratively created ''compositions'', or pixel-art drawings, in which transitions occur when one composition rapidly replaces another. We develop a machine-learning-based early warning system that combines the predictive power of multiple system-specific time series via gradient-boosted decision trees with memory-retaining features. Our method significantly outperforms standard early warning indicators. Trained on the 2022 r/place data, our algorithm detects half of the transitions occurring within 20 min at a false positive rate of just 3.6%. Its performance remains robust when tested on the 2023 r/place event, demonstrating generalizability across different contexts. Using SHapley Additive exPlanations (SHAP) for interpreting the predictions, we investigate the underlying drivers of warnings, which could be relevant to other complex systems, especially online social systems. We reveal an interplay of patterns preceding transitions, such as critical slowing down or speeding up, a lack of innovation or coordination, turbulent histories, and a lack of image complexity. These findings show the potential of machine learning indicators in socio-ecological systems for predicting regime shifts and understanding their dynamics.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。