测试大模型能否靠自身知识预测冲突,发现加外部数据更准。
Do Large Language Models Know Conflict? Investigating Parametric vs. Non-Parametric Knowledge of LLMs for Conflict Forecasting
- 用预训练权重做冲突趋势预测,不依赖外部数据。
- 接入实时冲突数据后,预测准确率显著提升。
- 适合政策制定与人道预警场景使用。
大型语言模型在自然语言任务中表现优异,但在暴力冲突预测方面仍待深入探索。本文研究大模型是否具备通过预训练权重编码的参数化知识,来预测冲突升级与伤亡人数,而无需外部数据。这对早期预警、人道主义规划和政策制定至关重要。我们对比了两种能力:一是仅依赖预训练知识的参数化预测;二是通过检索增强生成(RAG)获取来自ACLED、GDELT等冲突数据集及新闻报道的结构化与非结构化上下文的非参数化能力。评估覆盖2020–2024年非洲之角与中东高危地区。结果表明,引入外部信息可显著提升模型对冲突趋势(如升级、稳定、降级、和平)与死亡人数的预测性能,揭示了大模型在冲突预测中的潜力与局限。
原文摘要 · Abstract (English)
Large Language Models (LLMs) have shown impressive performance across natural language tasks, but their ability to forecast violent conflict remains underexplored. We investigate whether LLMs possess meaningful parametric knowledge-encoded in their pretrained weights-to predict conflict escalation and fatalities without external data. This is critical for early warning systems, humanitarian planning, and policy-making. We compare this parametric knowledge with non-parametric capabilities, where LLMs access structured and unstructured context from conflict datasets (e.g., ACLED, GDELT) and recent news reports via Retrieval-Augmented Generation (RAG). Incorporating external information could enhance model performance by providing up-to-date context otherwise missing from pretrained weights. Our two-part evaluation framework spans 2020-2024 across conflict-prone regions in the Horn of Africa and the Middle East. In the parametric setting, LLMs predict conflict trends and fatalities relying only on pretrained knowledge. In the non-parametric setting, models receive summaries of recent conflict events, indicators, and geopolitical developments. We compare predicted conflict trend labels (e.g., Escalate, Stable Conflict, De-escalate, Peace) and fatalities against historical data. Our findings highlight the strengths and limitations of LLMs for conflict forecasting and the benefits of augmenting them with structured external knowledge.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。