让AI更懂历史类比，提升前瞻分析能力
Analogical Deep Research: Retrieving and Integrating Historical Analogies for Foresight Analysis
- 基于机制对齐与跨类比验证，构建因果类比推理框架
- 在类比生成上提升最高10%，优于现有顶尖研究代理
- 适合需要深度历史洞察的政策制定与战略预测场景
系统性地比较当前情境与历史上结构相似事件，即历史类比，是前瞻分析中最有力的工具之一。本文提出一项新任务——类比深度研究（Analogical Deep Research, ADR），并构建首个ADR基准测试集ADR-bench，以评估大语言模型（LLM）代理在进行前瞻性分析时识别和利用历史类比的能力。研究发现，LLM代理在识别类比方面表现不佳，因其仅依赖表面特征匹配，而非深层机制理解。我们认为ADR本质上是一个因果问题，需理解事件发生的原因。基于理论分析，我们提出两项必要原则：机制对齐与跨类比验证。在此基础上，提出新型代理框架Causal Analogical Researcher（CANA），通过结构分解表示与结构反馈机制，实现对历史类比识别与整合的反思式优化。实验表明，CANA在历史类比生成上最高提升10%，并在ADR-bench中超越现有最先进深度研究代理。对当前事件的案例研究进一步验证了CANA的有效性。
原文摘要 · Abstract (English)
Systematic comparisons between current situations and structurally similar past events in the historical, i.e., historical analogies, is among the most powerful tools for foresight analysis. In this work, we present a new task called Analogical Deep Research (ADR) to Large Language Model (LLM) agents and construct the first ADR benchmark ADR-bench to study whether LLM agents are able to find and leverage historical analogies when doing foresight analysis. Our investigation reveals a key obstacle: LLM agents are poor at finding analogies because they match on surface features rather than underlying mechanisms. We argue that ADR is inherently a causal question as it requires understanding why the event occurred. Based on our theoretical analysis, we propose two principles required for ADR, including the mechanism alignment and cross-analogy confirmation. Built upon our theoretical results, we propose a new agentic framework called Causal Analogical Researcher (CANA) that guides LLMs to find and integrate historical analogies. CANA incorporates a simple yet effective structural decomposition representation, and integrates structural feedback for reflective improvements of historical analogy identification and integration. We show that CANA brings up to 10% improvements in historical analogy generation, and surpasses the state-of-the-art deep research agents in the ADR-bench. Case studies with the ongoing events confirm the effectiveness of CANA in leveraging historical analogies.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。