用多大模型+知识图谱,量化神经科学假说的证据支持度。
Ontology-constrained multi-LLM scoring of hypothesis support in the predictive processing literature

- 构建本地大模型联盟,按预定义概念框架评分研究证据。
- 发现局部与全局奇异性范式间存在系统性观点分歧。
- 提出假设空间温度指标,可衡量研究分布的紧凑程度。
跨学科领域常因方法与理论差异导致碎片化,预测编码神经科学即为典型:其文献涵盖计算理论、电生理、成像、行为和建模,传统元分析难以整合。本文提出一种基于本地图灵模型的多模型合成管道,通过读取论文、提取证据、结合图表描述、构造约束提示并对照专家术语表验证输出。人工定义了包含36个概念的预测编码术语表,分为三个假说:预测抑制、前向误差传播、普遍性。由十个本地语言模型对31项研究在局部与全局奇异性范式下,依据与术语表要素的一致性进行评分。实现了研究间一致性分析、模型间比较及三维假说空间映射。结果显示部分假说支持度高,但另一些则较弱,尤其在局部与全局奇异性范式间存在结构性分歧。进一步定义‘假设空间温度’——一个几何离散度指标,反映研究在假说空间中的聚集程度。局部奇异性情境下温度较低(聚集性强),全局情境下温度较高(分散性强)。该几何结构还可用于估计实验情境间的演化向量。结果表明,本地多大模型联盟能生成可审计的分歧度量,并将异质文献转化为可量化的证据空间。该框架或可推广至缺乏共同比较空间的跨研究假说映射。
原文摘要 · Abstract (English)
Fragmentation is common in interdisciplinary fields with diverse methods and theoretical commitments. Predictive coding neuroscience is a clear example: its literature spans computational theory, electrophysiology, imaging, behavior, and modeling, creating a synthesis problem that conventional meta-analysis cannot easily resolve. Here, we describe a local multi-LLM pipeline for ontology-constrained literature synthesis. The pipeline reads papers, extracts evidence, incorporates figure descriptions, assembles constrained prompts, and validates outputs against an expert glossary. We manually defined a predictive-coding glossary of thirty-six concepts grouped into three hypotheses: predictive suppression, feedforward error propagation, and ubiquity. A council of ten local language models scored 31 studies according to their agreement or disagreement with each glossary factor across local and global oddball contexts. This enabled pairwise study-agreement analysis, cross-model comparison, and three-dimensional hypothesis-space mapping. Agreement was high for some hypotheses but weaker for others, revealing structured disagreement, particularly across local versus global oddball paradigms. We further define hypothesis-space temperature, a geometric dispersion metric measuring how compactly studies occupy the hypothesis space. Temperature was lower for local oddball contexts and higher for global oddball contexts, indicating greater dispersion in the latter. The scoring geometry also allowed us to estimate vectors of change between experimental contexts. These results demonstrate that local multi-LLM councils can produce auditable disagreement measurements that map heterogeneous literatures into quantitative evidence spaces. This framework may generalize to cross-study hypothesis mapping where conventional meta-analysis lacks a common comparison space.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。