arXiv:2606.03763econ.GNcs.AI2026-06

用AI评估论文思想质量,发现发表靠执行力、思想力和人脉三者共同决定。

Merit or networks? What decides where research is published

  • 用训练过的LLM从文本直接评分思想质量,不看作者和发表结果。
  • 执行质量影响最大,人脉在顶尖期刊中提升成功率但有限。
  • 思想质量决定中间层级,人脉优势存在但无法让普通论文进顶级刊。

科学出版是奖励思想质量还是人脉优势?这个问题长期难解,因论文质量无法在发表前独立评估。我们通过领域训练的LLM模型,在不接触作者信息与发表结果的前提下,直接从文本量化论文思想质量。以6,208篇经济学工作论文为样本,结合执行质量评分、人脉指数、作者能力指数及通用语言模型文本得分,构建五输入生产函数预测期刊位置。执行质量设定了功绩制门槛,是影响最大的因素;思想质量衡量各层级差异;人脉构成偏见上限,主要影响最顶尖期刊。人脉通过双重路径起作用:连接作者的论文得分更高,且在同等得分下更易被录用。但此优势有边界:人脉提升各层级机会,却不能使普通思想轻易抵达顶峰,甚至高分论文也面临实际进入壁垒。结果并非非此即彼,而是融合了功绩制与网络论的双重视角。

原文摘要 · Abstract (English)

Does scientific publishing reward the quality of ideas or the advantage of connections? The question is universal to prestige-driven science, yet it has resisted decades of study because a paper's quality could not be gauged ahead of its publication fate without using that fate as the yardstick. We break this constraint by measuring a paper's idea quality directly from its text, before publication, using a discipline-trained LLM evaluator that scores the idea without seeing author names or outcomes. Using economics as a case study, we combine this text-legible idea-quality score with an execution-quality rubric, a connection index, an author-ability index, and an off-the-shelf language-model text score to estimate a five-input production function for journal placement across 6,208 economics working papers. The inputs are not rivals but a sequence along the ladder of prestige. Execution sets a meritocratic floor and is the largest input overall. Text-legible idea quality grades the rungs in between. Connections set a favoritism ceiling that bites mainly near the apex, the most selective journals. Connections work through two additive channels: connected authors write papers that score higher, and at equal scores their papers are still more likely to place better. Yet this advantage is bounded. Connections raise the odds of every rung without making the apex the typical outcome for ordinary ideas, and even the highest-scoring papers face real friction reaching the visible journal ladder. The result nests, rather than chooses between, the meritocracy and network accounts of how science is published.

科研评价因果推断大模型应用学术出版

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。