AI助力文献综述自动化,但全流程智能仍待突破
Transforming Evidence Synthesis: A Systematic Review of the Evolution of Automated Meta-Analysis in the Age of AI
- 构建系统评估框架,分析54项研究的自动化进展
- 仅17%研究覆盖高级综合阶段,仅1项实现全流程自动化
- 适合关注AI在科研合成中应用前景的研究者
科学文献指数级增长推动了高效循证综合的需求,促使基于自然语言处理与机器学习的自动化元分析(AMA)兴起。本篇遵循PRISMA指南的系统综述,筛选2006至2024年间978篇论文,分析54项跨领域研究。结果显示,57%的研究聚焦数据处理自动化(如信息提取与统计建模),仅17%涉及高级综合阶段,仅有1项(2%)探索全流程自动化,暴露出制约全面综合能力的关键短板。尽管大语言模型(LLMs)等先进AI取得突破,其在统计建模及异质性评估、偏倚评价等高阶综合任务中的整合仍不充分,限制了AMA实现完全自主元分析的潜力。数据集涵盖医学(67%)与非医学(33%)应用,显示自动化在提升效率、可扩展性与可重复性方面效果不一。虽特定任务已获改善,但端到端无缝自动化仍是开放挑战。随着AI在推理与上下文理解上的演进,亟需弥合各阶段自动化鸿沟,提升可解释性与方法稳健性,以实现可扩展、跨领域的自动化综合。
原文摘要 · Abstract (English)
Exponential growth in scientific literature has heightened the demand for efficient evidence-based synthesis, driving the rise of the field of Automated Meta-analysis (AMA) powered by natural language processing and machine learning. This PRISMA systematic review introduces a structured framework for assessing the current state of AMA, based on screening 978 papers from 2006 to 2024, and analyzing 54 studies across diverse domains. Findings reveal a predominant focus on automating data processing (57%), such as extraction and statistical modeling, while only 17% address advanced synthesis stages. Just one study (2%) explored preliminary full-process automation, highlighting a critical gap that limits AMA's capacity for comprehensive synthesis. Despite recent breakthroughs in large language models (LLMs) and advanced AI, their integration into statistical modeling and higher-order synthesis, such as heterogeneity assessment and bias evaluation, remains underdeveloped. This has constrained AMA's potential for fully autonomous meta-analysis. From our dataset spanning medical (67%) and non-medical (33%) applications, we found that AMA has exhibited distinct implementation patterns and varying degrees of effectiveness in actually improving efficiency, scalability, and reproducibility. While automation has enhanced specific meta-analytic tasks, achieving seamless, end-to-end automation remains an open challenge. As AI systems advance in reasoning and contextual understanding, addressing these gaps is now imperative. Future efforts must focus on bridging automation across all meta-analysis stages, refining interpretability, and ensuring methodological robustness to fully realize AMA's potential for scalable, domain-agnostic synthesis.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。