arXiv:2506.20844cs.IRcs.CL2025-06中稿 · ACM SIGIR Conferen…被引 7

针对复杂学术论文的科学事实核查,提出五大核心挑战与解决方案。

The Next Phase of Scientific Fact-Checking: Advanced Evidence Retrieval from Complex Structured Academic Papers

  • 构建面向完整论文的证据检索系统,突破摘要级简化限制。
  • 发现时间感知与结构解析能显著提升证据相关性与时效性。
  • 适合科研人员、期刊编辑及AI辅助审稿工具开发者参考。

科学事实核查旨在通过从研究文献中检索和分析证据来判断科学主张的真实性。该问题比一般事实核查更为复杂,需应对科学知识的动态演变、学术文献的结构复杂性以及长篇多模态表达带来的挑战。现有方法多基于小规模数据集的摘要而非全文,回避了处理完整文档的独特难题。本文分析现有系统的局限性,揭示可挖掘的潜在特征与资源,识别证据检索中的关键挑战:(1)基于证据的检索以克服语义局限与主题不平衡;(2)结合引文追踪的时间感知检索以减少过时信息影响;(3)结构化文档解析以利用长程上下文;(4)处理包含表格、图表和领域术语的复杂科学表达;(5)评估科学文献可信度。初步实验验证了这些挑战并探索可行解法。本文为真实应用场景下的专用信息检索系统推动科学事实核查发展提供新视角。

原文摘要 · Abstract (English)

Scientific fact-checking aims to determine the veracity of scientific claims by retrieving and analysing evidence from research literature. The problem is inherently more complex than general fact-checking since it must accommodate the evolving nature of scientific knowledge, the structural complexity of academic literature and the challenges posed by long-form, multimodal scientific expression. However, existing approaches focus on simplified versions of the problem based on small-scale datasets consisting of abstracts rather than full papers, thereby avoiding the distinct challenges associated with processing complete documents. This paper examines the limitations of current scientific fact-checking systems and reveals the many potential features and resources that could be exploited to advance their performance. It identifies key research challenges within evidence retrieval, including (1) evidence-driven retrieval that addresses semantic limitations and topic imbalance (2) time-aware evidence retrieval with citation tracking to mitigate outdated information, (3) structured document parsing to leverage long-range context, (4) handling complex scientific expressions, including tables, figures, and domain-specific terminology and (5) assessing the credibility of scientific literature. Preliminary experiments were conducted to substantiate these challenges and identify potential solutions. This perspective paper aims to advance scientific fact-checking with a specialised IR system tailored for real-world applications.

科学核查证据检索学术文档信息检索

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。