arXiv:2507.02212cs.CVcs.CL2025-07中稿 · CVPR被引 2

构建14.5万篇论文的图文数据集,助力科学图摘要自动设计

SciGA: A Comprehensive Dataset for Designing Graphical Abstracts in Academic Papers

  • 构建包含145,000篇论文与114万张图的SciGA数据集
  • 提出跨文与文中图摘要推荐任务,准确率显著提升
  • 设计新评估指标CAR,更合理衡量图摘要推荐效果

图摘要(Graphical Abstracts, GAs)在视觉传达学术论文核心发现中起关键作用。尽管近期研究越来越多地将图1等图表作为事实上的图摘要,但其在科学传播中的潜力尚未充分探索。设计有效图摘要需高阶可视化能力,限制了其广泛应用。为应对这些挑战,我们提出SciGA-145k,一个大规模数据集,包含约14.5万篇科学论文和114万张图,专用于支持图摘要选择与推荐,并推动自动化图摘要生成研究。作为初步步骤,我们定义两个任务:1)文中图摘要推荐(Intra-GA Recommendation),识别某篇论文内适合作为图摘要的图表;2)跨文图摘要推荐(Inter-GA Recommendation),从其他论文中检索灵感图摘要。此外,我们提出置信度调整的top-1真实标签比率(CAR),一种新型推荐评估指标,通过考虑除明确标注的图摘要外,其他论文内图也可能合理作为图摘要,克服传统基于排名指标的局限。基准实验验证了任务可行性与CAR有效性。总体而言,这些工作为人工智能赋能科学传播奠定了基础。

原文摘要 · Abstract (English)

Graphical Abstracts (GAs) play a crucial role in visually conveying the key findings of scientific papers. Although recent research increasingly incorporates visual materials such as Figure 1 as de facto GAs, their potential to enhance scientific communication remains largely unexplored. Designing effective GAs requires advanced visualization skills, hindering their widespread adoption. To tackle these challenges, we introduce SciGA-145k, a large-scale dataset comprising approximately 145,000 scientific papers and 1.14 million figures, specifically designed to support GA selection and recommendation, and to facilitate research in automated GA generation. As a preliminary step toward GA design support, we define two tasks: 1) Intra-GA Recommendation, identifying figures within a given paper well-suited as GAs, and 2) Inter-GA Recommendation, retrieving GAs from other papers to inspire new GA designs. Furthermore, we propose Confidence Adjusted top-1 ground truth Ratio (CAR), a novel recommendation metric for fine-grained analysis of model behavior. CAR addresses limitations of traditional rank-based metrics by considering that not only an explicitly labeled GA but also other in-paper figures may plausibly serve as GAs. Benchmark results demonstrate the viability of our tasks and the effectiveness of CAR. Collectively, these establish a foundation for advancing scientific communication within AI for Science.

图摘要数据集AI for Science推荐系统

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。