提出细粒度评估框架,精准衡量幻灯片生成质量。
PresentBench: A Fine-Grained Rubric-Based Benchmark for Slide Generation
- 设计238个实例+54.1项二元检查项,实现逐项评估
- 实验显示该基准与人工偏好更一致,结果更可靠
- 发现NotebookLM在生成质量上显著领先其他方法
幻灯片是学术、教育和商业场景中传递信息的关键载体。尽管重要,但制作高质量幻灯片仍耗时且认知负担重。近期生成模型(如Nano Banana Pro)使自动化幻灯片生成成为可能,但现有评估方式多为粗粒度整体判断,难以准确评估模型能力或追踪领域进展。本文提出PresentBench,一个基于评分量表的细粒度幻灯片生成评估基准,包含238个评估实例,每个实例配有生成所需背景材料,并由人工设计平均54.1项二元检查项,支持针对具体实例的精细评估。大量实验表明,PresentBench比现有方法提供更可靠的评估结果,且与人类偏好高度一致。此外,该基准揭示NotebookLM显著优于其他生成方法,反映出该领域的显著进步。
原文摘要 · Abstract (English)
Slides serve as a critical medium for conveying information in presentation-oriented scenarios such as academia, education, and business. Despite their importance, creating high-quality slide decks remains time-consuming and cognitively demanding. Recent advances in generative models, such as Nano Banana Pro, have made automated slide generation increasingly feasible. However, existing evaluations of slide generation are often coarse-grained and rely on holistic judgments, making it difficult to accurately assess model capabilities or track meaningful advances in the field. In practice, the lack of fine-grained, verifiable evaluation criteria poses a critical bottleneck for both research and real-world deployment. In this paper, we propose PresentBench, a fine-grained, rubric-based benchmark for evaluating automated real-world slide generation. It contains 238 evaluation instances, each supplemented with background materials required for slide creation. Moreover, we manually design an average of 54.1 checklist items per instance, each formulated as a binary question, to enable fine-grained, instance-specific evaluation of the generated slide decks. Extensive experiments show that PresentBench provides more reliable evaluation results than existing methods, and exhibits significantly stronger alignment with human preferences. Furthermore, our benchmark reveals that NotebookLM significantly outperforms other slide generation methods, highlighting substantial recent progress in this domain.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。