构建8000张学术海报结构数据集,提升复杂空间关系识别能力
SciPostLayoutTree: A Dataset for Structural Analysis of Scientific Posters
- 基于视觉与框位置信息设计布局树解码器
- 对远距离等复杂关系的预测准确率显著提升
- 适合研究海报可视化、结构分析的学者使用
学术海报通过视觉化方式呈现研究内容,在学术交流中至关重要。分析海报的阅读顺序和父子关系,有助于构建结构感知界面,提升内容理解的清晰性与准确性。尽管海报广泛用于学术交流,其结构分析仍被忽视,现有研究主要集中在论文上。为填补这一空白,我们构建了包含约8000张海报的SciPostLayoutTree数据集,标注了阅读顺序与父子关系。相比已有数据集,该数据集包含更多空间挑战性关系,如上下、水平及长距离关系。为此,我们提出布局树解码器(Layout Tree Decoder),融合视觉特征与边界框特征(含位置和类别信息),并采用束搜索预测关系,同时捕捉序列层面合理性。实验表明,该模型在复杂空间关系预测上表现更优,为海报结构分析建立了可靠基线。数据集与代码已公开于https://huggingface.co/datasets/omron-sinicx/scipostlayouttree 和 https://github.com/omron-sinicx/scipostlayouttree。
原文摘要 · Abstract (English)
Scientific posters play a vital role in academic communication by presenting ideas through visual summaries. Analyzing reading order and parent-child relations of posters is essential for building structure-aware interfaces that facilitate clear and accurate understanding of research content. Despite their prevalence in academic communication, posters remain underexplored in structural analysis research, which has primarily focused on papers. To address this gap, we constructed SciPostLayoutTree, a dataset of approximately 8,000 posters annotated with reading order and parent-child relations. Compared to an existing structural analysis dataset, SciPostLayoutTree contains more instances of spatially challenging relations, including upward, horizontal, and long-distance relations. As a solution to these challenges, we develop Layout Tree Decoder, which incorporates visual features as well as bounding box features including position and category information. The model also uses beam search to predict relations while capturing sequence-level plausibility. Experimental results demonstrate that our model improves the prediction accuracy for spatially challenging relations and establishes a solid baseline for poster structure analysis. The dataset is publicly available at https://huggingface.co/datasets/omron-sinicx/scipostlayouttree. The code is also publicly available at https://github.com/omron-sinicx/scipostlayouttree.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。