用AI批量分析古籍插图,发现跨文献艺术关联
Studying Illustrations in Manuscripts: An Efficient Deep-Learning Approach
- 构建端到端深度学习流水线,自动检测与提取插图
- 在梵蒂冈图书馆等多源数据中识别出有意义的视觉模式
- 适合艺术史、文化传承研究者开展大规模图像比较
人工智能革命为人文领域带来变革性可能,尤其在挖掘历史手稿中嵌入的视觉艺术内容方面。尽管数字档案已提供前所未有的访问便利,但系统化地大规模定位、提取与分析插图仍是重大挑战。本文提出一种通用且可扩展的AI分析框架,整合现代深度学习模型实现页面级插图检测、插图提取与多模态描述,使学者能够对整个文献库中的视觉材料和艺术趋势进行搜索、聚类与研究。该方法在大型异构集合(如梵蒂冈图书馆及《波尔索·德·埃斯特圣经》等精美手稿)上得到验证,通过将插图嵌入共享表示空间并分析其相似性结构,揭示了有意义的视觉规律与跨手稿关联(见图4)。借助计算机视觉与视觉-语言模型的最新进展,本框架推动了历史研究、艺术史与文化遗产领域的规模化视觉学术探索,使得以往难以实现的图像志、风格演变与文化联系研究成为可能。
原文摘要 · Abstract (English)
The recent Artificial Intelligence (AI) revolution has opened transformative possibilities for the humanities, particularly in unlocking the visual-artistic content embedded in historical illuminated manuscripts. While digital archives now offer unprecedented access to these materials, the ability to systematically locate, extract, and analyze illustrations at scale remains a major challenge. We present a general and scalable AI-based pipeline for large-scale visual analysis of illuminated manuscripts. The framework integrates modern deep-learning models for page-level illustration detection, illustration extraction, and multimodal description, enabling scholars to search, cluster, and study visual materials and artistic trends across entire corpora. We demonstrate the applicability of this approach on large heterogeneous collections, including the Vatican Library and richly illuminated manuscripts such as the Bible of Borso d'Este. The system reveals meaningful visual patterns and cross-manuscript relationships by embedding illustrations into a shared representation space and analyzing their similarity structure (see figure 4). By harnessing recent advances in computer vision and vision-language models, our framework enables new forms of large-scale visual scholarship in historical studies, art history, and cultural heritage making it possible to explore iconography, stylistic trends, and cultural connections in ways that were previously impractical.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。