arXiv:2601.19898cs.CV2026-01Conference of the …

构建阿拉伯书法多模态基准,推动AI理解艺术化文字

DuwatBench: Bridging Language and Visual Heritage through an Arabic Calligraphy Benchmark for Multimodal Understanding

  • 设计包含1272样本的阿拉伯书法数据集,覆盖6种风格
  • 13个模型在手写体上准确率低于50%,暴露出识别瓶颈
  • 适合关注文化传承与多模态理解的研究者使用

阿拉伯书法是阿拉伯语最丰富的视觉传统之一,融合语言意义与艺术形式。尽管多模态模型在多种语言中取得进展,但对艺术化、风格化的阿拉伯书法文本处理仍研究不足。为此,我们提出DuwatBench,一个包含1,272个精心筛选样本的数据集,涵盖约1,475个独特词汇,覆盖六种古典与现代书法风格,每条样本均配有句子级检测标注。数据集反映真实书写挑战,如复杂笔画、密集连字和风格差异,常导致标准文本识别系统失效。利用该数据集,我们评估了13个主流阿拉伯语及多语言多模态模型,发现它们在干净文本上表现良好,但在书法变体、艺术扭曲和精确图文对齐方面表现不佳。通过公开发布DuwatBench及其标注,我们旨在推动以文化为根基的多模态研究,促进阿拉伯语及视觉遗产在人工智能中的公平融入,并支持该领域持续进步。数据集(https://huggingface.co/datasets/MBZUAI/DuwatBench)与评测工具(https://github.com/mbzuai-oryx/DuwatBench)已公开。

原文摘要 · Abstract (English)

Arabic calligraphy represents one of the richest visual traditions of the Arabic language, blending linguistic meaning with artistic form. Although multimodal models have advanced across languages, their ability to process Arabic script, especially in artistic and stylized calligraphic forms, remains largely unexplored. To address this gap, we present DuwatBench, a benchmark of 1,272 curated samples containing about 1,475 unique words across six classical and modern calligraphic styles, each paired with sentence-level detection annotations. The dataset reflects real-world challenges in Arabic writing, such as complex stroke patterns, dense ligatures, and stylistic variations that often challenge standard text recognition systems. Using DuwatBench, we evaluated 13 leading Arabic and multilingual multimodal models and showed that while they perform well on clean text, they struggle with calligraphic variation, artistic distortions, and precise visual-text alignment. By publicly releasing DuwatBench and its annotations, we aim to advance culturally grounded multimodal research, foster fair inclusion of the Arabic language and visual heritage in AI systems, and support continued progress in this area. Our dataset (https://huggingface.co/datasets/MBZUAI/DuwatBench) and evaluation suit (https://github.com/mbzuai-oryx/DuwatBench) are publicly available.

多模态阿拉伯语书法识别文化传承

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。