用字形驱动微调,提升大模型分析汉字演变的能力。
Enhancing Multimodal Large Language Models for Ancient Chinese Character Evolution Analysis via Glyph-Driven Fine-Tuning
- 设计字形驱动微调框架,强化模型对字形演变的理解
- 在13万+样本上测试,2B模型性能全面显著提升
- 适合研究古文字、历史语言学与多模态模型的学者
近年来,多模态大模型(MLLMs)的快速发展推动了古汉字研究的进展。汉字演变是理解文化传承与历史延续的核心路径,但如何系统性利用MLLMs支持文本演化分析仍是未充分探索的问题。为此,我们构建了一个包含11项任务、超过130,000个实例的综合性基准,用于评估MLLMs在古汉字演变分析中的能力。在多个主流MLLM上进行广泛评测发现,现有模型在字形层面比较上能力有限,核心任务如字符识别和演化推理表现仍严重受限。基于此,我们提出字形驱动微调框架(GEVO),显式引导模型捕捉字形变换中的演化一致性,增强对文本演化的理解。实验表明,即使2B规模的模型也在所有任务中实现持续且全面的性能提升。为促进后续研究,我们公开发布该基准及训练模型(https://github.com/songruiecho/GEVO)。
原文摘要 · Abstract (English)
In recent years, rapid advances in Multimodal Large Language Models (MLLMs) have increasingly stimulated research on ancient Chinese scripts. As the evolution of written characters constitutes a fundamental pathway for understanding cultural transformation and historical continuity, how MLLMs can be systematically leveraged to support and advance text evolution analysis remains an open and largely underexplored problem. To bridge this gap, we construct a comprehensive benchmark comprising 11 tasks and over 130,000 instances, specifically designed to evaluate the capability of MLLMs in analyzing the evolution of ancient Chinese scripts. We conduct extensive evaluations across multiple widely used MLLMs and observe that, while existing models demonstrate a limited ability in glyph-level comparison, their performance on core tasks-such as character recognition and evolutionary reasoning-remains substantially constrained. Motivated by these findings, we propose a glyph-driven fine-tuning framework (GEVO) that explicitly encourages models to capture evolutionary consistency in glyph transformations and enhances their understanding of text evolution. Experimental results show that even models at the 2B scale achieve consistent and comprehensive performance improvements across all evaluated tasks. To facilitate future research, we publicly release both the benchmark and the trained models\footnote{https://github.com/songruiecho/GEVO}.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。