让AI像艺术专家一样评估中国画,提升生成质量
HanMoVLM: Large Vision-Language Models for Professional Artistic Painting Evaluation
- 构建链式思维推理框架,引导AI分步完成内容识别与专业评价
- 在真实拍卖级画作数据集上达到与专家高度一致的评估一致性
- 可作为生成模型的高质量验证器,提升艺术创作输出水准
尽管大视觉语言模型具备强大的通用视觉能力,但在特定艺术领域(如中国画)仍缺乏专业评估能力。为此,我们构建了面向中文艺术领域的专业评估模型HanMoVLM,引入真实拍卖级大师作品与AI生成作品组成的汉墨基准数据集(HanMo-Bench),基于真实市场估值。通过专家验证的链式思维(CoT)引导模型完成从内容识别、兴趣区域定位到主题化与三层次专业评价的完整推理流程,并设计奖励函数优化推理路径。实验与人工评测表明,该模型能有效缩小与专业评审者间的差距,在图像生成中作为高精度验证器,显著提升中国画生成质量。
原文摘要 · Abstract (English)
While Large Vision-Language Models (VLMs) demonstrate impressive general visual capabilities, they remain artistically blind and unable to offer professional evaluation of artworks within specific artistic domains like human experts. To bridge this gap, we transform VLMs into experts capable of professional-grade painting evaluation in the Chinese Artistic Domain, which is more abstract and demands extensive artistic training for evaluation. We introduce HanMo-Bench, a new dataset that features authentic auction-grade masterpieces and AI-generated works, grounded in real-world market valuations. To realize the rigorous judgment, we propose the HanMoVLM and construct a Chain-of-Thought (CoT) validated by experts. This CoT guides the model to perform expert-level reasoning: from content identification and Region of Interest (RoI) localization to professional evaluation, guided by both theme-specific evaluation and typical three-tier evaluation in Chinese paintings. Furthermore, we design a reward function to refine the reasoning process of the HanMoVLM to improve the accuracy. We demonstrate that HanMoVLM can serve as a critical backbone for Test-time Scaling in image generation. By acting as a high-quality verifier, HanMoVLM enables generative models to select the most artistically superior outputs from multiple candidates. Experimental results and human studies confirm that the proposed HanMoVLM effectively bridges the gap, achieving a high consistency with professional experts and significantly improving the quality of Chinese Painting generation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。