arXiv:2605.21090cs.CV2026-05

构建首个大规模场景文字编辑数据集与评测基准,提升开源模型性能。

TextSculptor: Training and Benchmarking Scene Text Editing

论文配图:TextSculptor: Training and Benchmarking Scene Text Editing
图 1 · 摘自论文原文
  • 自动化合成文本感知图像,生成320万带校验的训练样本。
  • 在四类文字编辑任务中显著提升准确性与视觉一致性,接近闭源模型水平。
  • 适合研究图文生成、视觉语言模型及真实场景内容编辑的开发者使用。

多模态大模型与基于扩散的生成模型虽已推动提示驱动的图像编辑发展,但场景文字编辑仍具挑战,需精准修改文字内容的同时保持视觉真实性和非目标区域一致。当前开源模型性能落后于闭源系统,主因是高质量训练数据稀缺且缺乏针对性评测基准。为此,我们提出TextSculptor框架,涵盖数据构建与评估。首先设计自动化数据构建流程,结合文本感知图像合成、程序化文本渲染与合成技术;据此构建TextSculpt-Data数据集,包含320万训练样本,其中120万经OCR验证的图文对,以及200万具有自然对齐源-目标图像和强背景一致性的成对编辑样本。进一步推出TextSculpt-Bench评测基准,覆盖文字添加、替换、删除与混合编辑四类基础任务。为保障评估可靠性,设计定制协议,通过OCR对齐、多模态判断与背景区域相似性度量文本准确率、视觉质量与背景保留效果。大量实验表明,TextSculptor显著提升开源模型性能,缩小与闭源模型差距。数据与基准已开源:https://github.com/linyiheng123/TextSculptor。

原文摘要 · Abstract (English)

Recent advances in Multimodal Large Language Models (MLLMs) and diffusion-based generative models have substantially improved prompt-driven image editing. However, scene text editing remains challenging, as it requires models to precisely modify textual content while preserving visual realism and non-target regions. Current open-source models still lag behind proprietary systems, largely due to the scarcity of high-quality training data and the lack of standardized benchmarks tailored to text editing. To address these challenges, we present TextSculptor, a comprehensive framework for data construction and evaluation of scene text editing. We first develop an automated data construction pipeline that combines text-aware image synthesis with programmatic text rendering and compositing. Based on this pipeline, we build TextSculpt-Data, a large-scale dataset containing 3.2M training samples, including 1.2M OCR-verified text-to-image samples and 2M paired text editing samples with naturally aligned source-target images and strong background consistency. We further introduce TextSculpt-Bench, a benchmark covering four fundamental text editing tasks: text addition, text replacement, text removal, and hybrid editing. To support reliable evaluation, we design a tailored protocol that measures text accuracy, visual quality, and background preservation through OCR-based text alignment, multimodal judgment, and background-region similarity. Extensive experiments show that TextSculptor improves open-source text editing performance and narrows the gap to proprietary models. The data and benchmark are available at https://github.com/linyiheng123/TextSculptor.

文本编辑图像生成数据集多模态

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。