arXiv:2605.16810cs.CV2026-05

无需训练即可生成文字被遮挡的图像,让文字和遮挡物位置精准对齐。

Training-Free Occluded Text Rendering via Glyph Priors and Attention-Guided Semantic Blending

论文配图:Training-Free Occluded Text Rendering via Glyph Priors and Attention-Guided Semantic Blending
图 1 · 摘自论文原文
  • 分双流推理:一路保文字布局,一路加遮挡物。
  • 用字形先验稳定文字结构,提升识别率。
  • 适合需要快速生成真实感遮挡文字的场景。

我们提出一种基于预训练FLUX.1-dev骨干网络的无训练遮挡文本渲染框架。该任务要求模型生成可读的文字,并在目标区域叠加遮挡物。现有文本到图像生成器常出现遮挡物偏移或文字扭曲、悬浮等问题。为此,我们设计重启式双流推理机制,分离文字布局保持与遮挡物插入过程。基础流提供干净的排版参考及同步的键值(K/V)特征,编辑流则受遮挡提示条件约束。进一步借鉴FreeText中的频谱字形先验思想,将其适配至早期至中期去噪阶段以稳定目标文字结构。在推理阶段,方法定位目标文字,通过标记条件注意力与字形支持估计文本带区域,并生成锚点感知的硬融合掩码用于遮挡物。最终编辑阶段从相同初始噪声重启,选择性地在注意力节点处进行硬掩码引导的图像标记K/V替换,保留掩码外的基础布局,同时在掩码内注入编辑流的遮挡物外观。在典型遮挡文本场景下的实验表明,该方法显著提升文字可读性并实现具有竞争力的遮挡对齐,生成更稳定的物体-文字组合,且无需任何模型微调。

原文摘要 · Abstract (English)

We present a training-free framework for occluded text rendering with a pretrained FLUX.1-dev backbone. The task requires a model to render recognizable typography and place an occluding object over the intended text region. This setting remains difficult for existing text-to-image generators: the occluder often drifts away from the text, while the text may be distorted or appear to float on top of the occluding object. To address this problem, we propose a restarted dual-stream inference framework that decouples text-layout preservation from occluder insertion. A Base Stream provides a clean typographic reference and same-step key/value (K/V) features, while the Edit Stream is conditioned on the occlusion prompt. We further adopt the spectral glyph-prior idea from FreeText and adapt it to stabilize the target text structure during early-to-mid denoising. In the reasoning pass, our method localizes the target text, estimates a text-band region from token-conditioned attention and glyph support, and derives an anchor-aware hard fusion mask for the occluder. In the final edit pass, generation restarts from the same initial noise and applies hard mask-guided image-token K/V replacement at selected attention sites, preserving the Base layout outside the mask while injecting the occluder appearance from the Edit Stream inside the mask. Experiments on representative occluded text scenarios demonstrate substantially improved text readability and competitive occlusion alignment, yielding more stable object-on-text compositions without any model fine-tuning.

文本生成图像合成无训练

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。