arXiv:2605.13027cs.CV2026-05

PRISM通过修正文本先验和感知结构不确定性,提升低质文本图像的超分辨率效果。

PRISM: Prior Rectification and Uncertainty-Aware Structure Modeling for Diffusion-Based Text Image Super-Resolution

论文配图:PRISM: Prior Rectification and Uncertainty-Aware Structure Modeling for Diffusion-Based Text Image Super-Resolution
图 1 · 摘自论文原文
  • 用流匹配构建训练时的优质先验,修正低质输入的不可靠条件
  • 提出不确定性感知结构残差编码器,精准保留清晰笔画边界
  • 单步扩散架构实现毫秒级推理,适合实际应用

文本图像超分辨率不仅需生成视觉逼真的细节,细微的笔画拓扑错误可能改变字符身份并影响可读性。现有方法虽借助更强的识别或生成先验提升文本保真度,但在严重退化下仍面临两大挑战:从低质量输入中提取的文本条件本身不可靠,且合理的全局先验无法完全确定细粒度笔画边界。本文提出PRISM,一种单步扩散基文本超分辨率框架,通过流匹配先验修正(FMPR)与结构引导的不确定性感知残差编码器(SURE)解决上述问题。FMPR利用成对的低质/高质量潜在表示构建训练时特权先验,并学习流匹配过程,将退化嵌入映射至以修复为导向的先验空间,从而获得更准确可靠的全局文本引导。SURE进一步预测不确定性感知的结构残差,选择性吸收可靠的局部边界信息,同时抑制模糊的笔画线索。二者协同实现在单次扩散修复过程中显式地进行全局先验修正与局部结构精炼。在合成与真实世界基准上的实验表明,PRISM达到当前最优性能,推理速度达毫秒级。代码与数据集将开源于https://github.com/faithxuz/PRISM。

原文摘要 · Abstract (English)

Text image super-resolution (Text-SR) requires more than visually plausible detail synthesis: slight errors in stroke topology may alter character identity and break readability. Existing methods improve text fidelity with stronger recognition-based or generative priors, yet they still face two unresolved challenges under severe degradation: the text condition extracted from low-quality inputs can itself be unreliable, and a plausible global prior does not fully determine fine-grained stroke boundaries. We present PRISM, a single-step diffusion-based Text-SR framework that addresses these two challenges through Flow-Matching Prior Rectification (FMPR) and a Structure-guided Uncertainty-aware Residual Encoder (SURE). FMPR constructs a privileged training-time prior from paired low-quality/high-quality latents and learns a flow matching that transports degraded embeddings toward this restoration-oriented prior space, yielding more accurate and reliable global text guidance. SURE further predicts uncertainty-aware structural residuals to selectively absorb reliable local boundary evidence while suppressing ambiguous stroke cues. Together, these components enable explicit global prior rectification and local structure refinement within a single diffusion restoration pass. Experiments on both synthetic and real-world benchmarks show that PRISM achieves state-of-the-art performance with millisecond-level inference. Our dataset and code will be available at https://github.com/faithxuz/PRISM.

文本超分扩散模型结构建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。