arXiv:2410.22922cs.CV2024-10中稿 · WACV2025被引 38

构建首个大规模文档污渍数据集,用记忆增强Transformer实现高保真去污。

High-Fidelity Document Stain Removal via A Large-Scale Real-World Dataset and A Memory-Augmented Transformer

  • 提出记忆增强Transformer,分层捕捉污渍特征
  • 在5000+图像对上实现优于现有方法的去污效果
  • 适合文档修复、历史文献数字化研究者使用

文档图像常因各类污渍退化,严重影响可读性并阻碍文档数字化与分析。现有方法受限于缺乏全面的污渍文档数据集。为此,我们构建了首个大规模高分辨率(2145×2245)的文档污渍去除专用数据集StainDoc,包含超过5000对不同场景下的污渍与清洁文档图像,涵盖多样污渍类型、严重程度及背景。同时提出基于Transformer的StainRestorer方法,其通过DocMemory模块在局部、实例和语义层面捕获层级污渍表示,并利用双注意力机制——扩展感受野的空间注意力与通道注意力——实现精准去污且保留内容完整性。大量实验表明,StainRestorer在StainDoc及其变体StainDoc_Mark和StainDoc_Seal上均显著超越现有方法,树立新基准。本工作验证了记忆增强Transformer在该任务中的潜力,并为后续研究提供宝贵数据资源。

原文摘要 · Abstract (English)

Document images are often degraded by various stains, significantly impacting their readability and hindering downstream applications such as document digitization and analysis. The absence of a comprehensive stained document dataset has limited the effectiveness of existing document enhancement methods in removing stains while preserving fine-grained details. To address this challenge, we construct StainDoc, the first large-scale, high-resolution ($2145\times2245$) dataset specifically designed for document stain removal. StainDoc comprises over 5,000 pairs of stained and clean document images across multiple scenes. This dataset encompasses a diverse range of stain types, severities, and document backgrounds, facilitating robust training and evaluation of document stain removal algorithms. Furthermore, we propose StainRestorer, a Transformer-based document stain removal approach. StainRestorer employs a memory-augmented Transformer architecture that captures hierarchical stain representations at part, instance, and semantic levels via the DocMemory module. The Stain Removal Transformer (SRTransformer) leverages these feature representations through a dual attention mechanism: an enhanced spatial attention with an expanded receptive field, and a channel attention captures channel-wise feature importance. This combination enables precise stain removal while preserving document content integrity. Extensive experiments demonstrate StainRestorer's superior performance over state-of-the-art methods on the StainDoc dataset and its variants StainDoc\_Mark and StainDoc\_Seal, establishing a new benchmark for document stain removal. Our work highlights the potential of memory-augmented Transformers for this task and contributes a valuable dataset to advance future research.

文档去污Transformer图像修复数据集

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。