用少量标注样本实现精准文本分割,关键在捕捉文本属性特征。
Learning Attribute-aware Representations for Few-shot Scene Text Segmentation
- 通过视觉与提示双分支学习文本语义和纹理特征。
- 仅需少量样本即可达到当前最优分割效果。
- 适合数据稀缺场景下的文本识别与分割任务。
近年来,监督式场景文本分割取得了显著进展,但其发展受限于高质量数据集的缺乏和像素级标注的高昂成本。为解决这一问题,我们探索了少样本学习在文本分割中的应用,提出TSAL框架——一种属性感知的少样本分割方法。该框架利用预训练的CLIP模型学习可迁移的文本属性特征,包含两个互补分支:1)视觉引导分支,分别提取前景文本与背景区域的语义和纹理特征;2)自适应提示引导分支,采用可学习提示模板,在低数据依赖下捕捉多样化的文本属性。为进一步对齐文本属性与视觉表示,引入自适应特征对齐(AFA)模块,将可学习属性标记与视觉特征及提示原型对齐,使模型能同时捕获通用与独特文本特征。实验表明,TSAL在多个公开文本分割基准上均取得少样本设置下的最优性能,并展现出对文本相关任务的强大泛化能力。
原文摘要 · Abstract (English)
Supervised scene text segmentation has achieved notable progress in recent years. However, its development is largely constrained by the scarcity of high-quality datasets and the high cost of pixel-level annotations. To address this limitation, we explore few-shot learning for text segmentation and propose TSAL, an attribute-aware few-shot framework that leverages a pre-trained CLIP model to learn transferable text attributes for segmentation. Our framework comprises two complementary branches: I) a Visual-Guided Branch that extracts semantic and textural features for foreground text and background regions, respectively, and II) an Adaptive Prompt-Guided Branch that employs learnable prompt templates to capture diverse text attributes with minimal data dependence. To effectively align textual attributes with visual representations, we further introduce an Adaptive Feature Alignment~(AFA) module, which aligns learnable attribute tokens with visual features and prompt prototypes, enabling the model to capture both general and distinctive textual characteristics. As a result, TSAL can accurately segment text regions using only a few annotated samples. Extensive experiments demonstrate that our method achieves state-of-the-art performance across several public text segmentation benchmarks under few-shot settings and exhibits strong generalization to text-related tasks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。