提出新基准LTB,揭示文本检测在长尾分布下的真实短板
The Devil is in Fine-tuning and Long-tailed Problems:A New Benchmark for Scene Text Detection
- 通过联合数据集学习缓解微调带来的领域特异性偏差
- 发现真实场景中罕见和复杂文本检测错误率高达42%
- 适合关注实际应用性能的计算机视觉研究者
场景文本检测虽在学术基准上表现优异,但在真实场景中常失效。我们通过大量实验揭示两大原因:一是微调偏差,即模型采用数据集特异性优化(DSO)提升单一领域性能却损害泛化能力;二是长尾分布问题,模型对罕见或复杂文本(如艺术字、重叠文本)识别效果差。为此,我们提出联合数据集学习(JDL)协议以缓解微调偏差,并构建长尾基准(LTB),系统评估13类长尾挑战。此外,提出基于自监督学习的MAEDet作为新基准基线。代码已开源。
原文摘要 · Abstract (English)
Scene text detection has seen the emergence of high-performing methods that excel on academic benchmarks. However, these detectors often fail to replicate such success in real-world scenarios. We uncover two key factors contributing to this discrepancy through extensive experiments. First, a \textit{Fine-tuning Gap}, where models leverage \textit{Dataset-Specific Optimization} (DSO) paradigm for one domain at the cost of reduced effectiveness in others, leads to inflated performances on academic benchmarks. Second, the suboptimal performance in practical settings is primarily attributed to the long-tailed distribution of texts, where detectors struggle with rare and complex categories as artistic or overlapped text. Given that the DSO paradigm might undermine the generalization ability of models, we advocate for a \textit{Joint-Dataset Learning} (JDL) protocol to alleviate the Fine-tuning Gap. Additionally, an error analysis is conducted to identify three major categories and 13 subcategories of challenges in long-tailed scene text, upon which we propose a Long-Tailed Benchmark (LTB). LTB facilitates a comprehensive evaluation of ability to handle a diverse range of long-tailed challenges. We further introduce MAEDet, a self-supervised learning-based method, as a strong baseline for LTB. The code is available at https://github.com/pd162/LTB.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。