将文本特征转为视觉表示,用小数据实现高精度文档分类
WordVIS: A Color Worth A Thousand Words
- 把文本信息映射到图像空间,让轻量级图像模型直接处理文档
- 在Tobacco-3482数据集上达91.14%准确率,比之前提升4.64%
- 无需预训练、低算力,适合工业场景落地
文档分类是自动化文档处理系统的关键环节。近年来多模态方法在文档分类中日益流行,但因需要大量训练数据和高计算资源,尚未在工业界广泛应用。本文提出将文本特征直接嵌入视觉空间,使轻量级图像分类器在小规模数据集上实现前沿性能。为验证该方法在有限数据下的有效性,我们在标准数据集Tobacco-3482上进行测试。实验显示,使用ResNet50不进行文档预训练即可提升4.64%准确率;采用基于图像的DocXClassifier同样无需预训练,在Tobacco-3482上达到91.14%的新纪录。该方法简单高效,资源消耗低,具备良好的工业应用前景。
原文摘要 · Abstract (English)
Document classification is considered a critical element in automated document processing systems. In recent years multi-modal approaches have become increasingly popular for document classification. Despite their improvements, these approaches are underutilized in the industry due to their requirement for a tremendous volume of training data and extensive computational power. In this paper, we attempt to address these issues by embedding textual features directly into the visual space, allowing lightweight image-based classifiers to achieve state-of-the-art results using small-scale datasets in document classification. To evaluate the efficacy of the visual features generated from our approach on limited data, we tested on the standard dataset Tobacco-3482. Our experiments show a tremendous improvement in image-based classifiers, achieving an improvement of 4.64% using ResNet50 with no document pre-training. It also sets a new record for the best accuracy of the Tobacco-3482 dataset with a score of 91.14% using the image-based DocXClassifier with no document pre-training. The simplicity of the approach, its resource requirements, and subsequent results provide a good prospect for its use in industrial use cases.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。