arXiv:2412.09922cs.CL2024-12被引 5

通过计算类内类间距离,实现低资源快速文本分类

Low-Resource Fast Text Classification Based on Intra-Class and Inter-Class Distance Calculation

  • 构建每类压缩列表挖掘类内规律,减少冗余信息
  • 在9个数据集上提升分类性能与处理速度
  • 适合计算资源有限的实时分类场景

近年来基于神经网络和预训练模型的文本分类方法受到广泛关注,表现出优异性能。然而这些方法在实际应用中仍存在局限:(1) 通常仅关注句间匹配相似性,忽视同类别内部及跨类别间的隐含高价值信息;(2) 预训练模型和图结构方法常需大量内存进行训练与图构建;(3) 部分低资源方法虽性能良好,但处理时间过长。为此,我们提出一种名为LFTC的低资源快速文本分类模型。该方法首先为每类构建压缩列表,充分挖掘类内数据的规律性信息;随后去除对分类无关的冗余内容以降低处理时间;最后通过计算文本对之间的相似性距离完成分类。我们在9个公开基准数据集上评估LFTC,结果表明其在性能与处理时间上均有显著提升,尤其在计算和数据资源受限条件下优势明显。

原文摘要 · Abstract (English)

In recent years, text classification methods based on neural networks and pre-trained models have gained increasing attention and demonstrated excellent performance. However, these methods still have some limitations in practical applications: (1) They typically focus only on the matching similarity between sentences. However, there exists implicit high-value information both within sentences of the same class and across different classes, which is very crucial for classification tasks. (2) Existing methods such as pre-trained language models and graph-based approaches often consume substantial memory for training and text-graph construction. (3) Although some low-resource methods can achieve good performance, they often suffer from excessively long processing times. To address these challenges, we propose a low-resource and fast text classification model called LFTC. Our approach begins by constructing a compressor list for each class to fully mine the regularity information within intra-class data. We then remove redundant information irrelevant to the target classification to reduce processing time. Finally, we compute the similarity distance between text pairs for classification. We evaluate LFTC on 9 publicly available benchmark datasets, and the results demonstrate significant improvements in performance and processing time, especially under limited computational and data resources, highlighting its superior advantages.

文本分类低资源快速推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。