arXiv:2602.20336cs.CL2026-02

对比三种模型,发现BiLSTM在准确率与效率间最平衡。

Natural Language Processing Models for Robust Document Categorization

  • 用Naive Bayes、BiLSTM和BERT做文档分类,比较性能与开销。
  • BERT准确率超99%,但训练慢资源多;BiLSTM达98.56%且成本适中。
  • 系统实测可自动处理技术请求,适合实际部署场景。

本文评估了多种机器学习方法在自动化文本分类中的应用,并设计了一个用于处理不平衡文档分类与分布的演示系统。研究聚焦于分类准确率与计算效率的平衡,这是将AI集成到真实世界自动化流程中的关键考量。考察了三种不同复杂度的模型:朴素贝叶斯分类器、双向LSTM网络和微调的基于BERT的Transformer模型。实验显示性能差异显著:BERT达到最高准确率,持续超过99%,但训练时间长、资源消耗大;BiLSTM模型提供了良好折衷,准确率达约98.56%,训练成本适中,并具备稳健的上下文理解能力;朴素贝叶斯训练最快,仅需毫秒级时间,但准确率最低,平均约94.5%。类别不平衡影响所有方法,尤其对少数类识别造成挑战。一个功能完整的演示系统被实现,验证了其实际应用价值,能够以人工无法企及的吞吐量自动分发技术请求。研究结论认为,对于所考察场景,BiLSTM是最佳平衡方案,同时指出了未来改进方向及对Transformer架构的进一步探索机会。

原文摘要 · Abstract (English)

This article presents an evaluation of several machine learning methods applied to automated text classification, alongside the design of a demonstrative system for unbalanced document categorization and distribution. The study focuses on balancing classification accuracy with computational efficiency, a key consideration when integrating AI into real world automation pipelines. Three models of varying complexity were examined: a Naive Bayes classifier, a bidirectional LSTM network, and a fine tuned transformer based BERT model. The experiments reveal substantial differences in performance. BERT achieved the highest accuracy, consistently exceeding 99\%, but required significantly longer training times and greater computational resources. The BiLSTM model provided a strong compromise, reaching approximately 98.56\% accuracy while maintaining moderate training costs and offering robust contextual understanding. Naive Bayes proved to be the fastest to train, on the order of milliseconds, yet delivered the lowest accuracy, averaging around 94.5\%. Class imbalance influenced all methods, particularly in the recognition of minority categories. A fully functional demonstrative system was implemented to validate practical applicability, enabling automated routing of technical requests with throughput unattainable through manual processing. The study concludes that BiLSTM offers the most balanced solution for the examined scenario, while also outlining opportunities for future improvements and further exploration of transformer architectures.

文本分类模型对比BiLSTMBERT

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。