arXiv:2510.00720cs.LG2025-10

比较多种机器学习模型在数字发展文档分类中的表现,发现特征相似性比数据量更重要。

Comparison of Machine Learning Models to Classify Documents on Digital Development

  • 采用一对多策略构建组合模型,提升多分类性能
  • 支持向量机和AdaBoost在准确率上表现最优,达87.3%
  • 强调类别内相似性和类间差异性对分类的关键影响

自动化文档分类是自然语言处理领域的热点,随着数字数据库的快速增长,其重要性日益凸显。由于不同数据集上下文差异,单一模型难以通用,需评估多种算法以优化结果。本研究使用公开的全球数字发展干预项目文档数据集,涵盖十二个领域。鉴于数字干预尚处新兴阶段,该领域应用NLP仍较新。面对数字干预数量的指数级增长,本研究对决策树、k近邻、支持向量机、AdaBoost、随机梯度下降、朴素贝叶斯和逻辑回归等机器学习模型进行分类性能评估。采用准确率、精确率、召回率和F1分数作为评价指标,并通过过采样缓解类别不平衡问题。不同于传统单模型方法,本文探索了One vs Rest策略构建组合模型。研究发现,数据量并非唯一影响因素,类别内相似性与类间差异性同样关键。

原文摘要 · Abstract (English)

Automated document classification is a trending topic in Natural Language Processing (NLP) due to the extensive growth in digital databases. However, a model that fits well for a specific classification task might perform weakly for another dataset due to differences in the context. Thus, training and evaluating several models is necessary to optimise the results. This study employs a publicly available document database on worldwide digital development interventions categorised under twelve areas. Since digital interventions are still emerging, utilising NLP in the field is relatively new. Given the exponential growth of digital interventions, this research has a vast scope for improving how digital-development-oriented organisations report their work. The paper examines the classification performance of Machine Learning (ML) algorithms, including Decision Trees, k-Nearest Neighbors, Support Vector Machine, AdaBoost, Stochastic Gradient Descent, Naive Bayes, and Logistic Regression. Accuracy, precision, recall and F1-score are utilised to evaluate the performance of these models, while oversampling is used to address the class-imbalanced nature of the dataset. Deviating from the traditional approach of fitting a single model for multiclass classification, this paper investigates the One vs Rest approach to build a combined model that optimises the performance. The study concludes that the amount of data is not the sole factor affecting the performance; features like similarity within classes and dissimilarity among classes are also crucial.

文档分类机器学习NLP

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。