arXiv:2412.14299cs.LG2024-12被引 1

通过转换问题、构建知识图谱和模型集成,提升多标签分类性能。

The Multiplex Classification Framework: optimizing multi-label classifiers through problem transformation, ontology engineering, and model ensembling

  • 将复杂分类问题转化为可管理子任务,结合知识图谱建模逻辑关系。
  • 在多标签场景下最高提升10%的F1分数,尤其适用于类别多且不均衡的情况。
  • 适合有领域知识背景的研究者,可应对复杂分类挑战。

分类是机器学习中的基础任务。尽管传统方法如二元分类、多类分类和多标签分类对简单问题有效,但在处理某些现实世界场景时可能不够充分。本文提出多路分类框架(Multiplex Classification Framework),通过问题转化、本体工程与模型集成的融合,应对上述挑战。该框架具有适应任意类别数量与逻辑约束的能力,创新性地解决类别不平衡问题,无需设定置信度阈值,且结构模块化。通过两次实验对比传统分类模型与多路方法的性能,结果表明:多路方法在类别较多且存在显著类别不平衡的问题中可显著提升分类性能,整体F1得分最高提升达10%。但其局限在于需深入理解问题领域、具备本体工程经验,并需训练多个模型,流程更复杂。总体而言,该方法为处理复杂分类问题的研究者与实践者提供了有力工具。

原文摘要 · Abstract (English)

Classification is a fundamental task in machine learning. While conventional methods-such as binary, multiclass, and multi-label classification-are effective for simpler problems, they may not adequately address the complexities of some real-world scenarios. This paper introduces the Multiplex Classification Framework, a novel approach developed to tackle these and similar challenges through the integration of problem transformation, ontology engineering, and model ensembling. The framework offers several advantages, including adaptability to any number of classes and logical constraints, an innovative method for managing class imbalance, the elimination of confidence threshold selection, and a modular structure. Two experiments were conducted to compare the performance of conventional classification models with the Multiplex approach. Our results demonstrate that the Multiplex approach can improve classification performance significantly (up to 10% gain in overall F1 score), particularly in classification problems with a large number of classes and pronounced class imbalances. However, it also has limitations, as it requires a thorough understanding of the problem domain and some experience with ontology engineering, and it involves training multiple models, which can make the whole process more intricate. Overall, this methodology provides a valuable tool for researchers and practitioners dealing with complex classification problems in machine learning.

多标签分类本体工程模型集成类别不平衡

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。