arXiv:2502.03386cs.LG2025-02被引 12

用概率图模型解决数据不平衡分类难题,提升少数类识别能力。

A Structured Reasoning Framework for Unbalanced Data Classification Using Probabilistic Models

  • 构建马尔可夫网络建模类别间依赖关系,实现全局推理优化。
  • 在信用卡欺诈数据集上F1分数和AUC-ROC显著优于传统模型。
  • 适合金融风控、医疗诊断等少数类关键的高风险场景使用。

本文研究一种用于不平衡数据分类的马尔可夫网络模型,旨在解决传统机器学习模型在类别分布不均环境下存在的分类偏差及少数类识别能力不足的问题。通过构建联合概率分布与条件依赖关系,该模型实现了样本类别的全局建模与推理优化。研究引入边缘概率估计与加权损失优化策略,结合正则化约束与结构化推理方法,有效提升了模型的泛化能力和鲁棒性。实验阶段采用真实信用卡欺诈检测数据集,与逻辑回归、支持向量机、随机森林及XGBoost等模型进行对比。结果表明,该马尔可夫网络在加权准确率、F1分数和AUC-ROC等指标上表现优异,显著优于传统分类模型,展现出强大的决策能力与在不平衡数据场景中的适用性。未来研究可聚焦于大规模不平衡数据环境下的高效训练、结构优化及深度学习融合,推动其在金融风险控制、医学诊断与智能监控等实际应用中的广泛落地。

原文摘要 · Abstract (English)

This paper studies a Markov network model for unbalanced data, aiming to solve the problems of classification bias and insufficient minority class recognition ability of traditional machine learning models in environments with uneven class distribution. By constructing joint probability distribution and conditional dependency, the model can achieve global modeling and reasoning optimization of sample categories. The study introduced marginal probability estimation and weighted loss optimization strategies, combined with regularization constraints and structured reasoning methods, effectively improving the generalization ability and robustness of the model. In the experimental stage, a real credit card fraud detection dataset was selected and compared with models such as logistic regression, support vector machine, random forest and XGBoost. The experimental results show that the Markov network performs well in indicators such as weighted accuracy, F1 score, and AUC-ROC, significantly outperforming traditional classification models, demonstrating its strong decision-making ability and applicability in unbalanced data scenarios. Future research can focus on efficient model training, structural optimization, and deep learning integration in large-scale unbalanced data environments and promote its wide application in practical applications such as financial risk control, medical diagnosis, and intelligent monitoring.

不平衡分类概率图模型欺诈检测

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。