通过自监督分块提升分类精度,实现零漏检与低误报。
Dynamic Classification: Leveraging Self-Supervised Classification to Enhance Prediction Performance
- 基于自监督学习将数据划分为多个子区域,每区用同类模型预测。
- 在多数据集上实现零漏检,误报率显著低于XGBoost等模型。
- 无需额外模型即可过滤劣质结果,适合医疗等高风险场景。
本文提出一种动态分类算法,旨在实现零漏检和极低误报率,这对医疗诊断等安全关键领域至关重要。该算法通过自监督学习生成数据划分,使模型能理解数据分布,并将训练集与测试集划分为N个子区域,同一子区域内的训练与测试子集边界几乎一致。每个子区域使用相同类型模型(如线性或随机森林)进行预测。利用子区域边界对预测结果进行优化与筛选,无需额外模型即可剔除不达标结果。该方法使各模型在更小的数据范围内运行,有效提升整体准确性。实验表明,即使在极小的划分误差下,该算法仍实现零漏检与极低误报,优于XGBoost、LGBM等现有集成模型;即便存在较大分类误差,性能仍可媲美当前最优模型。核心创新包括自监督分类学习、小范围子集预测以及无需额外模型即可优化并剔除劣质预测结果。尽管在参数自动调优与效率方面仍有改进空间,但已在多个数据集上表现优异。未来工作将聚焦于优化分类组件以增强鲁棒性与适应性。
原文摘要 · Abstract (English)
In this study, we propose an innovative dynamic classification algorithm aimed at achieving zero missed detections and minimal false positives,acritical in safety-critical domains (e.g., medical diagnostics) where undetected cases risk severe outcomes. The algorithm partitions data in a self-supervised learning-generated way, which allows the model to learn from the training set to understand the data distribution and thereby divides training set and test set into N different subareas. The training and test subsets in the same subarea will have nearly the same boundary. For each subarea, there will be the same type of model, such as linear or random forest model, to predict the results of that subareas. In addition, the algorithm uses subareas boundary to refine predictions results and filter out substandard results without requiring additional models. This approach allows each model to operate within a smaller data range and remove the inaccurate prediction results, thereby improving overall accuracy. Experimental results show that, with minimal data partitioning errors, the algorithm achieves exceptional performance with zero missed detections and minimal false positives, outperforming existing ensembles like XGBoost or LGBM model. Even with larger classification errors, it remains comparable to that of state-of-the-art models. Key innovations include self-supervised classification learning, small-range subset predictions, and optimizing the prediction results and eliminate the unqualified ones without the need for additional model support. Although the algorithm still has room for improvement in automatic parameter tuning and efficiency, it demonstrates outstanding performance across multiple datasets. Future work will focus on optimizing the classification components to enhance robustness and adaptability.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。