通过筛选数据与拒绝低信度预测,提升医疗模型可靠性。
Filtering instances and rejecting predictions to obtain reliable models in healthcare
- 用实例难易度筛选训练数据,剔除模糊样本
- 推理时按置信度拒绝低信度预测,保留可靠结果
- 适合对安全要求高的医疗AI部署场景
机器学习模型广泛应用于医疗等高风险领域,其预测可靠性至关重要。但现有模型常忽略不确定性,即使置信度低也给出预测。本文提出一种两步式数据驱动方法:第一步利用实例难易度(IH)在训练阶段过滤问题数据,提升数据质量;第二步在推理阶段引入基于置信度的拒绝机制,仅保留高可信预测。我们在三个真实医疗数据集上验证该方法,结果表明其在提升模型可靠性的同时,保持了良好的预测性能与较低的拒绝率。作为对比,我们采用影响值过滤和不确定性拒绝作为基线,进一步验证了所提方法的有效性。该方法有效提升了模型性能,同时保留了大量可用样本,为安全关键场景下的机器学习系统部署提供了实用方案。
原文摘要 · Abstract (English)
Machine Learning (ML) models are widely used in high-stakes domains such as healthcare, where the reliability of predictions is critical. However, these models often fail to account for uncertainty, providing predictions even with low confidence. This work proposes a novel two-step data-centric approach to enhance the performance of ML models by improving data quality and filtering low-confidence predictions. The first step involves leveraging Instance Hardness (IH) to filter problematic instances during training, thereby refining the dataset. The second step introduces a confidence-based rejection mechanism during inference, ensuring that only reliable predictions are retained. We evaluate our approach using three real-world healthcare datasets, demonstrating its effectiveness at improving model reliability while balancing predictive performance and rejection rate. Additionally, we use alternative criteria - influence values for filtering and uncertainty for rejection - as baselines to evaluate the efficiency of the proposed method. The results demonstrate that integrating IH filtering with confidence-based rejection effectively enhances model performance while preserving a large proportion of instances. This approach provides a practical method for deploying ML systems in safety-critical applications.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。