ALDA帮医生选最少标注量的高效学习策略,避免试错浪费人力。
How Many Labels Are Enough? ALDA: Active Learning Deployment Advisor for Medical Image Classification
- 基于小规模预实验拟合学习曲线,评估不同主动学习策略表现
- 预测达成临床目标所需标注数,最高省82%标注成本
- 推荐最抗阈值变动的策略,适合临床部署决策
主动学习(AL)有望通过减少医学影像标注数量来降低项目成本。但实际部署需在用完全部标注预算前选定采样策略,选错反而会增加成本。我们提出主动学习部署顾问(ALDA),一个面向部署的AL方法选择框架。给定短时预实验,ALDA为每个候选策略拟合参数化学习曲线模型,估计其是否能达到预设临床性能目标,并预测实现目标所需的专家标注数。除绝对标注成本外,ALDA引入部署窗口以量化成本估计对临床阈值不确定性的敏感度。最终推荐遵循风险感知规则:在预测成本接近最优的策略中,优先选择部署窗口最小者,即对阈值修改最鲁棒的策略。在四个医学影像分类任务上的实验表明,仅需15%-30%的预期预算作为预实验,ALDA即可预测出最优部署策略,相比差策略选择可降低高达82%的标注成本。ALDA并未引入新采样方法,而是提供一个解决关键部署问题的实用决策层:多少标签才够?
原文摘要 · Abstract (English)
Active learning (AL) promises to reduce the cost of medical imaging projects by lowering the number of clinical labels required. However, practical deployment requires committing to a sampling strategy before the full annotation budget is spent, and choosing the wrong strategy can increase rather than decrease costs. We propose Active-Learning Deployment Advisor (ALDA), a deployment-oriented framework for AL method selection under clinical performance constraints. Given a short pilot phase, ALDA fits a parametric learning-curve model to each candidate strategy, estimates whether that strategy is expected to reach a required clinical performance target, and predicts the number of expert annotations needed to do so. In addition to absolute annotation cost, ALDA introduces a deployment window that quantifies the sensitivity of this cost estimate to uncertainty in the clinical threshold. The final recommendation follows a risk-aware rule: among strategies with near-optimal predicted cost, ALDA prefers the strategy with the narrowest deployment window, the most robust to threshold revisions. Experiments on four medical imaging classification domains show that ALDA predicts the deployment-optimal method from a pilot of 15-30% of the intended budget and reduces annotation costs by up to 82% compared with a poor strategy choice. Rather than introducing a new sampling heuristic, ALDA provides a practical decision layer that answers a deployment-critical question: how many labels are enough?
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。