根据图像复杂度动态选择模型,显著降低推理成本。
CADS: Conformal Adaptive Decision System for Cost-Efficient Image Classification
- 用置信区间评估图像不确定性,决定使用轻量或重型模型
- 在两个数据集上实现最高12倍的计算成本降低
- 适合医疗等对精度和效率要求高的场景
高容量AI模型虽能实现先进性能,但实际部署常受高推理成本、环境影响及‘一刀切’策略制约。临床场景中,对简单病例过度使用计算资源是可持续AI的主要障碍。本文提出自适应决策系统CADS,一种基于数据复杂度实时采样的序列多模型算法。CADS利用置信预测量化运行时图像不确定性,构建数学严谨的代价-准确率权衡框架,动态将样本路由至从轻量级‘Scout’模型到高容量‘Oracle’架构的模型级联。在两个数据集上验证表明,与重型模型推理相比,CADS计算成本可降低最多12倍,同时保证高诊断可靠性,显著减少AI的经济与环境负担。
原文摘要 · Abstract (English)
While high-capacity AI models have advanced state-of-the-art performance, their practical deployment is often hindered by high inference costs, environmental impact, and a "one-size-fits-all" approach that ignores varying sample complexity. In clinical settings for instance, the waste of computational resources on routine cases is a significant barrier to sustainable AI. In this paper, we introduce the Conformal Adaptive Decision System (CADS), a sequential multi-model algorithm designed to optimize resource allocation by efficiently sampling models based on the estimated data complexity. CADS leverages conformal prediction to quantify image uncertainty at runtime. CADS provides a mathematically grounded framework for balancing the cost-accuracy dilemma that dynamically routes samples through a model cascade, ranging from lightweight "Scout" models to high-capacity "Oracle" architectures. Validated on two datasets, CADS demonstrated superior efficiency and accuracy at a computational cost that can be up to 12 times lower than heavy-model inference. By accurately routing samples based on real-time complexity, CADS ensures high diagnostic reliability while drastically reducing the economic and environmental footprint of AI.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。