arXiv:2608.17711cs.AI2026-08中稿 · KDD

研究轻量模型级联在数据扰动下的可靠性,发现节能设计可能因误判而失效。

Accuracy and Robustness of Model Cascades Under Data Perturbations

论文配图:Accuracy and Robustness of Model Cascades Under Data Perturbations
图 1 · 摘自论文原文
  • 用置信度引导轻量与大型模型分层处理输入,节省算力
  • 在静态干扰下,路由信号可能失灵或整体性能下降
  • 适合关注模型鲁棒性与实际部署效率的研究者

预测级联可显著降低人工智能模型的能耗,同时保持高预测性能:简单样本由小型轻量模型处理,复杂不确定样本则交由大型模型处理。该设计虽在干净数据上提升效率,但依赖置信度路由的可靠性。当输入受到静态损坏或序列扰动时,模型置信度和路由决策可能发生偏移。本文以图像分类任务为例,研究基于置信度的级联框架在数据退化下的行为表现,选取一个在准确率、路由质量与能耗之间达到帕累托最优的级联模型,其预测性能具竞争力,并实现最高达10倍的二氧化碳排放减少。分析发现三种失效模式:静态损坏可能导致路由信号中断(大模型仍有效),或导致两模型性能均下降使延迟无法恢复准确率;序列扰动则引发预测稳定但延迟机制抑制,产生看似稳定实则不可靠的结果。研究强调,高效模型级联必须超越干净数据上的准确率评估,需特别关注分布偏移下路由可靠性的验证。

原文摘要 · Abstract (English)

Prediction cascades significantly reduce energy consumption of Artificial Intelligence (AI) models while maintaining high predictive performance. The idea is that easy inputs are routed through a lightweight small model, and difficult uncertain cases are deferred to a larger model. While this design can improve computational efficiency on clean data, its effectiveness depends on the reliability of confidence-based routing. Input degradations, such as static corruptions and sequential perturbations, can shift model confidence and routing decisions. In this paper, we study confidence-based cascade frameworks for image classification and investigate how such degradations affect their confidence-based deferral behavior. We select a model cascade at the pareto-optimum of accuracy, routing quality, and energy consumption that achieves competitive predictive performance with an up to 10-fold decrease in CO$_2$ emissions. We study the behavior of that model cascade under input corruptions and analyze how the cascade's routing decisions change when the input distribution shifts. Our analysis identifies three failure modes. Static corruptions either (1) break the routing signal while the large model remains useful, or (2) degrade both models so deferral no longer recovers accuracy. Sequential perturbations reveal a third mode: predictions stabilize but deferral suppresses, yielding stable but unreliable predictions. These findings demonstrate that energy efficient model cascades require evaluation beyond clean accuracy, with explicit attention to routing reliability under distribution shift.

模型级联鲁棒性节能推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。