通过测试时优化提升模型置信度可靠性,更好识别不确定预测。
TRUST: Test-time Resource Utilization for Superior Trustworthiness
- 测试时优化修正噪声权重影响,改进置信度估计
- 移除低分样本后准确率持续提升,优于传统方法
- 能有效检测分布偏移,适合可信AI应用
标准不确定性估计方法(如丢弃法)往往难以清晰区分可靠与不可靠预测。我们归因于分类器权重的噪声,虽不影响整体类别预测,但使细粒度统计信息变得不明确。为此,提出一种新的测试时优化方法,考虑此类噪声的影响,生成更可靠的置信度估计。该得分定义了一个单调子集选择函数:随着低分样本被移除,群体准确率持续上升,在标准风险指标(如AUSE、AURC)上表现更优。此外,该方法能有效识别训练与测试分布间的差异,可靠区分分布内与分布外样本,并揭示了CNN与ViT分类器在多个视觉数据集上的关键差异。
原文摘要 · Abstract (English)
Standard uncertainty estimation techniques, such as dropout, often struggle to clearly distinguish reliable predictions from unreliable ones. We attribute this limitation to noisy classifier weights, which, while not impairing overall class-level predictions, render finer-level statistics less informative. To address this, we propose a novel test-time optimization method that accounts for the impact of such noise to produce more reliable confidence estimates. This score defines a monotonic subset-selection function, where population accuracy consistently increases as samples with lower scores are removed, and it demonstrates superior performance in standard risk-based metrics such as AUSE and AURC. Additionally, our method effectively identifies discrepancies between training and test distributions, reliably differentiates in-distribution from out-of-distribution samples, and elucidates key differences between CNN and ViT classifiers across various vision datasets.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。