揭示对称性与模型置信度校准的关系,解决稀疏数据下模型过自信问题
On Uncertainty Calibration for Equivariant Functions
- 建立对称函数的不确定性校准理论,给出误差上下界
- 发现对称性不匹配会导致分类与回归中的置信度失准
- 适用于机器人、分子物理等稀疏数据场景的可信学习
数据稀疏场景如机器人操作、分子物理和星系形态分类是深度学习的难点。对称网络可提升输入空间欠采样区域的建模能力,不确定性估计能防范过自信。但对称性与模型置信度、校准之间的关系尚未研究。由于传统分类与回归误差出现在校准误差定义中,我们推测先前工作可用于理解对称性与校准误差的关系。本文提出一个理论框架,关联对称性与不确定性估计。通过证明在不同对称性条件下不确定性校准误差(ECE和ENCE)的上下界,阐明了对称模型的泛化极限,并揭示对称性不匹配会引发分类与回归中的校准偏差。我们通过多种真实与模拟数据的数值实验,验证了该理论,分析了对称性不匹配、群大小以及偶然与认知不确定性的影响趋势。
原文摘要 · Abstract (English)
Data-sparse settings such as robotic manipulation, molecular physics, and galaxy morphology classification are some of the hardest domains for deep learning. For these problems, equivariant networks can help improve modeling across undersampled parts of the input space, and uncertainty estimation can guard against overconfidence. However, until now, the relationships between equivariance and model confidence, and more generally equivariance and model calibration, has yet to be studied. Since traditional classification and regression error terms show up in the definitions of calibration error, it is natural to suspect that previous work can be used to help understand the relationship between equivariance and calibration error. In this work, we present a theory relating equivariance to uncertainty estimation. By proving lower and upper bounds on uncertainty calibration errors (ECE and ENCE) under various equivariance conditions, we elucidate the generalization limits of equivariant models and illustrate how symmetry mismatch can result in miscalibration in both classification and regression. We complement our theoretical framework with numerical experiments that clarify the relationship between equivariance and uncertainty using a variety of real and simulated datasets, and we comment on trends with symmetry mismatch, group size, and aleatoric and epistemic uncertainties.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。