提出新评估框架,揭示模型在模糊数据中盲目自信的致命缺陷
Certainty-Validity: A Diagnostic Framework for Discrete Commitment Systems
- 将模型表现分解为确定性与正确性二维矩阵,识别出自信错误行为
- 发现离散系统在噪声数据上存在83%准确率天花板,无法突破
- 主张以CVS得分取代准确率,让模型学会在证据不足时停止判断
机器学习标准评估指标(如准确率、精确率、召回率、AUROC)假设所有错误等价:自信的错误预测与不确定的预测受到相同惩罚。对于离散承诺系统(即选择{-W, 0, +W}状态的架构),这一假设在认识论上存在缺陷。本文提出确定性-有效性(CVS)诊断框架,将模型性能分解为2×2矩阵,区分高/低确定性与有效/无效预测。该框架揭示了标准准确率掩盖的关键失效模式:自信错误(CI)行为,即模型在模糊数据中虚构结构。在Fashion-MNIST、EMNIST和IMDB上的消融实验表明,此类离散架构在噪声基准上存在83%的‘模糊上限’,始终无法突破。与可记忆纹理或统计噪声的连续模型不同,离散模型拒绝对模糊样本作出承诺。我们指出,这种拒绝并非缺陷,而是优势:模型在结构性证据终结处停止判断。然而,在模糊数据上标准训练最终引发良性过拟合,导致从‘不确定错误’(合理怀疑)向‘自信错误’(幻觉)的病理迁移。我们建议,推理系统的‘良好训练’应以最大化确定性-有效性得分(CVS)为目标,确保模型知道何时停止决策。
原文摘要 · Abstract (English)
Standard evaluation metrics for machine learning -- accuracy, precision, recall, and AUROC -- assume that all errors are equivalent: a confident incorrect prediction is penalized identically to an uncertain one. For discrete commitment systems (architectures that select committed states {-W, 0, +W}), this assumption is epistemologically flawed. We introduce the Certainty-Validity (CVS) Framework, a diagnostic method that decomposes model performance into a 2x2 matrix distinguishing high/low certainty from valid/invalid predictions. This framework reveals a critical failure mode hidden by standard accuracy: Confident-Incorrect (CI) behavior, where models hallucinate structure in ambiguous data. Through ablation experiments on Fashion-MNIST, EMNIST, and IMDB, we analyze the "83% Ambiguity Ceiling" -- a stopping point where this specific discrete architecture consistently plateaus on noisy benchmarks. Unlike continuous models that can surpass this ceiling by memorizing texture or statistical noise, the discrete model refuses to commit to ambiguous samples. We show that this refusal is not a failure but a feature: the model stops where structural evidence ends. However, standard training on ambiguous data eventually forces Benign Overfitting, causing a pathological migration from Uncertain-Incorrect (appropriate doubt) to Confident-Incorrect (hallucination). We propose that "good training" for reasoning systems must be defined not by accuracy, but by maximizing the Certainty-Validity Score (CVS) -- ensuring the model knows where to stop.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。