提出检测模型表示缺陷的诊断框架,帮系统识别何时解释力不足。
Detecting Explanatory Insufficiency in Learned Representations: A Framework for Representational Vigilance
- 通过五步流程分析表示中的残留结构
- 可区分残差是噪声、数据局限还是表征本身缺陷
- 适合关注模型可信性与可解释性的研究者
学习到的表示是现代机器学习的核心,但预测性能、鲁棒性、不确定性估计和泛化能力并不能单独证明表示的充分性。模型可能在操作上成功,却仍保留结构性残差,暗示解释力不足。我们提出VER(Vigilant Evaluator of Representations)——一个用于监控学习表示并检测其局限性变得科学相关的概念与方法框架。VER不引入新算法、损失函数或模型架构,而是定义了一套诊断流程:识别表示、划定解释域、检测残差结构、评估解释抗性、发出警惕信号。该框架将表示充分性作为显式研究对象,弥补传统性能评估的不足,为表示学习与‘表示涌现的自举理论’(TBER)中描述的解释力不足诊断之间建立操作桥梁。长期目标是构建不仅能学习表示,还能识别其解释力失效的系统。
原文摘要 · Abstract (English)
Learned representations are central to modern machine learning, but predictive performance, robustness, uncertainty estimation, and generalization do not by themselves establish representational adequacy. A model may remain operationally successful while preserving structured residuals that indicate explanatory insufficiency. We introduce VER (Vigilant Evaluator of Representations), a conceptual and methodological framework for monitoring learned representations and detecting when their limits become scientifically relevant. VER does not propose a new learning algorithm, loss function, or model architecture. It defines a diagnostic process that identifies persistent residual structure and evaluates whether it is better explained by uncertainty, noise, data limitations, local model error, distribution shift, or a limitation of the active representation. The framework comprises five operations: representation identification, explanatory-domain delimitation, residual-structure detection, explanatory-resistance evaluation, and vigilance signaling. VER complements conventional performance evaluation by making representational adequacy an explicit object of inquiry. It provides an operational bridge between representation learning and the diagnosis of explanatory insufficiency described by the Bootstrap Theory of Representational Emergence (TBER). The long-term objective is to support systems capable not only of learning representations, but also of recognizing when those representations no longer provide an adequate basis for explanation, generalization, or further reasoning.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。