arXiv:2511.08789cs.LGstat.ML2025-11被引 37

将偏差-方差分解拓展至Bregman散度,适用于指数族最大似然估计。

A Generalized Bias-Variance Decomposition for Bregman Divergences

  • 用Bregman散度替代平方误差,推导通用偏差-方差分解
  • 结果在指数族分布的最大似然估计中具有直接应用价值
  • 提供清晰独立的推导过程,适合教学与理论学习

偏差-方差分解是统计学和机器学习中的核心结果,但通常仅针对平方误差给出。本文提出一种推广形式,其中预测误差由Bregman散度衡量,这与指数族分布的最大似然估计密切相关。尽管该结果已有文献记载,但此前缺乏清晰、独立的推导,因此本文为教学目的提供了完整推导。此前版本曾发布于作者个人网站,未附上下文;本文补充了相关文献讨论与背景说明。

原文摘要 · Abstract (English)

The bias-variance decomposition is a central result in statistics and machine learning, but is typically presented only for the squared error. We present a generalization of the bias-variance decomposition where the prediction error is a Bregman divergence, which is relevant to maximum likelihood estimation with exponential families. While the result is already known, there was not previously a clear, standalone derivation, so we provide one for pedagogical purposes. A version of this note previously appeared on the author's personal website without context. Here we provide additional discussion and references to the relevant prior literature.

偏差-方差Bregman散度统计学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。