用得分函数修正核密度估计,显著降低误差。
SD-KDE: Score-Debiased Kernel Density Estimation
- 基于得分函数单步调整数据点,再用优化带宽做核密度估计。
- 在1D、2D及MNIST上均比经典Silverman方法误差更低。
- 适合对非参数密度估计精度有要求的研究者。
我们提出一种新型密度估计方法——基于得分函数的核密度估计(SD-KDE),通过估计得分函数对核密度估计进行偏差修正。具体地,每个数据点沿得分函数方向进行一步调整,随后采用修改后的带宽执行标准核密度估计。步骤大小和修改后的带宽被精心设计,以消除核密度估计的一阶主导偏差。在1维、2维合成任务以及MNIST数据集上的实验表明,即使得分函数存在噪声,本方法仍显著降低均方积分误差,优于标准Silverman核密度估计。这些结果突显了将基于得分的修正融入非参数密度估计的巨大潜力。
原文摘要 · Abstract (English)
We propose a novel method for density estimation that leverages an estimated score function to debias kernel density estimation (SD-KDE). In our approach, each data point is adjusted by taking a single step along the score function with a specific choice of step size, followed by standard KDE with a modified bandwidth. The step size and modified bandwidth are chosen to remove the leading order bias in the KDE. Our experiments on synthetic tasks in 1D, 2D and on MNIST, demonstrate that our proposed SD-KDE method significantly reduces the mean integrated squared error compared to the standard Silverman KDE, even with noisy estimates in the score function. These results underscore the potential of integrating score-based corrections into nonparametric density estimation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。