arXiv:2605.13092stat.MLcs.LG2026-05

用预训练神经网络自适应选择核函数,提升高维密度估计精度。

Adaptive Kernel Density Estimation with Pre-training

论文配图:Adaptive Kernel Density Estimation with Pre-training
图 1 · 摘自论文原文
  • 用预训练模型为每个数据点推荐合适的自适应核函数
  • 在目标分布与预训练分布相近时,误差显著降低
  • 可通过微调恢复差异较大分布下的性能优势

高维场景下的密度估计是重要且具挑战性的统计问题。传统基于核平滑的方法因难以设定合适的局部自适应核而效率低下。本文引入预训练这一前沿人工智能核心思想,用于非参数密度估计。通过构建一个预训练神经网络,为每个样本点推荐合适的局部自适应核,从而在高维下实现高效密度估计。大量数值实验表明,当目标分布接近预训练分布族时,该策略能显著提升估计精度;若目标分布与预训练分布差异较大,性能优势可能减弱,但可通过额外微调重新激活。

原文摘要 · Abstract (English)

Density estimation in high-dimensional settings is an important and challenging statistical problem.Traditional methods based on kernel smoothing are inefficient in high dimensions due to the difficulties in specifying appropriate location-adaptive kernels. In this work, we introduce pre-training, a key idea behind many cutting-edge AI technologies, to the context of non-parametric density estimation. By establishing a pre-trained neural network that can recommend an appropriate location-adaptive kernel for each sample point, efficient density estimation with adaptive kernels is achieved in high dimensions. A wide range of numerical experiments show that this strategy is highly effective for improving density-estimation accuracy, when the target distribution is close to the distribution family for pre-training. When the target distribution is substantially different from the pre-training distribution family, the benefit from the proposed pre-training strategy may be diluted, but can be reactivated by an additional fine-tuning procedure.

密度估计预训练核方法高维统计

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。