arXiv:2607.11956cs.LGcs.AI2026-07

首次实现加权k近邻回归与软标签预测的精确数据贡献度计算。

Exact and Certified Data Shapley for Weighted k-Nearest-Neighbor Regression and Soft-Label Prediction

论文配图:Exact and Certified Data Shapley for Weighted k-Nearest-Neighbor Regression and Soft-Label Prediction
图 1 · 摘自论文原文
  • 构建联合权重与加权目标的动态规划算法,突破比例项阻碍。
  • 算法时间复杂度伪多项式,与穷举法结果完全一致无偏差。
  • 支持连续权重与证书化近似,适用于数据审计与模型可解释性研究。

Data Shapley 能量化每个训练样本的价值,其最近邻版本已被 pyDVL、OpenDataVal 等工具包部署使用。已有精确算法适用于无权重近邻分类与回归,以及加权分类;但加权回归与软标签预测长期缺乏精确方法,此前唯一精确解法为依赖邻域大小指数级增长的枚举。问题根源在于加权回归预测是两个依赖联盟的加权和之比,其分母使加法与阈值路径失效,仅剩指数级计数路径。本文提出一种基于累积权重与加权目标联合整数状态的计数型动态规划,该状态是比值的最小充分统计量,实现精确、伪多项式复杂度,并与穷举法零误差匹配。同时引入连续权重与目标的可认证近似方案,提供每值机器可验证证书,刻画精确问题的复杂性边界,并扩展至软标签情形。我们开源了首个仅依赖 CPU 的精确加权回归实现及基准数据集,用于误标检测时,精确值与蒙特卡洛估计在统计上等价,但精确解带来确定性、可认证边界与审计参考,为近似方法提供真实价值衡量标准。

原文摘要 · Abstract (English)

Data Shapley answers which training points are worth what, and its nearest-neighbor specialization is the version actually deployed, shipped by toolkits such as pyDVL and OpenDataVal. Exact algorithms exist for unweighted nearest-neighbor classification and regression, and recently for weighted classification; weighted regression and soft-label prediction have resisted, the only exact method being enumeration exponential in the neighborhood size. The obstruction, in the prior authors' own words, is that the weighted regression prediction is a ratio of two coalition-dependent weighted sums: its normalization denominator blocks the additive and threshold routes, and leaves the counting route exponential in the target resolution. We close this gap with a counting dynamic program over the joint integer state of accumulated weight and weighted target, a minimal sufficient statistic for the ratio; it is exact, pseudo-polynomial, and matched exhaustive enumeration with zero mismatch. We add a certified approximation scheme for continuous weights and targets carrying a machine-checkable per-value certificate, a complexity landscape delimiting the exact problem, and a soft-label extension. We release an open-source, CPU-only library and the first exact weighted-regression ground truth. On mislabel detection our exact values are statistically equivalent to Monte-Carlo Data Shapley; exactness instead buys determinism, a certified bound, and an auditing reference, and it puts a measured price on approximation.

数据贡献度加权回归可解释性动态规划

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。