arXiv:2608.30254cs.LGmath.ST2026-08

确定向量回归中加权数据选择的精确最小预算阈值

Exact Recovery Thresholds for Weighted Data Selection in Vector-Valued Linear Regression

  • 证明最小有效样本数为 (m+1)d,达到全数据性能
  • 在接近阈值时,损失放大系数为 1+1/(dm²), spanning 预算为 d+1
  • 解决二元向量回归小规模情形,支持关键猜想的结构性证据

在向量值线性回归与平方损失下,针对经验风险最小化且具有最小Frobenius范数的学习器,本文解决了COLT 2025开放问题‘数据选择任务’中的阈值部分。我们证明,恢复全数据损失所需的最小加权样本预算恰好为 n*(d,m) = (m+1)d。进一步确定了两个关键点:在近阈值预算 (m+1)d-1 下,加权选择性能比为 1+1/(dm²);在跨度预算下,当 n=d 时,性能比为 d+1(对任意 m),而 n<d 时性能比为无穷大。对于最小未解情形 (d,m)=(2,2),证明 F_w(2,2,3) ∈ [13/8,15/8] 且 F_w(2,2,4) ∈ [5/4,3/2],将猜想值 13/8 和 5/4 化为最多七原子的圆上有限矩问题,并提供强结构证据支持猜想。所用方法(固定基锥压缩引理、最大证书的行列式面刚性定理、零均值加权点系统的紧致稀疏化引理)具有独立研究价值。作为副产品,纠正了一篇近期未同行评审预印本中的错误主张,给出一个 m=2 时,任何 2d 个加权点都无法恢复最优损失的显式数据集。所有结果仅对 m≥2 为新,标量情形 m=1 已由 Hanneke 等人完成。

原文摘要 · Abstract (English)

We resolve the threshold part of Question 4 of the COLT 2025 open problem "Data Selection for Regression Tasks" of Hanneke, Moran, Shlimovich and Yehudayoff. In vector-valued linear regression with square loss $\ell_{(x,y)}(W)=|Wx-y|_2^2$, where $x\in\mathbb{R}^d$, $y\in\mathbb{R}^m$ and the learner is the empirical risk minimizer of minimal Frobenius norm, we prove that the minimal budget of weighted examples that recovers the full-data loss on every finite dataset is exactly $n^*(d,m)=(m+1)d$. We further determine two more values of the weighted selection profile $F_w(d,m,n)$: at the near-threshold budget, $F_w(d,m,(m+1)d-1)=1+\frac{1}{dm^2}$, and at the spanning budget, $F_w(d,m,d)=d+1$ for every $m$, while $F_w(d,m,n)=\infty$ for $n<d$. For the smallest open intermediate cell $(d,m)=(2,2)$ we prove $F_w(2,2,3)\in[13/8,15/8]$ and $F_w(2,2,4)\in[5/4,3/2]$, reduce the conjectured exact values $13/8$ and $5/4$ to a finite moment problem on the circle with at most seven atoms, and establish strong structural evidence for the conjecture. The upper-bound techniques (a fixed-basis conic compression lemma, a determinant-facet rigidity theorem for maximal certificates, and sharp sparsification lemmas for zero-mean weighted point systems) are of independent interest. As a byproduct we correct an erroneous claim circulating in a recent unrefereed preprint, exhibiting an explicit dataset with $m=2$ on which no weighted selection of $2d$ points recovers the optimal loss. All results are new only for $m\ge 2$; the scalar case $m=1$ is due to Hanneke et al.

数据选择线性回归优化理论统计学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。