arXiv:2504.02723cs.DScs.LG2025-04被引 3

提出高效计算高维分布置信集的新算法,显著降低体积误差。

Computing High-dimensional Confidence Sets for Arbitrary Distributions

  • 用椭球逼近最优欧氏球,实现更小体积的置信集
  • 体积误差仅比最优解差 exp(Õ(d¹ᐟ²)) 倍,优于现有方法
  • 适用于高维统计中的不确定性量化与支持估计

研究在任意分布上学习高密度区域的问题。给定目标覆盖概率 δ 及对分布 D 的样本访问,目标是输出一个置信集 S ⊂ ℝᵈ,使得 S 对 D 的覆盖概率 ≥ δ,且体积尽可能小。该问题在高维统计中具有重要应用,如置信集构建、不确定性量化和支撑估计。在一般情况下该问题统计上不可行,因此我们限制于与一个具有有界 VC 维的集合类 C 比较。若算法能以多项式时间输出一个覆盖概率为 δ、体积与类中最小满足覆盖的集合相比具有可竞争性的集合,则称其为竞争性算法。即使在最基础的情形(即 C 为所有欧氏球)下,该问题仍具计算挑战性。现有基于核压缩的方法可在多项式时间内找到一个体积为最优球的 exp(Õ(d/log d)) 倍的球。本文主要成果是提出一种算法,其输出的置信集体积仅比最优球差 exp(Õ(d¹ᐟ²)) 倍,且为不当学习(输出椭球)。结合我们关于正确定理球在体积上无法达到 exp(Õ(d¹⁻ᵒ⁽¹⁾)) 近似因子的计算困难性结果,本工作揭示了正确学习与不当学习之间的有趣分离。

原文摘要 · Abstract (English)

We study the problem of learning a high-density region of an arbitrary distribution over $\mathbb{R}^d$. Given a target coverage parameter $δ$, and sample access to an arbitrary distribution $D$, we want to output a confidence set $S \subset \mathbb{R}^d$ such that $S$ achieves $δ$ coverage of $D$, i.e., $\mathbb{P}_{y \sim D} \left[ y \in S \right] \ge δ$, and the volume of $S$ is as small as possible. This is a central problem in high-dimensional statistics with applications in finding confidence sets, uncertainty quantification, and support estimation. In the most general setting, this problem is statistically intractable, so we restrict our attention to competing with sets from a concept class $C$ with bounded VC-dimension. An algorithm is competitive with class $C$ if, given samples from an arbitrary distribution $D$, it outputs in polynomial time a set that achieves $δ$ coverage of $D$, and whose volume is competitive with the smallest set in $C$ with the required coverage $δ$. This problem is computationally challenging even in the basic setting when $C$ is the set of all Euclidean balls. Existing algorithms based on coresets find in polynomial time a ball whose volume is $\exp(\tilde{O}( d/ \log d))$-factor competitive with the volume of the best ball. Our main result is an algorithm that finds a confidence set whose volume is $\exp(\tilde{O}(d^{1/2}))$ factor competitive with the optimal ball having the desired coverage. The algorithm is improper (it outputs an ellipsoid). Combined with our computational intractability result for proper learning balls within an $\exp(\tilde{O}(d^{1-o(1)}))$ approximation factor in volume, our results provide an interesting separation between proper and (improper) learning of confidence sets.

高维统计置信集体积优化椭球逼近

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。