arXiv:2506.16651cs.LGcs.CC2025-06被引 4

将特定分布学习器升级为通用分布学习器,效率损失可控。

A Distributional-Lifting Theorem for PAC Learning

  • 通过混合分布表达复杂度控制升级效率
  • 在标准PAC模型下实现更优样本复杂度
  • 无需学习目标分布,适合各类基础分布族

分布无关的高效PAC学习看似困难,促使研究转向分布特定学习。后者虽提升效率但限制适用范围。本文提出分布提升定理:将对有限分布族$\mathcal{D}$有效的学习器,升级为对任意分布$D^\star$有效,其效率开销与$D^\star$表示为$\mathcal{D}$中分布混合的复杂度相关。之前工作针对均匀分布学习器设计了需条件采样口的提升器,依赖半监督学习思路先学$D^\star$再提升。本文证明该方法在仅随机样本访问下信息论不可行,从而合理化其使用条件采样。我们提出新方法避免学习$D^\star$,可在标准PAC模型中运作,适用于所有基础分布族,保持噪声容错性,样本复杂度更优且实现更简洁。

原文摘要 · Abstract (English)

The apparent difficulty of efficient distribution-free PAC learning has led to a large body of work on distribution-specific learning. Distributional assumptions facilitate the design of efficient algorithms but also limit their reach and relevance. Towards addressing this, we prove a distributional-lifting theorem: This upgrades a learner that succeeds with respect to a limited distribution family $\mathcal{D}$ to one that succeeds with respect to any distribution $D^\star$, with an efficiency overhead that scales with the complexity of expressing $D^\star$ as a mixture of distributions in $\mathcal{D}$. Recent work of Blanc, Lange, Malik, and Tan considered the special case of lifting uniform-distribution learners and designed a lifter that uses a conditional sample oracle for $D^\star$, a strong form of access not afforded by the standard PAC model. Their approach, which draws on ideas from semi-supervised learning, first learns $D^\star$ and then uses this information to lift. We show that their approach is information-theoretically intractable with access only to random examples, thereby giving formal justification for their use of the conditional sample oracle. We then take a different approach that sidesteps the need to learn $D^\star$, yielding a lifter that works in the standard PAC model and enjoys additional advantages: it works for all base distribution families, preserves the noise tolerance of learners, has better sample complexity, and is simpler.

PAC学习分布提升样本复杂度

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。