研究如何用列表猜测语言,突破经典识别理论限制。
A Characterization of List Language Identification in the Limit
- 允许每次输出多个猜测,通过列表机制提升识别能力。
- 证明可列表识别当且仅当语言集能分解为k个可单列识别的子集。
- 在统计设置下实现指数级收敛,且无法更快,理论严谨。
我们研究语言识别在极限情形下的问题:给定目标语言的示例序列,学习者需输出一个猜测序列,使得在某个有限时间之后所有猜测均正确。经典结果表明,对于大多数有意义的语言集合,该任务不可能实现。随后,Angluin给出了可实现识别的语言集合的精确刻画。受近期语言生成相关积极成果的启发,我们重新审视这一经典问题,假设学习者在每个时间步可输出大小为k的猜测列表。目标是确保在某个有限时间后,每一步的列表中至少有一个正确。本文给出了一类语言集合可被k-列表在极限下识别的精确刻画,基于Angluin原始结果的递归形式。进一步得出一个直观的等价条件:当且仅当该语言集合可被划分为k个子集,每个子集均可在极限下以单列表识别。我们还利用该刻画,在独立同分布输入的统计设置下建立了识别速率。结果表明,若集合可被k-列表在极限下识别,则其可在指数速率下实现,且这是最优的;反之,若不可,则无法以趋于零的速率识别。
原文摘要 · Abstract (English)
We study the problem of language identification in the limit, where given a sequence of examples from a target language, the goal of the learner is to output a sequence of guesses for the target language such that all the guesses beyond some finite time are correct. Classical results of Gold showed that language identification in the limit is impossible for essentially any interesting collection of languages. Later, Angluin gave a precise characterization of language collections for which this task is possible. Motivated by recent positive results for the related problem of language generation, we revisit the classic language identification problem in the setting where the learner is given the additional power of producing a list of $k$ guesses at each time step. The goal is to ensure that beyond some finite time, one of the guesses is correct at each time step. We give an exact characterization of collections of languages that can be $k$-list identified in the limit, based on a recursive version of Angluin's characterization (for language identification with a list of size $1$). This further leads to a conceptually appealing characterization: A language collection can be $k$-list identified in the limit if and only if the collection can be decomposed into $k$ collections of languages, each of which can be identified in the limit (with a list of size $1$). We also use our characterization to establish rates for list identification in the statistical setting where the input is drawn as an i.i.d. stream from a distribution supported on some language in the collection. Our results show that if a collection is $k$-list identifiable in the limit, then the collection can be $k$-list identified at an exponential rate, and this is best possible. On the other hand, if a collection is not $k$-list identifiable in the limit, then it cannot be $k$-list identified at any rate that goes to zero.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。