arXiv:2510.02795cs.DScs.AI2025-10被引 10

提出最优非均匀语言生成算法,兼顾各语言生成效率

Pareto-optimal Non-uniform Language Generation

  • 构建帕累托最优生成框架,确保每种语言生成时间不可进一步压缩
  • 生成时间仅依赖语言本身,不随输入顺序变化,且逼近理论最优
  • 适用于噪声和代表性生成等实际场景,适合需高效多语言生成的研究

Kleinberg 和 Mullainathan(2024)提出了语言生成的极限模型:给定可数语言集合,对手按某种顺序枚举目标语言 $L$ 的字符串,目标是生成新有效字符串,使得在有限时间后所有生成字符串均合法。Li、Raman 与 Tewari(2024)以及 Charikar 与 Pabbaraju(2024)在此模型中给出了强非均匀生成保证,其算法在仅依赖 $L$ 与语言集合的前提下,经过 $t(L)$ 个不同输入字符串后即可生成有效字符串,但 $t(L)$ 可能非最优。本文研究该问题的帕累托最优性,提出新算法,其生成时间 $t^\star(L)$ 几乎帕累托最优:若某算法对某语言 $L$ 的生成时间严格更短,则必导致另一语言 $L'$ 的生成时间更差。帕累托最优即非均匀生成所能达到的最佳平衡。该框架可自然扩展至含噪声及代表性生成等实用场景。

原文摘要 · Abstract (English)

Kleinberg and Mullainathan (2024) recently proposed an interesting model for language generation in the limit: Given a countable collection of languages, and an adversary enumerating the strings of some language $L$ from the collection, the objective is to generate new strings from the target language, such that all strings generated beyond some finite time are valid. Li, Raman and Tewari (2024) and Charikar and Pabbaraju (2024) showed strong non-uniform generation guarantees in this model, giving algorithms that generate new valid strings from $L$ after seeing a number of distinct input strings $t(L)$ that depends only on $L$ (and the collection), but not the enumeration order. However, for both these works, the language-wise generation times $t(L)$ of the algorithm can be strictly sub-optimal. In this work, we study Pareto-optimality of non-uniform language generation in the limit. We propose an algorithm, whose generation times $t^\star(L)$ are (almost) Pareto-optimal: any other algorithm whose generation time for some language $L$ is strictly smaller than $t^\star(L)$, must satisfy that its generation time for some other language $L'$ is strictly worse than $t^\star(L')$. Pareto-optimality is essentially the best that one can achieve for non-uniform generation. Our algorithmic framework conveniently adapts to further give Pareto-optimal non-uniform generation algorithms in the practically motivated settings of noisy as well as representative generation.

语言生成帕累托优化非均匀生成算法设计

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。