arXiv:2510.02332cs.CLcs.AI2025-10被引 1

提升语言隐写术容量,同时保证安全且避免解码失败。

A High-Capacity and Secure Disambiguation Algorithm for Neural Linguistic Steganography

  • 仅对无法区分的词元序列做最小同步采样,保留其他可区分路径
  • 英文嵌入率提升超160%,中文超25%,接近理论上限
  • 适合需要高容量且安全的隐写应用,如隐蔽通信

神经语言隐写旨在将信息嵌入自然文本中,同时保持统计不可检测性。当前核心挑战源于现代分词器带来的词元歧义,可能导致解码灾难性失败。近期方法SyncPool通过粗粒度同步机制解决歧义,但牺牲了嵌入容量——将整个歧义组的香农熵用于同步而非载荷。本文提出look-ahead Sync方法,在保留同步安全性的前提下突破容量瓶颈。该方法仅对真正不可区分的词元序列进行最小同步采样,战略性保留其余可区分路径以最大化嵌入容量。我们提供了方法的安全性理论证明,并分析其实际容量与理论上限之间的差距。在英文(使用Llama 3)和中文(使用Qwen 2.5)基准上的实验表明,本方法持续逼近理论容量上限,显著优于SyncPool:英文嵌入率提升超过160%,中文提升25%,尤其在候选池较大时优势明显。该工作为实现高容量、可证明安全的语言隐写迈出关键一步。

原文摘要 · Abstract (English)

Neural linguistic steganography aims to embed information into natural text while preserving statistical undetectability. A fundamental challenge in this ffeld stems from tokenization ambiguity in modern tokenizers, which can lead to catastrophic decoding failures. The recent method, SyncPool, addresses this ambiguity by employing a coarse-grained synchronization mechanism over groups of ambiguous candidates. However, SyncPool sacriffces embedding capacity, as it utilizes the entire Shannon entropy of an ambiguous group solely for synchronization rather than for payload embedding. We propose a method named look-ahead Sync, which overcomes the capacity limitation of SyncPool while retaining its provable security guarantees. Our approach performs minimal synchronized sampling only on truly indistinguishable token sequences, while strategically preserving all other discernible paths to maximize embedding capacity. We provide theoretical proofs for the security of our method and analyze the gap between its achievable embedding capacity and the theoretical upper bound. Experiments on English (using Llama 3) and Chinese (using Qwen 2.5) benchmarks show that our method consistently approaches the theoretical capacity upper bound and signiffcantly outperforms SyncPool. The improvement in embedding rate exceeds 160% in English and 25% in Chinese, particularly in settings with larger candidate pools. This work represents a signiffcant step toward practical high-capacity provably secure linguistic steganography.

隐写术语言模型安全通信容量优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。