检测并阻断大模型通过隐秘通道外泄数据的实时监控系统
An Application-Layer Multi-Modal Covert-Channel Reference Monitor for LLM Agent Egress
- 分阶段文本处理+容量账本,强制执行无损安全策略
- 用加密认证区分合法媒体与伪装载体,可疑内容默认拦截
- 量化残留泄露风险,对不可破坏通道设上限
大型语言模型(LLM)代理在发送消息时可能通过零宽度字符、同形字、空白符、Base64、JSON键顺序、消息时间或大小等隐蔽方式泄漏数据;在二进制外泄中,还可利用图像最低有效位平面、每图平均亮度、图像序列排列、超声波或可听频段声化数据作为载波。本文提出的出站参考监控器有三项贡献:(i) 十个降容阶段的文本处理流水线、按接收端设置的漏桶容量账本,以及从第一天起就强制执行无损阶段的分步姿态;(ii) 两个媒体混淆器(傅里叶域音频带宽限制器和RGB图像位深/均亮度分桶器),由启动时的密码学合法性验证开启:审计员在启动时发布受信任的Ed25519密钥及{类型, 数据类别}对,仅携带授权类别的有效签名才可豁免;该验证绕过真实媒体与经声化或栅格化伪装为载波的媒体之间的难以区分问题;未签名媒体默认可疑;内容寻址归一化器关闭图像序列排列通道;(iii) 残余容量定义为嵌入与恢复比特间经过Miller-Madow修正的互信息(销毁后为零),由十五个跨文本、图像和音频的对抗性编码器集合测量。参考实现使所有可破坏通道的残余容量降至零,并在无法破坏而不损图像的通道(每图平均亮度)上达到既定上限。
原文摘要 · Abstract (English)
A large language model (LLM) agent that sends messages can leak data inside them. Destination allowlists and content scanners do not police whether an otherwise-benign payload is itself a covert channel: a compromised agent encodes bits in zero-width characters, homoglyphs, whitespace, base64, JavaScript Object Notation (JSON) key ordering, message timing or size -- and, in binary egress, in least-significant-bit (LSB) pixel planes, per-image mean luminance, inter-image sequence permutation, ultrasonic tones, or audible-band sonified data. Our egress reference monitor has three contributions. (i) A text pipeline of ten capacity-reducing stages, a per-sink leaky-bucket capacity ledger, and a staged posture that enforces lossless stages from day one. (ii) Two media scramblers (a Fourier-domain audio band-limiter and a red-green-blue (RGB) image bit-depth and mean-luminance bucketer) gated by a boot-time cryptographic legitimacy attestation: an auditor publishes at boot the trusted Ed25519 keys and {kind, data-class} pairs; only payloads with a verifying signature for an authorized class are exempt. The attestation sidesteps the intractable content-based discrimination between real media and data sonified or rasterized as a carrier; unsigned media is suspect by default; a content-addressed canonicalizer closes the inter-image permutation channel. (iii) Residual capacity is the Miller--Madow corrected mutual information between embedded and recovered bits (zero when destroyed), measured by an adversarial ensemble of fifteen working encoders across text, image and audio. The reference implementation drives residual capacity to zero on every destroyable channel and to a stated bound on the one (per-image mean luminance) that cannot be destroyed without ruining the image.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。