arXiv:2605.17304cs.LGcs.CL2026-05被引 3

提出可验证的对话上下文压缩框架,确保关键承诺不丢失。

Compress the Context, Keep the Commitments: A Formal Framework for Verifiable LLM Context Compression

  • 将对话状态抽象为带来源的语义原子,实现结构化表示
  • 定义四类量化指标,评估压缩后承诺保留程度
  • 适合需保证推理一致性的长对话系统开发者

大语言模型的上下文不仅是词元序列,更是一组必须保留的承诺。长期对话中累积的目标、约束、决策、偏好、工具结果、检索证据、生成物和安全边界,未来回复必须维持。现有方法通过截断、检索、摘要、记忆系统或词元级压缩减少长度,但很少明确哪些语义承诺必须保留,也缺乏衡量标准。本文提出 Context Codec 框架,将对话状态表示为具有规范身份、等价性、冲突性、置信度、风险与证据跨度的类型化、来源绑定的语义原子。该框架分离了提取、归一化、表示、渲染与验证五个核心环节,引入关键原子召回率、加权原子召回率、承诺密度及往返可恢复性等度量指标。同时构建语义压缩错误分类体系,给出具体归一化流程,对低置信度和安全关键原子设定保守回退规则,并设计了以 ASCII 为主的紧凑渲染格式 CCL(Context Compression Language)。小规模诊断研究显示,CCL-Core 在结构化叙述与 JSON 之间取得平衡:比自然语言更明确可审计,通常比 JSON 更紧凑,且比高度压缩符号更安全。本工作并非宣称简写能解决压缩问题,而是提供一个可验证上下文压缩的正式框架:压缩上下文,保留承诺。

原文摘要 · Abstract (English)

LLM context is not just tokens; it is a set of commitments. Long-running conversations accumulate goals, constraints, decisions, preferences, tool results, retrieved evidence, artifacts, and safety boundaries that future responses must preserve. Existing context-management methods reduce length through truncation, retrieval, summarization, memory systems, or token-level prompt compression, but they rarely specify which semantic commitments must survive compression or how their preservation should be measured. We propose Context Codec, a commitment-level framework for compressing prompts and chat histories. Context Codec represents dialogue state as typed, source-grounded semantic atoms with canonical identity, equivalence, conflict, confidence, risk, and evidence spans. It separates five concerns - extraction, normalization, representation, rendering, and verification - and introduces metrics for Critical Atom Recall, Weighted Atom Recall, Commitment Density, and round-trip recoverability. It also defines a taxonomy of semantic compression errors, a concrete normalization procedure, conservative fallback rules for low-confidence and safety-critical atoms, and Context Compression Language (CCL), an ASCII-first compact rendering of canonical JSON atoms. In a small diagnostic study, CCL-Core occupies a useful middle ground between structured prose and JSON: more explicit and auditable than prose, usually more compact than JSON, and less risky than heavily minified notation. The result is not a claim that shorthand solves compression, but a framework for making context compression verifiable: compress the conversation, keep the commitments.

上下文压缩可验证性大模型对话系统

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。