arXiv:2604.17512cs.CLcs.LG2026-04

ONTO通过列式格式减少大模型输入的冗余标记,提升效率。

ONTO: A Token-Efficient Columnar Notation for LLM Input Optimization

  • 字段名仅声明一次,值按管道分隔行排列,支持嵌套结构
  • 相比JSON降低46%-51%标记数,1000条数据下延迟降5%-10%
  • 适合处理物联网等结构化操作数据,兼顾可读性与效率

为大规模操作数据设计的序列化格式会带来结构性开销,当大语言模型处理海量数据时问题突出。一个仅1000条物联网传感器读数的JSON序列化需约80,000个标记,其中多数消耗在重复字段名、嵌套括号和结构标点上。本文提出ONTO(Object Notation for Token Optimization),一种列式表示法:每实体仅声明一次字段名,值以竖线分隔的行组织,通过缩进表达层级。该‘模式一次,数据多次’设计消除每条记录的键重复,同时保持人类可读性和嵌套结构支持。在三个合成操作数据集上的评估显示,相比JSON减少46%-51%标记数,且从100到1000条记录仍保持稳定。在Qwen2.5-7B上的受控推理测试表明对应延迟降低5%-10%。理解验证确认,在提供格式上下文的前提下,查找、计数、抽取和聚合任务的准确率无明显下降。消融分析表明,键重复是JSON开销的主要来源,嵌套缩进成本解释了平铺与层次数据间4个百分点的差距。ONTO填补了序列化领域的空白:兼具列式高效与层级结构,专为大模型上下文窗口优化而非文档交换。代码与规范见https://github.com/harsh-aranga/onto。

原文摘要 · Abstract (English)

Serialization formats designed for document interchange impose structural overhead that becomes prohibitive when large language models consume operational data at scale. A modest dataset of 1,000 IoT sensor readings serialized as JSON requires approximately 80,000 tokens - the majority spent on repeated field names, nested braces, and structural punctuation rather than semantic content. We present ONTO (Object Notation for Token Optimization), a columnar notation that declares field names once per entity and arranges values in pipe-delimited rows with indentation-based hierarchy. This schema-once, data-many design eliminates per-record key repetition while preserving human readability and nested structure support. Evaluation across three synthetic operational datasets demonstrates 46-51% token reduction versus JSON, with stable scaling from 100 to 1,000 records. Controlled inference benchmarks on Qwen2.5-7B show corresponding 5-10% latency improvement. Comprehension validation confirms no material degradation in LLM task accuracy across lookup, counting, extraction, and aggregation operations when format context is provided. Ablation analysis reveals that key repetition accounts for the majority of JSON overhead, with indentation costs in nested structures explaining the 4-percentage-point gap between flat and hierarchical data. ONTO occupies a previously unfilled position in the serialization landscape: columnar efficiency with hierarchical structure, optimized for LLM context windows rather than document interchange. Code and specification are available at https://github.com/harsh-aranga/onto.

标记优化列式存储大模型输入

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。