arXiv:2602.02014cs.CVcs.AI2026-02中稿 · ICML

用OCR思想重构基因组建模,实现高效压缩与精准理解

Rethinking Genomic Modeling Through Optical Character Recognition

  • 将DNA转为视觉布局,通过视觉-语言模型进行编码与解码
  • 450k碱基序列下仅需约1/20有效令牌,性能超越参数多985倍的模型
  • 适合需要长序列压缩与细粒度基因信息捕捉的研究者

当前基因组基础模型多采用大语言模型架构,将DNA视为一维标记序列,但这种逐字读取方式与基因组稀疏、非连续的语义结构不匹配,造成大量计算浪费且难以实现基于理解的长序列压缩。本文提出OpticalDNA,一种基于视觉的基因组建模框架,将基因组理解重构为类似光学字符识别(OCR)的文档理解任务。该框架将DNA渲染为结构化视觉布局,训练一个具备OCR能力的视觉-语言模型,其中视觉编码器生成紧凑可重构的视觉标记,实现高保真压缩。在此表示基础上,定义基于提示的基因组原语任务——读取、区域定位、子序列检索与掩码片段补全,从而学习具备布局感知的基因组表示,在减少有效令牌数量的同时保留细粒度信息。在多个基因组基准测试中,OpticalDNA持续优于近期基线;在长达450,000碱基的序列上,其整体表现最佳,有效令牌数仅为基线的约1/20,且在仅微调25.6万参数的情况下,超越参数高达985倍的模型。

原文摘要 · Abstract (English)

Recent genomic foundation models largely adopt large language model architectures that treat DNA as a one-dimensional token sequence. However, exhaustive sequential reading is structurally misaligned with sparse and discontinuous genomic semantics, leading to wasted computation on low-information background and preventing understanding-driven compression for long contexts. Here, we present OpticalDNA, a vision-based framework that reframes genomic modeling as Optical Character Recognition (OCR)-style document understanding. OpticalDNA renders DNA into structured visual layouts and trains an OCR-capable vision--language model with a visual DNA encoder and a document decoder, where the encoder produces compact, reconstructible visual tokens for high-fidelity compression. Building on this representation, OpticalDNA defines prompt-conditioned objectives over core genomic primitives-reading, region grounding, subsequence retrieval, and masked span completion-thereby learning layout-aware DNA representations that retain fine-grained genomic information under a reduced effective token budget. Across diverse genomic benchmarks, OpticalDNA consistently outperforms recent baselines; on sequences up to 450k bases, it achieves the best overall performance with nearly 20$\times$ fewer effective tokens, and surpasses models with up to 985$\times$ more activated parameters while tuning only 256k trainable parameters.

基因组建模OCR视觉语言模型压缩

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。