arXiv:2608.09268cs.HCcs.AI2026-08

用代码图像压缩提升编码代理的效率,但效果受限于任务阶段。

Can Coding Agents Solve Repository-Level Issues with Rendered Code? An Exploratory Study of Visual Representations

论文配图:Can Coding Agents Solve Repository-Level Issues with Rendered Code? An Exploratory Study of Visual Representations
图 1 · 摘自论文原文
  • 将代码渲染为图像以降低提示词消耗,压缩比非线性增长。
  • 修复准确率基本保持,但无法突破底层模型性能瓶颈。
  • 适合源码读取困难场景,对测试迭代阶段帮助有限。

视觉模态近年被用于压缩文本标记,包括将代码渲染为图像以实现静态代码理解。本文研究该表示能否作为编码代理在仓库级修复任务中的操作上下文,代理需导航仓库、编辑源文件并验证可执行补丁。基于 SWE-bench Verified,评估了在仓库级修复工作流中使用渲染代码的效果,并引入受控代理设置,区分无导向仓库探索与结构化修复阶段。结果表明:渲染代码持续降低提示词成本,但节省量不随名义视觉压缩比线性增加;整体修复准确率基本维持,但无法突破底层模型或代理架构的性能极限,在激进压缩下可能不稳定。进一步分析显示,视觉代码最适用于原始源码读取为瓶颈的情况;一旦仓库定位结构化,剩余主要成本来自补丁-测试试错,此时视觉压缩作用有限。总体而言,本研究将渲染代码定位为现实编码代理中可行但条件性的压缩机制。

原文摘要 · Abstract (English)

Visual modality has recently been explored as a way to compress textual tokens, including rendering code as images for static code understanding. We study whether this representation can serve as operational context for agentic coding, where an agent must navigate repositories, edit source files, and verify executable patches. Using SWE-bench Verified, we evaluate rendered code in repository-level repair workflows and introduce controlled agent settings to separate unguided repository exploration from more structured repair stages. Our results show a mixed picture. Rendered code consistently reduces prompt-token cost, but the savings do not increase linearly with the nominal visual compression ratio. It largely preserves end-to-end repair accuracy, but does not overcome the performance limits of the underlying model or agent architecture, and can become unstable under aggressive compression. Further analysis suggests that visual code is most useful when raw source reading is a major bottleneck; once repository localization is structured, much of the remaining cost comes from patch--test trial-and-error, where visual compression has limited leverage. Overall, our study positions rendered code as a viable but conditional compression mechanism for realistic coding agents.

代码生成视觉编码智能代理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。