arXiv:2606.00472cs.CVcs.AI2026-06

用代码增强的智能体,让科研人员轻松探索空间分子图像中的自定义细胞特征。

CodeCytos: AI-assisted spatial molecular imaging analysis via code-augmented agent action space

论文配图:CodeCytos: AI-assisted spatial molecular imaging analysis via code-augmented agent action space
图 1 · 摘自论文原文
  • 构建可编程智能体,通过代码动态交互实现空间分子图像分析自动化。
  • 在4个不同组织数据集上表现优于基线,最小提示下仍能准确响应复杂问题。
  • 无需领域专家示范,随机代码示例即可显著提升性能,适合生物科研人员使用。

传统组织图像分析软件虽具备分割、基础形态特征提取和空间组织分析等基础功能,但通常需人工干预,且与代码驱动自动化集成度低,限制了复杂空间组织研究的效率与可扩展性。此外,其支持的细胞空间特征固定,难以满足定制化分析需求。为此,我们提出CodeCytos——一种基于代码推理的智能体框架,支持对空间分子影像数据进行动态、可编程的交互,提升自动化与定制化能力。我们在四个由专家整理的异质组织数据集(额叶皮层、非小细胞肺癌、胰腺、扁桃体)上验证其有效性。在真实场景下的最小提示设置中,研究人员仅提出简单问题,无需任务指令或上下文信息,对比多个具备强编码能力的大语言模型。结果表明,引入领域无关的少量示例(随机采样的代码推理示例)即可显著提升性能,而无需昂贵的领域内专家示范。总体而言,CodeCytos超越基线方法,证明代码动作智能体在空间分子成像中辅助自定义特征探索的巨大潜力,并有望加速生物标志物发现。

原文摘要 · Abstract (English)

Conventional tissue image analysis software provides foundational capabilities for cellular analysis, including segmentation, basic morphological feature extraction, and spatial organization analysis. However, these tools often require manual intervention and are not well integrated with code-driven automation, limiting efficiency and scalability for complex spatial tissue studies. In addition, they offer limited flexibility for custom analyses, as they typically support only a fixed set of pre-implemented spatial cellular features. To address these limitations, we propose CodeCytos, a coding-based reasoning agent framework that enables dynamic, programmable interaction with spatial molecular imaging data to improve automation and customization. CodeCytos is designed to streamline the exploration of custom spatial cellular features and adapt to diverse research needs. We demonstrate its utility through case studies on four expert-curated datasets from distinct tissue types: frontal cortex, non-small-cell lung cancer, pancreas, and tonsil. We evaluate CodeCytos under a realistic minimal prompt setting, where bioscientists pose simple questions without task-specific instructions or contextual information about spatial cellular analysis, and benchmark multiple LLM backbones with strong coding capabilities. We further show that incorporating tailored, domain-agnostic few-shot in-context coding-reasoning examples (randomly sampled demonstrations outside the spatial analysis domain) can substantially improve performance without requiring costly, expert-crafted in-domain demonstrations. Overall, CodeCytos outperforms baseline approaches, highlighting the potential of code-action agents to assist with custom feature exploration in spatial molecular imaging and to accelerate biomarker discovery.

空间转录组智能体代码生成生物医学图像

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。