arXiv:2605.14980cs.CVcs.AI2026-05

提出首个无需调优的显微图像分析框架,跨场景自动分割追踪计数。

MicroscopyMatching: Towards a Ready-to-use Framework for Microscopy Image Analysis in Diverse Conditions

论文配图:MicroscopyMatching: Towards a Ready-to-use Framework for Microscopy Image Analysis in Diverse Conditions
图 1 · 摘自论文原文
  • 将多种分析任务统一为匹配问题,利用预训练扩散模型的鲁棒匹配能力。
  • 在10类不同样本和设备条件下均实现高精度分割、追踪与计数,性能稳定。
  • 适合缺乏深度学习经验的生物实验室,直接使用无需额外训练。

分析显微图像以提取生物对象属性(如形态组织、动态变化、群体密度)是生物医学研究的基础。然而手动分析成本高、耗时长。尽管已有基于深度学习的方法尝试自动化,但实际中生物对象类型、样本处理流程、成像设备和分析任务的多样性常导致模型失效。现有方法通常需大量适配,对实验室而言难以持续承担,迫使研究者仍依赖人工分析,严重制约科研进展。因此,亟需一个可靠且普适的显微图像分析工具,但至今仍未出现。为此,我们提出首个开箱即用的显微图像分析框架——MicroscopyMatching,可跨多样分析场景稳定完成分割、追踪和计数等关键任务。从新视角出发,MicroscopyMatching 将多种分析任务统一建模为匹配问题,通过预训练潜空间扩散模型的强健匹配能力有效求解。

原文摘要 · Abstract (English)

Analyzing microscopy images to extract biological object properties (e.g., their morphological organization, temporal dynamics, and population density) is fundamental to various biomedical research. Yet conducting this manually is costly and time-consuming. Though deep learning-based approaches have been explored to automate this process, the substantial diversity of microscopy analysis settings in practice (including variations of biological object types, sample processing protocols, imaging equipment, and analysis tasks, etc.) often renders them ineffective. As a result, these approaches typically require extensive adaptation for different settings, which, however, can impose burdens that are often practically unsustainable for laboratories, forcing biomedical researchers to still commonly rely on manual analysis, thereby severely bottlenecking the pace of biomedical research progress. This situation has created a pressing and long-standing need for a reliable and broadly applicable microscopy image analysis tool, yet such a tool is still missing. To address this gap, we present the first ready-to-use microscopy image analysis framework, MicroscopyMatching, that can reliably perform key analysis tasks (including segmentation, tracking, and counting) across diverse microscopy analysis settings. From a fundamentally different perspective, MicroscopyMatching reformulates diverse microscopy image analysis tasks as a unified matching problem, effectively handling this problem by exploiting the robust matching capability from pre-trained latent diffusion models.

显微图像自动化分析扩散模型生物医学

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。