arXiv:2503.18583cs.CV2025-03

用扩散模型生成真实细胞分裂视频,可扩展至长时序序列。

Adapting Video Diffusion Models for Time-Lapse Microscopy

  • 微调预训练扩散模型,结合表型数值或图像进行条件生成。
  • 生成视频在形态、增殖与迁移指标上符合生物真实,能持续生成动态。
  • 适合需要合成显微数据的研究者,尤其用于虚拟实验与数据增强。

我们提出一种针对显微时间序列的视频扩散模型领域自适应方法,用于生成高保真的海拉细胞分裂时间序列视频。尽管先进生成式视频模型在自然视频上已取得显著进展,但在显微领域仍研究不足。为此,我们在显微特定序列上微调预训练视频扩散模型,探索三种条件策略:(1) 基于数值表型测量(如增殖率、迁移速度、细胞死亡频率)的文本提示;(2) 表型评分的直接数值嵌入;(3) 图像条件生成,即以初始显微帧为起点扩展完整视频序列。通过生物学意义明确的形态、增殖与迁移指标评估表明,微调显著提升生成真实性,并准确捕捉有丝分裂与迁移等关键细胞行为。值得注意的是,微调模型在训练范围外仍能生成连贯的细胞动态。然而,对特定表型特征的精确控制仍具挑战,提示未来需优化条件机制。结果证明,领域专用微调可生成具有生物合理性的合成显微数据,支持体外假说验证与数据增强应用。

原文摘要 · Abstract (English)

We present a domain adaptation of video diffusion models to generate highly realistic time-lapse microscopy videos of cell division in HeLa cells. Although state-of-the-art generative video models have advanced significantly for natural videos, they remain underexplored in microscopy domains. To address this gap, we fine-tune a pretrained video diffusion model on microscopy-specific sequences, exploring three conditioning strategies: (1) text prompts derived from numeric phenotypic measurements (e.g., proliferation rates, migration speeds, cell-death frequencies), (2) direct numeric embeddings of phenotype scores, and (3) image-conditioned generation, where an initial microscopy frame is extended into a complete video sequence. Evaluation using biologically meaningful morphological, proliferation, and migration metrics demonstrates that fine-tuning substantially improves realism and accurately captures critical cellular behaviors such as mitosis and migration. Notably, the fine-tuned model also generalizes beyond the training horizon, generating coherent cell dynamics even in extended sequences. However, precisely controlling specific phenotypic characteristics remains challenging, highlighting opportunities for future work to enhance conditioning methods. Our results demonstrate the potential for domain-specific fine-tuning of generative video models to produce biologically plausible synthetic microscopy data, supporting applications such as in-silico hypothesis testing and data augmentation.

视频生成显微成像扩散模型细胞动力学

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。