用椭圆傅里叶描述符生成时序一致的细胞模拟视频,解决标注数据少的问题
Cell Phantom Video Generation in Elliptical Fourier Descriptor Domain

- 在椭圆傅里叶描述符域建模细胞轮廓演化,实现形态与时间的一致性
- 生成的细胞视频符合生物学规律,可作为真实标注数据替代方案
- 适合需要大量合成标注数据的生物医学图像分析研究者
训练深度神经网络追踪生物医学视频中的单个细胞需要大量标注数据。细胞追踪的视频标注耗时且需领域知识,导致公开标注数据稀缺,制约组织修复或癌症治疗等关键医学问题的研究。生成带真实标注的合成视频是可行解决方案,其基础步骤是生成单细胞标注(即细胞幻影)。幻影需具备时间一致性,以复现特定细胞类型的真实生物学过程。本文提出一种新框架,在椭圆傅里叶描述符(EFD)域生成细胞幻影视频,该域是二维闭合轮廓的紧凑且几何可解释表示。我们将细胞幻影演化表示为多变量时间序列的EFD系数,引入细胞形态强先验,实现时间上连贯的序列高效生成。实验验证表明,在EFD空间建模时间演化可生成生物上合理的幻影视频。该方法可用于生成式数据合成流水线,显著降低细胞追踪数据集构建的标注成本。代码已开源:https://github.com/FrancescoBenedetto99/efd-cell-video-gen。
原文摘要 · Abstract (English)
Training Deep Neural Networks for tracking individual cells in biomedical videos requires a large amount of annotated data. The annotation of videos for cell tracking is very time consuming and often requires domain expertise; this explains the limited availability of public annotated data to address important medical problems like tissue repair or cancer treatment. Generating synthetic videos along with their Ground Truth annotations is a promising solution that relies, as a foundational first step, on the synthesis of single cell annotations (or phantoms). Phantoms need to be time consistent, as they have to replicate biological processes that are specific to the cell types. In this work, we propose a novel framework for generating videos of cell phantoms in the Elliptical Fourier Descriptors (EFDs) domain, a compact and geometrically interpretable representation for 2D closed contours. We represent the cell phantom evolution as a multivariate time series of EFD coefficients, introducing a strong prior for cell morphology and enabling the efficient generation of sequences that evolve coherently in time. Our experimental validation proves that modelling the temporal evolution in EFD space enables the generation of biologically plausible phantom videos. Our method can be used in generative pipelines for synthesizing annotated data for cell tracking, thus strongly mitigating the annotation effort for creating new datasets. Our code is available for download here: https://github.com/FrancescoBenedetto99/efd-cell-video-gen.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。