arXiv:2508.15883eess.IVcs.AI2025-08

用视觉变压器构建果蝇肠道动态的高保真数字孪生模型。

Beyond Imaging: Vision Transformer Digital Twin Surrogates for 3D+T Biological Tissue Dynamics

  • 基于DINO预训练的视觉变压器,融合多视角信息重建3D+T动态。
  • 在多层与生物重复实验中保持低误差与高结构相似性。
  • 适合做细胞行为与组织稳态的计算模拟研究。

理解活体组织的动态组织与稳态需要高分辨率、时间分辨成像及从复杂数据中提取可解释、可预测洞察的方法。本文提出视觉变压器数字孪生代理网络(VT-DTSN),一种用于生物组织3D+T成像数据预测建模的深度学习框架。通过利用DINO(无标签自蒸馏)预训练的视觉变压器并采用多视角融合策略,VT-DTSN能重建果蝇中肠的高保真、时间分辨动态,同时在成像深度下保持形态与特征层面的一致性。模型采用复合损失函数,优先保障像素级精度、感知结构和特征空间对齐,确保输出具有生物学意义,适用于体外实验与假设检验。在不同层与生物重复中的评估表明,该模型具备强鲁棒性与一致性,误差低、结构相似度高,并通过模型优化实现高效推理。本工作确立了VT-DTSN作为跨时间点重构的可行、高保真代理模型,支持对细胞行为与稳态的计算探索,可补充时间分辨成像研究。

原文摘要 · Abstract (English)

Understanding the dynamic organization and homeostasis of living tissues requires high-resolution, time-resolved imaging coupled with methods capable of extracting interpretable, predictive insights from complex datasets. Here, we present the Vision Transformer Digital Twin Surrogate Network (VT-DTSN), a deep learning framework for predictive modeling of 3D+T imaging data from biological tissue. By leveraging Vision Transformers pretrained with DINO (Self-Distillation with NO Labels) and employing a multi-view fusion strategy, VT-DTSN learns to reconstruct high-fidelity, time-resolved dynamics of a Drosophila midgut while preserving morphological and feature-level integrity across imaging depths. The model is trained with a composite loss prioritizing pixel-level accuracy, perceptual structure, and feature-space alignment, ensuring biologically meaningful outputs suitable for in silico experimentation and hypothesis testing. Evaluation across layers and biological replicates demonstrates VT-DTSN's robustness and consistency, achieving low error rates and high structural similarity while maintaining efficient inference through model optimization. This work establishes VT-DTSN as a feasible, high-fidelity surrogate for cross-timepoint reconstruction and for studying tissue dynamics, enabling computational exploration of cellular behaviors and homeostasis to complement time-resolved imaging studies in biological research.

数字孪生视觉变压器3D+T建模生物组织

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。