用AI生成高保真免疫突触图像,解决标注数据少难题
Data Augmentation for High-Fidelity Generation of CAR-T/NK Immunological Synapse Images
- 结合两种AI增强方法,生成真实感强的免疫突触图像和分割图
- 在小样本下检测与分割准确率显著提升,验证了方法有效性
- 适合免疫治疗研究者、医学影像分析人员使用
嵌合抗原受体(CAR)-T和NK细胞免疫疗法已改变癌症治疗格局,近期研究表明,CAR-T/NK细胞免疫突触(IS)质量可作为预测疗效的功能生物标志物。利用人工神经网络(ANN)精准检测与分割CAR-T/NK IS结构,可大幅提升IS定量的速度与可靠性。然而,标注显微镜图像数据集规模有限,制约了ANN的泛化能力。为此,本文整合两种互补的数据增强框架:一是实例感知自动增强(IAAA),通过优化增强策略生成合成的CAR-T/NK IS图像及对应分割掩码,支持荧光与明场等多种成像模态;二是语义感知AI增强(SAAA),结合基于扩散的掩码生成器与Pix2Pix条件图像合成器,生成多样且解剖学上合理的分割掩码,并生成与之对齐的高质量免疫突触图像。二者协同生成的合成图像在视觉与结构上均接近真实数据,显著提升检测与分割性能。该工作增强了IS定量的鲁棒性与准确性,助力发展更可靠的影像生物标志物以预测患者对CAR-T/NK免疫治疗的响应。
原文摘要 · Abstract (English)
Chimeric antigen receptor (CAR)-T and NK cell immunotherapies have transformed cancer treatment, and recent studies suggest that the quality of the CAR-T/NK cell immunological synapse (IS) may serve as a functional biomarker for predicting therapeutic efficacy. Accurate detection and segmentation of CAR-T/NK IS structures using artificial neural networks (ANNs) can greatly increase the speed and reliability of IS quantification. However, a persistent challenge is the limited size of annotated microscopy datasets, which restricts the ability of ANNs to generalize. To address this challenge, we integrate two complementary data-augmentation frameworks. First, we employ Instance Aware Automatic Augmentation (IAAA), an automated, instance-preserving augmentation method that generates synthetic CAR-T/NK IS images and corresponding segmentation masks by applying optimized augmentation policies to original IS data. IAAA supports multiple imaging modalities (e.g., fluorescence and brightfield) and can be applied directly to CAR-T/NK IS images derived from patient samples. In parallel, we introduce a Semantic-Aware AI Augmentation (SAAA) pipeline that combines a diffusion-based mask generator with a Pix2Pix conditional image synthesizer. This second method enables the creation of diverse, anatomically realistic segmentation masks and produces high-fidelity CAR-T/NK IS images aligned with those masks, further expanding the training corpus beyond what IAAA alone can provide. Together, these augmentation strategies generate synthetic images whose visual and structural properties closely match real IS data, significantly improving CAR-T/NK IS detection and segmentation performance. By enhancing the robustness and accuracy of IS quantification, this work supports the development of more reliable imaging-based biomarkers for predicting patient response to CAR-T/NK immunotherapy.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。