arXiv:2409.01781cs.CV2024-09被引 3

DARLC提升稀疏噪声图像的表示学习与聚类,更精准捕捉基因互作关系。

Dual Advancement of Representation Learning and Clustering for Sparse and Noisy Images

  • 联合优化表示学习与聚类,通过对比学习增强特征感知
  • 用图注意力网络去噪生成正样本,提升表征质量
  • 采用t混合模型实现鲁棒聚类,适合生物图像分析

稀疏且噪声严重的图像(SNIs),如空间基因表达数据,对有效的表示学习和聚类构成重大挑战,而这两者是深入数据分析与解释的关键。针对此问题,我们提出双推进表示学习与聚类框架(DARLC),利用对比学习增强掩码图像建模所得表示。同时,以端到端方式融合聚类分配,解决对比学习中的“类别碰撞问题”,从而提升表示质量。为生成更合理的正样本用于对比学习,我们采用基于图注意力网络的方法生成去噪图像作为增强数据。该框架通过提升表示的局部感知性、区分度和关系语义理解能力,实现了全面优化。此外,我们使用学生t混合模型实现对SNIs更鲁棒、自适应的聚类。在包含12种不同类型SNIs数据集上的大量实验表明,DARLC在图像聚类及生成准确反映基因互作的图像表示方面均优于现有最先进方法。代码已开源:https://github.com/zipging/DARLC。

原文摘要 · Abstract (English)

Sparse and noisy images (SNIs), like those in spatial gene expression data, pose significant challenges for effective representation learning and clustering, which are essential for thorough data analysis and interpretation. In response to these challenges, we propose Dual Advancement of Representation Learning and Clustering (DARLC), an innovative framework that leverages contrastive learning to enhance the representations derived from masked image modeling. Simultaneously, DARLC integrates cluster assignments in a cohesive, end-to-end approach. This integrated clustering strategy addresses the "class collision problem" inherent in contrastive learning, thus improving the quality of the resulting representations. To generate more plausible positive views for contrastive learning, we employ a graph attention network-based technique that produces denoised images as augmented data. As such, our framework offers a comprehensive approach that improves the learning of representations by enhancing their local perceptibility, distinctiveness, and the understanding of relational semantics. Furthermore, we utilize a Student's t mixture model to achieve more robust and adaptable clustering of SNIs. Extensive experiments, conducted across 12 different types of datasets consisting of SNIs, demonstrate that DARLC surpasses the state-of-the-art methods in both image clustering and generating image representations that accurately capture gene interactions. Code is available at https://github.com/zipging/DARLC.

表示学习聚类基因表达去噪

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。