构建首个统一标准的单细胞测序聚类算法评测平台。
scCluBench: Comprehensive Benchmarking of Clustering Algorithms for Single-Cell RNA Sequencing
- 整合36个标准化数据集,覆盖多组织来源的单细胞数据。
- 评估多种聚类方法在标记基因识别等任务中的表现差异。
- 适合生物信息学研究者和算法开发者参考选型。
细胞聚类对揭示单细胞RNA测序(scRNA-seq)数据中的细胞异质性至关重要,可用于识别细胞类型和标记基因。尽管其重要性显著,现有的scRNA-seq聚类方法评测仍零散且缺乏标准化流程,未能充分纳入人工智能新进展。为此,我们提出scCluBench,一个全面的scRNA-seq聚类算法基准测试平台。首先,scCluBench整合了36个来自不同公共数据库的scRNA-seq数据集,涵盖多种组织类型,并经过统一处理与标准化,确保评估的一致性和可重复性。为评估性能,我们收集并复现了包括传统方法、深度学习、图神经网络及生物学基础模型在内的多种聚类算法。通过核心评价指标与可视化分析,进行定量与定性综合评估。此外,构建了典型下游任务如标记基因鉴定和细胞类型注释,以进一步检验方法的实际应用价值。scCluBench系统性分析各类模型在不同任务中的表现差异与适用边界,评估其在真实场景下的鲁棒性与可扩展性。整体而言,scCluBench提供了一个标准化、用户友好的评估框架,包含精选数据集、统一评估协议与透明分析过程,有助于指导方法选择,并揭示模型泛化能力与应用场景范围。
原文摘要 · Abstract (English)
Cell clustering is crucial for uncovering cellular heterogeneity in single-cell RNA sequencing (scRNA-seq) data by identifying cell types and marker genes. Despite its importance, benchmarks for scRNA-seq clustering methods remain fragmented, often lacking standardized protocols and failing to incorporate recent advances in artificial intelligence. To fill these gaps, we present scCluBench, a comprehensive benchmark of clustering algorithms for scRNA-seq data. First, scCluBench provides 36 scRNA-seq datasets collected from diverse public sources, covering multiple tissues, which are uniformly processed and standardized to ensure consistency for systematic evaluation and downstream analyses. To evaluate performance, we collect and reproduce a range of scRNA-seq clustering methods, including traditional, deep learning-based, graph-based, and biological foundation models. We comprehensively evaluate each method both quantitatively and qualitatively, using core performance metrics as well as visualization analyses. Furthermore, we construct representative downstream biological tasks, such as marker gene identification and cell type annotation, to further assess the practical utility. scCluBench then investigates the performance differences and applicability boundaries of various clustering models across diverse analytical tasks, systematically assessing their robustness and scalability in real-world scenarios. Overall, scCluBench offers a standardized and user-friendly benchmark for scRNA-seq clustering, with curated datasets, unified evaluation protocols, and transparent analyses, facilitating informed method selection and providing valuable insights into model generalizability and application scope.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。