arXiv:2607.04595cs.LGq-bio.QM2026-07

传统细胞分类方法误判了扰动重叠,新方法用群体得分更准识别扰动

Score Distributions, Not Cells: Evaluating Single-Cell Perturbations Under Class Overlap

论文配图:Score Distributions, Not Cells: Evaluating Single-Cell Perturbations Under Class Overlap
图 1 · 摘自论文原文
  • 不按单个细胞分类,而是汇总全群体的预测概率形成群体特征
  • 相同模型下,新方法将识别准确率从0.2-0.3提升至接近完美
  • 适合评估基因扰动实验中细胞重叠严重的场景

大多数分类任务假设类别可分,但单细胞扰动数据常出现两种扰动产生的细胞群体高度重叠,导致单个细胞难以归属。此时,基于单细胞准确率的评价指标实际反映的是类别重叠程度而非模型性能。在Tahoe-100M和Virtual Cell Challenge数据集上,线性分类器、MLP和Transformer均在宏平均F1 0.2-0.3处饱和,尽管每对扰动在统计上均可区分。解决方法是将分类器对每个扰动所有细胞的预测概率向量求平均,得到群体特征表示,再据此排序候选扰动,称为分类器判别得分(CDS)。CDS无需重新训练,计算复杂度为线性,可从原本表现差的模型中恢复近乎完美的扰动识别。相比基于伪批量表达的PDS,CDS在学习判别空间后识别更可靠,尤其在细胞稀少时优势更大。因此,若评价指标本身错排真实扰动,则其评估的模型排名也将错误,故应谨慎使用单细胞准确率与原始伪批量得分比较扰动模型。

原文摘要 · Abstract (English)

Most classification problems assume the classes are roughly separable, so that an individual sample can usually be assigned to one class. Single-cell perturbation data violates this assumption: two perturbations can produce different populations of cells while overlapping so much that an individual cell could belong to either. Per-cell accuracy then measures this overlap rather than model quality. We see this on Tahoe-100M and the Virtual Cell Challenge, where a linear classifier, an MLP, and a Transformer all plateau near macro-F1 0.2-0.3 even though almost every pair of perturbations is statistically distinguishable. The fix is to score perturbations across the whole population rather than cell by cell. We average a classifier's per-cell probability vectors over all cells of a perturbation to form a population profile, then rank candidate perturbations by this profile; we call the resulting score the Classifier Discrimination Score (CDS). Taking the top-ranked class recovers the winning perturbation. It needs no retraining, costs linear time in the number of cells, and recovers near-perfect identification from the same weak models. CDS differs from the pseudobulk-based Perturbation Discrimination Score (PDS) used in recent benchmarks only in where the average is taken, raw gene expression for PDS versus a learned discriminative space for CDS, and identifies the true perturbation more reliably on both datasets, with the gap widening as cells grow scarce. Because a metric that misranks the ground truth will misrank the models scored against it, per-cell accuracy and raw-pseudobulk scores should be used with caution when comparing perturbation models.

单细胞分析扰动识别分类评估群体特征

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。