arXiv:2605.28075cs.LG2026-05被引 1

用Transformer学习概率分布间的非线性映射,适用于细胞演化等科学场景。

Measure-to-measure Regression with Transformers

论文配图:Measure-to-measure Regression with Transformers
图 1 · 摘自论文原文
  • 用Transformer构建分布到分布的映射,支持静态与动态两种形式
  • 在合成数据、粒子系统和结直肠癌类器官数据上实现未见分布的准确预测
  • 特别适合处理细胞等作为整体演化的群体数据,如生物医学研究

许多学习问题需要预测群体在未知变换下的演化。这类群体的自然表示是概率测度,点云即为一例。本文研究测度到测度(M2M)回归问题,即从有限的输入-输出对中学习测度之间的映射。不同于传统回归中独立变换单个样本,M2M回归将整个分布视为数据点。这一视角在细胞与分子生物学等科学应用中至关重要,因细胞并非独立个体而是集体演化。然而,现有方法在表达能力与可扩展性上仍不足。本文提出非线性M2M回归的形式化框架,并引入两种易用、高效且可扩展的方案:静态M2M映射与动态M2M速度场的Transformer模型。方法利用Transformer天然的测度依赖与平均场结构,在概率分布空间中学习非线性映射。实验表明,该方法在合成数据、交互粒子系统及大规模患者来源类器官数据集(用于预测结直肠癌治疗反应)上均展现出良好泛化能力。

原文摘要 · Abstract (English)

Many learning problems require predicting how populations evolve under an unknown transformation. A natural representation for such populations is a probability measure, with point clouds as a key example. In this work, we study the measure-to-measure (M2M) regression problem, in which one seeks to learn a map between probability measures from a finite collection of observed input-output pairs. In contrast to classical regression, where individual samples are transformed independently, M2M regression treats entire distributions as the data points. This perspective is vital in certain scientific applications, for example, cellular and molecular biology, where cells are known to evolve not as independent data points but as a collection. However, few existing approaches address the problem of M2M regression with sufficient expressivity and scalability. We present a formalization of nonlinear M2M regression and introduce two easy-to-use, expressive, and scalable approaches to learn such operators: transformers as static M2M maps and transformers as dynamic M2M velocity fields. Our approach leverages the natural measure-dependent and mean-field structure of transformers to learn nonlinear M2M maps on the space of probability distributions. We illustrate the effectiveness of our proposed method to generalize to unseen measures on synthetic experiments, interacting particle systems, and a large-scale patient-derived organoid dataset for predicting treatment response in colorectal cancer.

测度回归Transformer生物医学建模分布映射

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。