arXiv:2608.19115cs.LGcs.MM2026-08

让多视角推理可复用,通过合成先验训练通用推理能力。

Pretraining Reusable Inference Across Views with Synthetic Task Priors

论文配图:Pretraining Reusable Inference Across Views with Synthetic Task Priors
图 1 · 摘自论文原文
  • 用合成数据构建可控的多视角任务先验,模拟多样视图配置。
  • 冻结主干网络仍达媲美新训练模型的性能,适配器轻量校准即领先。
  • 适合需跨任务复用视角推理的研究者,尤其多模态/多组学场景。

现代预训练编码器使异构视角表征日益可复用,但决定视图效用与证据融合的机制仍需为每个下游任务重新学习。因此,关于视图相关性、互补性、可靠性及缺失性的知识被反复丢弃而非传递。本文将多视角学习重构为学习可复用的、任务条件化的推理过程,而非固定融合函数。提出 SIMPLE:一种基于先验拟合的多视角上下文学习器,通过少量标注支持集预测查询标签。由于真实数据集覆盖的视图配置和任务结构有限,我们构建了嵌入空间中的可控合成任务先验,生成包含不同类别结构、共享与视图特有因子、表示几何、跨视图依赖、可靠性水平、缺失模式及分布偏移的多样化支持-查询样本对。采用分层推理架构,在视图内、跨视图以及支持与查询样本间进行推理。在多视角与多组学基准上实验表明,冻结版本的 SIMPLE 在不更新推理主干的情况下表现竞争力;轻量适配器校准在多数数据集上达到领先效果。结果在冻结、零样本及缺失视图设置下均支持核心假设:多视角推理本身可预训练并复用,而轻量适配器提供必要时的任务特异性对齐。

原文摘要 · Abstract (English)

Modern pretrained encoders make representations from heterogeneous views increasingly reusable, but the procedure that determines view utility and combines evidence is still relearned for each downstream task. Consequently, knowledge about view relevance, complementarity, reliability, and missingness is repeatedly discarded rather than transferred across tasks. We therefore reformulate multi-view learning as learning a reusable, task-conditioned inference procedure rather than a fixed fusion function. Based on this perspective, we propose SIMPLE, a prior-fitted multi-view in-context learner that predicts query labels by conditioning on a small labeled support set. Since existing real-world datasets cover only a limited range of view configurations and task structures, we construct a controllable synthetic task prior in embedding space. It generates diverse support-query episodes with varying class structures, shared and view-specific factors, representation geometries, cross-view dependencies, reliability levels, missingness patterns, and distribution shifts. A hierarchical inference architecture then performs reasoning within views, across views, and across support and query samples. Experiments on multi-view and multi-omics benchmarks demonstrate that the frozen variant of SIMPLE achieves competitive performance without updating the inference backbone, while lightweight adapter calibration attains leading performance on most evaluated datasets. Together, the results under frozen, one-shot, and missing-view settings support the central hypothesis that multi-view reasoning itself can be pretrained and reused, while lightweight adapter calibration provides task-specific alignment when needed.

多视角学习预训练合成数据推理复用

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。