提出LAF框架,用决策链解析2D到3D模型迁移的全过程。
Lift, Associate, and Fuse: A Decision-Centric Framework for 2D-to-3D Foundation Model Transfer

- 将迁移过程拆解为生成、关联、调和、融合、持久化五步决策操作
- 161个系统实测揭示:关联不等于身份确认,载体设计决定查询与纠错边界
- 首次定义不可逆证据丢失节点,为3D感知系统提供可审计的诊断标准
将二维基础模型预测迁移到三维分割的方法通常按任务或表征分类,但这类分组掩盖了跨视图保持系统一致性的关键决策:图像证据在何处被锚定、何时观察被认定为同一实体、语义与粒度冲突如何处理、哪些信息被融合、以及何种状态可保留供后续查询。本文提出决策中心框架Lift, Associate, and Fuse (LAF),将迁移系统建模为五个操作符:生成、关联、调和、融合、持久化/查询。LAF明确定义持久载体的契约——其空间支持、语义状态、身份状态、不确定性、来源及支持的操作,并识别出最早无法恢复的废弃证据阶段。该框架被实现为结构化审计协议,应用于截至2026年8月7日可用的161个系统,涵盖点、场、高斯、对象、图、记忆等载体类型。表征、时间、关系与前馈压力测试均无需额外分析阶段即可完成最终确认。决策轨迹揭示四大共性规律:关联不建立身份;载体设计同时决定查询接口与纠错边界;渲染视图、原生3D与提案级评估不可互换;‘无训练’、‘实时’、‘开放词汇’、‘通用’等限定词仅在指定阶段与完整成本清单下才有意义。LAF因此提供一种与表征无关的比较方法,可用于诊断不可逆失败并规范未来智能体的可修订3D感知。
原文摘要 · Abstract (English)
Methods that transfer predictions from two-dimensional foundation models into three-dimensional segmentation are commonly grouped by task or representation. Those groupings obscure the decisions that determine whether a system remains coherent across views: where image evidence is grounded, when observations become one identity, how semantic and granularity conflicts are handled, which information is fused, and what state survives for later queries. We introduce \textbf{Lift, Associate, and Fuse (LAF)}, a decision-centric framework that represents a transfer system as five operators: \textbf{Generate, Associate, Reconcile, Fuse, and Persist/Query}. LAF defines an explicit contract for the persistent carrier---its spatial support, semantic state, identity state, uncertainty, provenance, and supported operations---and identifies the first stage at which discarded evidence becomes unrecoverable. We operationalize the framework as a structured audit protocol and apply it to 161 systems available through 7 August 2026, spanning point-, field-, Gaussian-, object-, graph-, and memory-based carriers. Representation, temporal, relational, and feed-forward stress tests required no additional analytical stage after the final confirmation pass. The resulting decision traces expose four recurring properties: association does not establish identity; carrier design fixes both the query interface and correction boundary; rendered-view, native-3D, and proposal-level evaluations are not interchangeable; and qualifiers such as \emph{training-free}, \emph{real-time}, \emph{open-vocabulary}, and \emph{generalizable} are meaningful only when attached to a stage and a complete cost ledger. LAF therefore supplies a representation-neutral method for comparing existing systems, diagnosing irreversible failures, and specifying revisable 3D perception for future agents.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。