提出可验证的模型合并诊断框架,解决多模型对齐不一致问题。
TwistedMerge: Certified Higher-Order Diagnostics and Abstention for Model Merging
- 将模型合并建模为非阿贝尔下降问题,通过循环一致性检测残差
- 仅在通过多重验证后才认证结果,否则自动退化为安全备用方案
- 适用于需要高可信度合并的场景,如医疗或金融模型集成
模型合并将独立训练或微调的模型融合,但成对对齐性不保证全局一致性。本文将合并问题形式化为有限下降过程:检查点为局部对象,对齐映射为转移,循环乘积为残差。TwistedMerge 是一种保守的可验证流程,分离了固定图平均、可消除规范不一致、指定对比复形上的已认证中心障碍,以及非交换全息性。只有在逆一致性、系数识别、中心性和闭合性测试均通过后,残差才被提升为上同调类;否则方法拒绝判断并返回普通或同步退路。证明了常边不可能定理、冻结复形三向及预声明族误差控制定理,以及对比复形敏感性精炼测试。通过循环一致同步可消除人为植入的神经对齐缺陷,表明非零循环得分本身并非更高阶障碍。受控中心系统恢复预测的非上边界与投影秩行为,而噪声估计则从认证转向拒判,且在测试控制下无误提升。训练的低秩适配器审计显示,朴素因子平均依赖于选定的 GLr 代表,而全局因子同步和密集-δ SVD 则稳定。在自然检查点集合中,循环残差无法预测合并退化,且未认证出自然中心或周期指数类。结果将下降理论定位为可证伪的验证与拒判框架。
原文摘要 · Abstract (English)
Model merging combines independently trained or fine-tuned models, but pairwise alignability does not imply globally consistent alignment. We formulate merging as a finite descent problem in which checkpoints are local objects, alignment maps are transitions, and cycle products are residuals. TwistedMerge is a conservative certification pipeline that separates fixed-chart averaging, synchronization-removable gauge inconsistency, a certified central obstruction on a specified comparison complex, and nonabelian holonomy. A residual is promoted to a cohomology class only after inverse-consistency, coefficient-identification, centrality, and closure tests; otherwise the method abstains and returns an ordinary or synchronized fallback. We prove a constant-edge no-go result, frozen-complex three-way and predeclared-family error-control theorems, and a refinement test for comparison-complex sensitivity. A planted neural alignment defect is removed by cycle-consistent synchronization, showing that a nonzero cycle score alone is not a higher obstruction. Controlled central systems recover the predicted non-coboundary and projective-rank behavior, while noisy estimates move from certification to abstention without false lifts on the tested controls. A trained low-rank-adapter audit shows that naive factor averaging depends on the chosen GLr representative, whereas global factor synchronization and dense-delta SVD are stable. On natural checkpoint collections, cycle residuals do not predict merge degradation and no natural central or period-index class is certified. The results position descent theory as a falsifiable certification and abstention framework.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。