让并行计算结果可信:用证据和分支谱系防重复错误放大
Evidence-Aware MapReduce for Forkable Compute
- 为并行计算设计带证据追踪的归约协议,防止重复错误被误当共识
- 通过逆信息加权合并结果,残差Δ可量化分歧,支持树形聚合
- 适合需验证AI分支可信度的研究者,尤其关注可复现与证据溯源
基于快照的沙盒使分支操作开销极低,但错误依赖关系不变。多个分支可能重复使用同一模型、提示、代码库、测试或执行祖先,导致单一错误被反复放大为高置信共识。本文提出一种‘证据感知归约合约’:每个工作者报告估计值、信息量、证据标识符、分叉谱系及执行元数据。对于独立估算同一参数的工作者,采用标准逆信息池化(高斯/瓦尔德形式)。固定维度数值摘要可在任意树形顺序下合并;证据ID与谱系遵循独立规则。残差Δ在标量逆方差情形下对应科克兰Q统计量,并出现在乘积积分中。参考实现验证序列化记录,拒绝重复非空证据标识符,确保证据与谱系贯穿树归约过程,采用基于Cholesky的数值线性代数。单元测试与种子合成数据检验代数一致性、不等信息量及伪造精度;一个四工作者命名快照追踪案例完整验证端到端路径。平台日志记录了所有执行路径。核心开放挑战在于如何将证据身份与分叉谱系转化为相关性和自适应选择的AI分支依赖模型。
原文摘要 · Abstract (English)
Snapshot-backed sandboxes make branching cheap while leaving evidence dependence unchanged. Branches can reuse a model, prompt, repository, tests, observations, or execution ancestor, so counting outputs can amplify one repeated error into high-confidence consensus. We introduce an \emph{evidence-aware reduction contract}: each worker reports an estimate, estimated information, evidence identifiers, fork lineage, and execution metadata. For independent workers estimating one common parameter, we use standard inverse-information pooling in its Gaussian/Wald form. The fixed-dimensional numeric summary can merge in any tree order; evidence IDs and lineage follow separate rules. The residual $Δ$ measures disagreement, becomes Cochran's $Q$ in the scalar inverse-variance case, and appears in the product integral. A reference implementation validates serialized records, rejects repeated nonempty evidence identifiers, carries evidence and lineage through tree reduction, and uses Cholesky-based numerical linear algebra. Unit tests and seeded synthetic checks exercise the algebra, unequal information, and forged precision; one four-worker named-snapshot trace exercises the end-to-end path. Platform logs document the exercised execution paths. A central open systems challenge is to turn evidence identity and fork lineage into a dependence model for correlated and adaptively selected AI branches.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。